-- Logs begin at Sun 2022-10-02 00:10:46 UTC, end at Sun 2022-10-02 02:46:05 UTC. -- Oct 02 00:49:48.024515 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 02 00:49:48.033109 n-d-master-1 devstack@n-api.service[106304]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:49:48 2022] *** Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: nodename: n-d-master-1 Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: machine: x86_64 Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: clock source: unix Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: pcre jit disabled Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: detected number of CPU cores: 4 Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: current working directory: / Oct 02 00:49:48.035080 n-d-master-1 devstack@n-api.service[106304]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: your processes number limit is 47680 Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: your memory page size is 4096 bytes Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: detected max file descriptor number: 2048 Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: lock engine: pthread robust mutexes Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: thunder lock: enabled Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 02 00:49:48.035865 n-d-master-1 devstack@n-api.service[106304]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:49:48.075108 n-d-master-1 devstack@n-api.service[106304]: Python main interpreter initialized at 0x557310d2a9c0 Oct 02 00:49:48.075108 n-d-master-1 devstack@n-api.service[106304]: python threads support enabled Oct 02 00:49:48.075108 n-d-master-1 devstack@n-api.service[106304]: your server socket listen backlog is limited to 100 connections Oct 02 00:49:48.075108 n-d-master-1 devstack@n-api.service[106304]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:49:48.075436 n-d-master-1 devstack@n-api.service[106304]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:49:48.075517 n-d-master-1 devstack@n-api.service[106304]: *** Operational MODE: preforking *** Oct 02 00:49:48.075758 n-d-master-1 devstack@n-api.service[106304]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:49:48.075758 n-d-master-1 devstack@n-api.service[106304]: spawned uWSGI master process (pid: 106304) Oct 02 00:49:48.075948 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 02 00:49:48.076731 n-d-master-1 devstack@n-api.service[106304]: spawned uWSGI worker 1 (pid: 106305, cores: 1) Oct 02 00:49:48.076905 n-d-master-1 devstack@n-api.service[106304]: spawned uWSGI worker 2 (pid: 106306, cores: 1) Oct 02 00:49:48.077409 n-d-master-1 devstack@n-api.service[106304]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:49:48.733722 n-d-master-1 devstack@n-api.service[106305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:49:48.736486 n-d-master-1 devstack@n-api.service[106306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:49:49.815175 n-d-master-1 devstack@n-api.service[106305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:49:49.815175 n-d-master-1 devstack@n-api.service[106305]: from cryptography.utils import int_from_bytes Oct 02 00:49:49.815812 n-d-master-1 devstack@n-api.service[106305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:49:49.815812 n-d-master-1 devstack@n-api.service[106305]: from cryptography.utils import int_from_bytes Oct 02 00:49:49.830367 n-d-master-1 devstack@n-api.service[106306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:49:49.830367 n-d-master-1 devstack@n-api.service[106306]: from cryptography.utils import int_from_bytes Oct 02 00:49:49.830841 n-d-master-1 devstack@n-api.service[106306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:49:49.830841 n-d-master-1 devstack@n-api.service[106306]: from cryptography.utils import int_from_bytes Oct 02 00:49:52.301415 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:49:52.302038 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:49:52.302139 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:49:52.302472 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:49:52.303105 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:49:52.303183 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:49:52.303261 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:49:52.303401 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:49:52.303617 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:49:52.303875 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:49:52.303990 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.304268 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.304362 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.304595 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.304696 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.304917 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305004 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305252 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305343 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305549 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305648 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305868 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.305962 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.306184 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.306270 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.306501 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.306584 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.306799 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.306895 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.307107 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.307193 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.307426 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.307517 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.307745 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.307831 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308050 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308143 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308359 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308451 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308670 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308764 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.308971 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.309058 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.309283 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.309371 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.309585 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.309673 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.309912 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.310183 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.310423 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.310650 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.310768 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.310962 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.311075 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.311273 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.311398 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.311613 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.311742 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.311934 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312029 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312239 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312371 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312558 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312656 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312863 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.312960 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.313187 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.313340 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.313499 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.313628 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.314144 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.314287 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.314467 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.314607 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.314807 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.314912 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.315118 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.315210 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.315533 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.315697 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.315845 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.315931 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.316153 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.316243 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.316472 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.316559 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.316795 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.316888 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.317103 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.317189 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.317430 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.317515 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.317749 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.317852 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.318069 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.318784 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.319064 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.319152 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.319380 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.319477 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.319693 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.319793 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320008 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320095 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320332 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320418 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320638 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320730 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.320942 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321034 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321192 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321277 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321500 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321594 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321822 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.321921 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.322147 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.322240 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.322470 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.322577 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.322746 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.322835 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323000 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323087 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323319 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323406 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323643 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323728 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.323951 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324044 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324259 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324391 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324568 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324704 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324874 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.324973 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.325183 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.325268 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.325487 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.325614 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.325794 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.325889 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.326101 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.326193 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.326416 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.326511 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.326755 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.326858 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.327081 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.327167 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.327391 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.327476 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.327710 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.327797 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.328108 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.328196 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.328363 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.328449 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.328670 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.328761 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329011 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329096 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329331 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329420 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329639 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329734 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.329959 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.330052 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.330280 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.330374 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.330588 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.330692 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.330916 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331009 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331226 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331321 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331548 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331634 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331883 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.331973 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.332189 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.332282 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.332441 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.332533 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.332742 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.332843 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.333046 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.333147 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.333365 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.333496 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.333672 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.333782 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334003 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334194 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334320 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334550 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334663 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334884 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.334981 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.335193 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.335285 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.335502 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.335638 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.335805 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.335903 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.336114 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.336199 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.336417 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.336503 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.336722 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.336815 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337028 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337121 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337333 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337428 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337638 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337731 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.337942 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338038 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338261 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338347 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338568 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338673 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338898 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.338985 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.339201 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.339295 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.339507 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.339600 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.339809 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.339895 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.340125 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.340211 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.340429 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.340526 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.340735 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.340828 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341043 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341128 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341350 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341445 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341650 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341743 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.341964 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342048 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342269 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342354 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342575 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342693 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342902 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.342998 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.343205 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.343291 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.343511 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.343604 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.343818 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.343910 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.344119 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.344205 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.344422 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.344513 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.344725 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.344871 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345026 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345111 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345326 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345410 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345629 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345726 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.345928 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346022 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346228 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346324 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346526 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346650 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346870 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.346967 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.347178 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.347269 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.347484 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.347575 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.347789 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.347874 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.348092 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.348178 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.348409 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:49:52.348592 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.348746 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.348842 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.349078 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.349164 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.349415 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.349505 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.349748 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.349832 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.350082 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.350179 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.350413 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.350506 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.350753 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.350844 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.351069 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.351163 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.351383 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.351469 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.351706 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.351791 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352023 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352117 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352333 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352436 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352638 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352723 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.352954 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353057 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353271 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353360 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353587 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353717 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353904 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.353991 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.354219 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.354315 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.354532 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.354631 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.354867 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.354979 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.355185 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.355273 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.355505 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.355592 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.355820 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.355949 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.356126 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.356212 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.356466 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.356558 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.356802 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.356896 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.357110 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.357205 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.357434 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.357520 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.357747 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.357841 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.358053 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.358138 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.358361 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.358457 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.358690 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.358782 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359029 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359115 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359341 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359436 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359652 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359738 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.359966 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360051 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360275 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360360 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360597 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360684 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360906 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.360991 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.361216 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.361309 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.361527 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.361624 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.361838 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.361924 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.362146 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.362240 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.362479 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.362567 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.362822 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.362922 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.363139 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.363238 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.363452 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.363538 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.363762 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.363856 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.364077 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.364171 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.364386 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.364473 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.364693 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.364821 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.365507 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.365618 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.365859 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.365946 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.366165 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.366255 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.366468 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.366567 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.366802 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.366890 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.367106 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.367201 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.367424 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.367512 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.367747 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.367833 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368052 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368137 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368380 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368468 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368686 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368772 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.368996 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369084 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369304 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369391 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369612 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369698 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369913 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.369999 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.370224 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.370318 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.370529 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.370632 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.370861 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.370964 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.371182 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.371275 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.371489 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.371574 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.371794 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.371888 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.372109 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.372201 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.372416 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.372508 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.372723 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.372841 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373039 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373135 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373344 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373430 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373654 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373759 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.373966 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.374055 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.374272 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.374359 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.374591 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.374699 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.374926 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375012 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375235 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375323 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375568 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375656 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375876 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.375961 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.376189 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.376275 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.376512 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.376600 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.376830 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.376918 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.377138 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.377225 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.377440 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.377526 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.377743 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.377835 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378043 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378136 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378345 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378432 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378669 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378760 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.378978 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.379075 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.379279 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.379365 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.379581 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.379666 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.379879 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.380040 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.380180 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.380276 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.380483 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.380573 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.381333 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.381439 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.381639 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.381724 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.381939 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382024 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382241 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382327 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382538 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382655 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382905 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.382993 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.383212 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.383310 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.383548 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.383635 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.383876 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.383998 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.384193 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.384288 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.384510 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.384596 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.384820 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.384905 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.385133 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.385221 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.385440 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.385527 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.385752 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.385847 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.386062 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.386147 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.386373 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.386461 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.386712 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.386813 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387025 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387111 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387334 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387420 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387643 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387741 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.387959 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388045 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388268 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388352 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388575 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388670 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388879 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.388964 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.389193 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.389279 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.389532 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.389626 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.389848 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.389933 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.390168 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.390271 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.390472 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.390566 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.390806 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.390892 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.391115 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.391201 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.391421 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.391515 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.391731 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.391816 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392043 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392129 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392353 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392449 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392662 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392747 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.392968 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.393054 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.393283 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.393418 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.393595 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.393695 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.393907 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394036 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394213 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394310 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394526 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394651 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394853 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.394971 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.395167 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.395310 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.395493 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.395580 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.395802 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.395897 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.396115 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.396202 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.396449 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.396535 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.396769 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.396890 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.397080 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.397209 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.397388 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.397524 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.397696 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.397832 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398000 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398141 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398303 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398454 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398622 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398813 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.398944 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.399128 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.399253 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.399442 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.399561 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.399749 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.399866 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400069 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400180 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400383 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400479 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400691 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400779 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.400998 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.401092 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.401313 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.401401 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.401639 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.401726 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.401952 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.402040 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.402274 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.402375 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.402591 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.402746 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.402917 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403005 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403219 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403322 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403541 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403639 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403847 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.403934 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.404153 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.404265 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.404454 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.404553 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.404757 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.404858 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.405094 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.405203 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.405402 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.405502 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.405707 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.405813 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406019 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406129 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406339 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406454 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406667 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406779 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.406980 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.407070 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.407288 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.407377 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.407597 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.407698 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.407914 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408003 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408227 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408316 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408535 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408641 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408843 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.408932 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.409151 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.409239 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.409457 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.409548 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.409765 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.409854 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.410085 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.410180 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.410392 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.410482 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.410722 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.410812 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411034 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411133 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411337 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411426 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411643 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411731 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.411998 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.412110 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.412645 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.412737 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.412989 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.413086 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.413306 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.413404 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.413625 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.413714 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.413965 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.414065 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.414284 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.414388 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.414625 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.414732 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.414959 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415048 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415272 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415356 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415577 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415673 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415884 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.415973 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.416187 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.416285 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.416491 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.416593 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.416798 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.416885 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.417100 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.417202 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.417401 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.417502 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.417706 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.417794 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418012 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418100 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418315 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418413 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418632 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418734 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.418939 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419027 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419244 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419341 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419553 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419649 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419855 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.419944 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.420164 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.420263 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.420465 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.420561 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.420784 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.420872 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421089 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421185 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421391 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421479 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421690 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421777 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.421993 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.422084 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.422332 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.422421 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.422657 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.422900 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.423013 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.423314 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.423932 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.423932 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.424655 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.424655 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.424814 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.424897 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.425117 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.425207 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.425419 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.425563 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.425727 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.425818 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426033 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426123 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426333 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426431 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426659 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426809 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.426969 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.427067 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.427275 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.427366 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.428153 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.428269 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.428503 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.428726 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.428832 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.428916 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.429082 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.429171 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.429394 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.429483 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.429706 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.429798 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430008 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430097 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430310 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430399 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430636 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430728 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.430947 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431049 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431246 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431343 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431553 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431643 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431855 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.431944 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.432161 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.432260 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.432461 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.432556 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.432763 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.432852 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433066 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433165 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433370 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433466 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433672 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433768 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.433973 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.434089 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.434280 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.434369 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.434585 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.434720 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.434909 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435080 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435211 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435309 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435553 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435668 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435816 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.435912 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.436118 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.436210 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.436425 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.436514 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.436731 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.436872 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437034 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437126 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437335 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437423 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437639 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437728 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.437936 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.438033 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.438239 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.438329 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.438542 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.438665 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.438876 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.439235 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.439444 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.439547 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.439746 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.439836 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440045 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440136 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440347 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440445 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440647 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440736 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.440955 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441042 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441260 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441361 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441559 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441647 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441860 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.441948 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.442163 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.442264 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.442464 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.442551 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.442811 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.442904 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.443198 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.443391 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.443524 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.443606 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.443769 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.443867 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.444074 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.444164 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.444406 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.444496 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.444709 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.444797 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445018 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445115 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445320 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445408 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445631 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445727 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.445936 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446035 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446247 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446345 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446551 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446688 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446881 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.446970 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.447191 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.447279 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.447500 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.447597 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.447807 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.447901 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.448121 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.448209 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.448427 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.448525 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.448734 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.448825 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449034 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449131 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449341 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449441 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449650 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449748 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.449955 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450044 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450262 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450352 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450570 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450691 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450902 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.450994 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.451211 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.451301 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.451518 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.451607 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.451827 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.451922 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.452139 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.452234 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.452443 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.452553 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.452754 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.452846 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453059 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453149 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453362 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453459 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453672 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453769 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.453981 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.454070 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.454283 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.454379 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.454592 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.454719 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.454917 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455005 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455222 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455311 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455524 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455625 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455845 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.455945 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.456159 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.456249 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.456471 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.456569 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.456778 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.456868 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.457092 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.457181 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.457398 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.457488 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.457721 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.457809 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.458036 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.458124 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.458341 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.458432 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.459254 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.459391 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.459579 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.459670 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.459895 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.459985 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.460205 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.460293 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.460509 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.460605 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.460813 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.460908 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.461120 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.461231 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.461442 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.461540 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.461744 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.461833 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.462045 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.462134 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.462351 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.462450 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.462699 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.462790 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463004 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463103 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463324 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463423 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463657 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463745 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.463964 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.464061 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.464272 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.464447 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.464596 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.464718 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.464902 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.465030 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.465227 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.465339 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.465644 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.465742 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.465958 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466050 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466265 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466380 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466568 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466713 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466907 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.466996 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.467217 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.467306 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.467542 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.467633 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.467865 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.467954 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.468175 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.468263 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.468487 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.468578 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.468793 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.468882 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.469117 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.469208 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.469441 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.469531 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.469754 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.469842 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.470064 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.470160 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.470379 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.470470 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.470714 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.470808 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.471041 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.471142 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.471366 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.471456 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.471685 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.471774 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472010 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472110 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472314 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472425 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472626 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472753 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.472929 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.473070 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.473232 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.473394 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.473553 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.473719 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.473856 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.474029 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.474165 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.474336 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.474541 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.474822 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475016 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475136 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475227 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475444 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475534 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475770 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.475869 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.476073 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.476170 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.476386 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.476474 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.476698 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.476795 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477012 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477109 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477321 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477418 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477622 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477712 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.477944 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478032 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478251 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478338 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478556 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478687 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478881 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.478971 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.479184 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.479273 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.479526 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.479616 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.479831 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.479920 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.480152 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.480241 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.480464 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.480553 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.480771 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.480861 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.481078 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.481176 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.481385 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.481474 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.481726 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.481815 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.482033 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.482135 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.482343 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.482431 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.482688 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.482782 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483015 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483117 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483319 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483410 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483623 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483712 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.483933 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484035 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484238 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484369 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484542 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484639 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484845 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.484935 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.485153 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.485242 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.485455 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.485543 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.485757 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.485855 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.486060 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.486166 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.486370 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.486460 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.486709 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.486802 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487020 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487109 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487335 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487424 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487642 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487734 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.487943 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488032 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488244 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488340 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488568 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488658 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488875 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.488962 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.489200 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.489305 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.489505 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.489595 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.489810 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.489907 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.490682 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.490796 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.490992 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.491082 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.491333 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.491429 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.491638 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.491736 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.491953 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492040 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492267 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492354 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492578 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492667 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492889 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.492985 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.493204 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.493292 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.493516 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.493605 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.493833 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.493922 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.494152 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.494347 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.494485 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.494698 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.494793 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495016 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495105 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495330 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495438 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495643 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495732 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.495956 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.496046 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.496268 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.496522 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.496618 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.496853 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.496942 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.497170 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.497268 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.497478 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.497568 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.497790 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.497880 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.498108 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.498205 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.498424 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.498513 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.498762 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.498853 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.499079 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.499171 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.499391 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.499478 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.499702 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.499836 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500010 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500100 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500342 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500431 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500663 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500759 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.500969 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501066 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501281 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501371 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501596 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501692 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501908 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.501995 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.502215 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.502374 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.502526 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.502662 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.502862 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.502952 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.503178 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.503270 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.503490 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.503587 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.503800 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.503889 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.504112 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.504201 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.504422 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.504514 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.504733 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.504830 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.505048 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.505136 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.505363 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.505454 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.505715 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.505802 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.506029 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.506129 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.506342 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.506438 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.506676 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.506885 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507007 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507201 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507351 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507533 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507672 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507860 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.507989 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.508183 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.508303 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.508499 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.508621 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.508815 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.509139 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.509229 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.509444 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.509543 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.509749 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.509839 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.510058 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.510156 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.510368 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.510457 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.510700 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.510791 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511024 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511122 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511335 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511424 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511637 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511726 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.511955 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.512046 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.512262 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.512353 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.512574 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.512791 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.512881 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.513141 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.513229 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.513456 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.513554 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.513783 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.513879 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.514105 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.514194 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.514416 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.514506 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.514744 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.514973 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.515075 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.515320 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.515409 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.515639 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.515738 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.515959 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.516055 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.516269 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.516370 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.516575 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.516666 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.516938 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517039 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517187 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517276 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517498 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517589 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517804 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.517912 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.518112 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.518201 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.518414 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.518513 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.518744 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.518847 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519056 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519153 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519358 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519448 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519663 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519753 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.519970 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520067 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520273 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520368 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520577 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520675 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520879 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.520978 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.521182 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.521777 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522025 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522115 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522327 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522424 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522659 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522752 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.522971 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523070 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523278 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523376 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523583 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523679 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523888 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.523977 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.524204 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.524295 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.524512 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.524608 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.524812 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.524899 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.525113 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.525204 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.525422 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.525511 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.525731 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.525818 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.526053 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.526143 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.526364 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.526459 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.526697 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.526795 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.527015 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.527114 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.527321 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.527420 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.527644 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528166 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528291 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528380 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528463 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528553 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528635 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528809 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.528901 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.529142 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.529245 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.529451 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.529550 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.529761 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.530023 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.530164 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.530358 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.530449 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.530698 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.530809 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531015 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531104 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531325 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531415 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531634 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531724 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.531942 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532039 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532249 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532347 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532556 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532652 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532868 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.532957 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.533176 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.533264 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.533483 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.533574 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.533790 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.533879 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.534095 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.534261 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.534404 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.534493 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.534733 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.534825 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535047 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535161 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535358 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535467 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535670 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535765 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.535981 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.536080 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.536292 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.536428 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.536603 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.536692 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.536987 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.537571 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.537820 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.537917 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.538154 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.538250 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.538463 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.538561 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.538805 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.538897 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.539125 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.539222 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.539437 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.539527 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.539741 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.539831 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.540053 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.540366 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.540464 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.540678 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.540767 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.540996 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.541124 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.541316 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.541406 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.541629 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.541719 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.541933 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.542021 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.542262 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.542572 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.542722 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.542920 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543011 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543232 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543323 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543554 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543650 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543869 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.543959 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.544196 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.544294 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.544517 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.544604 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.544820 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.544909 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.545126 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.545226 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.545429 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.545527 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.545739 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.545837 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.546054 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.546144 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.546363 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.546452 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.546698 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.546832 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547003 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547103 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547310 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547399 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547614 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547710 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.547921 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548028 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548223 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548315 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548527 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548631 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548833 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.548931 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.549133 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.549220 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.549435 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.549526 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.549736 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.549833 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550038 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550127 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550340 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550430 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550662 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550771 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.550972 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551062 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551277 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551387 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551619 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551716 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551875 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.551966 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.552176 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.552266 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.552474 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.552724 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.552903 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553011 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553254 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553343 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553571 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553672 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553894 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.553994 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.554206 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.554296 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.554522 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.554652 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.554852 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.554956 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.555173 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.555268 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.555495 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.555586 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.555807 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.555906 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.556114 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.556203 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.556431 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.556518 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.556743 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.556833 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557051 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557139 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557361 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557449 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557669 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557761 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.557976 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.558105 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.558285 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.558377 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.558622 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.558716 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.558935 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559024 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559244 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559332 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559556 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559647 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559867 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.559957 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.560178 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.560277 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.560489 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.560586 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.560800 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.560897 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.561124 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.561221 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.561433 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.561537 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.561740 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.561829 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.562049 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.562148 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.562359 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.562449 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.562693 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.562787 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.563011 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.563101 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.563319 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.563407 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.563630 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.563720 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.564190 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.564294 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.564511 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.564608 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.564827 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.564916 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.565141 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.565287 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.565451 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.565541 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.565761 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.565858 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.566077 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.566169 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.566397 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.566485 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.566737 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.566849 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.567068 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.567164 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.567395 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.567485 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.567706 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.567811 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.568014 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.568103 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.568847 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.569049 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.569170 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:49:52.569406 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.569725 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.570071 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.570403 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.570744 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.571064 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.571373 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:49:52.571621 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:49:52.722161 n-d-master-1 devstack@n-api.service[106305]: INFO dbcounter [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Registered counter for database nova_api Oct 02 00:49:52.724991 n-d-master-1 devstack@n-api.service[106306]: INFO dbcounter [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Registered counter for database nova_api Oct 02 00:49:52.745004 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_db.sqlalchemy.engines [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:52.746728 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_db.sqlalchemy.engines [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:52.751604 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writer thread running {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:52.753448 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writer thread running {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:52.808445 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.context [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=106305) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:49:52.809978 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.context [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=106306) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:49:52.812265 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:49:52.812746 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:49:52.813828 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_concurrency.lockutils [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:49:52.814563 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:49:52.814694 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_concurrency.lockutils [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:49:52.815312 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:49:52.815764 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:49:52.816180 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_concurrency.lockutils [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:49:52.816894 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_concurrency.lockutils [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:49:52.817366 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_concurrency.lockutils [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:49:52.817755 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:49:52.819880 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_concurrency.lockutils [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:49:52.820290 n-d-master-1 devstack@n-api.service[106305]: INFO dbcounter [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Registered counter for database nova_cell0 Oct 02 00:49:52.821850 n-d-master-1 devstack@n-api.service[106306]: INFO dbcounter [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Registered counter for database nova_cell0 Oct 02 00:49:52.824324 n-d-master-1 devstack@n-api.service[106305]: INFO dbcounter [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Registered counter for database nova_cell1 Oct 02 00:49:52.825818 n-d-master-1 devstack@n-api.service[106306]: INFO dbcounter [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Registered counter for database nova_cell1 Oct 02 00:49:52.832679 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_db.sqlalchemy.engines [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:52.833538 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_db.sqlalchemy.engines [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:52.835992 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_db.sqlalchemy.engines [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:52.839026 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_db.sqlalchemy.engines [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:52.839503 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writer thread running {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:52.843189 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writer thread running {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:52.844689 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writer thread running {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:52.846518 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writer thread running {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:52.987968 n-d-master-1 devstack@n-api.service[106305]: INFO dbcounter [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Registered counter for database nova_cell0 Oct 02 00:49:52.990389 n-d-master-1 devstack@n-api.service[106306]: INFO dbcounter [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Registered counter for database nova_cell0 Oct 02 00:49:52.997059 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_db.sqlalchemy.engines [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:53.000544 n-d-master-1 devstack@n-api.service[106306]: DEBUG oslo_db.sqlalchemy.engines [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:49:53.001907 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writer thread running {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:53.005232 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writer thread running {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:49:53.341591 n-d-master-1 devstack@n-api.service[106306]: WARNING keystonemiddleware.auth_token [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:49:53.342960 n-d-master-1 devstack@n-api.service[106305]: WARNING keystonemiddleware.auth_token [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:49:53.349160 n-d-master-1 devstack@n-api.service[106306]: WARNING keystonemiddleware.auth_token [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:49:53.350445 n-d-master-1 devstack@n-api.service[106305]: WARNING keystonemiddleware.auth_token [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:49:53.690397 n-d-master-1 devstack@n-api.service[106306]: WARNING keystonemiddleware.auth_token [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:49:53.690993 n-d-master-1 devstack@n-api.service[106305]: WARNING keystonemiddleware.auth_token [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:49:53.696692 n-d-master-1 devstack@n-api.service[106306]: WARNING keystonemiddleware.auth_token [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:49:53.696946 n-d-master-1 devstack@n-api.service[106305]: WARNING keystonemiddleware.auth_token [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:49:53.701958 n-d-master-1 devstack@n-api.service[106306]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557310d2a9c0 pid: 106306 (default app) Oct 02 00:49:53.702257 n-d-master-1 devstack@n-api.service[106305]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557310d2a9c0 pid: 106305 (default app) Oct 02 00:49:53.704058 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:53.705245 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-857c042a-2fd1-4a4a-b586-9a3ed6374977 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Oct 02 00:49:53.705668 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sun Oct 2 00:49:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:15.410695 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:15.411916 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Oct 02 00:51:15.412332 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:15.424395 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_api:SELECT=3 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:15.426271 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_cell0:SELECT=3 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:15.428262 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_cell1:SELECT=3 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:15.429012 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:16.335685 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-02e7eae0-41ca-4328-a7c5-74fa125dd069 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:16.370688 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-02e7eae0-41ca-4328-a7c5-74fa125dd069 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.952329 Oct 02 00:51:16.371525 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 00:51:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:18.994833 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:18.995856 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-c3bbdba4-52d1-4200-bfe9-a01ee2e34136 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 02 00:51:18.996433 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:19.434035 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-03f51f05-ce20-40b0-ac62-51f25e0d1f8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:19.484593 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-03f51f05-ce20-40b0-ac62-51f25e0d1f8c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481881 Oct 02 00:51:19.485153 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:19.499533 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_api:SELECT=3 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:19.500551 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_cell0:SELECT=3 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:19.502395 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_cell1:SELECT=3 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:19.503330 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:19.709943 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-0329cd10-e92a-4b4c-af36-1903c3d8288b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:19.778202 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-0329cd10-e92a-4b4c-af36-1903c3d8288b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284297 Oct 02 00:51:19.778878 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 2 00:51:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:22.486749 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-03f51f05-ce20-40b0-ac62-51f25e0d1f8c admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:22.488111 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-03f51f05-ce20-40b0-ac62-51f25e0d1f8c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 02 00:51:22.489941 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:23.359329 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-4a5da1e6-b858-4bc2-b265-575f1155d9a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "id": "d1"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:23.416612 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-4a5da1e6-b858-4bc2-b265-575f1155d9a6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.920060 Oct 02 00:51:23.417766 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:23.431142 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-4a5be8aa-b19a-4dd0-8342-9568bc33052d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:23.479213 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-4a5be8aa-b19a-4dd0-8342-9568bc33052d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051600 Oct 02 00:51:23.479964 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 2 00:51:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:26.402727 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-4a5da1e6-b858-4bc2-b265-575f1155d9a6 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:26.403757 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-4a5da1e6-b858-4bc2-b265-575f1155d9a6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 02 00:51:26.404519 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:26.875436 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-cc7a846b-6d37-43e0-9615-d4fc810e420d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:26.895946 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-cc7a846b-6d37-43e0-9615-d4fc810e420d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484344 Oct 02 00:51:26.896944 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:26.910478 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-a4a59d34-9ab6-4375-a635-345880126dbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:26.939282 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-a4a59d34-9ab6-4375-a635-345880126dbb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033804 Oct 02 00:51:26.940149 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 2 00:51:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:51:29.552334 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-cc7a846b-6d37-43e0-9615-d4fc810e420d admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:29.554097 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-cc7a846b-6d37-43e0-9615-d4fc810e420d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002287 Oct 02 00:51:29.554594 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:30.020518 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-62f303c7-3bd7-48b4-984c-7e248b7cded6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "disk": 10, "swap": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:30.048750 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-62f303c7-3bd7-48b4-984c-7e248b7cded6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487211 Oct 02 00:51:30.049536 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:30.061296 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-b9a15f71-96d3-40ea-be8b-00d5cf76e0dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:30.092481 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-b9a15f71-96d3-40ea-be8b-00d5cf76e0dc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034845 Oct 02 00:51:30.099006 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 2 00:51:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:51:32.919471 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-62f303c7-3bd7-48b4-984c-7e248b7cded6 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:32.921251 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-62f303c7-3bd7-48b4-984c-7e248b7cded6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Oct 02 00:51:32.922477 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:33.392638 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-d3d0189b-639e-49ed-947c-63e3de479924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:33.419728 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-d3d0189b-639e-49ed-947c-63e3de479924 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490248 Oct 02 00:51:33.421418 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:33.434149 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-02ac4086-297f-4602-acf3-6be588dc1363 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:33.496514 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-02ac4086-297f-4602-acf3-6be588dc1363 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065960 Oct 02 00:51:33.497114 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 2 00:51:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:36.258319 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-d3d0189b-639e-49ed-947c-63e3de479924 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:36.259292 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-d3d0189b-639e-49ed-947c-63e3de479924 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 02 00:51:36.259693 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:36.742574 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-d164c68f-c9ea-49d6-ae00-e6727fb6b032 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:36.786621 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-d164c68f-c9ea-49d6-ae00-e6727fb6b032 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.515545 Oct 02 00:51:36.786621 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 00:51:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:51:39.562937 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-d3d0189b-639e-49ed-947c-63e3de479924 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:39.564180 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-d3d0189b-639e-49ed-947c-63e3de479924 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Oct 02 00:51:39.564589 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:40.026821 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-a76581e5-60b0-481e-8e81-46f1fe5e743a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "vcpus": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:40.051923 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-a76581e5-60b0-481e-8e81-46f1fe5e743a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481006 Oct 02 00:51:40.052475 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:40.065147 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-c3914438-53b8-4b3b-917f-ebbeb072f98d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:40.093367 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-c3914438-53b8-4b3b-917f-ebbeb072f98d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032477 Oct 02 00:51:40.093899 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 2 00:51:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:42.713793 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-a76581e5-60b0-481e-8e81-46f1fe5e743a admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:42.714873 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-a76581e5-60b0-481e-8e81-46f1fe5e743a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 02 00:51:42.715273 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:43.114886 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-578ceb5b-eb40-448d-90b8-a7a8fe88e8d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:43.133294 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-578ceb5b-eb40-448d-90b8-a7a8fe88e8d7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411640 Oct 02 00:51:43.133848 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:43.146403 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-87a39f6d-548e-42b5-b1e2-7406f597137a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:43.170183 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-87a39f6d-548e-42b5-b1e2-7406f597137a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027379 Oct 02 00:51:43.170778 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 2 00:51:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:51:45.819192 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-578ceb5b-eb40-448d-90b8-a7a8fe88e8d7 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:45.820221 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-578ceb5b-eb40-448d-90b8-a7a8fe88e8d7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 02 00:51:45.820627 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:46.373482 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-dfc1e6fd-2be4-45ee-b418-f6463a54493e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:46.397435 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-dfc1e6fd-2be4-45ee-b418-f6463a54493e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.570721 Oct 02 00:51:46.398133 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:46.412197 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-322dc7fc-e7fc-4b58-a28d-b2c0573a921e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:46.417297 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:46.444466 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-322dc7fc-e7fc-4b58-a28d-b2c0573a921e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037680 Oct 02 00:51:46.445367 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 2 00:51:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:49.138784 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-dfc1e6fd-2be4-45ee-b418-f6463a54493e admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:49.140512 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-dfc1e6fd-2be4-45ee-b418-f6463a54493e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Oct 02 00:51:49.141158 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:49.587587 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-7390603d-3710-40ce-b22d-fa764a261ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:49.606532 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-7390603d-3710-40ce-b22d-fa764a261ef4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458860 Oct 02 00:51:49.607409 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:49.619928 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-3c56ae5a-a2ac-401c-ae29-45fd15d854a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:49.645431 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-3c56ae5a-a2ac-401c-ae29-45fd15d854a7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029172 Oct 02 00:51:49.646206 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 2 00:51:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:51:52.306510 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-7390603d-3710-40ce-b22d-fa764a261ef4 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:51:52.307611 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-7390603d-3710-40ce-b22d-fa764a261ef4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 02 00:51:52.308190 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:51:52.752265 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-9b6990ad-6245-4b06-9d08-256f04ae9f3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:52.760719 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:52.777866 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-9b6990ad-6245-4b06-9d08-256f04ae9f3c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463447 Oct 02 00:51:52.779119 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 2 00:51:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:51:52.791323 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-0b5955d0-416c-437a-82b5-4ee54e37a47f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:51:52.818689 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-0b5955d0-416c-437a-82b5-4ee54e37a47f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031200 Oct 02 00:51:52.819607 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 2 00:51:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:52:13.002648 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-9b6990ad-6245-4b06-9d08-256f04ae9f3c admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:13.003608 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-9b6990ad-6245-4b06-9d08-256f04ae9f3c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 02 00:52:13.004011 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:13.014542 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:13.399272 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-bad1d970-5561-44c3-b2df-4fd3efe50f5b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:13.417286 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-bad1d970-5561-44c3-b2df-4fd3efe50f5b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407209 Oct 02 00:52:13.417814 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 00:52:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:52:14.729321 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-9b6990ad-6245-4b06-9d08-256f04ae9f3c admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:14.730325 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-9b6990ad-6245-4b06-9d08-256f04ae9f3c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 02 00:52:14.730763 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:15.263438 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-13f3a0ea-930f-4c3e-b9a0-2525fb81cb76 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:15.268705 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.wsgi [None req-13f3a0ea-930f-4c3e-b9a0-2525fb81cb76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-13f3a0ea-930f-4c3e-b9a0-2525fb81cb76 admin admin] Request method failure captured: Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Accept: application/json Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Accept-Encoding: gzip, deflate Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Connection: keep-alive Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Content-Length: 0 Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Host: 10.222.0.23 Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Openstack-Api-Version: compute 2.92 Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: Openstack-System-Scope: None Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: User-Agent: python-novaclient Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Auth-Token: gAAAAABjOOC-mBKgq9Qvse_0X7O6PxWBIWts_g49H2AtYnqMwu-RFDHir0Q3emJfm9Wohav2Au-lMvkBOCPHVBdW1OL2-7bU0gHflpHqXBd6wggj49VP29g0HqcntVcevbKporM40jev6zqvmFOVN36TppIYkafhrqUxcALFbDrjrt-Rb3uM7tU Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Domain-Id: None Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Domain-Name: None Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Identity-Status: Confirmed Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Is-Admin-Project: True Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Project-Domain-Id: default Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Project-Domain-Name: Default Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Project-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Project-Name: admin Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Role: member,reader,admin Oct 02 00:52:15.272397 n-d-master-1 devstack@n-api.service[106306]: X-Roles: member,reader,admin Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd709e757c564f0baea68763e7e07e28"}]}] Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-Tenant: admin Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-Tenant-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-Tenant-Name: admin Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-User: admin Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-User-Domain-Id: default Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-User-Domain-Name: Default Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-User-Id: a87a2f5ec4d74905b0b84b2127c02e7c Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: X-User-Name: admin Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: method: > Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: exception: Flavor 42 could not be found. Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: action_args: {'id': '42'} Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:52:15.274056 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:15.275080 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.276244 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-13f3a0ea-930f-4c3e-b9a0-2525fb81cb76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:52:15.277279 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-13f3a0ea-930f-4c3e-b9a0-2525fb81cb76 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393690 Oct 02 00:52:15.277279 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 2 00:52:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:15.284040 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-f3dacfbb-d888-4700-89bc-a7852a059da0 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:15.307025 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-f3dacfbb-d888-4700-89bc-a7852a059da0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026794 Oct 02 00:52:15.307580 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 2 00:52:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:52:15.318283 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-1bc44c1d-6dd6-4a8b-93da-8b2017e4d114 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:15.340688 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-1bc44c1d-6dd6-4a8b-93da-8b2017e4d114 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026934 Oct 02 00:52:15.341213 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 2 00:52:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:52:15.351098 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-64442cbd-6c20-4d42-9b83-f2a7c90e0cd9 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:15.356723 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.wsgi [None req-64442cbd-6c20-4d42-9b83-f2a7c90e0cd9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-64442cbd-6c20-4d42-9b83-f2a7c90e0cd9 admin admin] Request method failure captured: Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Accept: application/json Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Accept-Encoding: gzip, deflate Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Connection: keep-alive Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Content-Length: 0 Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Host: 10.222.0.23 Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Openstack-Api-Version: compute 2.92 Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: Openstack-System-Scope: None Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: User-Agent: python-novaclient Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Auth-Token: gAAAAABjOOC-mBKgq9Qvse_0X7O6PxWBIWts_g49H2AtYnqMwu-RFDHir0Q3emJfm9Wohav2Au-lMvkBOCPHVBdW1OL2-7bU0gHflpHqXBd6wggj49VP29g0HqcntVcevbKporM40jev6zqvmFOVN36TppIYkafhrqUxcALFbDrjrt-Rb3uM7tU Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Domain-Id: None Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Domain-Name: None Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Identity-Status: Confirmed Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Is-Admin-Project: True Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Project-Domain-Id: default Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Project-Domain-Name: Default Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Project-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Project-Name: admin Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Role: member,reader,admin Oct 02 00:52:15.360024 n-d-master-1 devstack@n-api.service[106305]: X-Roles: member,reader,admin Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd709e757c564f0baea68763e7e07e28"}]}] Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-Tenant: admin Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-Tenant-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-Tenant-Name: admin Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-User: admin Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-User-Domain-Id: default Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-User-Domain-Name: Default Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-User-Id: a87a2f5ec4d74905b0b84b2127c02e7c Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: X-User-Name: admin Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: method: > Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: exception: Flavor 42 could not be found. Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: action_args: {'id': '42'} Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:52:15.362344 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:15.363358 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:15.364443 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-64442cbd-6c20-4d42-9b83-f2a7c90e0cd9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:52:15.365444 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-64442cbd-6c20-4d42-9b83-f2a7c90e0cd9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014527 Oct 02 00:52:15.365444 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 2 00:52:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 02 00:52:16.594045 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-1bc44c1d-6dd6-4a8b-93da-8b2017e4d114 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:16.595095 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-1bc44c1d-6dd6-4a8b-93da-8b2017e4d114 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 02 00:52:16.595635 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:17.115865 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-e1c4b076-f379-4dc5-8d63-3209f886e0d2 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:17.120832 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.wsgi [None req-e1c4b076-f379-4dc5-8d63-3209f886e0d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-e1c4b076-f379-4dc5-8d63-3209f886e0d2 admin admin] Request method failure captured: Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Accept: application/json Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Accept-Encoding: gzip, deflate Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Connection: keep-alive Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Content-Length: 0 Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Host: 10.222.0.23 Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Openstack-Api-Version: compute 2.92 Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: Openstack-System-Scope: None Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: User-Agent: python-novaclient Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Auth-Token: gAAAAABjOODARD2smTTc9rGh-3xdVGlipqd7GjxYnvCMxPYc_5Lj21kZ_dNolczqJjBTvbcfhPeBHhZsqQYau-8YZoUIet3dyWTx0C7DsTlPnqvFCRKeiI3XECHFrdtdBWevroXlSGq5hlp1DqwrduhqOa_QtUC_vtGyjpvOU2ayR2NE_49J6Cg Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Domain-Id: None Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Domain-Name: None Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Identity-Status: Confirmed Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Is-Admin-Project: True Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Project-Domain-Id: default Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Project-Domain-Name: Default Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Project-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Project-Name: admin Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Role: member,reader,admin Oct 02 00:52:17.122326 n-d-master-1 devstack@n-api.service[106305]: X-Roles: member,reader,admin Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd709e757c564f0baea68763e7e07e28"}]}] Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-Tenant: admin Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-Tenant-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-Tenant-Name: admin Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-User: admin Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-User-Domain-Id: default Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-User-Domain-Name: Default Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-User-Id: a87a2f5ec4d74905b0b84b2127c02e7c Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: X-User-Name: admin Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: method: > Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: exception: Flavor 84 could not be found. Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: action_args: {'id': '84'} Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:52:17.123848 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:17.124869 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.126276 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-e1c4b076-f379-4dc5-8d63-3209f886e0d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:52:17.127525 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-e1c4b076-f379-4dc5-8d63-3209f886e0d2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388818 Oct 02 00:52:17.127525 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 2 00:52:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:17.133942 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-601a3858-1e5c-48a0-8984-d29316f39421 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:17.149616 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-601a3858-1e5c-48a0-8984-d29316f39421 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019235 Oct 02 00:52:17.150145 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 2 00:52:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:52:17.159703 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-a8c20aed-4e8f-42d1-a313-1f314b7f481f admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:17.175273 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-a8c20aed-4e8f-42d1-a313-1f314b7f481f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019113 Oct 02 00:52:17.175811 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 2 00:52:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:52:17.185125 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-92204b5b-3c1c-4394-92bd-dda0576ffa43 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:17.190080 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.wsgi [None req-92204b5b-3c1c-4394-92bd-dda0576ffa43 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-92204b5b-3c1c-4394-92bd-dda0576ffa43 admin admin] Request method failure captured: Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Accept: application/json Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Accept-Encoding: gzip, deflate Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Connection: keep-alive Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Content-Length: 0 Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Host: 10.222.0.23 Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Openstack-Api-Version: compute 2.92 Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: Openstack-System-Scope: None Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: User-Agent: python-novaclient Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Auth-Token: gAAAAABjOODARD2smTTc9rGh-3xdVGlipqd7GjxYnvCMxPYc_5Lj21kZ_dNolczqJjBTvbcfhPeBHhZsqQYau-8YZoUIet3dyWTx0C7DsTlPnqvFCRKeiI3XECHFrdtdBWevroXlSGq5hlp1DqwrduhqOa_QtUC_vtGyjpvOU2ayR2NE_49J6Cg Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Domain-Id: None Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Domain-Name: None Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Identity-Status: Confirmed Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Is-Admin-Project: True Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Project-Domain-Id: default Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Project-Domain-Name: Default Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Project-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Project-Name: admin Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Role: member,reader,admin Oct 02 00:52:17.192262 n-d-master-1 devstack@n-api.service[106306]: X-Roles: member,reader,admin Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd709e757c564f0baea68763e7e07e28"}]}] Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-Tenant: admin Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-Tenant-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-Tenant-Name: admin Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-User: admin Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-User-Domain-Id: default Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-User-Domain-Name: Default Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-User-Id: a87a2f5ec4d74905b0b84b2127c02e7c Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: X-User-Name: admin Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: method: > Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: exception: Flavor 84 could not be found. Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: action_args: {'id': '84'} Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:52:17.193736 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:17.194650 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:17.195708 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-92204b5b-3c1c-4394-92bd-dda0576ffa43 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:52:17.196898 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-92204b5b-3c1c-4394-92bd-dda0576ffa43 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012699 Oct 02 00:52:17.196898 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 2 00:52:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 02 00:52:18.412853 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-a8c20aed-4e8f-42d1-a313-1f314b7f481f admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:18.413885 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-a8c20aed-4e8f-42d1-a313-1f314b7f481f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 02 00:52:18.414281 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:18.933676 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-0a060fc0-d67f-440d-a3be-d9e3b87640d7 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:18.939480 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.wsgi [None req-0a060fc0-d67f-440d-a3be-d9e3b87640d7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-0a060fc0-d67f-440d-a3be-d9e3b87640d7 admin admin] Request method failure captured: Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Accept: application/json Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Accept-Encoding: gzip, deflate Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Connection: keep-alive Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Content-Length: 0 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Host: 10.222.0.23 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Openstack-Api-Version: compute 2.92 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: Openstack-System-Scope: None Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: User-Agent: python-novaclient Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Auth-Token: gAAAAABjOODCgqZHrOkstLW4S4l1Q9VJuvUJ3fPVMuVIGoEGm5CA7fToZMjWfhlEhAJhejqO3Is1NOaXtwU92tyYaKXWLj9bWnPkinsjtfjSGLuD5j-IiYqcmxzkffJJBZZkJkhbbxt5mQxdARnqcP89VCzRDCLUq3KEiJEWVHbCn2Wz2Ey2lF0 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Domain-Id: None Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Domain-Name: None Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Identity-Status: Confirmed Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Is-Admin-Project: True Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Project-Domain-Id: default Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Project-Domain-Name: Default Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Project-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Project-Name: admin Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Role: member,reader,admin Oct 02 00:52:18.940967 n-d-master-1 devstack@n-api.service[106306]: X-Roles: member,reader,admin Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd709e757c564f0baea68763e7e07e28"}]}] Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-Tenant: admin Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-Tenant-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-Tenant-Name: admin Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-User: admin Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-User-Domain-Id: default Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-User-Domain-Name: Default Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-User-Id: a87a2f5ec4d74905b0b84b2127c02e7c Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: X-User-Name: admin Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: method: > Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: exception: Flavor 451 could not be found. Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: action_args: {'id': '451'} Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:52:18.943022 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:18.943978 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: ERROR nova.api.openstack.wsgi Oct 02 00:52:18.945149 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-0a060fc0-d67f-440d-a3be-d9e3b87640d7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:52:18.946355 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-0a060fc0-d67f-440d-a3be-d9e3b87640d7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.386758 Oct 02 00:52:18.946355 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 00:52:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:18.952708 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-b9deaa29-e37d-4439-a2c6-dc15ec396611 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:18.967928 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-b9deaa29-e37d-4439-a2c6-dc15ec396611 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018697 Oct 02 00:52:18.968475 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 2 00:52:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:52:18.977962 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:18.993510 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019055 Oct 02 00:52:18.994035 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 2 00:52:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:52:19.003284 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-31a73cd6-7922-4ad1-b216-6dc8ee5df8ab admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:19.008824 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.wsgi [None req-31a73cd6-7922-4ad1-b216-6dc8ee5df8ab admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-31a73cd6-7922-4ad1-b216-6dc8ee5df8ab admin admin] Request method failure captured: Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Accept: application/json Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Accept-Encoding: gzip, deflate Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Connection: keep-alive Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Content-Length: 0 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Host: 10.222.0.23 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Openstack-Api-Version: compute 2.92 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: Openstack-System-Scope: None Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: User-Agent: python-novaclient Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Auth-Token: gAAAAABjOODCgqZHrOkstLW4S4l1Q9VJuvUJ3fPVMuVIGoEGm5CA7fToZMjWfhlEhAJhejqO3Is1NOaXtwU92tyYaKXWLj9bWnPkinsjtfjSGLuD5j-IiYqcmxzkffJJBZZkJkhbbxt5mQxdARnqcP89VCzRDCLUq3KEiJEWVHbCn2Wz2Ey2lF0 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Domain-Id: None Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Domain-Name: None Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Identity-Status: Confirmed Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Is-Admin-Project: True Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Project-Domain-Id: default Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Project-Domain-Name: Default Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Project-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Project-Name: admin Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Role: member,reader,admin Oct 02 00:52:19.010322 n-d-master-1 devstack@n-api.service[106305]: X-Roles: member,reader,admin Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd709e757c564f0baea68763e7e07e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd709e757c564f0baea68763e7e07e28"}]}] Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-Tenant: admin Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-Tenant-Id: bd709e757c564f0baea68763e7e07e28 Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-Tenant-Name: admin Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-User: admin Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-User-Domain-Id: default Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-User-Domain-Name: Default Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-User-Id: a87a2f5ec4d74905b0b84b2127c02e7c Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: X-User-Name: admin Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: method: > Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: exception: Flavor 451 could not be found. Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: action_args: {'id': '451'} Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:52:19.011908 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:19.012855 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: ERROR nova.api.openstack.wsgi Oct 02 00:52:19.014114 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-31a73cd6-7922-4ad1-b216-6dc8ee5df8ab admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:52:19.015433 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-31a73cd6-7922-4ad1-b216-6dc8ee5df8ab admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011939 Oct 02 00:52:19.015433 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 00:52:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:20.223025 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:20.224655 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Oct 02 00:52:20.225049 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:20.742498 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-cf4373b1-aba7-4ac9-9f07-720a824a1e62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:52:20.762661 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-cf4373b1-aba7-4ac9-9f07-720a824a1e62 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402313 Oct 02 00:52:20.763210 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 2 00:52:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:52:21.982881 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:21.983901 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 02 00:52:21.984292 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:22.496004 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-5505a87a-08b6-472f-a143-21e0ce612eb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:52:22.515546 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-5505a87a-08b6-472f-a143-21e0ce612eb6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395230 Oct 02 00:52:22.516169 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 2 00:52:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:52:23.730027 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:23.731070 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 02 00:52:23.731467 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:24.280324 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-faa4e066-ede2-4955-80c7-18ce21dacd1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:52:24.299454 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-faa4e066-ede2-4955-80c7-18ce21dacd1a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.425712 Oct 02 00:52:24.299990 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 2 00:52:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:52:25.516696 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:25.517693 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 02 00:52:25.518084 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:26.045960 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-3a49036f-a8ca-432a-9682-c126683b63d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:52:26.064727 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-3a49036f-a8ca-432a-9682-c126683b63d3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400995 Oct 02 00:52:26.065268 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 2 00:52:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:52:27.289391 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:27.290406 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 02 00:52:27.290834 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:27.810263 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-902afca1-19f0-44c5-b628-644b5d2358ea admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:27.831002 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-902afca1-19f0-44c5-b628-644b5d2358ea admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402630 Oct 02 00:52:27.831630 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sun Oct 2 00:52:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:53:25.087815 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:53:25.088822 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-85923d06-8f3c-474d-b1d3-e9dc8cb06c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Oct 02 00:53:25.089227 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 2 00:53:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:53:25.100068 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:25.522224 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-76f4eaac-6a69-4950-844c-aa548aaa3d55 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:53:25.545286 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-76f4eaac-6a69-4950-844c-aa548aaa3d55 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.449673 Oct 02 00:53:25.546636 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 00:53:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:53:25.573231 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_api:SELECT=14 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:25.577738 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-c56bcc72-ff30-4453-ac73-db305a656ca1 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:53:25.586272 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-c56bcc72-ff30-4453-ac73-db305a656ca1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014491 Oct 02 00:53:25.586860 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Sun Oct 2 00:53:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:53:25.599911 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-b86e959e-39c0-4568-b238-04daf3ef9b8e admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:53:25.607815 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-b86e959e-39c0-4568-b238-04daf3ef9b8e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011573 Oct 02 00:53:25.608396 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Sun Oct 2 00:53:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:53:25.621637 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-d7840a86-f1a0-49cf-9d31-6f3f61317aa1 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:53:25.630530 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-d7840a86-f1a0-49cf-9d31-6f3f61317aa1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012448 Oct 02 00:53:25.631115 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Sun Oct 2 00:53:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:53:25.644419 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-70465939-7f10-4201-876d-e25135a1e6ff admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:53:25.651845 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-70465939-7f10-4201-876d-e25135a1e6ff admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011439 Oct 02 00:53:25.652373 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Sun Oct 2 00:53:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:45.695928 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-d7840a86-f1a0-49cf-9d31-6f3f61317aa1 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:45.696954 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-d7840a86-f1a0-49cf-9d31-6f3f61317aa1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 02 00:58:45.697356 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:45.837785 n-d-master-1 devstack@n-api.service[106305]: DEBUG dbcounter [-] [106305] Writing DB stats nova_api:SELECT=6 {{(pid=106305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:45.983239 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:45.987952 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.988427 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.988853 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.989594 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.990039 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.990460 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.028736 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-9f7892a3-ad9c-4e48-95ac-afed2073991d admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.192073 Oct 02 00:58:46.029282 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 00:58:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:47.107074 n-d-master-1 devstack@n-api.service[106306]: DEBUG nova.api.openstack.wsgi [None req-d7840a86-f1a0-49cf-9d31-6f3f61317aa1 admin admin] Calling method '>' {{(pid=106306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:47.108082 n-d-master-1 devstack@n-api.service[106306]: INFO nova.api.openstack.requestlog [None req-d7840a86-f1a0-49cf-9d31-6f3f61317aa1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 02 00:58:47.108506 n-d-master-1 devstack@n-api.service[106306]: [pid: 106306|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:47.298726 n-d-master-1 devstack@n-api.service[106305]: DEBUG nova.api.openstack.wsgi [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Calling method '>' {{(pid=106305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:47.302118 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.302617 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.303092 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.303806 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.304258 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.304675 n-d-master-1 devstack@n-api.service[106305]: DEBUG oslo_concurrency.lockutils [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.327896 n-d-master-1 devstack@n-api.service[106305]: INFO nova.api.openstack.requestlog [None req-c7152a89-aed5-4c23-ad89-2de8afc4db69 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079760 Oct 02 00:58:47.328433 n-d-master-1 devstack@n-api.service[106305]: [pid: 106305|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:33.679636 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 02 00:59:33.680173 n-d-master-1 devstack@n-api.service[106304]: Sun Oct 2 00:59:33 2022 - graceful shutdown triggered... Oct 02 00:59:33.680618 n-d-master-1 devstack@n-api.service[106305]: Gracefully killing worker 1 (pid: 106305)... Oct 02 00:59:33.680986 n-d-master-1 devstack@n-api.service[106306]: Gracefully killing worker 2 (pid: 106306)... Oct 02 00:59:33.806782 n-d-master-1 devstack@n-api.service[106306]: DEBUG dbcounter [-] [106306] Writing DB stats nova_api:SELECT=4 {{(pid=106306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:34.681286 n-d-master-1 devstack@n-api.service[106304]: worker 1 buried after 1 seconds Oct 02 00:59:34.681286 n-d-master-1 devstack@n-api.service[106304]: worker 2 buried after 1 seconds Oct 02 00:59:34.681286 n-d-master-1 devstack@n-api.service[106304]: goodbye to uWSGI. Oct 02 00:59:34.682894 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 02 00:59:34.683449 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 02 00:59:34.686396 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 02 00:59:34.702626 n-d-master-1 devstack@n-api.service[122342]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:59:34 2022] *** Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: nodename: n-d-master-1 Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: machine: x86_64 Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: clock source: unix Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: pcre jit disabled Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: detected number of CPU cores: 4 Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: current working directory: / Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:59:34.704737 n-d-master-1 devstack@n-api.service[122342]: your processes number limit is 47680 Oct 02 00:59:34.705508 n-d-master-1 devstack@n-api.service[122342]: your memory page size is 4096 bytes Oct 02 00:59:34.705508 n-d-master-1 devstack@n-api.service[122342]: detected max file descriptor number: 2048 Oct 02 00:59:34.705508 n-d-master-1 devstack@n-api.service[122342]: lock engine: pthread robust mutexes Oct 02 00:59:34.705508 n-d-master-1 devstack@n-api.service[122342]: thunder lock: enabled Oct 02 00:59:34.705508 n-d-master-1 devstack@n-api.service[122342]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 02 00:59:34.705508 n-d-master-1 devstack@n-api.service[122342]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:59:34.745732 n-d-master-1 devstack@n-api.service[122342]: Python main interpreter initialized at 0x5578ace459c0 Oct 02 00:59:34.745732 n-d-master-1 devstack@n-api.service[122342]: python threads support enabled Oct 02 00:59:34.745732 n-d-master-1 devstack@n-api.service[122342]: your server socket listen backlog is limited to 100 connections Oct 02 00:59:34.745732 n-d-master-1 devstack@n-api.service[122342]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:59:34.746177 n-d-master-1 devstack@n-api.service[122342]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:59:34.746177 n-d-master-1 devstack@n-api.service[122342]: *** Operational MODE: preforking *** Oct 02 00:59:34.746433 n-d-master-1 devstack@n-api.service[122342]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:59:34.746433 n-d-master-1 devstack@n-api.service[122342]: spawned uWSGI master process (pid: 122342) Oct 02 00:59:34.746658 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 02 00:59:34.747329 n-d-master-1 devstack@n-api.service[122342]: spawned uWSGI worker 1 (pid: 122354, cores: 1) Oct 02 00:59:34.747579 n-d-master-1 devstack@n-api.service[122342]: spawned uWSGI worker 2 (pid: 122355, cores: 1) Oct 02 00:59:34.747737 n-d-master-1 devstack@n-api.service[122342]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:59:35.408001 n-d-master-1 devstack@n-api.service[122355]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:59:35.411628 n-d-master-1 devstack@n-api.service[122354]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:59:36.577326 n-d-master-1 devstack@n-api.service[122355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:59:36.577326 n-d-master-1 devstack@n-api.service[122355]: from cryptography.utils import int_from_bytes Oct 02 00:59:36.579170 n-d-master-1 devstack@n-api.service[122355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:59:36.579170 n-d-master-1 devstack@n-api.service[122355]: from cryptography.utils import int_from_bytes Oct 02 00:59:36.592454 n-d-master-1 devstack@n-api.service[122354]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:59:36.592454 n-d-master-1 devstack@n-api.service[122354]: from cryptography.utils import int_from_bytes Oct 02 00:59:36.593024 n-d-master-1 devstack@n-api.service[122354]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:59:36.593024 n-d-master-1 devstack@n-api.service[122354]: from cryptography.utils import int_from_bytes Oct 02 00:59:38.995930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:59:38.996500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:59:38.996706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:59:38.997074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:59:38.997328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:59:38.997716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:38.998042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:38.998363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:38.998718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:38.999056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:38.999375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:38.999697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.000014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.000404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.000844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.001173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.001629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.001957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.002269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.002585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.002930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.003241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.003570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.003890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.004390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.004840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.005151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.005682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.005804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.006095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.006406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.006754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.007069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.007393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.007704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.008103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.008424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.008741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.009055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.009470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.009785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.010099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.010428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.010777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.011096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.011427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.011750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.012074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.012397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.012704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.013015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.013325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.013646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.013952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.014263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.014511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.015023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.015353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.015677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.016024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.016276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.016622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.016956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.017283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.017596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.017908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.018219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.018528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.018860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.019166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.019474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.019780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.020100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.020416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.020738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.021045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.021372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.021772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.022023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.022333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.022695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.023018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.023332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.023655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.023977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.024285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.024591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.024896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.025217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.025554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.025862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.026113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.026414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.026744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.027067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.027375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.027680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.027988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.028290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.028596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.028902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.029207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.029512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.029817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.030124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.030429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.030760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.031073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.031378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.032246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.032653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.032969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.033281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.033592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.033903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.034229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.034540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.034881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.035207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.035522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.035830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.036153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.036461 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.036770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.037093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.037415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.037713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.038032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.038341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.038672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.038981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.039288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.039595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.039904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.040209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.040515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.040819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.041135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.041461 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.041775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.042084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.042393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.042741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.043085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.043419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.043766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.044088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.044427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.044761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.045083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.045399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.045716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.046050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.046364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.046711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.047030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.048078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.048363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.048685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.049008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.049329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.049648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.049962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.050282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.050642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.051047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.051361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.051713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.052067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.052382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.052717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.053051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.053371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.053686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.054001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.054352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.054693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.055012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.055336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.055652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.055982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.056298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.056613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.056928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.057241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.057557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.057904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.058228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.058555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.058900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.059215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.059535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.060107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.060420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.060733 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.061041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.061350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.061665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.062016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.062286 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.062636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.063010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.063323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.063665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.063976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.064289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.064602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.064914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.065223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.065540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.065854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.066163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.066494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.066837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.067168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.067474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.067785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.068093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.068414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.068725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.069038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.069354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.069666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.069996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.070310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.070647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.070995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.071329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.071641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.071970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.072296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.072617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.072928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.073245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.073554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.073862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.074170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.074484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.074816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.075124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.075432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.075742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.076050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.076384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.076696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.077003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.077307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.077614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.077962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.078268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.078677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.079024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.079355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.079674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.079988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.080310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.080624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.080939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.081252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.081569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.081891 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.082208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.082529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.082870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.083205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.083523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.083845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.084153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.084473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.084824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.085164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.085485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.085812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.086125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.086443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.086787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.087101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.087411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.087723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.088045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.088356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.088680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.088984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.089314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.089629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.089950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.090257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.090575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.090943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.091292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.091606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.091920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.092246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.092558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.092872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.093328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.093482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.093791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.094681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.095243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.095590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.095907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.096219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.096538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.096854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.097163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.097469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.097786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.098122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.098438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.098799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.099126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.099433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.099743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.100073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.100385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.100702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.101001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.101306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.101654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.101973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.102277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.102652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.102943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.103255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.103576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.103892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.104204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.104529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.104846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.105159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.105473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.105784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.106095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.106407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.106758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.107072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.107384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.107696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.108003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.108314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.108635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.109238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.109575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.110459 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.110803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.111315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.111645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.111991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.112325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.112646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.112957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.113272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.113583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.113894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.114215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.114523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.114859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.115170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.115485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.115792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.116098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.116408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.116717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.117041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.117350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.117666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.117975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.118310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.118644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.118956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.119268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.119576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.119926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.120235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.120584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.120920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.121271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.121582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.121897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.122229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.122544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.122895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.123206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.123520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.123832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.124185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.124506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.124818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.125131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.125488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.125996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.126314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.126645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.126970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.127284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.127645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.127889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.128204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.128516 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.128825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.129140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.129446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.129769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.130081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.130392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.130732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.131048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.131362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.131741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.132083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.132397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.132712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.133018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.133331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.133638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.133942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.134256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.134582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.134926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.135232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.135542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.135850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.136155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.136463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.136776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.137080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.137387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.137713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.137998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.138303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.138648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.138964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.139274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.139584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.139886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.140237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.140547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.140910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.140910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.140910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.140910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.142552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.142552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.142912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.143062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:59:39.143555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.143788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:59:39.143944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.143944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.144339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:59:39.144523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.144668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:59:39.144934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.145085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:59:39.145229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.145379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.145529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.145680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.145833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.145978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.146120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.146263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.146405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.146562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.146757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.146904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.147072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.147224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.147368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.147520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.147663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.147813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.147964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.148121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.148268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.148423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.148575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.148575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.148857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.149007 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.149163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.149349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.149503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.149669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.149820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.149963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.150117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.150268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.150419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.150569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.150753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.150898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.151049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.151194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.151194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.151480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.151648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.151806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.151956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.152099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.152241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.152403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.152546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.152697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.152840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.152992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.153142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.153293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.153436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.153591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.153591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.153877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.154028 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.154179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.154355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.154510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.154510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.154826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.155075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.155240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.155385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.155535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.155677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.155827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.155994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.156152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.156307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.156458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.157099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.157251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.157395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.157547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.157699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.157850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.157993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.158150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.158296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.158448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.158590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.158770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.158913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.159057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.159217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.159368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.159512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.159655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.159805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.159956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.160113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.160269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.160420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.160581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.160725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.160875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.161029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.161172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.161172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.161451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.161602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.161759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.161903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.162045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.162187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.162329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.162481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.162693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.162853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.162998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.163140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.163292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.163435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.163435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.163717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.163860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.164001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.164153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.164311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.164454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.164604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.164755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.164897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.165079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.165318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.165479 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.165623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.165774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.165917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.166060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.166221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.166365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.166514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.166674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.166833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.167002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.167150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.167292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.167433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.167585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.167736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.167893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.168045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.168223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.168375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.168518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.168667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.168823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.168969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.169118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.169261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.169442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.169598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.169750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.169901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.170045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.170221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.170366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.170521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.170691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.170851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.171005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.171149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.171292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.171449 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.171600 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.171743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.171886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.172037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.172180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.173093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.173276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.173585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.173756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.173913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.174065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.174224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.174376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.174520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.174972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.175131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.175306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.175469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.175614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.175757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.175907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.176051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.176204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.176349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.176492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.176642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.176785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.176785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.177064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.177219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.177364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.177515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.177658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.177801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.177965 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.178116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.178266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.178428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.178573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.178737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.178894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.179044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.179205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.179355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.179499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.179655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.179807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.179965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.180123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.180268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.180411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.180562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.180705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.180855 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.181008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.181168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.181319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.181470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.181615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.181764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.181917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.182068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.182220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.182380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.182538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.182718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.182864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.183028 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.183173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.183316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.183470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.183628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.183775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.183918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.184060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.184202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.184353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.184506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.184665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.185081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.185256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.185417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.185567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.185730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.185881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.186036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.186194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.186345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.186502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.186710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.186876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.187032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.187217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.187379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.187562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.187722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.187932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.188220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.188427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.188629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.188797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.188958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.189117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.189268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.189455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.189455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.189797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:59:39.189956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.190115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.190273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.190450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.190657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.190815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.190980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.191132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.191289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.191447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.191613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.191779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.191929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.192079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.192228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.192385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.192549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.192707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.192707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.193999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.194157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.194321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.194480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.194657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.194813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.194963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.195120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.195280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.195438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.195589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.195756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.195912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.196062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.196231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.196389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.196539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.196696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.196854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.197975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.198128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.198279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.198434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.198434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.198747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.198747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.199058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.199251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.199406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.199555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.199756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.199909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.200964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.201123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.201273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.201432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.201609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.201761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.201911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.202060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.202216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.202367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.202526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.202737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.202890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.203039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.203190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.203351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.203527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.203749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.203929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.204081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.204238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.204398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.204559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.204716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.204866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.205015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.205164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.205396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.205549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.205711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.205862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.206987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.207147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.207305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.207462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.207613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.207776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.207933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.208096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.208247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.208404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.208558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.208708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.208866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.209972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.210150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.210314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.210565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.210812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.210999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.211165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.211165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.211458 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.211634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.211798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.211965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.212127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.212286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.212437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.212586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.212743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.212965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.213119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.213269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.213426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.213583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.213747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.213907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.214078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.214239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.214389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.214538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.214730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.214890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.215987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.216928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.217228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.217391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.217542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.217699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.217856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.218014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.218174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.218340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.218494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.218676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.218842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.219000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.219661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.219820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.219978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.220128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.220279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.220428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.220579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.220748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.220899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.221955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.222112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.222262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.222421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.222421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.222769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.222922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.223072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.223228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.223391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.223550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.223701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.223858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.224937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.225100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.225250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.225407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.225558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.225708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.225857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.226962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.227119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.227277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.227427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.227584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.227741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.227900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.228058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.228215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.228374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.228523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.228695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.228855 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.229954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.230918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.231212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.231361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.231519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.231669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.231826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.231983 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.232140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.232303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.232454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.232614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.232770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.232929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.233079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.233236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.233393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.233549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.233706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.233868 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.234026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.234188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.234339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.234502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.234689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.235393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.235604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.235768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.235918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.236069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.236218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.236382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.236541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.236691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.236850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.237944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.238108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.238265 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.238430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.238430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.238750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.238911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.239071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.239238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.239389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.239538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.239687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.239846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.240928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.241096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.241248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.241405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.241556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.241718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.241875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.242026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.242183 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.242333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.242483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.242704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.242868 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.243963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.244120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.244278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.244439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.244590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.244739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.244896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.245047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.245207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.245365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.245524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.245690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.245851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.246970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.247279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.247431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.247589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.247740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.247897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.248991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.249158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.249308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.249458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.249607 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.249803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.249966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.250117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.250273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.250455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.250669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.250864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.251062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.251215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.251375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.251541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.251692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.251850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.252919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.253077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.253235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.253404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.253554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.253716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.253868 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.254961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.255111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.255291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.255453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.255610 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.255760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.255910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.256061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.256211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.256370 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.256529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.256689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.256859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.257954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.258111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.258265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.258422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.258580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.258781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.258939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.259099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.259259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.259416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.259568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.259726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.259877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.260965 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.261114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.261282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.261441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.261600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.261750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.261900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.262099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.262258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.262421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.262572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.262762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.262915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.263078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.263251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.263465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.263618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.263775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.263932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.264082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.264240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.264405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.264558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.264708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.264865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.265979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.266173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.266388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.266543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.266755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.266916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.267067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.268248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.269392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.269392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.269392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.269392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.269392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.270114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.270114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.270413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.270671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.270899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.271210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.271527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.271845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.272157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.272488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.272804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.273116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.273426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.273747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.274060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.274366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.274705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.275037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.275361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.275672 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.275988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.276296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.276605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.276916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.277231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.277541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.277850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.278159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.278469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.278804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.279137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.279453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.279761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.280070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.280376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.300482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.302392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.310938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.311940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.313373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.314904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.316268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.317285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.318721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.319703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.320704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.326384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.327566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.329084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.330325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.331522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.332519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.333572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.334362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.334362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.334362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.334774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.334979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.335326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.335657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.335883 n-d-master-1 devstack@n-api.service[122355]: INFO dbcounter [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Registered counter for database nova_api Oct 02 00:59:39.335975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.336289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.336615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.336940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.337273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.337583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.338055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.338532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.339039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.339375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.339954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.340290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.340614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.340934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.341257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.341576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.342064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.342365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.342716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.343039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.343360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.343700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.344035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.345003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.345313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.345639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.346091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.346571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.346934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.347651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.347651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.347917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.348413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.348932 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.349262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.349764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.350781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.350781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.350781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.351181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.351437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.351760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.352081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.352414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.353002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.353508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.353843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.354173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.354496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.355116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.355440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.355784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.356122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.356462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.356786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.357115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.357453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.357770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.358081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.358590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.359197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.359565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.359943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.360260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.360578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.361105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.361436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.362662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.362662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.362843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.363128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.363325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_db.sqlalchemy.engines [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.363489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.363793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.364113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.364451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.364771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.365104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.365416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.365740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.366055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.366371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.366795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.367120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.367431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.367751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.368060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.368393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.368708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.369023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.369337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.369655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.369964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.370279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.370389 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writer thread running {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.370590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.370941 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.371263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.371580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.372001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.372632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.372632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.373026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.373286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.373612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.373933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.374245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.374563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.374920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.375268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.375820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.376153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.376511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.376816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.377158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.377704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.378045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.378372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.378743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.379085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.379401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.379717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.380031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.380363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.380682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.381002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.381319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.381636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.381951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.382268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.382586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.382925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.383240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.383554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.383868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.384185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.384507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.384825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.385145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.385493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.385817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.386140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.386464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.386811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.387129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.387449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.387762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.388078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.388400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.388736 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.389058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.389369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.389807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.390127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.390526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.391483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.391769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.392245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.392414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.392874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.393206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.393527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.393868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.394216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.394556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.394911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.395223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.395537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.395851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.396168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.396494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.396811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.397123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.397938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.397938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.398165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.398489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.398882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.399188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.399576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.399865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.400173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.400530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.400841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.401150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.401459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.401775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.402082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.402391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.402777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.403097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.403828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.404245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.404564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.405312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.405650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.405975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.406312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.407212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.407909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.408564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.409002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.409278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.410164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.410498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.410923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.411254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.411620 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.411947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.412305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.412653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.412990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.413308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.413646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.413982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.414315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.414663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.414985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.415327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.415645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.415966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.416283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.416602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.416921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.417244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.417562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.417878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.418205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.418527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.418891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.419230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.419549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.419883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.420221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.420577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.420894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.421243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.421581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.421904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.422287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.422819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:59:39.423073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:59:39.429643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.context [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=122355) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:59:39.433630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.434100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.435973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.436698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.437142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.439572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.441632 n-d-master-1 devstack@n-api.service[122355]: INFO dbcounter [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Registered counter for database nova_cell0 Oct 02 00:59:39.445682 n-d-master-1 devstack@n-api.service[122355]: INFO dbcounter [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Registered counter for database nova_cell1 Oct 02 00:59:39.452907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_db.sqlalchemy.engines [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.455719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_db.sqlalchemy.engines [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.462482 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writer thread running {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.463844 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writer thread running {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.487150 n-d-master-1 devstack@n-api.service[122354]: INFO dbcounter [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Registered counter for database nova_api Oct 02 00:59:39.508188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_db.sqlalchemy.engines [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.515098 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writer thread running {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.573925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.context [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=122354) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:59:39.577909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.578388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.580382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.581136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.581576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.583682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.585728 n-d-master-1 devstack@n-api.service[122354]: INFO dbcounter [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Registered counter for database nova_cell0 Oct 02 00:59:39.590326 n-d-master-1 devstack@n-api.service[122354]: INFO dbcounter [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Registered counter for database nova_cell1 Oct 02 00:59:39.597830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_db.sqlalchemy.engines [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.602974 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writer thread running {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.603646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_db.sqlalchemy.engines [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.613692 n-d-master-1 devstack@n-api.service[122355]: INFO dbcounter [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Registered counter for database nova_cell0 Oct 02 00:59:39.620427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_db.sqlalchemy.engines [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.624941 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writer thread running {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.753744 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writer thread running {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.762453 n-d-master-1 devstack@n-api.service[122354]: INFO dbcounter [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Registered counter for database nova_cell0 Oct 02 00:59:39.771435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_db.sqlalchemy.engines [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:59:39.776264 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writer thread running {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:59:39.952234 n-d-master-1 devstack@n-api.service[122355]: WARNING keystonemiddleware.auth_token [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:59:39.962647 n-d-master-1 devstack@n-api.service[122355]: WARNING keystonemiddleware.auth_token [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:59:40.111278 n-d-master-1 devstack@n-api.service[122354]: WARNING keystonemiddleware.auth_token [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:59:40.118572 n-d-master-1 devstack@n-api.service[122354]: WARNING keystonemiddleware.auth_token [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:59:40.302403 n-d-master-1 devstack@n-api.service[122355]: WARNING keystonemiddleware.auth_token [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:59:40.308643 n-d-master-1 devstack@n-api.service[122355]: WARNING keystonemiddleware.auth_token [None req-ff8f8642-c746-4ce1-ac9c-1bb143944a09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:59:40.314410 n-d-master-1 devstack@n-api.service[122355]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578ace459c0 pid: 122355 (default app) Oct 02 00:59:40.465596 n-d-master-1 devstack@n-api.service[122354]: WARNING keystonemiddleware.auth_token [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:59:40.471989 n-d-master-1 devstack@n-api.service[122354]: WARNING keystonemiddleware.auth_token [None req-dad666f1-d517-4512-9944-74dcc39ebce1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:59:40.477280 n-d-master-1 devstack@n-api.service[122354]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578ace459c0 pid: 122354 (default app) Oct 02 01:00:20.938350 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.939473 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.940569 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.941346 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.738154 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.739143 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.740238 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.741352 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.124876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:22.127320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.127739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.128174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.128908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.129386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.129773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.170525 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-34ee778c-d884-4c85-a840-b4c78cfcf1b1 tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.244985 Oct 02 01:00:22.176704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1164 bytes} [Sun Oct 2 01:00:20 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:22.186268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:22.188479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.189000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.189985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.191098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.191554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.191976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.215995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f550e0b-6ee3-491a-9239-c9f6d72eb7cd tempest-AZAdminV2TestJSON-1771346657 tempest-AZAdminV2TestJSON-1771346657-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.033628 Oct 02 01:00:22.216710 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:00:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:22.796212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4bb2d02-72a7-401a-bf16-9faa8042ae70 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1524932347", "id": 139114273, "os-flavor-access:is_public": "True"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:22.900927 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4bb2d02-72a7-401a-bf16-9faa8042ae70 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.563481 Oct 02 01:00:22.901557 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3/3] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:22 2022] POST /compute/v2.1/flavors => generated 427 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:23.257375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '.version_select at 0x7fb882e3c550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.264075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=122354) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 02 01:00:23.264795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.265262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.265685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.292189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.292730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.293100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.293826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e06d6f94-93f2-4ac9-8ac1-ef46c7d01b17 tempest-AZAdminNegativeTestJSON-1671418187 tempest-AZAdminNegativeTestJSON-1671418187-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.296849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e06d6f94-93f2-4ac9-8ac1-ef46c7d01b17 tempest-AZAdminNegativeTestJSON-1671418187 tempest-AZAdminNegativeTestJSON-1671418187-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'fa303d40ed4b4f20844ef7b3cb8ee103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c93a928745c4a9cbb0abe5fceb01c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e06d6f94-93f2-4ac9-8ac1-ef46c7d01b17 tempest-AZAdminNegativeTestJSON-1671418187 tempest-AZAdminNegativeTestJSON-1671418187-project] Request method failure captured: Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKjWWtbgItehK-mCB_1p8XZ9Hz56LNGpgTy9H4lt3I76bCz9ZC3zM0yjQAOrqp_K6Q8fpKA86UjkQz4r4iH-jIrWFJzIr-QJuoyflBB4vdBQp5fU3-_vd-_rSbEbqgraqqbpxcAPHWGDJAlN8A-7Palt9xlvWVNqiTOTmDC0KW3FMc Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1c93a928745c4a9cbb0abe5fceb01c2c Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1671418187 Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:23.303003 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c93a928745c4a9cbb0abe5fceb01c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c93a928745c4a9cbb0abe5fceb01c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c93a928745c4a9cbb0abe5fceb01c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c93a928745c4a9cbb0abe5fceb01c2c"}]}] Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AZAdminNegativeTestJSON-1671418187 Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1c93a928745c4a9cbb0abe5fceb01c2c Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1671418187 Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AZAdminNegativeTestJSON-1671418187-project Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fa303d40ed4b4f20844ef7b3cb8ee103 Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AZAdminNegativeTestJSON-1671418187-project Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 02 01:00:23.304188 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:23.304808 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 02 01:00:23.305816 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:23.307486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.307685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.308114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.309113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e06d6f94-93f2-4ac9-8ac1-ef46c7d01b17 tempest-AZAdminNegativeTestJSON-1671418187 tempest-AZAdminNegativeTestJSON-1671418187-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:23.310555 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e06d6f94-93f2-4ac9-8ac1-ef46c7d01b17 tempest-AZAdminNegativeTestJSON-1671418187 tempest-AZAdminNegativeTestJSON-1671418187-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.406876 Oct 02 01:00:23.314784 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 4/4] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:00:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 412 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:23.315876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-baba71ad-1961-4ece-9131-08b922830209 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.584332 Oct 02 01:00:23.316691 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1/5] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:00:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:23.322781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87d0a1c8-309c-4745-93ff-f8047ec1dc01 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.355304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87d0a1c8-309c-4745-93ff-f8047ec1dc01 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/139114273" status: 202 len: 0 microversion: 2.1 time: 0.038505 Oct 02 01:00:23.356252 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 5/6] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:23 2022] DELETE /compute/v2.1/flavors/139114273 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:23.627361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Calling method '.version_select at 0x7fb882dbc790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.633033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.633890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.634474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.651443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.651937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.652367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.698166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.698858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.699622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.711505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.712136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.712864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.726075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.726729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.727010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.734428 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c70f17c8-e493-436b-bc1d-e1d55a37decc tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.416494 Oct 02 01:00:23.747688 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2/7] 10.222.0.23 () {60 vars in 1243 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:23.804721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.809545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.810475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.811097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.812165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.813037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.813734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.838693 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e8ac9cc-fd42-4ca1-b8b7-00466bb6403c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.481182 Oct 02 01:00:23.839623 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:23.846911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d470dcb6-dffe-4af2-a02d-5895949dc942 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-105075903", "name": "tempest-test_aggregate-991330524"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:23.867231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-d470dcb6-dffe-4af2-a02d-5895949dc942 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid 31a91479-01a0-4f28-a962-1a4e7cea916f for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:00:23.928864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-040904e4-3823-4b00-b638-c51866618451 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1336247674", "id": 1009846084, "os-flavor-access:is_public": "False"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:23.961456 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d470dcb6-dffe-4af2-a02d-5895949dc942 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.120625 Oct 02 01:00:23.968671 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 7/9] 10.222.0.23 () {60 vars in 1165 bytes} [Sun Oct 2 01:00:23 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:23.974396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6f8c43b-6d10-4b73-8180-8437a2f26e2b tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.996783 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-040904e4-3823-4b00-b638-c51866618451 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.260657 Oct 02 01:00:24.006711 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b6f8c43b-6d10-4b73-8180-8437a2f26e2b tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036841 Oct 02 01:00:24.007510 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 8/11] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:24.007622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3/11] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:23 2022] POST /compute/v2.1/flavors => generated 431 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:24.012857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Calling method '.version_select at 0x7fb882e3c8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:24.016531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.017079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.017627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.024894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-29ff1033-16f1-49c0-911f-6139f5f31b4e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:24.033880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.034445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.034969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.046222 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-29ff1033-16f1-49c0-911f-6139f5f31b4e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.037294 Oct 02 01:00:24.047289 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 9/12] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:00:24 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:24.048056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.048720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.049655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.054430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f1d38ca-8205-4369-85ba-828186cb6e70 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ec04da7367a94b348d958c02bc64bd26"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:24.064958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.065510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.066106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.078181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.078816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.079330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.085460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd6c5aa8-e24b-4ffb-afb0-9aebe65a7497 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.076773 Oct 02 01:00:24.086020 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4/13] 10.222.0.23 () {60 vars in 1222 bytes} [Sun Oct 2 01:00:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:24.091733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20b6e2d5-bc59-4128-9400-0d499fe52def tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-815003780", "id": 1175033485, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:24.115156 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20b6e2d5-bc59-4128-9400-0d499fe52def tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.027528 Oct 02 01:00:24.116139 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 5/14] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:24.120697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76f5f1bd-31ff-42c7-b610-b5277273792e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:24.155025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76f5f1bd-31ff-42c7-b610-b5277273792e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.155574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76f5f1bd-31ff-42c7-b610-b5277273792e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.156324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76f5f1bd-31ff-42c7-b610-b5277273792e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.620255 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f1d38ca-8205-4369-85ba-828186cb6e70 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1009846084/action" status: 200 len: 97 microversion: 2.1 time: 0.571191 Oct 02 01:00:24.626344 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 10/15] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:24 2022] POST /compute/v2.1/flavors/1009846084/action => generated 97 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:24.635535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Calling method '.version_select at 0x7fb882c00040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:24.654085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=122355) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 02 01:00:24.655005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.655648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.656162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.691289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.691977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.692426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.702654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8020213a-dd9e-4d50-af1c-b031e0490684 tempest-HypervisorAdminV253TestBase-403405290 tempest-HypervisorAdminV253TestBase-403405290-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/23e00a10-e3cd-433d-bffd-a3183ea0adad" status: 200 len: 791 microversion: 2.53 time: 0.076446 Oct 02 01:00:24.703449 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 11/16] 10.222.0.23 () {60 vars in 1298 bytes} [Sun Oct 2 01:00:24 2022] GET /compute/v2.1/os-hypervisors/23e00a10-e3cd-433d-bffd-a3183ea0adad => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:24.709046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72632660-89f8-463d-9e3f-d27740e96ea6 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:24.730274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72632660-89f8-463d-9e3f-d27740e96ea6 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.025643 Oct 02 01:00:24.738729 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 12/17] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:24 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:25.001468 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76f5f1bd-31ff-42c7-b610-b5277273792e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.883946 Oct 02 01:00:25.003194 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 6/18] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:00:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:25.009093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3521d368-f66e-422c-9621-602103ce0f7e tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.038221 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3521d368-f66e-422c-9621-602103ce0f7e tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1175033485" status: 202 len: 0 microversion: 2.1 time: 0.032974 Oct 02 01:00:25.038901 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 7/19] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:25 2022] DELETE /compute/v2.1/flavors/1175033485 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:25.046980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfa367fe-426b-4634-841c-c9e969cbb6b5 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.078796 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfa367fe-426b-4634-841c-c9e969cbb6b5 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035345 Oct 02 01:00:25.079383 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 8/20] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:25.101611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ac7e93d-ee26-423b-b20f-cb57de63154b tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1996948705", "id": 1164244523, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.114392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25c5ff91-1334-40d1-b6ef-356105142a25 tempest-FlavorsAccessTestJSON-1944817109 tempest-FlavorsAccessTestJSON-1944817109-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.121984 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ac7e93d-ee26-423b-b20f-cb57de63154b tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.025231 Oct 02 01:00:25.123009 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 9/21] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/flavors => generated 429 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:25.137045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5bdca83-367f-42e6-81c5-abfa5fefb6ac tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.151830 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-25c5ff91-1334-40d1-b6ef-356105142a25 tempest-FlavorsAccessTestJSON-1944817109 tempest-FlavorsAccessTestJSON-1944817109-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5831 microversion: 2.1 time: 0.410511 Oct 02 01:00:25.152704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 13/22] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:24 2022] GET /compute/v2.1/flavors/detail => generated 5831 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:25.157191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5bdca83-367f-42e6-81c5-abfa5fefb6ac tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1164244523" status: 202 len: 0 microversion: 2.1 time: 0.024280 Oct 02 01:00:25.157826 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 10/23] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:25 2022] DELETE /compute/v2.1/flavors/1164244523 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:25.170706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25321121-ee0b-4884-8e3f-dfceaedfbd7d tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.175180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b6e5357-5726-46d7-8346-40317ae6f64f tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ec04da7367a94b348d958c02bc64bd26"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.195698 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-25321121-ee0b-4884-8e3f-dfceaedfbd7d tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031203 Oct 02 01:00:25.198640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 14/24] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:25.216175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e7e907b-87c8-4522-9beb-f9c9776e4140 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-934114491", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.241567 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e7e907b-87c8-4522-9beb-f9c9776e4140 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.028793 Oct 02 01:00:25.243969 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 15/25] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:25.260571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0472126-7deb-4e17-8243-6877e7b1761e tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.285959 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0472126-7deb-4e17-8243-6877e7b1761e tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/e66b16ad-2037-4913-b797-dcb8365a1a3c" status: 202 len: 0 microversion: 2.1 time: 0.029521 Oct 02 01:00:25.286840 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 16/26] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:00:25 2022] DELETE /compute/v2.1/flavors/e66b16ad-2037-4913-b797-dcb8365a1a3c => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:25.297855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-63ae605e-0084-45e4-8e24-885b0082ff5f tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.335826 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-63ae605e-0084-45e4-8e24-885b0082ff5f tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044004 Oct 02 01:00:25.338642 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 17/27] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:25.660329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2011434723", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "availability_zone": "tempest-test_az-105075903"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.694831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.695388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.696221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.697369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.698056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.698584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.796523 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b6e5357-5726-46d7-8346-40317ae6f64f tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1009846084/action" status: 200 len: 21 microversion: 2.1 time: 0.626202 Oct 02 01:00:25.797440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 11/28] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/flavors/1009846084/action => generated 21 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:00:25.810036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f937f446-806a-4c8e-acbf-eb8802ad6bef tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-54746099", "id": "10034223-0386-4263-b281-5c8c7ea3af02", "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.839425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f937f446-806a-4c8e-acbf-eb8802ad6bef tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.040683 Oct 02 01:00:25.840328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 12/29] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/flavors => generated 505 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:25.855765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe29fb5a-dd1c-4db7-9b1e-42f2a5683458 tempest-FlavorsAccessTestJSON-1944817109 tempest-FlavorsAccessTestJSON-1944817109-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.904220 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe29fb5a-dd1c-4db7-9b1e-42f2a5683458 tempest-FlavorsAccessTestJSON-1944817109 tempest-FlavorsAccessTestJSON-1944817109-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5486 microversion: 2.1 time: 0.062374 Oct 02 01:00:25.905311 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 13/30] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/flavors/detail => generated 5486 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:25.918573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab2c0f34-e730-4909-909b-150f9a896e19 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.937541 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab2c0f34-e730-4909-909b-150f9a896e19 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/10034223-0386-4263-b281-5c8c7ea3af02" status: 202 len: 0 microversion: 2.1 time: 0.025273 Oct 02 01:00:25.939078 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 14/31] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:00:25 2022] DELETE /compute/v2.1/flavors/10034223-0386-4263-b281-5c8c7ea3af02 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:25.946449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9e917c6-e4d8-4649-800d-7cd4d9b99320 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.976100 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9e917c6-e4d8-4649-800d-7cd4d9b99320 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1009846084" status: 202 len: 0 microversion: 2.1 time: 0.034684 Oct 02 01:00:25.976887 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:25 2022] DELETE /compute/v2.1/flavors/1009846084 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:25.983938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1118933a-59c5-4358-8a23-d29f76513a09 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.009879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1118933a-59c5-4358-8a23-d29f76513a09 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031739 Oct 02 01:00:26.010560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.014902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-670ee981-d65a-4c6d-b42b-5f08c42f4704 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.039099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-670ee981-d65a-4c6d-b42b-5f08c42f4704 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027548 Oct 02 01:00:26.046637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.046637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d173fe50-027d-4cc0-9e22-b2bb26b995fb tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1111402931", "id": 1504564255, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.074618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d173fe50-027d-4cc0-9e22-b2bb26b995fb tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033316 Oct 02 01:00:26.075343 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 18/35] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:26.082643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10d45ff6-8ab3-47ae-a5a3-b7589c9cd97e tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-612821909", "id": 459357079, "os-flavor-access:is_public": "False"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.099173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10d45ff6-8ab3-47ae-a5a3-b7589c9cd97e tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.022474 Oct 02 01:00:26.099996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 19/36] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/flavors => generated 427 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:26.104542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5050493b-f92b-4396-8d63-8140edc8236f tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.106536 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=13 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.116749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5050493b-f92b-4396-8d63-8140edc8236f tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1504564255" status: 200 len: 414 microversion: 2.1 time: 0.015550 Oct 02 01:00:26.117311 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/1504564255 => generated 414 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:26.124061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3161b429-94f4-47f0-b68d-1a7951a315fa tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.139512 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3161b429-94f4-47f0-b68d-1a7951a315fa tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/459357079/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.020212 Oct 02 01:00:26.140080 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 21/38] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/459357079/os-flavor-access => generated 21 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:26.446044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe4a202d-01f0-45ff-b7ba-0ab8b4b776cb tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.469211 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe4a202d-01f0-45ff-b7ba-0ab8b4b776cb tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.327790 Oct 02 01:00:26.469802 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 22/39] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.478287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b29b888-b9d3-46af-8077-e680c33691df tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.496280 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b29b888-b9d3-46af-8077-e680c33691df tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/459357079" status: 202 len: 0 microversion: 2.1 time: 0.025381 Oct 02 01:00:26.497028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 23/40] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:26 2022] DELETE /compute/v2.1/flavors/459357079 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:26.502109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-778d48d5-cfa1-4711-a711-d85819178b88 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.522544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-778d48d5-cfa1-4711-a711-d85819178b88 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1504564255" status: 202 len: 0 microversion: 2.1 time: 0.024080 Oct 02 01:00:26.523338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 24/41] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:26 2022] DELETE /compute/v2.1/flavors/1504564255 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:26.530341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0548926e-fb81-44a2-a6ec-841dbea4ecb1 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.540312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:26.553480 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0548926e-fb81-44a2-a6ec-841dbea4ecb1 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028463 Oct 02 01:00:26.554384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 25/42] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.558894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3351d64e-886f-4864-8d5f-5f594aef97fe tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.582131 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3351d64e-886f-4864-8d5f-5f594aef97fe tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026108 Oct 02 01:00:26.582489 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 26/43] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.604593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3249381-2c01-4a9f-aeb2-951a5aa8e5df tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1219379169", "id": 466504984, "os-flavor-access:is_public": "False"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.627072 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3249381-2c01-4a9f-aeb2-951a5aa8e5df tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.025818 Oct 02 01:00:26.627989 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 27/44] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/flavors => generated 427 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:26.641986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be549382-b35e-4e63-b38b-8c0574ce8bd1 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "466504984"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.680041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-be549382-b35e-4e63-b38b-8c0574ce8bd1 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] HTTP exception thrown: Flavor 466504984 could not be found. Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be549382-b35e-4e63-b38b-8c0574ce8bd1 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] Request method failure captured: Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 106 Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKjr1P0BiDYK3MhJWtQ49I8XottHYOgDMmmU-nJQH84twptcZeZ6BKk9Y4Y0ADpkZuYVTHIq-XPlvj1Qq2PleL1XviE-LBiV3y1likyPfom5YjGIPoBGU-24fCDA9B9XLNfgFh-obVTsS2ZbZ3SZfpYOSzhvjy0w8Nj1GqtWYKJeGk Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2afb0399210740248eb07650b8e3bcf1 Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsAdminTestJSON-24676832 Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:00:26.695534 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2afb0399210740248eb07650b8e3bcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2afb0399210740248eb07650b8e3bcf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2afb0399210740248eb07650b8e3bcf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2afb0399210740248eb07650b8e3bcf1"}]}] Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsAdminTestJSON-24676832 Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2afb0399210740248eb07650b8e3bcf1 Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-24676832 Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsAdminTestJSON-24676832-project Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: ce541f9934a84e06b44ae2b4a1e643f4 Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsAdminTestJSON-24676832-project Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "test", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "466504984"}} Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:00:26.697293 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor 466504984 could not be found. Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '466504984'}}} Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 466504984 could not be found. Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:26.699108 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 466504984 could not be found. Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:26.700367 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:26.701895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:26.701895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:26.701895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:26.701895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 466504984 could not be found. Oct 02 01:00:26.701895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:26.704385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be549382-b35e-4e63-b38b-8c0574ce8bd1 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] Returning 400 to user: Flavor 466504984 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:26.706881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be549382-b35e-4e63-b38b-8c0574ce8bd1 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.069259 Oct 02 01:00:26.707661 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 28/45] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/servers => generated 80 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:26.734098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc9afc12-4cef-4711-8244-78e636e11dd9 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.772617 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dc9afc12-4cef-4711-8244-78e636e11dd9 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/466504984" status: 202 len: 0 microversion: 2.1 time: 0.059124 Oct 02 01:00:26.774900 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 29/46] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:26 2022] DELETE /compute/v2.1/flavors/466504984 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:26.785149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b96319b-4581-4534-b35b-892ffd7e8cd7 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.834934 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b96319b-4581-4534-b35b-892ffd7e8cd7 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055495 Oct 02 01:00:26.836574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 30/47] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.859663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16c12dc4-5d59-4290-8618-702f0ad503f5 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1396628570", "id": 277767952, "os-flavor-access:is_public": "False"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.895669 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16c12dc4-5d59-4290-8618-702f0ad503f5 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.040246 Oct 02 01:00:26.900218 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 31/48] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/flavors => generated 412 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:26.919826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:00:26.920268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:00:26.920729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:00:26.921140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:00:26.921414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-acc2b2fa-e13d-4610-9d55-9ede62f28172 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1383694016", "id": 2037466654, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.921548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:00:26.938993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.940489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.941118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.941867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.946895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-acc2b2fa-e13d-4610-9d55-9ede62f28172 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036736 Oct 02 01:00:26.947884 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 32/49] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/flavors => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:26.952376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.953009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.991833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc32e827-392e-41d5-a2cf-76ad25fa6036 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.995907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Getting quotas for project 2593cd49763c4c02ac5f7b30b03a0366. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:27.008107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Getting quotas for user ae3c3aba9b784076beb1b6713a439f78 and project 2593cd49763c4c02ac5f7b30b03a0366. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:27.024016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:00:27.028979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:00:27.035347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc32e827-392e-41d5-a2cf-76ad25fa6036 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.077920 Oct 02 01:00:27.036649 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 33/50] 10.222.0.23 () {58 vars in 1169 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:27.052929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83fa2378-3116-4169-a275-0e51ef88a30c tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.073119 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83fa2378-3116-4169-a275-0e51ef88a30c tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.026877 Oct 02 01:00:27.074375 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 34/51] 10.222.0.23 () {58 vars in 1177 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:27.090220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16c67b79-82aa-4824-8026-6c81ea90e4c9 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.106880 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2631a9b-0511-49c1-92cb-0530d6ad4ba3 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761069 Oct 02 01:00:27.107873 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 18/52] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:00:27.110556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16c67b79-82aa-4824-8026-6c81ea90e4c9 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.027171 Oct 02 01:00:27.111163 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 35/53] 10.222.0.23 () {58 vars in 1171 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:27.124322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-afd1a924-82f1-4bc1-9e15-b91d26c777c2 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.128270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-afd1a924-82f1-4bc1-9e15-b91d26c777c2 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:27.129150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20eab71d-c795-4e74-967e-934345582856 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.159738 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20eab71d-c795-4e74-967e-934345582856 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.035921 Oct 02 01:00:27.159738 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 36/54] 10.222.0.23 () {58 vars in 1169 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:27.170924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e68c659-8851-4a46-8ccf-1d4ac113be51 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.226794 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e68c659-8851-4a46-8ccf-1d4ac113be51 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.059408 Oct 02 01:00:27.231539 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 37/55] 10.222.0.23 () {58 vars in 1169 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:27.251503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10aa6cfa-c943-4271-9aa1-fc250e8fae8c tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.280248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afd1a924-82f1-4bc1-9e15-b91d26c777c2 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:27.282055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10aa6cfa-c943-4271-9aa1-fc250e8fae8c tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.034742 Oct 02 01:00:27.284399 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 38/56] 10.222.0.23 () {58 vars in 1175 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:27.295354 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-afd1a924-82f1-4bc1-9e15-b91d26c777c2 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1242 microversion: 2.1 time: 0.178599 Oct 02 01:00:27.295993 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 19/57] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.306449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff63e3a3-3ba7-4589-bd4a-902d85a86864 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.339866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff63e3a3-3ba7-4589-bd4a-902d85a86864 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.037023 Oct 02 01:00:27.340461 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 39/58] 10.222.0.23 () {58 vars in 1173 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.364239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b79ac5fd-8253-4b29-a077-cfb4502de9e7 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.386718 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b79ac5fd-8253-4b29-a077-cfb4502de9e7 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.026901 Oct 02 01:00:27.387537 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 20/59] 10.222.0.23 () {58 vars in 1169 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.406187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c162cc12-8b1c-49ac-a3fe-1eddc1db72a6 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.427581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c162cc12-8b1c-49ac-a3fe-1eddc1db72a6 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2037466654" status: 202 len: 0 microversion: 2.1 time: 0.025144 Oct 02 01:00:27.428717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 40/60] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:27 2022] DELETE /compute/v2.1/flavors/2037466654 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:27.436715 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e0426452-c12d-4f82-a734-53de2fb19ce5 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.458271 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e0426452-c12d-4f82-a734-53de2fb19ce5 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025358 Oct 02 01:00:27.459060 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 21/61] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.478151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-097958b2-fd8d-4686-bdb4-d14076be5acc tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.498486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-097958b2-fd8d-4686-bdb4-d14076be5acc tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/277767952" status: 202 len: 0 microversion: 2.1 time: 0.024648 Oct 02 01:00:27.499102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 41/62] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:27 2022] DELETE /compute/v2.1/flavors/277767952 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:27.507836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cfbaf37d-a9a9-46d6-a9de-20016e62267f tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.531194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cfbaf37d-a9a9-46d6-a9de-20016e62267f tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026861 Oct 02 01:00:27.532108 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 22/63] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.552867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cc86fcd-9eea-40e3-8ea5-d6261a373180 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-479061253", "id": 393932623, "os-flavor-access:is_public": "False"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:27.577173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2cc86fcd-9eea-40e3-8ea5-d6261a373180 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028892 Oct 02 01:00:27.577914 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 23/64] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:27 2022] POST /compute/v2.1/flavors => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:27.590636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56fbcc9c-34b4-4c46-9a49-de1b5383d367 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.596858 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.610733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56fbcc9c-34b4-4c46-9a49-de1b5383d367 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024338 Oct 02 01:00:27.612139 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 24/65] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.631547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54c232ba-794d-456e-8243-efd69d025b3c tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.652672 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-54c232ba-794d-456e-8243-efd69d025b3c tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026328 Oct 02 01:00:27.653262 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 25/66] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:27.671260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22eaf691-bd6c-4455-8c5d-4318eaebdd4e tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.696515 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22eaf691-bd6c-4455-8c5d-4318eaebdd4e tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/393932623" status: 202 len: 0 microversion: 2.1 time: 0.028630 Oct 02 01:00:27.697260 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 26/67] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:27 2022] DELETE /compute/v2.1/flavors/393932623 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:27.705622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a15546d1-b199-4460-a5a0-6ee7de2f3781 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.725462 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a15546d1-b199-4460-a5a0-6ee7de2f3781 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023880 Oct 02 01:00:27.726049 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 27/68] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:27.745725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5d7f8d6-b24c-4b5b-b05e-c080b84b4033 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-928040589", "id": 1381023768, "os-flavor-access:is_public": "True"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:27.765416 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f5d7f8d6-b24c-4b5b-b05e-c080b84b4033 tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.023267 Oct 02 01:00:27.766138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 28/69] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:27 2022] POST /compute/v2.1/flavors => generated 413 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:27.779519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3cc50510-65bc-40a6-b555-01f809655cf2 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.835699 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3cc50510-65bc-40a6-b555-01f809655cf2 tempest-FlavorsAdminTestJSON-24676832 tempest-FlavorsAdminTestJSON-24676832-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.059597 Oct 02 01:00:27.836305 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 29/70] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.855101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec283079-de1c-4684-a4cd-c75d8b8c57dc tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.885444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec283079-de1c-4684-a4cd-c75d8b8c57dc tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1381023768" status: 202 len: 0 microversion: 2.1 time: 0.034073 Oct 02 01:00:27.886088 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 30/71] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:27 2022] DELETE /compute/v2.1/flavors/1381023768 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:27.895674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e0352c9-6538-4263-a428-a2ca7763562a tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.917781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e0352c9-6538-4263-a428-a2ca7763562a tempest-FlavorsAdminTestJSON-1093483939 tempest-FlavorsAdminTestJSON-1093483939-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027256 Oct 02 01:00:27.918548 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 31/72] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:28.067457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0dfd576a-dc1a-41a7-9d4e-e0459c62dd6d tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1221343544", "id": 1034690, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:28.107307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0dfd576a-dc1a-41a7-9d4e-e0459c62dd6d tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 459 microversion: 2.61 time: 0.568213 Oct 02 01:00:28.110812 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 42/73] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:00:27 2022] POST /compute/v2.1/flavors => generated 459 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:28.320576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49d1efd0-6ad2-4ac2-af24-544bf49c4c27 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.321666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49d1efd0-6ad2-4ac2-af24-544bf49c4c27 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:28.597367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d72dc1e1-838e-4a98-b142-7b55d3c36ee6 tempest-FlavorsV261TestJSON-1724019181 tempest-FlavorsV261TestJSON-1724019181-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.619875 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d72dc1e1-838e-4a98-b142-7b55d3c36ee6 tempest-FlavorsV261TestJSON-1724019181 tempest-FlavorsV261TestJSON-1724019181-project] 10.222.0.23 "GET /compute/v2.1/flavors/1034690" status: 200 len: 459 microversion: 2.61 time: 0.493971 Oct 02 01:00:28.621753 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 32/74] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/flavors/1034690 => generated 459 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:28.637067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-979de9ac-1c58-482a-9faf-798220d4f7da tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] Action: 'update', calling method: .version_select at 0x7fb8831f6b80>, body: {"flavor": {"description": "new"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:28.687581 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-979de9ac-1c58-482a-9faf-798220d4f7da tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1034690" status: 200 len: 460 microversion: 2.61 time: 0.055406 Oct 02 01:00:28.689350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 33/75] 10.222.0.23 () {62 vars in 1210 bytes} [Sun Oct 2 01:00:28 2022] PUT /compute/v2.1/flavors/1034690 => generated 460 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:00:28.710512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f8a78013-ee12-44d1-ae8a-4f0a3d770d9d tempest-FlavorsV261TestJSON-1724019181 tempest-FlavorsV261TestJSON-1724019181-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.735399 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f8a78013-ee12-44d1-ae8a-4f0a3d770d9d tempest-FlavorsV261TestJSON-1724019181 tempest-FlavorsV261TestJSON-1724019181-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.61 time: 0.029191 Oct 02 01:00:28.737362 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 34/76] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:28.760632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-98f08f02-93fb-4ff4-955f-3fb38eff1dde tempest-FlavorsV261TestJSON-1724019181 tempest-FlavorsV261TestJSON-1724019181-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.808169 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-98f08f02-93fb-4ff4-955f-3fb38eff1dde tempest-FlavorsV261TestJSON-1724019181 tempest-FlavorsV261TestJSON-1724019181-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3148 microversion: 2.61 time: 0.051273 Oct 02 01:00:28.810023 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 35/77] 10.222.0.23 () {60 vars in 1166 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/flavors => generated 3148 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:28.829565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a923db9a-a5d7-476d-97dd-74fc8f53f545 tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.872576 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a923db9a-a5d7-476d-97dd-74fc8f53f545 tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1034690" status: 202 len: 0 microversion: 2.61 time: 0.046898 Oct 02 01:00:28.874217 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 36/78] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 01:00:28 2022] DELETE /compute/v2.1/flavors/1034690 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:00:28.882734 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cdc63605-a276-4436-8156-fc613cddd9ac tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.933108 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cdc63605-a276-4436-8156-fc613cddd9ac tempest-FlavorsV261TestJSON-798283817 tempest-FlavorsV261TestJSON-798283817-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.055304 Oct 02 01:00:28.934111 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 37/79] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:29.979724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49d1efd0-6ad2-4ac2-af24-544bf49c4c27 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.007461 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49d1efd0-6ad2-4ac2-af24-544bf49c4c27 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1242 microversion: 2.1 time: 1.689118 Oct 02 01:00:30.019591 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 43/80] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1242 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:31.037356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:31.037972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:31.054893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.055819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.056399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.057389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.057983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.058555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.296448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:31.317551 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f320f455-c7e7-4274-a29b-49270953a628 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1296 microversion: 2.1 time: 0.286269 Oct 02 01:00:31.319162 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 38/81] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:31 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1296 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:31.921184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Calling method '.version_select at 0x7fb88366eaf0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:31.925898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.926401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.926859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.931225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.931773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.932388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.003967 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f2754ba-d841-4f02-a683-28a8dd71651f tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.759992 Oct 02 01:00:32.004574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 44/82] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:00:31 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:32.346994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.350741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:32.385686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.388753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.389658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.397514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.398337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.399303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.865382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a50ba75-3487-4af2-a01f-45babeae4cf1 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Calling method '.version_select at 0x7fb882249d30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.869091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a50ba75-3487-4af2-a01f-45babeae4cf1 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '8b7c3e6f75924533b22927dfee4465e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3017966de9442aad1e7fb2c8cc57ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a50ba75-3487-4af2-a01f-45babeae4cf1 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Request method failure captured: Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKsO-6HGjrqgQ6FItvFhJDDYb0u8pDa77fxOG2ehZLVbWl-XZXVgSgFysHnHAUmZvMyAx4XEjOm3keLSaHTE07R0IJzzqBDeH03t7-1Gs9aeqcZOgu1a1XNvuHBOs1sJSOR1-C5tbR9R-mQI2TvDKLjVxhv1YqquXnWXWy-JwaD9D8 Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:32.880522 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3017966de9442aad1e7fb2c8cc57ae"}]}] Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8b7c3e6f75924533b22927dfee4465e4 Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:00:32.881740 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:32.882468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 02 01:00:32.884327 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.885284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a50ba75-3487-4af2-a01f-45babeae4cf1 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:32.885284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a50ba75-3487-4af2-a01f-45babeae4cf1 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.867166 Oct 02 01:00:32.889903 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 39/83] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 876 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:32.908718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3738587-d103-4120-a7fe-bc31aee80549 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Calling method '.version_select at 0x7fb88221b430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.911115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3738587-d103-4120-a7fe-bc31aee80549 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '8b7c3e6f75924533b22927dfee4465e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3017966de9442aad1e7fb2c8cc57ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3738587-d103-4120-a7fe-bc31aee80549 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Request method failure captured: Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKsO-6HGjrqgQ6FItvFhJDDYb0u8pDa77fxOG2ehZLVbWl-XZXVgSgFysHnHAUmZvMyAx4XEjOm3keLSaHTE07R0IJzzqBDeH03t7-1Gs9aeqcZOgu1a1XNvuHBOs1sJSOR1-C5tbR9R-mQI2TvDKLjVxhv1YqquXnWXWy-JwaD9D8 Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:32.917828 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3017966de9442aad1e7fb2c8cc57ae"}]}] Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8b7c3e6f75924533b22927dfee4465e4 Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-d-master-1'} Oct 02 01:00:32.919314 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:32.920371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 02 01:00:32.921527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:32.923649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3738587-d103-4120-a7fe-bc31aee80549 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:32.927528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3738587-d103-4120-a7fe-bc31aee80549 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.029171 Oct 02 01:00:32.928767 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 40/84] 10.222.0.23 () {58 vars in 1188 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:00:32.945987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a46e791-a7d7-402e-84c6-cb1f27ef5805 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Calling method '.version_select at 0x7fb8822b3790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.983820 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6a46e791-a7d7-402e-84c6-cb1f27ef5805 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a46e791-a7d7-402e-84c6-cb1f27ef5805 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:33.009278 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'nonexistent_hostname'} Oct 02 01:00:33.010733 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:33.011635 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 02 01:00:33.012939 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.014112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.016126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a46e791-a7d7-402e-84c6-cb1f27ef5805 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.022474 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a46e791-a7d7-402e-84c6-cb1f27ef5805 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.080929 Oct 02 01:00:33.023864 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 41/85] 10.222.0.23 () {58 vars in 1212 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:00:33.035115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e51d797-d924-4f0f-90b1-c5cb7293a71d tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Calling method '.version_select at 0x7fb8820e8ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.038032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e51d797-d924-4f0f-90b1-c5cb7293a71d tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '8b7c3e6f75924533b22927dfee4465e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3017966de9442aad1e7fb2c8cc57ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e51d797-d924-4f0f-90b1-c5cb7293a71d tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Request method failure captured: Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKsO-6HGjrqgQ6FItvFhJDDYb0u8pDa77fxOG2ehZLVbWl-XZXVgSgFysHnHAUmZvMyAx4XEjOm3keLSaHTE07R0IJzzqBDeH03t7-1Gs9aeqcZOgu1a1XNvuHBOs1sJSOR1-C5tbR9R-mQI2TvDKLjVxhv1YqquXnWXWy-JwaD9D8 Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:33.040025 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3017966de9442aad1e7fb2c8cc57ae"}]}] Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8b7c3e6f75924533b22927dfee4465e4 Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-d-master-1'} Oct 02 01:00:33.041439 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.042231 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 02 01:00:33.043529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.046889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e51d797-d924-4f0f-90b1-c5cb7293a71d tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.048393 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e51d797-d924-4f0f-90b1-c5cb7293a71d tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.019111 Oct 02 01:00:33.050237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 42/86] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:00:33.060218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a9ce682-c98d-4075-badf-e7e30d6ecf87 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Calling method '.version_select at 0x7fb8821bba60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.072820 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2a9ce682-c98d-4075-badf-e7e30d6ecf87 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a9ce682-c98d-4075-badf-e7e30d6ecf87 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:33.075322 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'nonexistent_hostname'} Oct 02 01:00:33.077026 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.078077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.080948 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.084167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a9ce682-c98d-4075-badf-e7e30d6ecf87 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.085662 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a9ce682-c98d-4075-badf-e7e30d6ecf87 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030332 Oct 02 01:00:33.087159 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1191 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:00:33.098034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-309cc1a3-ed7f-4f91-a8f8-506a74b5b282 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Calling method '.version_select at 0x7fb8821bb3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.101307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-309cc1a3-ed7f-4f91-a8f8-506a74b5b282 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '8b7c3e6f75924533b22927dfee4465e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3017966de9442aad1e7fb2c8cc57ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-309cc1a3-ed7f-4f91-a8f8-506a74b5b282 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Request method failure captured: Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKsO-6HGjrqgQ6FItvFhJDDYb0u8pDa77fxOG2ehZLVbWl-XZXVgSgFysHnHAUmZvMyAx4XEjOm3keLSaHTE07R0IJzzqBDeH03t7-1Gs9aeqcZOgu1a1XNvuHBOs1sJSOR1-C5tbR9R-mQI2TvDKLjVxhv1YqquXnWXWy-JwaD9D8 Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:33.105156 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3017966de9442aad1e7fb2c8cc57ae"}]}] Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8b7c3e6f75924533b22927dfee4465e4 Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-d-master-1'} Oct 02 01:00:33.106458 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.114991 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 02 01:00:33.116075 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.118929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-309cc1a3-ed7f-4f91-a8f8-506a74b5b282 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.120274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-309cc1a3-ed7f-4f91-a8f8-506a74b5b282 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027808 Oct 02 01:00:33.121714 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 44/88] 10.222.0.23 () {58 vars in 1194 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:00:33.140543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b540ba61-e9ff-4062-9b5c-986c2df53c42 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Calling method '.version_select at 0x7fb8820ba0d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.157424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b540ba61-e9ff-4062-9b5c-986c2df53c42 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b540ba61-e9ff-4062-9b5c-986c2df53c42 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:33.160239 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'nonexistent_hostname'} Oct 02 01:00:33.162302 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:33.163340 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 02 01:00:33.164633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.166265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.167012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.168643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b540ba61-e9ff-4062-9b5c-986c2df53c42 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.169704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b540ba61-e9ff-4062-9b5c-986c2df53c42 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.039995 Oct 02 01:00:33.171159 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 45/89] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:00:33.180469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be9de325-6ca5-4dc6-9f9a-eaae60eb9ce3 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Calling method '.version_select at 0x7fb8821bb1f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.182442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be9de325-6ca5-4dc6-9f9a-eaae60eb9ce3 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '8b7c3e6f75924533b22927dfee4465e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3017966de9442aad1e7fb2c8cc57ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be9de325-6ca5-4dc6-9f9a-eaae60eb9ce3 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Request method failure captured: Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKsO-6HGjrqgQ6FItvFhJDDYb0u8pDa77fxOG2ehZLVbWl-XZXVgSgFysHnHAUmZvMyAx4XEjOm3keLSaHTE07R0IJzzqBDeH03t7-1Gs9aeqcZOgu1a1XNvuHBOs1sJSOR1-C5tbR9R-mQI2TvDKLjVxhv1YqquXnWXWy-JwaD9D8 Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:33.184599 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3017966de9442aad1e7fb2c8cc57ae"}]}] Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8b7c3e6f75924533b22927dfee4465e4 Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-d-master-1'} Oct 02 01:00:33.185891 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.186643 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 02 01:00:33.187742 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.189323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be9de325-6ca5-4dc6-9f9a-eaae60eb9ce3 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.191188 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be9de325-6ca5-4dc6-9f9a-eaae60eb9ce3 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.014622 Oct 02 01:00:33.196094 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 46/90] 10.222.0.23 () {58 vars in 1191 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:00:33.201862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-357adef2-8102-4b0f-bbd3-c34c45df8232 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Calling method '.version_select at 0x7fb8820ba1f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.203728 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10fd0e5f-55db-4a6a-bf82-7210550fcbcd tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.858248 Oct 02 01:00:33.204404 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 45/91] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:33.212362 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-357adef2-8102-4b0f-bbd3-c34c45df8232 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-357adef2-8102-4b0f-bbd3-c34c45df8232 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:33.214145 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'nonexistent_hostname'} Oct 02 01:00:33.215648 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:33.216355 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 02 01:00:33.217303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.220288 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.223683 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-357adef2-8102-4b0f-bbd3-c34c45df8232 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.224777 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-357adef2-8102-4b0f-bbd3-c34c45df8232 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027573 Oct 02 01:00:33.230321 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 47/92] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:00:33.239341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e63db185-7841-40ca-9e8b-7aa3b829cebb tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Action: 'update', calling method: .version_select at 0x7fb88223c790>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e63db185-7841-40ca-9e8b-7aa3b829cebb tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 51 Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:00:33.245634 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: {"status": "enable", "maintenance_mode": "invalid"} Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:00:33.246826 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'disable', Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'Enable', Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'Disable', Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance: Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'invalid' Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.247491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.248982 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.250131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.250131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:00:33.250131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:00:33.250131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.250131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.255424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e63db185-7841-40ca-9e8b-7aa3b829cebb tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.256577 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e63db185-7841-40ca-9e8b-7aa3b829cebb tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.024670 Oct 02 01:00:33.257371 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 46/93] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:33 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:00:33.267663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13b44d33-13c3-49a1-85a2-463867db4619 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Action: 'update', calling method: .version_select at 0x7fb8821bb8b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13b44d33-13c3-49a1-85a2-463867db4619 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 51 Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:33.273589 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: {"status": "invalid", "maintenance_mode": "enable"} Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.274776 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'disable', Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'Enable', Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'Disable', Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance: Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'invalid' Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.275452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.276788 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.277743 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.277743 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:00:33.277743 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:00:33.277743 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 02 01:00:33.277743 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.282448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13b44d33-13c3-49a1-85a2-463867db4619 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.284400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13b44d33-13c3-49a1-85a2-463867db4619 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.021091 Oct 02 01:00:33.285222 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 48/94] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:33 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:00:33.296723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f5fa588-0381-44ac-b462-428c30dd0c94 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Action: 'update', calling method: .version_select at 0x7fb88223cdc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:33.301120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6f5fa588-0381-44ac-b462-428c30dd0c94 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '8b7c3e6f75924533b22927dfee4465e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3017966de9442aad1e7fb2c8cc57ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f5fa588-0381-44ac-b462-428c30dd0c94 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Request method failure captured: Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 50 Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKsO-6HGjrqgQ6FItvFhJDDYb0u8pDa77fxOG2ehZLVbWl-XZXVgSgFysHnHAUmZvMyAx4XEjOm3keLSaHTE07R0IJzzqBDeH03t7-1Gs9aeqcZOgu1a1XNvuHBOs1sJSOR1-C5tbR9R-mQI2TvDKLjVxhv1YqquXnWXWy-JwaD9D8 Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:00:33.305954 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a3017966de9442aad1e7fb2c8cc57ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a3017966de9442aad1e7fb2c8cc57ae"}]}] Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1a3017966de9442aad1e7fb2c8cc57ae Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-497051073 Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 8b7c3e6f75924533b22927dfee4465e4 Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-HostsAdminNegativeTestJSON-497051073-project Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: {"status": "enable", "maintenance_mode": "enable"} Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 02 01:00:33.307142 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.307870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 02 01:00:33.308851 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.314126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f5fa588-0381-44ac-b462-428c30dd0c94 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.316586 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f5fa588-0381-44ac-b462-428c30dd0c94 tempest-HostsAdminNegativeTestJSON-497051073 tempest-HostsAdminNegativeTestJSON-497051073-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.024932 Oct 02 01:00:33.317696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 47/95] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:33 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:33.327830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2465fa40-c0eb-4f78-9b3a-051b551ef3c4 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Action: 'update', calling method: .version_select at 0x7fb8820badc0>, body: {"status": null, "maintenance_mode": null} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2465fa40-c0eb-4f78-9b3a-051b551ef3c4 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 42 Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:33.334478 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: {"status": null, "maintenance_mode": null} Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 02 01:00:33.335971 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'disable', Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'Enable', Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'Disable', Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance: Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi None Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.336772 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.338001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.339389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:00:33.339389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:00:33.339389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 02 01:00:33.339389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.341566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2465fa40-c0eb-4f78-9b3a-051b551ef3c4 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.344922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2465fa40-c0eb-4f78-9b3a-051b551ef3c4 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.018331 Oct 02 01:00:33.350802 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 49/96] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:33 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:00:33.361173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a513fec-c38e-47d1-bb40-1438ce66bbf5 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Action: 'update', calling method: .version_select at 0x7fb88213b160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:33.369743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.hosts [None req-7a513fec-c38e-47d1-bb40-1438ce66bbf5 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Enabling host nonexistent_hostname. Oct 02 01:00:33.437356 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7a513fec-c38e-47d1-bb40-1438ce66bbf5 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a513fec-c38e-47d1-bb40-1438ce66bbf5 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Request method failure captured: Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 50 Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKvWn13QfGUpzVeoOZpBmrBYsk7P2GOSBDOJDh4yFvFsRBS5MLsB8s7hMFFdfpIAAwZg3iFstGN_-SG2X9MtIgWHOoGvnOfs1VBpw8TMNw2Zyap2S5FQOq7G87-nfS6x5J_pLCT9gBd9FhXxIVGodiYrbler_ENLCkebAaNu39G7tw Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:00:33.466772 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/502fab92439d47ba935a887c56189ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/502fab92439d47ba935a887c56189ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_502fab92439d47ba935a887c56189ad1"}]}] Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 502fab92439d47ba935a887c56189ad1 Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2045762739 Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bbadcc55221a4c8c9e07da910cc6170d Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2045762739-project-admin Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: {"status": "enable", "maintenance_mode": "enable"} Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.467914 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:00:33.468632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:33.469520 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 02 01:00:33.470504 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:33.479514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a513fec-c38e-47d1-bb40-1438ce66bbf5 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:33.485136 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a513fec-c38e-47d1-bb40-1438ce66bbf5 tempest-HostsAdminNegativeTestJSON-2045762739 tempest-HostsAdminNegativeTestJSON-2045762739-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.131818 Oct 02 01:00:33.492033 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 48/97] 10.222.0.23 () {60 vars in 1211 bytes} [Sun Oct 2 01:00:33 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:00:34.231283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:34.232823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:34.247227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:34.248791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:34.250159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.254939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:34.256069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:34.256602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.649269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:34.666322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-149a39af-0369-4d6e-8882-a904131bf503 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.439074 Oct 02 01:00:34.667373 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 49/98] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:34 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:34.716933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6546a917-ac0c-4eea-9f79-723e81994dcc tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] Calling method '.version_select at 0x7fb8821bb280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:34.749459 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6546a917-ac0c-4eea-9f79-723e81994dcc tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 1.181135 Oct 02 01:00:34.753395 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 50/99] 10.222.0.23 () {60 vars in 1226 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:34.766210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db7db567-a7a7-4dfc-ac88-73c04bee223c tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] Action: 'update', calling method: .version_select at 0x7fb88208d430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:34.865363 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=15,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:35.440767 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-db7db567-a7a7-4dfc-ac88-73c04bee223c tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.678429 Oct 02 01:00:35.444809 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 50/100] 10.222.0.23 () {62 vars in 1247 bytes} [Sun Oct 2 01:00:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:35.457696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8fc3996e-73c0-4963-9e29-f266a1b75e3f tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] Calling method '.version_select at 0x7fb8821bbf70>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:35.498994 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8fc3996e-73c0-4963-9e29-f266a1b75e3f tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.045690 Oct 02 01:00:35.503451 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 51/101] 10.222.0.23 () {60 vars in 1226 bytes} [Sun Oct 2 01:00:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:35.516587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0696c5e4-c290-4dc8-ae19-332db9a3086b tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] Action: 'update', calling method: .version_select at 0x7fb8820db790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:35.634240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0696c5e4-c290-4dc8-ae19-332db9a3086b tempest-QuotaClassesAdmin257Test-1248639364 tempest-QuotaClassesAdmin257Test-1248639364-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.123563 Oct 02 01:00:35.635537 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 51/102] 10.222.0.23 () {62 vars in 1247 bytes} [Sun Oct 2 01:00:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:35.692244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:35.693268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:35.716208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:35.719300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:35.720694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:35.723817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:35.727060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:35.730681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.574306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.593701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd4b9727-887a-4ba7-945a-4beaf7403ae7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.904814 Oct 02 01:00:36.597047 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 52/103] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:35 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:37.623210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:37.624594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:37.641116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.643963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.647187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.652578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.655487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.657048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.296516 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=10 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:38.438303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.461950 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ef5483c-0a41-4467-98d0-ee29820e5dde tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.839477 Oct 02 01:00:38.462617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 52/104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:37 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:38.933948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0", "tag": "f70a2e23-7b5a-45b1-a0f9-f701e205ba68"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:38.961205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.966301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.967499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.012351 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Creating event network-changed:f70a2e23-7b5a-45b1-a0f9-f701e205ba68 for instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 on n-h2-master-1 Oct 02 01:00:39.014266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:00:39.015222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0b88258a-bc9d-4a2d-a4fd-d0db01603fa9 req-868b37f5-5b69-494c-9a88-cbd0f2f2fcbe service nova] Acquired lock "compute-rpcapi-router" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:00:39.016551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.017239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.018466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.019447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.019977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.020480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.033071 n-d-master-1 devstack@n-api.service[122355]: INFO nova.compute.rpcapi [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 02 01:00:39.034406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:00:39.055886 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-208db46c-2a46-4ae4-bd74-b07031dfa4e8 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.764708 Oct 02 01:00:39.057100 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 53/105] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:39.491754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:39.492668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:39.505316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.505817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.506268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.507006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.511678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.512269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.833487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:39.842333 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d46099d7-4c94-4834-b1f6-f4390d72bfa4 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.358315 Oct 02 01:00:39.864443 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 53/106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:39 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:40.874415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:40.875169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:40.896836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:40.901940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:40.903706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.904736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:40.908547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:40.910466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.276412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:41.286549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b7d06ea-7548-4abf-a09f-7b6c35acedf6 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.418013 Oct 02 01:00:41.294668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 54/107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:40 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:41.970921 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:42.345721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Calling method '.version_select at 0x7fb88213bee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.348492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.349125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.349585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.388686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.395202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.395980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.427199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.428268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.429441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.451798 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e93dd19-32ab-4d9e-8673-9fad65eaa8ca tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.021292 Oct 02 01:00:42.456692 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 54/108] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:42.465136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.475299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:42.492025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.493603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.494764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.497631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.498492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.508540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.521322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-060e4ae1-4bca-484c-9932-07184f0f2045 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1713526755", "id": 1564359723, "os-flavor-access:is_public": "False"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:42.578679 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-060e4ae1-4bca-484c-9932-07184f0f2045 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.697107 Oct 02 01:00:42.591997 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 55/109] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:41 2022] POST /compute/v2.1/flavors => generated 439 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:42.607230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Calling method '.version_select at 0x7fb8820e01f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.614159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.619513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.621961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.666060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.667566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.672553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.732664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.733862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.734497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.741654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b043143-cd17-420e-b5dd-51fe34f89d2f tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.148207 Oct 02 01:00:42.742876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 56/110] 10.222.0.23 () {58 vars in 1212 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers => generated 196 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:42.755263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9619172-33c8-459a-a38d-0b4dcbaf1598 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:42.872683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:42.882317 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfe3d6e5-53cc-4c99-b285-acf24f0cf779 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.424124 Oct 02 01:00:42.885104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 55/111] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:42.891853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Calling method '.version_select at 0x7fb88209d8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.894450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.895129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.895740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.911085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.911817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.912405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.924897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.925564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.926149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.933453 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf775953-218b-4de3-9502-dcbf701db1c0 tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045897 Oct 02 01:00:42.934703 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 56/112] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:42.950345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Calling method '.version_select at 0x7fb88208d940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.952307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.952829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.953492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.986787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.987933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.988527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.995834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dcc6a2f1-f1db-40bb-9a1d-6e8411ac1d5b tempest-HypervisorAdminUnderV252Test-1071291731 tempest-HypervisorAdminUnderV252Test-1071291731-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.049265 Oct 02 01:00:42.996630 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:43.512299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9619172-33c8-459a-a38d-0b4dcbaf1598 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1564359723/action" status: 200 len: 97 microversion: 2.1 time: 0.767255 Oct 02 01:00:43.514064 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 57/114] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:42 2022] POST /compute/v2.1/flavors/1564359723/action => generated 97 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:43.525263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2284524-9988-48dd-bf56-4d68fa34a502 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:43.910091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:43.910888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:43.932070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.934528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.937844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.938648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.939119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.939798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.364797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a2284524-9988-48dd-bf56-4d68fa34a502 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 89a64d4589204aa4ab873fba0cd0f687 combination. Oct 02 01:00:44.367985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:44.376813 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ad1d108-c345-484d-bc72-b2a0e26c52e7 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.471395 Oct 02 01:00:44.385906 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 58/115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:43 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2284524-9988-48dd-bf56-4d68fa34a502 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Request method failure captured: Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/flavors/1564359723/action HTTP/1.1 Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 67 Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK1yT2Fd7CdlqcgEO3_CsSyAOkuYRmwxI-s_7qE6G_iTlz1vPZ90x42_YYI4yTc7ItLF9_huFM_cR2T-zCXE_G9ViwlvMUcZ9TTUj8wn8ElvR26uIpvBvHuhhC1yxNnacSKF1sKu1FlNA_SESp4llK__ismgBfUu_fLjmzszz8igf8 Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0689cfb594ea4d7b8c67766a5debfb0f Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:00:44.392047 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0689cfb594ea4d7b8c67766a5debfb0f"}]}] Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0689cfb594ea4d7b8c67766a5debfb0f Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 09c0eb3f4d194c6bb7a9cb17181af537 Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: {"addTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} Oct 02 01:00:44.394327 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor access already exists for flavor 29 and project 89a64d4589204aa4ab873fba0cd0f687 combination. Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1564359723', 'body': {'addTenantAccess': {'tenant': '89a64d4589204aa4ab873fba0cd0f687'}}} Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result.read() Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:00:44.395097 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-89a64d4589204aa4ab873fba0cd0f687' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi session.flush() Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 01:00:44.396228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 01:00:44.397256 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:00:44.398313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result.read() Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-89a64d4589204aa4ab873fba0cd0f687' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 2, 1, 0, 44, 359033), 'updated_at': None, 'flavor_id': 29, 'project_id': '89a64d4589204aa4ab873fba0cd0f687'}] Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:44.399474 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 89a64d4589204aa4ab873fba0cd0f687 combination. Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:44.400606 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 89a64d4589204aa4ab873fba0cd0f687 combination. Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:44.401829 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:44.411137 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 89a64d4589204aa4ab873fba0cd0f687 combination. Oct 02 01:00:44.411137 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:44.411137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2284524-9988-48dd-bf56-4d68fa34a502 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 89a64d4589204aa4ab873fba0cd0f687 combination. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:44.411137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2284524-9988-48dd-bf56-4d68fa34a502 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1564359723/action" status: 409 len: 152 microversion: 2.1 time: 0.884342 Oct 02 01:00:44.411137 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 58/116] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:43 2022] POST /compute/v2.1/flavors/1564359723/action => generated 152 bytes in 886 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:00:44.426800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e2dd344-e84f-4467-929a-092c28f1374d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:44.890157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Calling method '.version_select at 0x7fb8821bbf70>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:44.892725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:44.893614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:44.894396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.924941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:44.926447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:44.927105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.946743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:44.949519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:44.951691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.959809 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7bf5aee3-7ed8-4b50-a398-5a1e0e6c7b6f tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.572687 Oct 02 01:00:44.960893 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:45.231010 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e2dd344-e84f-4467-929a-092c28f1374d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1564359723/action" status: 200 len: 21 microversion: 2.1 time: 0.817925 Oct 02 01:00:45.237133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 59/118] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:44 2022] POST /compute/v2.1/flavors/1564359723/action => generated 21 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:45.254919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e97d799b-948e-447b-9d63-4c409baa47aa tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.292410 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e97d799b-948e-447b-9d63-4c409baa47aa tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1564359723" status: 202 len: 0 microversion: 2.1 time: 0.042250 Oct 02 01:00:45.293618 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 60/119] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:45 2022] DELETE /compute/v2.1/flavors/1564359723 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:45.302538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d389f00-9e5b-4c82-a31f-c2522b47dba2 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.376863 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d389f00-9e5b-4c82-a31f-c2522b47dba2 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079017 Oct 02 01:00:45.378440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 61/120] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:45.404767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3e19e74-cb11-4243-86ce-e15a74e2fff1 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1222919192", "id": 1898962383, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:45.431919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86fb241a-4f80-450c-a6cb-988e7d485ddf tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Calling method '.version_select at 0x7fb8821bb280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.434654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-86fb241a-4f80-450c-a6cb-988e7d485ddf tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '82af4233a03e4907a522e61dfcd4b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add837b1ffcd4592bd662f6519605fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86fb241a-4f80-450c-a6cb-988e7d485ddf tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Request method failure captured: Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/n-h2-master-1/search HTTP/1.1 Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOK4rSct3SalXtJ_Gk1zoM91vTq72avLiyEhKNrsNwCHAJJNTTpVpjr3c-MkwTF3upCdewAOe2SZs6SpI0RYpIeMGo1PHL8TcKNBeC6RJ7AAliuLc5enX6zt6OrPGbBulDkWevUl5TZ87F1YdRowMS73WYM4TUPBz7BdmWSXu-wXiBA Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: add837b1ffcd4592bd662f6519605fc8 Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1257140736 Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:45.437444 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/add837b1ffcd4592bd662f6519605fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/add837b1ffcd4592bd662f6519605fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/add837b1ffcd4592bd662f6519605fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_add837b1ffcd4592bd662f6519605fc8"}]}] Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1257140736 Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: add837b1ffcd4592bd662f6519605fc8 Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1257140736 Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 82af4233a03e4907a522e61dfcd4b3f6 Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 02 01:00:45.438931 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'n-h2-master-1'} Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:45.440616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 02 01:00:45.441989 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.457013 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3e19e74-cb11-4243-86ce-e15a74e2fff1 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.056533 Oct 02 01:00:45.466412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 62/121] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:45.468717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86fb241a-4f80-450c-a6cb-988e7d485ddf tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:45.474723 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-86fb241a-4f80-450c-a6cb-988e7d485ddf tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.500677 Oct 02 01:00:45.476063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 60/122] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:00:44 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 117 bytes in 507 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:45.483439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.484678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:45.492563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4edcab47-98ee-4cc0-9947-ffe4f86d8b52 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.495658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.496337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.496779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.497500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.497954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.498375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.501341 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:45.515145 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4edcab47-98ee-4cc0-9947-ffe4f86d8b52 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4edcab47-98ee-4cc0-9947-ffe4f86d8b52 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Request method failure captured: Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/flavors/1898962383/os-flavor-access HTTP/1.1 Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOK1yT2Fd7CdlqcgEO3_CsSyAOkuYRmwxI-s_7qE6G_iTlz1vPZ90x42_YYI4yTc7ItLF9_huFM_cR2T-zCXE_G9ViwlvMUcZ9TTUj8wn8ElvR26uIpvBvHuhhC1yxNnacSKF1sKu1FlNA_SESp4llK__ismgBfUu_fLjmzszz8igf8 Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0689cfb594ea4d7b8c67766a5debfb0f Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:45.518939 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0689cfb594ea4d7b8c67766a5debfb0f"}]}] Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0689cfb594ea4d7b8c67766a5debfb0f Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 09c0eb3f4d194c6bb7a9cb17181af537 Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: exception: Access list not available for public flavors. Oct 02 01:00:45.520451 n-d-master-1 devstack@n-api.service[122355]: action_args: {'flavor_id': '1898962383'} Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 02 01:00:45.521238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.533385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4edcab47-98ee-4cc0-9947-ffe4f86d8b52 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:45.535621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4edcab47-98ee-4cc0-9947-ffe4f86d8b52 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1898962383/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.055085 Oct 02 01:00:45.539553 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 61/123] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/flavors/1898962383/os-flavor-access => generated 91 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:00:45.548285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Calling method '.version_select at 0x7fb8820ba8b0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.552860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.553600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.554190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.562893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Request method failure captured: Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOK7P15d4E1r5y80b4ZA29CfqCdvcwmLT73BUj1BLjR0jqpdwAZFnIL1_6aLb5B7PkpJmzXXCvVwahHsY8ftuJS9tpNt3QELLjBriBggPfn-49Eo1YVsgAqhUjY55s3c0vgcJiipMCGMStjoaC-1r2XxvaJd3MzgG8_IT1PCGKNtdt0 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0f979977d8e341c08abbd6b80f227250 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-900795649 Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:45.570281 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f979977d8e341c08abbd6b80f227250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f979977d8e341c08abbd6b80f227250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f979977d8e341c08abbd6b80f227250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f979977d8e341c08abbd6b80f227250"}]}] Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-900795649 Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0f979977d8e341c08abbd6b80f227250 Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-900795649 Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fc037a4fdbff45adbce4aa39d8b5d7fd Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 02 01:00:45.571716 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.572634 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:45.573890 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae326c78-6f91-4526-a2b3-fe2a7be17777 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.031085 Oct 02 01:00:45.578513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 62/124] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:45.584364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ead47f23-9e4b-429b-a982-df7df914e669 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.634302 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:45.639813 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ead47f23-9e4b-429b-a982-df7df914e669 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1898962383" status: 202 len: 0 microversion: 2.1 time: 0.060121 Oct 02 01:00:45.640827 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 63/125] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:45 2022] DELETE /compute/v2.1/flavors/1898962383 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:45.649313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Calling method '.version_select at 0x7fb8820e8940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.653618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.656303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.659271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.685053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.686446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.687170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.707069 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:45.709040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.709680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.710264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.723875 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90cfd359-9807-4da0-a7da-55b770367118 tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081121 Oct 02 01:00:45.726540 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 64/126] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:45.731529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eac493da-a8f3-4c30-880e-dc4287fa9cac tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.758056 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eac493da-a8f3-4c30-880e-dc4287fa9cac tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029717 Oct 02 01:00:45.759041 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 65/127] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:45.765357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09a07e67-0064-4f81-a349-e74c3d6b035a tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Calling method '.version_select at 0x7fb8820e0700>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.767536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09a07e67-0064-4f81-a349-e74c3d6b035a tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '82af4233a03e4907a522e61dfcd4b3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add837b1ffcd4592bd662f6519605fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09a07e67-0064-4f81-a349-e74c3d6b035a tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Request method failure captured: Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOK4rSct3SalXtJ_Gk1zoM91vTq72avLiyEhKNrsNwCHAJJNTTpVpjr3c-MkwTF3upCdewAOe2SZs6SpI0RYpIeMGo1PHL8TcKNBeC6RJ7AAliuLc5enX6zt6OrPGbBulDkWevUl5TZ87F1YdRowMS73WYM4TUPBz7BdmWSXu-wXiBA Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: add837b1ffcd4592bd662f6519605fc8 Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1257140736 Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:45.769793 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/add837b1ffcd4592bd662f6519605fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/add837b1ffcd4592bd662f6519605fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/add837b1ffcd4592bd662f6519605fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_add837b1ffcd4592bd662f6519605fc8"}]}] Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1257140736 Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: add837b1ffcd4592bd662f6519605fc8 Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1257140736 Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 82af4233a03e4907a522e61dfcd4b3f6 Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 02 01:00:45.771233 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '1'} Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:45.772002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 02 01:00:45.773150 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.775065 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09a07e67-0064-4f81-a349-e74c3d6b035a tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:45.776234 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09a07e67-0064-4f81-a349-e74c3d6b035a tempest-HypervisorAdminNegativeUnderV252Test-1257140736 tempest-HypervisorAdminNegativeUnderV252Test-1257140736-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016159 Oct 02 01:00:45.776976 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 66/128] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:45.782474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9bcc2b6-febe-4273-a75c-e5b16a3112f2 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-779161447", "id": 641725337, "os-flavor-access:is_public": "False"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:45.810475 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f9bcc2b6-febe-4273-a75c-e5b16a3112f2 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.032055 Oct 02 01:00:45.811666 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 67/129] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:45 2022] POST /compute/v2.1/flavors => generated 435 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:45.817231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Calling method '.version_select at 0x7fb8820e8820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.819705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.820406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.820841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.827455 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] HTTP exception thrown: No hypervisor matching '93eaabfe-844f-4a21-afb6-2c551f14cfe9' could be found. Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Request method failure captured: Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/93eaabfe-844f-4a21-afb6-2c551f14cfe9/servers HTTP/1.1 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOK7P15d4E1r5y80b4ZA29CfqCdvcwmLT73BUj1BLjR0jqpdwAZFnIL1_6aLb5B7PkpJmzXXCvVwahHsY8ftuJS9tpNt3QELLjBriBggPfn-49Eo1YVsgAqhUjY55s3c0vgcJiipMCGMStjoaC-1r2XxvaJd3MzgG8_IT1PCGKNtdt0 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0f979977d8e341c08abbd6b80f227250 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-900795649 Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:00:45.829269 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f979977d8e341c08abbd6b80f227250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f979977d8e341c08abbd6b80f227250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f979977d8e341c08abbd6b80f227250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f979977d8e341c08abbd6b80f227250"}]}] Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-900795649 Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0f979977d8e341c08abbd6b80f227250 Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-900795649 Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fc037a4fdbff45adbce4aa39d8b5d7fd Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: exception: No hypervisor matching '93eaabfe-844f-4a21-afb6-2c551f14cfe9' could be found. Oct 02 01:00:45.830581 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '93eaabfe-844f-4a21-afb6-2c551f14cfe9'} Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '93eaabfe-844f-4a21-afb6-2c551f14cfe9' could be found. Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.831397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:45.832417 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:45.832417 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:45.832417 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:45.832417 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:45.832417 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '93eaabfe-844f-4a21-afb6-2c551f14cfe9' could be found. Oct 02 01:00:45.832417 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:45.833463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] Returning 404 to user: No hypervisor matching '93eaabfe-844f-4a21-afb6-2c551f14cfe9' could be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:45.834457 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e14e8f3d-9bfa-48e7-b6d9-45f31150d0ac tempest-HypervisorAdminNegativeUnderV252Test-900795649 tempest-HypervisorAdminNegativeUnderV252Test-900795649-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/93eaabfe-844f-4a21-afb6-2c551f14cfe9/servers" status: 404 len: 123 microversion: 2.1 time: 0.021668 Oct 02 01:00:45.835739 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 68/130] 10.222.0.23 () {58 vars in 1281 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/os-hypervisors/93eaabfe-844f-4a21-afb6-2c551f14cfe9/servers => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:45.977896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:45.988910 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-432e9e0f-c787-46ba-ab9c-c11735f76f2c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.520936 Oct 02 01:00:45.990521 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 63/131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:46.496526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2f2e5ae-da9f-43d0-a039-3a324829d855 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:46.508638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c2f2e5ae-da9f-43d0-a039-3a324829d855 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '2dc3379a5fe444c8944f8c342aa7852e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a64d4589204aa4ab873fba0cd0f687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2f2e5ae-da9f-43d0-a039-3a324829d855 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Request method failure captured: Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/flavors/641725337/action HTTP/1.1 Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 67 Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKyxoU_PMNrKTkeNmxzMQ3gMZpHfigmOpV1hxKMXj0hbiPAjbrQeDZ6wc6ZTMQHDWQjsp4PeVZWVQG8Djjr8p5os2EVXsMHjYEeji5q2r7rjbQjmtXahcKNX_BaNO5ovLInOQaRgqyLQhkQC-cnb7eCQBYB6FO0nJEdgp3H2pZP54o Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 89a64d4589204aa4ab873fba0cd0f687 Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1424675107 Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:00:46.511308 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89a64d4589204aa4ab873fba0cd0f687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89a64d4589204aa4ab873fba0cd0f687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89a64d4589204aa4ab873fba0cd0f687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89a64d4589204aa4ab873fba0cd0f687"}]}] Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1424675107 Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 89a64d4589204aa4ab873fba0cd0f687 Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1424675107 Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsAccessNegativeTestJSON-1424675107-project Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 2dc3379a5fe444c8944f8c342aa7852e Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1424675107-project Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: {"addTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} Oct 02 01:00:46.512656 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '641725337', 'body': {'addTenantAccess': {'tenant': '89a64d4589204aa4ab873fba0cd0f687'}}} Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:46.513434 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 02 01:00:46.514439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:00:46.515494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2f2e5ae-da9f-43d0-a039-3a324829d855 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:46.515494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c2f2e5ae-da9f-43d0-a039-3a324829d855 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] 10.222.0.23 "POST /compute/v2.1/flavors/641725337/action" status: 403 len: 130 microversion: 2.1 time: 0.674960 Oct 02 01:00:46.518220 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 69/132] 10.222.0.23 () {60 vars in 1197 bytes} [Sun Oct 2 01:00:45 2022] POST /compute/v2.1/flavors/641725337/action => generated 130 bytes in 681 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:46.523197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97faad1f-375b-44d9-aa7a-737e788a4dcf tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:46.554032 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97faad1f-375b-44d9-aa7a-737e788a4dcf tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/641725337" status: 202 len: 0 microversion: 2.1 time: 0.035353 Oct 02 01:00:46.556610 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 64/133] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:46 2022] DELETE /compute/v2.1/flavors/641725337 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:46.574812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-277217dc-1aa3-402e-ad03-9f91f569bdf7 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:46.599918 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-277217dc-1aa3-402e-ad03-9f91f569bdf7 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029197 Oct 02 01:00:46.602192 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 70/134] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:46.622748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c98c08e8-3f15-4a93-bbeb-70d949fa2d4a tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-671639007", "id": 1425224238, "os-flavor-access:is_public": "False"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:46.654537 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c98c08e8-3f15-4a93-bbeb-70d949fa2d4a tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.033432 Oct 02 01:00:46.658569 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 65/135] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:46 2022] POST /compute/v2.1/flavors => generated 438 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:46.670405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71569429-5a25-4808-a12e-bee82adecae1 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:47.484849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f8af4d0-ebbe-4f15-931b-675db0c15140 tempest-NetworksTest-2099247899 tempest-NetworksTest-2099247899-project-admin] Calling method '.version_select at 0x7fb881deee50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.521051 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71569429-5a25-4808-a12e-bee82adecae1 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1425224238/action" status: 200 len: 97 microversion: 2.1 time: 0.854626 Oct 02 01:00:47.537192 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 71/136] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:46 2022] POST /compute/v2.1/flavors/1425224238/action => generated 97 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:47.543926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.545177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:47.588880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.589453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.589908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.595572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.596214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.596959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:48.125779 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f8af4d0-ebbe-4f15-931b-675db0c15140 tempest-NetworksTest-2099247899 tempest-NetworksTest-2099247899-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 1.143156 Oct 02 01:00:48.129637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 66/137] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:00:46 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:48.132100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11d5eb3b-28a6-4199-a522-6cdfed2bab10 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:48.144010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-11d5eb3b-28a6-4199-a522-6cdfed2bab10 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '2dc3379a5fe444c8944f8c342aa7852e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a64d4589204aa4ab873fba0cd0f687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11d5eb3b-28a6-4199-a522-6cdfed2bab10 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Request method failure captured: Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/flavors/1425224238/action HTTP/1.1 Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 70 Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKyxoU_PMNrKTkeNmxzMQ3gMZpHfigmOpV1hxKMXj0hbiPAjbrQeDZ6wc6ZTMQHDWQjsp4PeVZWVQG8Djjr8p5os2EVXsMHjYEeji5q2r7rjbQjmtXahcKNX_BaNO5ovLInOQaRgqyLQhkQC-cnb7eCQBYB6FO0nJEdgp3H2pZP54o Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 89a64d4589204aa4ab873fba0cd0f687 Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1424675107 Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:00:48.146116 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89a64d4589204aa4ab873fba0cd0f687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89a64d4589204aa4ab873fba0cd0f687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89a64d4589204aa4ab873fba0cd0f687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89a64d4589204aa4ab873fba0cd0f687"}]}] Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1424675107 Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 89a64d4589204aa4ab873fba0cd0f687 Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1424675107 Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsAccessNegativeTestJSON-1424675107-project Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2dc3379a5fe444c8944f8c342aa7852e Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1424675107-project Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: {"removeTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} Oct 02 01:00:48.147290 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1425224238', 'body': {'removeTenantAccess': {'tenant': '89a64d4589204aa4ab873fba0cd0f687'}}} Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can( Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:00:48.147993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 02 01:00:48.152739 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.154168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11d5eb3b-28a6-4199-a522-6cdfed2bab10 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:48.154168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11d5eb3b-28a6-4199-a522-6cdfed2bab10 tempest-FlavorsAccessNegativeTestJSON-1424675107 tempest-FlavorsAccessNegativeTestJSON-1424675107-project] 10.222.0.23 "POST /compute/v2.1/flavors/1425224238/action" status: 403 len: 133 microversion: 2.1 time: 0.019782 Oct 02 01:00:48.154168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 67/138] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:48 2022] POST /compute/v2.1/flavors/1425224238/action => generated 133 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:48.224034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:48.235474 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd8a9a03-44f5-47b3-b66f-d2551245117c tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.694867 Oct 02 01:00:48.236067 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:47 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:48.248863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7488a98f-d102-418c-a9d9-639639943858 tempest-NetworksTest-2099247899 tempest-NetworksTest-2099247899-project-admin] Calling method '.version_select at 0x7fb8820bae50>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:48.450235 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7488a98f-d102-418c-a9d9-639639943858 tempest-NetworksTest-2099247899 tempest-NetworksTest-2099247899-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/38cab524-487b-4b38-8872-81306b82592c" status: 200 len: 652 microversion: 2.1 time: 0.207807 Oct 02 01:00:48.454653 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 73/140] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:00:48 2022] GET /compute/v2.1/os-networks/38cab524-487b-4b38-8872-81306b82592c => generated 652 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:48.457663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8052d71e-430d-416b-bda6-9d7e636ccb06 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89a64d4589204aa4ab873fba0cd0f687"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:48.747415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfaf4571-11ef-4f22-b887-ce76acbc319c tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] Calling method '.version_select at 0x7fb881e58ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:48.757809 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:UPDATE=13,nova_api:SELECT=71,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:48.777999 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfaf4571-11ef-4f22-b887-ce76acbc319c tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.628628 Oct 02 01:00:48.786553 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 68/141] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:00:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:48.788583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebb07033-c5da-4c50-bf1b-c7049aa12c61 tempest-NetworksTest-2099247899 tempest-NetworksTest-2099247899-project-admin] Calling method '.version_select at 0x7fb881e58430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:48.863613 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8052d71e-430d-416b-bda6-9d7e636ccb06 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1425224238/action" status: 200 len: 21 microversion: 2.1 time: 0.410930 Oct 02 01:00:48.864964 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 74/142] 10.222.0.23 () {60 vars in 1200 bytes} [Sun Oct 2 01:00:48 2022] POST /compute/v2.1/flavors/1425224238/action => generated 21 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:48.871642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b87ccd1e-5b93-465a-9e60-f60748584eaf tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] Action: 'update', calling method: .version_select at 0x7fb8821bbf70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:49.033119 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:49.137026 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebb07033-c5da-4c50-bf1b-c7049aa12c61 tempest-NetworksTest-2099247899 tempest-NetworksTest-2099247899-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.356213 Oct 02 01:00:49.138246 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 69/143] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:00:48 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:49.153289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e326a028-982a-43b6-8f11-5f9c112585a0 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:49.208557 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e326a028-982a-43b6-8f11-5f9c112585a0 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1425224238" status: 202 len: 0 microversion: 2.1 time: 0.068139 Oct 02 01:00:49.210132 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 70/144] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:00:49 2022] DELETE /compute/v2.1/flavors/1425224238 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:00:49.222407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c829044b-fedd-4dbc-ad9c-9558f5986d2e tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:49.248138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b87ccd1e-5b93-465a-9e60-f60748584eaf tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.381788 Oct 02 01:00:49.249447 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 75/145] 10.222.0.23 () {60 vars in 1206 bytes} [Sun Oct 2 01:00:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:49.275047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:49.275705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:49.284316 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c829044b-fedd-4dbc-ad9c-9558f5986d2e tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069396 Oct 02 01:00:49.285236 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 71/146] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:49.289697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:49.290244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:49.290757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:49.291532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:49.292037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:49.292487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:49.298145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4255964a-5439-4b3c-b7da-de55c533ff42 tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] Calling method '.version_select at 0x7fb881e488b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:49.320743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4255964a-5439-4b3c-b7da-de55c533ff42 tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.032885 Oct 02 01:00:49.329195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 72/147] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:00:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:49.334297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84494fea-b9bc-42e5-9a43-4d879ffb86e2 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-284086031", "id": 927598942, "os-flavor-access:is_public": "False"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:49.359281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84494fea-b9bc-42e5-9a43-4d879ffb86e2 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026642 Oct 02 01:00:49.363017 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 73/148] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:49 2022] POST /compute/v2.1/flavors => generated 435 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:49.376542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-455b7691-abff-4530-ae0a-b726494d30c9 tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] Action: 'update', calling method: .version_select at 0x7fb881dee940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:49.597500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-455b7691-abff-4530-ae0a-b726494d30c9 tempest-QuotaClassesAdminTestJSON-2078557328 tempest-QuotaClassesAdminTestJSON-2078557328-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.232948 Oct 02 01:00:49.598944 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 74/149] 10.222.0.23 () {60 vars in 1206 bytes} [Sun Oct 2 01:00:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:49.609793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29e2ad8f-da1c-4a21-965a-c3ad32e25c5c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "971a3b910aec48df8184ce85d2ee104b"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:49.781186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:49.793885 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f46dfe7-5199-4332-a799-c6a2f2e1aa97 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.537133 Oct 02 01:00:49.798765 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 76/150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:49 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:50.530426 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-29e2ad8f-da1c-4a21-965a-c3ad32e25c5c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] HTTP exception thrown: Flavor access not found for 33 / 971a3b910aec48df8184ce85d2ee104b combination. Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29e2ad8f-da1c-4a21-965a-c3ad32e25c5c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Request method failure captured: Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/flavors/927598942/action HTTP/1.1 Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 70 Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK1yT2Fd7CdlqcgEO3_CsSyAOkuYRmwxI-s_7qE6G_iTlz1vPZ90x42_YYI4yTc7ItLF9_huFM_cR2T-zCXE_G9ViwlvMUcZ9TTUj8wn8ElvR26uIpvBvHuhhC1yxNnacSKF1sKu1FlNA_SESp4llK__ismgBfUu_fLjmzszz8igf8 Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0689cfb594ea4d7b8c67766a5debfb0f Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:00:50.545037 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0689cfb594ea4d7b8c67766a5debfb0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0689cfb594ea4d7b8c67766a5debfb0f"}]}] Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0689cfb594ea4d7b8c67766a5debfb0f Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359 Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 09c0eb3f4d194c6bb7a9cb17181af537 Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: {"removeTenantAccess": {"tenant": "971a3b910aec48df8184ce85d2ee104b"}} Oct 02 01:00:50.546667 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor access not found for 33 / 971a3b910aec48df8184ce85d2ee104b combination. Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '927598942', 'body': {'removeTenantAccess': {'tenant': '971a3b910aec48df8184ce85d2ee104b'}}} Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 02 01:00:50.547501 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 971a3b910aec48df8184ce85d2ee104b combination. Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 971a3b910aec48df8184ce85d2ee104b combination. Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:50.548786 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:50.551963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:50.551963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:50.551963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:50.551963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:50.551963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 971a3b910aec48df8184ce85d2ee104b combination. Oct 02 01:00:50.551963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:00:50.555905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29e2ad8f-da1c-4a21-965a-c3ad32e25c5c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Returning 404 to user: Flavor access not found for 33 / 971a3b910aec48df8184ce85d2ee104b combination. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:50.557138 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29e2ad8f-da1c-4a21-965a-c3ad32e25c5c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/927598942/action" status: 404 len: 124 microversion: 2.1 time: 0.956413 Oct 02 01:00:50.558872 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 75/151] 10.222.0.23 () {60 vars in 1197 bytes} [Sun Oct 2 01:00:49 2022] POST /compute/v2.1/flavors/927598942/action => generated 124 bytes in 959 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:50.572151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8eca1c9f-c7e1-4ae7-b018-7ebe68a1e1fd tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:50.608210 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8eca1c9f-c7e1-4ae7-b018-7ebe68a1e1fd tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/927598942" status: 202 len: 0 microversion: 2.1 time: 0.044612 Oct 02 01:00:50.609376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 76/152] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:00:50 2022] DELETE /compute/v2.1/flavors/927598942 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:00:50.622322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd6ddecf-2e10-4f42-ac42-ccf556b74b47 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:50.647902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd6ddecf-2e10-4f42-ac42-ccf556b74b47 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033878 Oct 02 01:00:50.648552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:00:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:50.801171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-932774ed-699d-4970-ad88-0b70dd6ab53a req-3475078d-a1ba-43bd-b5c5-bfeb78c93179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0", "name": "network-vif-plugged", "status": "completed", "tag": "f70a2e23-7b5a-45b1-a0f9-f701e205ba68"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:50.817493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:50.818725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:50.820864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-932774ed-699d-4970-ad88-0b70dd6ab53a req-3475078d-a1ba-43bd-b5c5-bfeb78c93179 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.823669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-932774ed-699d-4970-ad88-0b70dd6ab53a req-3475078d-a1ba-43bd-b5c5-bfeb78c93179 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.824988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-932774ed-699d-4970-ad88-0b70dd6ab53a req-3475078d-a1ba-43bd-b5c5-bfeb78c93179 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.827352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.829334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.830427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.843862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:50.844965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:50.845723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:50.861318 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-932774ed-699d-4970-ad88-0b70dd6ab53a req-3475078d-a1ba-43bd-b5c5-bfeb78c93179 service nova] Creating event network-vif-plugged:f70a2e23-7b5a-45b1-a0f9-f701e205ba68 for instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 on n-h2-master-1 Oct 02 01:00:50.873563 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-932774ed-699d-4970-ad88-0b70dd6ab53a req-3475078d-a1ba-43bd-b5c5-bfeb78c93179 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442025 Oct 02 01:00:50.881075 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 77/154] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:51.548069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:51.561703 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8b05182-1b71-4a47-a8e3-5a5f5c7ad212 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.748269 Oct 02 01:00:51.579873 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:50 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:52.216567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Calling method '.version_select at 0x7fb8820e00d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:52.218414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.218928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.219366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.222542 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=81 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:52.254473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.256018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.256484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.277548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.278044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.278486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.288869 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-248b1a5e-a917-4a03-832e-f6ea1dfa2a66 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.701992 Oct 02 01:00:52.301055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Calling method '.version_select at 0x7fb881dee8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:52.303169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.303799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.304384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.306090 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 78/156] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:00:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:52.308470 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=91 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:52.325176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.325919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.326823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.333953 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df60157a-a0bc-4930-bc53-746a2922bfc6 tempest-HypervisorAdminV228Test-1539599512 tempest-HypervisorAdminV228Test-1539599512-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.037023 Oct 02 01:00:52.337016 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 79/157] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 01:00:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:00:52.594916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:52.597855 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:52.607594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.608271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.608731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.609491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:52.610668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:52.611248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:52.804409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:52.813418 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df1bc1d3-63d2-47e0-ad53-dce0008d92fa tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1338 microversion: 2.1 time: 0.226324 Oct 02 01:00:52.815085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 80/158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:52 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:52.914297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32740097-e8f5-4ca2-9f48-33f7fe300b84 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:52.928592 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32740097-e8f5-4ca2-9f48-33f7fe300b84 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.478933 Oct 02 01:00:52.929229 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 79/159] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:00:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:53.306300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f54f8f8a-1496-4581-8fd0-b710f65513bf tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-21787294", "id": 1126982761, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:53.325876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f54f8f8a-1496-4581-8fd0-b710f65513bf tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.387858 Oct 02 01:00:53.327145 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 81/160] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:52 2022] POST /compute/v2.1/flavors => generated 423 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:53.342268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc0da0fa-6835-4699-8066-60ed160b898c tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:53.351783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc0da0fa-6835-4699-8066-60ed160b898c tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015032 Oct 02 01:00:53.353360 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 80/161] 10.222.0.23 () {58 vars in 1182 bytes} [Sun Oct 2 01:00:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:00:53.364185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fbdf704-82a6-40e8-a89d-ad586e1ce9b7 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-162942859", "id": 404378477, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:53.388526 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5fbdf704-82a6-40e8-a89d-ad586e1ce9b7 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.029908 Oct 02 01:00:53.390237 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 82/162] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:53 2022] POST /compute/v2.1/flavors => generated 421 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:53.401491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6471450-c09c-4269-8103-f9fa3d16fa35 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:53.414046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6471450-c09c-4269-8103-f9fa3d16fa35 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016309 Oct 02 01:00:53.422844 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 81/163] 10.222.0.23 () {58 vars in 1182 bytes} [Sun Oct 2 01:00:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:00:53.429811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09c9094a-9363-4661-b138-1d5c29e8762d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Action: 'create', calling method: .version_select at 0x7fb881e58ee0>, body: {"keypair": {"name": "tempest-keypair-469006903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtA/GKJjYRWIUiKzZLQMxJ6IU+toByBEsEb6JZIYFtgT+n3+zPBeqgdqt4lCY9I5CHom20nt2Ot1Be30/Ig+cUgWw+MZYWsCOUhY6G+6f0cQdgUyOJKRPcXZmeZbKrB5w=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:53.464692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-09c9094a-9363-4661-b138-1d5c29e8762d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Getting quotas for project 1906af62eccb4a4d9e533a763a3e2018. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:53.471120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-09c9094a-9363-4661-b138-1d5c29e8762d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Getting quotas for user 0533d6c52e394ecc980d67c7d985076e and project 1906af62eccb4a4d9e533a763a3e2018. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:53.513135 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09c9094a-9363-4661-b138-1d5c29e8762d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088367 Oct 02 01:00:53.516751 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 83/164] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:00:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:53.836971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:53.837607 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:53.849389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:53.849898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:53.850336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:53.851086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:53.854711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:53.855222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:54.522321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:54.543493 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db1050b5-4d27-4996-972f-f7c1c89d9e06 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1487 microversion: 2.1 time: 0.707446 Oct 02 01:00:54.545199 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 82/165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:53 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1487 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:54.575961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:54.576545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:54.596097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:54.597420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:54.598093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:54.599119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:54.599636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:54.600067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:55.459757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82e8cf95-2317-4d9c-abd1-0c7390dbe92a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1638 microversion: 2.1 time: 0.890057 Oct 02 01:00:55.461178 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 84/166] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:54 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1638 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:55.487143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:55.487836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:55.497057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:55.497785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:55.498522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:55.499555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:55.500395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:55.500885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:55.540712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:00:55.765514 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9360535-766f-46a4-a2f3-e438881794f1 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 204 len: 0 microversion: 2.1 time: 0.281441 Oct 02 01:00:55.767717 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 83/167] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:00:55 2022] DELETE /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:00:55.783166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:55.785707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:55.811094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:55.812606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:55.819216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:55.820367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:55.821067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:55.822337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:56.186642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:56.195957 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-624e83d1-fb1e-4fa1-a55d-6537e9408a91 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1493 microversion: 2.1 time: 0.422046 Oct 02 01:00:56.196531 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 85/168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:55 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1493 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:57.043468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1cb1925-0f40-4a69-a727-8095297ba2d8 tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] Action: 'create', calling method: .version_select at 0x7fb8820119d0>, body: {"security_group": {"name": "tempest-securitygroup-298409119", "description": "tempest-description-836479662"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:57.101246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1134136181", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "404378477", "adminPass": "***", "networks": [{"uuid": "af3b4624-1c74-447f-bf99-fef286c20b75"}], "security_groups": [{"name": "tempest-securitygroup--429819099"}], "key_name": "tempest-keypair-469006903", "user_data": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:57.563257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] validate_networks() for [('af3b4624-1c74-447f-bf99-fef286c20b75', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:59.140276 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1cb1925-0f40-4a69-a727-8095297ba2d8 tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.611138 Oct 02 01:00:59.141332 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 84/169] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:00:56 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:59.149672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:59.150955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:59.178709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:59.180197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:59.182410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:59.186061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:59.187841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:59.191044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:59.259768 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=23,nova_cell0:UPDATE=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:59.773599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3c3aba9b784076beb1b6713a439f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2593cd49763c4c02ac5f7b30b03a0366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:59.781730 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9ff592a9-e10d-4744-b9e2-a7f988ac5a30 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 200 len: 1493 microversion: 2.1 time: 0.639247 Oct 02 01:00:59.782336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:59 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 1493 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:59.792790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89c64308-4c35-46ca-b386-672c1a8fb73f tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] Action: 'create', calling method: .version_select at 0x7fb882020790>, body: {"security_group": {"name": "tempest-securitygroup-1935791112", "description": "tempest-description-1907740129"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:00.455494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89c64308-4c35-46ca-b386-672c1a8fb73f tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.668749 Oct 02 01:01:00.457522 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 86/171] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:00:59 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:00.464389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9f4e5d4f-8356-4437-baae-a563cb52ce4c req-85a6923b-92e7-4410-b084-1169a61c2179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0", "name": "network-vif-deleted", "tag": "f70a2e23-7b5a-45b1-a0f9-f701e205ba68"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:00.503512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9f4e5d4f-8356-4437-baae-a563cb52ce4c req-85a6923b-92e7-4410-b084-1169a61c2179 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.504941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9f4e5d4f-8356-4437-baae-a563cb52ce4c req-85a6923b-92e7-4410-b084-1169a61c2179 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.506697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9f4e5d4f-8356-4437-baae-a563cb52ce4c req-85a6923b-92e7-4410-b084-1169a61c2179 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.532384 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9f4e5d4f-8356-4437-baae-a563cb52ce4c req-85a6923b-92e7-4410-b084-1169a61c2179 service nova] Creating event network-vif-deleted:f70a2e23-7b5a-45b1-a0f9-f701e205ba68 for instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 on n-h2-master-1 Oct 02 01:01:00.542663 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9f4e5d4f-8356-4437-baae-a563cb52ce4c req-85a6923b-92e7-4410-b084-1169a61c2179 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083021 Oct 02 01:01:00.543974 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 87/172] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:00.731317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:00.731894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:00.739400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:00.739903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:00.740324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:00.750386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.750823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.751260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.752621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.753609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.754207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.788231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Getting quotas for project 1906af62eccb4a4d9e533a763a3e2018. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:00.795375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Getting quotas for user 0533d6c52e394ecc980d67c7d985076e and project 1906af62eccb4a4d9e533a763a3e2018. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:00.815900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:00.820089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:00.837108 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=7,nova_api:INSERT=4,nova_api:UPDATE=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.903820 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e264776-63c3-48f5-aa0c-b7cff755215a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.806254 Oct 02 01:01:00.913884 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 86/173] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 3820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:01:01.115782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-257cc74b-353b-4444-9cf8-ec57438653d2 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] Action: 'create', calling method: .version_select at 0x7fb88205c5e0>, body: {"security_group": {"name": "tempest-securitygroup-1790904244", "description": "tempest-description-1154791311"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:01.205794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a121af4c-89b7-4647-8b48-8c50959f937f tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Calling method '.version_select at 0x7fb881df3ca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:01.208520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a121af4c-89b7-4647-8b48-8c50959f937f tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cbc3d3505371450e8d6caaa8b7c5dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df90dbb0ac462890b5797af9ccf3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a121af4c-89b7-4647-8b48-8c50959f937f tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Request method failure captured: Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLKjgZPoT7IyXoefHhGG_-0oklhkXlkF9XfD_a8_WYZpC6uKYR2In7PDcg0HM8n12u0s0VnuHk25EQzI4rpfI52NwMUdBhDVFA3mlM0reafJ0c_lgyhhxaCnPldXvqXDATGyYKlj1yhYNDWqfYDq90vLs_gfdBTNTENkIRyMXpM_vw Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:01.210908 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51df90dbb0ac462890b5797af9ccf3b4"}]}] Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cbc3d3505371450e8d6caaa8b7c5dfd0 Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: action_args: {} Oct 02 01:01:01.212155 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:01.212843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 02 01:01:01.213889 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.222018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a121af4c-89b7-4647-8b48-8c50959f937f tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:01.232020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a121af4c-89b7-4647-8b48-8c50959f937f tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.314057 Oct 02 01:01:01.241156 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 87/174] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:01:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:01.249971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:01.250584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:01.258283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.259449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.260118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.261102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.262049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.262704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.281172 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] HTTP exception thrown: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Request method failure captured: Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 HTTP/1.1 Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKjaVGkdfVLZDCQ0GBwhJ9VBEZC8Psu7WppWyDlBSldMaSzhZRACAKIOT4VuPtroRzbly1QrHuB-Pbcg1vcxitpvh6Oa5laINOlBfcCX33aa_at5IH7Azrc8FUwGG4TajMlkURDKRJw1SexbcGyRMChPV-4NCeI3EumOlVzGX97X5c Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2593cd49763c4c02ac5f7b30b03a0366 Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:01.285037 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2593cd49763c4c02ac5f7b30b03a0366"}]}] Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2593cd49763c4c02ac5f7b30b03a0366 Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminTestJSON-175002889-project Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: ae3c3aba9b784076beb1b6713a439f78 Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminTestJSON-175002889-project Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:01.286520 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0'} Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:01.287218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:01.288290 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.290877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Returning 404 to user: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:01.292372 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-945ce2f7-223e-4e20-a7ff-eaa54ad2921a tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 404 len: 111 microversion: 2.1 time: 0.048686 Oct 02 01:01:01.297201 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 88/175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:01 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:01.303992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e46cada-719e-4662-8e20-f448f7dbf259 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:01.304730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4e46cada-719e-4662-8e20-f448f7dbf259 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:01.502314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4e46cada-719e-4662-8e20-f448f7dbf259 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:01.518399 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e46cada-719e-4662-8e20-f448f7dbf259 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1262 microversion: 2.1 time: 0.220063 Oct 02 01:01:01.520406 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 89/176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:01 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1262 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:01.783844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-257cc74b-353b-4444-9cf8-ec57438653d2 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.238306 Oct 02 01:01:01.785445 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 88/177] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:01:00 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:01.790401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f41d0d40-936e-41a6-862a-b3614b11ccdb tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Calling method '.version_select at 0x7fb8820119d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:01.793491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f41d0d40-936e-41a6-862a-b3614b11ccdb tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cbc3d3505371450e8d6caaa8b7c5dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df90dbb0ac462890b5797af9ccf3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f41d0d40-936e-41a6-862a-b3614b11ccdb tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Request method failure captured: Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLKjgZPoT7IyXoefHhGG_-0oklhkXlkF9XfD_a8_WYZpC6uKYR2In7PDcg0HM8n12u0s0VnuHk25EQzI4rpfI52NwMUdBhDVFA3mlM0reafJ0c_lgyhhxaCnPldXvqXDATGyYKlj1yhYNDWqfYDq90vLs_gfdBTNTENkIRyMXpM_vw Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:01.795520 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51df90dbb0ac462890b5797af9ccf3b4"}]}] Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cbc3d3505371450e8d6caaa8b7c5dfd0 Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:01:01.796657 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:01.797443 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 02 01:01:01.798472 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:01.804381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f41d0d40-936e-41a6-862a-b3614b11ccdb tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:01.805480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f41d0d40-936e-41a6-862a-b3614b11ccdb tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.018860 Oct 02 01:01:01.806659 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:01:01 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:01.815020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ec6db36-2fd3-42cc-bd78-cb37181045db tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:01.824928 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=13 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.833120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec6db36-2fd3-42cc-bd78-cb37181045db tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:01.833979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec6db36-2fd3-42cc-bd78-cb37181045db tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:01.834644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec6db36-2fd3-42cc-bd78-cb37181045db tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:01.930439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90131b84-4b55-4d21-acf8-0f8e17f100ef tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1779473504", "ram": 512, "vcpus": 1, "disk": 10, "id": 1540035536, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:01.996744 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90131b84-4b55-4d21-acf8-0f8e17f100ef tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.472509 Oct 02 01:01:01.999173 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 90/179] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:01 2022] POST /compute/v2.1/flavors => generated 416 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:02.025821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5308d55e-2ea3-4f55-86f6-6fbd2fa62243 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] Action: 'create', calling method: .version_select at 0x7fb881dd9670>, body: {"security_group": {"name": "tempest-securitygroup-647861761", "description": "tempest-description-1357824452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:02.370719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5308d55e-2ea3-4f55-86f6-6fbd2fa62243 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.354967 Oct 02 01:01:02.373577 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 91/180] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:01:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:02.382463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21b4da3e-57f8-4dda-9f3a-bcc4d8c05de8 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Calling method '.version_select at 0x7fb881cf6dc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:02.390972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21b4da3e-57f8-4dda-9f3a-bcc4d8c05de8 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cbc3d3505371450e8d6caaa8b7c5dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df90dbb0ac462890b5797af9ccf3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21b4da3e-57f8-4dda-9f3a-bcc4d8c05de8 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Request method failure captured: Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLKjgZPoT7IyXoefHhGG_-0oklhkXlkF9XfD_a8_WYZpC6uKYR2In7PDcg0HM8n12u0s0VnuHk25EQzI4rpfI52NwMUdBhDVFA3mlM0reafJ0c_lgyhhxaCnPldXvqXDATGyYKlj1yhYNDWqfYDq90vLs_gfdBTNTENkIRyMXpM_vw Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:02.401486 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51df90dbb0ac462890b5797af9ccf3b4"}]}] Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cbc3d3505371450e8d6caaa8b7c5dfd0 Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: action_args: {} Oct 02 01:01:02.402906 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:02.403609 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 02 01:01:02.404714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:02.406741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21b4da3e-57f8-4dda-9f3a-bcc4d8c05de8 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:02.406741 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21b4da3e-57f8-4dda-9f3a-bcc4d8c05de8 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.028811 Oct 02 01:01:02.406741 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 92/181] 10.222.0.23 () {58 vars in 1179 bytes} [Sun Oct 2 01:01:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:02.418543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-869a0bdf-c979-418c-9a06-87fa37fa85b0 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:02.469595 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-869a0bdf-c979-418c-9a06-87fa37fa85b0 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064455 Oct 02 01:01:02.472899 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 93/182] 10.222.0.23 () {60 vars in 1224 bytes} [Sun Oct 2 01:01:02 2022] POST /compute/v2.1/flavors/1540035536/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:02.484828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1519377d-98ee-4a0d-a1c4-21523a641bb5 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] Calling method '.version_select at 0x7fb8820db8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:02.703602 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ec6db36-2fd3-42cc-bd78-cb37181045db tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.894549 Oct 02 01:01:02.705193 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 90/183] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:01 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:03.169228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Calling method '.version_select at 0x7fb881f88c10>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:03.171150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.171858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.172526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.202567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.207319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.207858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.229264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.229752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.230184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.240649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c19b65a-98c7-4846-aa23-6c5937f37548 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.532024 Oct 02 01:01:03.247516 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 91/184] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:01:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:03.582187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c66fbe4-e1af-45a4-8dee-130d5c4f6bf0 tempest-FlavorsExtraSpecsTestJSON-1434860230 tempest-FlavorsExtraSpecsTestJSON-1434860230-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:03.599143 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c66fbe4-e1af-45a4-8dee-130d5c4f6bf0 tempest-FlavorsExtraSpecsTestJSON-1434860230 tempest-FlavorsExtraSpecsTestJSON-1434860230-project] 10.222.0.23 "GET /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.346837 Oct 02 01:01:03.599754 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 92/185] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:01:03 2022] GET /compute/v2.1/flavors/1540035536/os-extra_specs => generated 66 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:03.617916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:03.618700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:03.625756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.626259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.627575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.628299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:03.628763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:03.631182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.821751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:03.831215 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-84c52875-6983-4cb7-aa43-8beead885fd0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.221323 Oct 02 01:01:03.847202 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 93/186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:03 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:03.853970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56b2a507-d121-4fdf-a0f6-021b0e484146 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:03.894259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56b2a507-d121-4fdf-a0f6-021b0e484146 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.045534 Oct 02 01:01:03.902432 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 94/187] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:03 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:03.915228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f04134e-14d2-4660-a463-023a72b12159 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Calling method '.version_select at 0x7fb881ef8ca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:03.918072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0f04134e-14d2-4660-a463-023a72b12159 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cbc3d3505371450e8d6caaa8b7c5dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df90dbb0ac462890b5797af9ccf3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f04134e-14d2-4660-a463-023a72b12159 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Request method failure captured: Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLKjgZPoT7IyXoefHhGG_-0oklhkXlkF9XfD_a8_WYZpC6uKYR2In7PDcg0HM8n12u0s0VnuHk25EQzI4rpfI52NwMUdBhDVFA3mlM0reafJ0c_lgyhhxaCnPldXvqXDATGyYKlj1yhYNDWqfYDq90vLs_gfdBTNTENkIRyMXpM_vw Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:03.929870 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51df90dbb0ac462890b5797af9ccf3b4"}]}] Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cbc3d3505371450e8d6caaa8b7c5dfd0 Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '1'} Oct 02 01:01:03.931431 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:03.932329 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 02 01:01:03.933467 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:03.935207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f04134e-14d2-4660-a463-023a72b12159 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:03.937795 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f04134e-14d2-4660-a463-023a72b12159 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.033074 Oct 02 01:01:03.940051 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 95/188] 10.222.0.23 () {58 vars in 1173 bytes} [Sun Oct 2 01:01:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:03.951644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dff10c0-13cb-4586-acbc-adbdff8d2d97 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:04.040103 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9dff10c0-13cb-4586-acbc-adbdff8d2d97 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095606 Oct 02 01:01:04.049361 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 96/189] 10.222.0.23 () {60 vars in 1224 bytes} [Sun Oct 2 01:01:03 2022] POST /compute/v2.1/flavors/1540035536/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.058515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e32a43d-2091-40ad-ad02-8ef15fb5ede4 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1317856315"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:04.062387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-5e32a43d-2091-40ad-ad02-8ef15fb5ede4 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid 6e8c141a-24ad-4f22-a9c5-746a87f6b74a for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:04.109531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e32a43d-2091-40ad-ad02-8ef15fb5ede4 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051392 Oct 02 01:01:04.109531 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 97/190] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:04.109531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3a2d2ff-ed06-4dca-9e4b-69ae2f750698 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Calling method '.version_select at 0x7fb882092dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.110642 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c3a2d2ff-ed06-4dca-9e4b-69ae2f750698 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] HTTP exception thrown: Hypervisor with ID '0255908c-08bb-4dbe-9c5b-08a4b41debbe' could not be found. Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3a2d2ff-ed06-4dca-9e4b-69ae2f750698 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Request method failure captured: Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/0255908c-08bb-4dbe-9c5b-08a4b41debbe/uptime HTTP/1.1 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLMvdQm9Bc2C7cii-1qteCSc5bvTepk-qagM8FNjt3nFs8K7m5r8_UFwf3jmbHXJLtFg5dajA7GYA1CPbW7TvZEp9wrYZwn_rwwiFqAwEyFd3lMSti_LLLJzTH_z7lQft0xDIuUFBTm9971_WwB8oq-EcbkObruJgG7XJ1-lf_7414 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: c59c4ea4eea04c318bacbfd5520f2fc2 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-975245974 Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:04.118866 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c59c4ea4eea04c318bacbfd5520f2fc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c59c4ea4eea04c318bacbfd5520f2fc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c59c4ea4eea04c318bacbfd5520f2fc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c59c4ea4eea04c318bacbfd5520f2fc2"}]}] Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-975245974 Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: c59c4ea4eea04c318bacbfd5520f2fc2 Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-975245974 Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: b5fc87239b7c47c5a61057c09540b64f Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: exception: Hypervisor with ID '0255908c-08bb-4dbe-9c5b-08a4b41debbe' could not be found. Oct 02 01:01:04.120411 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0255908c-08bb-4dbe-9c5b-08a4b41debbe'} Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0255908c-08bb-4dbe-9c5b-08a4b41debbe' Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 02 01:01:04.121266 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0255908c-08bb-4dbe-9c5b-08a4b41debbe' could not be found. Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:04.122783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0255908c-08bb-4dbe-9c5b-08a4b41debbe' could not be found. Oct 02 01:01:04.124210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.127927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3a2d2ff-ed06-4dca-9e4b-69ae2f750698 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Returning 404 to user: Hypervisor with ID '0255908c-08bb-4dbe-9c5b-08a4b41debbe' could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:04.130194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c3a2d2ff-ed06-4dca-9e4b-69ae2f750698 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/0255908c-08bb-4dbe-9c5b-08a4b41debbe/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025561 Oct 02 01:01:04.136395 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 98/191] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/os-hypervisors/0255908c-08bb-4dbe-9c5b-08a4b41debbe/uptime => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:04.142985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-504c1840-19be-449f-92b9-6a3c0e48b6af tempest-FlavorsExtraSpecsTestJSON-1434860230 tempest-FlavorsExtraSpecsTestJSON-1434860230-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.162116 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-504c1840-19be-449f-92b9-6a3c0e48b6af tempest-FlavorsExtraSpecsTestJSON-1434860230 tempest-FlavorsExtraSpecsTestJSON-1434860230-project] 10.222.0.23 "GET /compute/v2.1/flavors/1540035536/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.021544 Oct 02 01:01:04.163020 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 99/192] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/flavors/1540035536/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.180126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd134c16-ecba-46d5-b174-d35138c6fdf7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:04.205871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd134c16-ecba-46d5-b174-d35138c6fdf7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.206772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd134c16-ecba-46d5-b174-d35138c6fdf7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.207514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd134c16-ecba-46d5-b174-d35138c6fdf7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.424447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd134c16-ecba-46d5-b174-d35138c6fdf7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.259284 Oct 02 01:01:04.425074 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 100/193] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:04.434796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Calling method '.version_select at 0x7fb881ef83a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.437358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.438011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.438813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.467200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.467833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.468328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.484896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.485507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.486209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.524479 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0fd8c199-2bdd-4c62-b152-58e05d117491 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.097153 Oct 02 01:01:04.527594 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 101/194] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:04.539912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87735e6e-a0b5-41b7-b4e1-f241b5b7c6a6 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:04.588773 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87735e6e-a0b5-41b7-b4e1-f241b5b7c6a6 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059686 Oct 02 01:01:04.589471 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 102/195] 10.222.0.23 () {60 vars in 1224 bytes} [Sun Oct 2 01:01:04 2022] POST /compute/v2.1/flavors/1540035536/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.852385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1519377d-98ee-4a0d-a1c4-21523a641bb5 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8309 microversion: 2.1 time: 2.378396 Oct 02 01:01:04.871507 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 94/196] 10.222.0.23 () {58 vars in 1191 bytes} [Sun Oct 2 01:01:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8309 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:04.877978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9fb1deac-4b65-4ac3-8307-9076a1bfbf94 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.886928 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9fb1deac-4b65-4ac3-8307-9076a1bfbf94 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.014124 Oct 02 01:01:04.887994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 95/197] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:04.893272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43240d8a-0e77-4eab-909b-ff9b46ccce04 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Calling method '.version_select at 0x7fb881cf6430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.895546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43240d8a-0e77-4eab-909b-ff9b46ccce04 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cbc3d3505371450e8d6caaa8b7c5dfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df90dbb0ac462890b5797af9ccf3b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43240d8a-0e77-4eab-909b-ff9b46ccce04 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Request method failure captured: Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLKjgZPoT7IyXoefHhGG_-0oklhkXlkF9XfD_a8_WYZpC6uKYR2In7PDcg0HM8n12u0s0VnuHk25EQzI4rpfI52NwMUdBhDVFA3mlM0reafJ0c_lgyhhxaCnPldXvqXDATGyYKlj1yhYNDWqfYDq90vLs_gfdBTNTENkIRyMXpM_vw Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:04.897466 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51df90dbb0ac462890b5797af9ccf3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51df90dbb0ac462890b5797af9ccf3b4"}]}] Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 51df90dbb0ac462890b5797af9ccf3b4 Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-6840484 Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cbc3d3505371450e8d6caaa8b7c5dfd0 Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-6840484-project Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1'} Oct 02 01:01:04.899013 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:04.899783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 02 01:01:04.900828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:04.903547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43240d8a-0e77-4eab-909b-ff9b46ccce04 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:04.904895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43240d8a-0e77-4eab-909b-ff9b46ccce04 tempest-HypervisorAdminNegativeTestJSON-6840484 tempest-HypervisorAdminNegativeTestJSON-6840484-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015798 Oct 02 01:01:04.905960 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 96/198] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:04.914201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb8b0fba-3c8b-4a5f-9ad8-61ad4d4ba76d tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.924675 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb8b0fba-3c8b-4a5f-9ad8-61ad4d4ba76d tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017368 Oct 02 01:01:04.930996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 97/199] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/flavors/1540035536/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.937306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.938283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.950031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.951208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.951885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.952900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.953930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.954678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.996144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-915624721", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:05.032980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:05.043504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e1fe8c7-71fb-429c-ae97-ce42698b295a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.110807 Oct 02 01:01:05.051930 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 98/200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:05.063633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0edcce7c-8603-4dbe-9256-b06a7b6e5f98 tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] Calling method '.version_select at 0x7fb881cf6e50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:05.073394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:05.432005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:05.433123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:05.433598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:05.434016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:05.434419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:05.444574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:05.445152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:05.445697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:05.446590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:05.448319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:05.448788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:05.458776 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0edcce7c-8603-4dbe-9256-b06a7b6e5f98 tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.405480 Oct 02 01:01:05.470572 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 99/201] 10.222.0.23 () {58 vars in 1191 bytes} [Sun Oct 2 01:01:05 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:05.476470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45d166bf-5d08-40d1-badb-66f85eb6ae23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:05.482045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Getting quotas for project 683c16b60ba34123bf0175396dffaf83. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:05.492102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Getting quotas for user c42d04f7289e49ef950eeaf764c91216 and project 683c16b60ba34123bf0175396dffaf83. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:05.497621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d166bf-5d08-40d1-badb-66f85eb6ae23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:05.498213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d166bf-5d08-40d1-badb-66f85eb6ae23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:05.499273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d166bf-5d08-40d1-badb-66f85eb6ae23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:05.512097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:05.517022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:05.574374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41a6a916-0052-4c32-896e-de3da19fa86c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983790 Oct 02 01:01:05.575543 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 103/202] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:05.592765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-780c5488-c4f5-41a6-8bed-c133472b23a5 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Calling method '.version_select at 0x7fb88205ce50>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:05.595752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-780c5488-c4f5-41a6-8bed-c133472b23a5 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] HTTP exception thrown: Hypervisor with ID 'e457d478-b867-46df-847b-5149a08fb578' could not be found. Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-780c5488-c4f5-41a6-8bed-c133472b23a5 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Request method failure captured: Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-hypervisors/e457d478-b867-46df-847b-5149a08fb578 HTTP/1.1 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLMvdQm9Bc2C7cii-1qteCSc5bvTepk-qagM8FNjt3nFs8K7m5r8_UFwf3jmbHXJLtFg5dajA7GYA1CPbW7TvZEp9wrYZwn_rwwiFqAwEyFd3lMSti_LLLJzTH_z7lQft0xDIuUFBTm9971_WwB8oq-EcbkObruJgG7XJ1-lf_7414 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: c59c4ea4eea04c318bacbfd5520f2fc2 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-975245974 Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:05.597979 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c59c4ea4eea04c318bacbfd5520f2fc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c59c4ea4eea04c318bacbfd5520f2fc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c59c4ea4eea04c318bacbfd5520f2fc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c59c4ea4eea04c318bacbfd5520f2fc2"}]}] Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-975245974 Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: c59c4ea4eea04c318bacbfd5520f2fc2 Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-975245974 Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: b5fc87239b7c47c5a61057c09540b64f Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: exception: Hypervisor with ID 'e457d478-b867-46df-847b-5149a08fb578' could not be found. Oct 02 01:01:05.599160 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'e457d478-b867-46df-847b-5149a08fb578'} Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e457d478-b867-46df-847b-5149a08fb578' Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 02 01:01:05.599925 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:01:05.601055 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e457d478-b867-46df-847b-5149a08fb578' could not be found. Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e457d478-b867-46df-847b-5149a08fb578' could not be found. Oct 02 01:01:05.602104 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:05.604511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-780c5488-c4f5-41a6-8bed-c133472b23a5 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] Returning 404 to user: Hypervisor with ID 'e457d478-b867-46df-847b-5149a08fb578' could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:05.605791 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-780c5488-c4f5-41a6-8bed-c133472b23a5 tempest-HypervisorAdminNegativeTestJSON-975245974 tempest-HypervisorAdminNegativeTestJSON-975245974-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/e457d478-b867-46df-847b-5149a08fb578" status: 404 len: 123 microversion: 2.1 time: 0.016888 Oct 02 01:01:05.610401 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 104/203] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:01:05 2022] GET /compute/v2.1/os-hypervisors/e457d478-b867-46df-847b-5149a08fb578 => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:05.617044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2c976f0f-9d8e-4826-b861-571a0c1741a0 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:05.663586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2c976f0f-9d8e-4826-b861-571a0c1741a0 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1540035536/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.050416 Oct 02 01:01:05.669062 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 105/204] 10.222.0.23 () {60 vars in 1265 bytes} [Sun Oct 2 01:01:05 2022] PUT /compute/v2.1/flavors/1540035536/os-extra_specs/hw:numa_nodes => generated 22 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:05.689817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d51e7ccf-73db-4cae-aeea-4997e462ab3f tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] Calling method '.version_select at 0x7fb881ef89d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:05.742306 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45d166bf-5d08-40d1-badb-66f85eb6ae23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.269744 Oct 02 01:01:05.743562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 100/205] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:05.755340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-575446b9-1d36-46dc-9e8b-f0e402f6dff3 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:05.774951 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-575446b9-1d36-46dc-9e8b-f0e402f6dff3 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029361 Oct 02 01:01:05.775893 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 101/206] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:01:05 2022] GET /compute/v2.1/flavors/1540035536/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:05.792778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-463564833", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:05.893154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:06.715026 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d51e7ccf-73db-4cae-aeea-4997e462ab3f tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/35847821-9d28-48ac-b547-cce26ea4eac0" status: 202 len: 0 microversion: 2.1 time: 1.044559 Oct 02 01:01:06.716237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 106/207] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:01:05 2022] DELETE /compute/v2.1/os-security-groups/35847821-9d28-48ac-b547-cce26ea4eac0 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:06.724514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e77e3fc1-28e9-43c0-acd9-305823140ced tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:06.746236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:06.746838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:06.747591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:06.748139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:06.748769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:06.779492 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e77e3fc1-28e9-43c0-acd9-305823140ced tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.061903 Oct 02 01:01:06.789116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 107/208] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:06 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:06.795716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.799512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.800254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.801262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.802045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.802764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.803508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4412e66-0389-4ce7-af9e-b9335757de46 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:06.836626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Getting quotas for project 683c16b60ba34123bf0175396dffaf83. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:06.857620 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Getting quotas for user c42d04f7289e49ef950eeaf764c91216 and project 683c16b60ba34123bf0175396dffaf83. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:06.871876 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=6,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:06.884205 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4412e66-0389-4ce7-af9e-b9335757de46 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1540035536/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.087810 Oct 02 01:01:06.886081 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 108/209] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:01:06 2022] DELETE /compute/v2.1/flavors/1540035536/os-extra_specs/hw:numa_nodes => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:06.895124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:06.896598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:06.897413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:06.898435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:06.909965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.910780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.911400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.912799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.913454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.914041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:07.009535 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b7b876a-2df8-4d01-971a-269844a335e1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232438 Oct 02 01:01:07.018684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 102/210] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:07.018906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:07.025869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa89b6e0-5c70-437c-8cf6-76c52d303981 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] Calling method '.version_select at 0x7fb881ce7550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.046283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8156c182-ab7c-4c80-ad7f-d9637aa29225 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.137627 Oct 02 01:01:07.047595 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 109/211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:06 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:07.051948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89925482-2b7a-43a8-a410-93a7151e47f1 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2037524088"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:07.072445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-89925482-2b7a-43a8-a410-93a7151e47f1 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid 4746e1c6-59ca-41ac-8dc7-e9c23fa15a70 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:07.134004 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89925482-2b7a-43a8-a410-93a7151e47f1 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085292 Oct 02 01:01:07.134934 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 110/212] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:07.149860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70a48d47-d2ec-4db6-8b7a-76271b807def tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.210568 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70a48d47-d2ec-4db6-8b7a-76271b807def tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1540035536/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.071985 Oct 02 01:01:07.212635 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 111/213] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:01:07 2022] DELETE /compute/v2.1/flavors/1540035536/os-extra_specs/hw:cpu_policy => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:07.223046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1dfc122c-c36f-4e19-aab6-ca55f8def01e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.227498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1dfc122c-c36f-4e19-aab6-ca55f8def01e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:07.363446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1dfc122c-c36f-4e19-aab6-ca55f8def01e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:07.379824 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1dfc122c-c36f-4e19-aab6-ca55f8def01e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1213 microversion: 2.1 time: 0.162357 Oct 02 01:01:07.379824 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 112/214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:07 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:07.428832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ed85c67-5c4b-466b-93de-6441406dd83b tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:07.464137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ed85c67-5c4b-466b-93de-6441406dd83b tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:07.465842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ed85c67-5c4b-466b-93de-6441406dd83b tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:07.467112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ed85c67-5c4b-466b-93de-6441406dd83b tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:07.757729 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9ed85c67-5c4b-466b-93de-6441406dd83b tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.340759 Oct 02 01:01:07.758965 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 113/215] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:07 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:07.768169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47e6736e-10b5-4bf3-ada6-859d3f2a33d5 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.786975 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47e6736e-10b5-4bf3-ada6-859d3f2a33d5 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1540035536/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025771 Oct 02 01:01:07.796025 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 114/216] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:01:07 2022] GET /compute/v2.1/flavors/1540035536/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:07.809436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae7f7754-08b7-40ea-927c-588eec086c23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.879402 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae7f7754-08b7-40ea-927c-588eec086c23 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.081444 Oct 02 01:01:07.881959 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 115/217] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:01:07 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:07.908967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5be278f1-b221-4248-8f71-f78a7e4329c7 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.963905 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5be278f1-b221-4248-8f71-f78a7e4329c7 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1540035536" status: 202 len: 0 microversion: 2.1 time: 0.079103 Oct 02 01:01:07.964503 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 116/218] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:01:07 2022] DELETE /compute/v2.1/flavors/1540035536 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:07.972045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8bf6a918-3d33-4580-bd7b-3f59b1602cb9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:08.004010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bf6a918-3d33-4580-bd7b-3f59b1602cb9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.004968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bf6a918-3d33-4580-bd7b-3f59b1602cb9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.006880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bf6a918-3d33-4580-bd7b-3f59b1602cb9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.264303 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8bf6a918-3d33-4580-bd7b-3f59b1602cb9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.298497 Oct 02 01:01:08.268220 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 117/219] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:07 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:08.272958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-586cbdc3-5423-476c-aeeb-b2a1e52e2071 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:08.312660 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-586cbdc3-5423-476c-aeeb-b2a1e52e2071 tempest-FlavorsExtraSpecsTestJSON-766955734 tempest-FlavorsExtraSpecsTestJSON-766955734-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.043205 Oct 02 01:01:08.314291 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 118/220] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:01:08 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:08.331910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:08.336600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:08.357163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.358003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.358756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.359816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.360705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.361606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.499527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:08.516143 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4e0597e-0e63-4179-b00d-50b87be47255 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.198455 Oct 02 01:01:08.518569 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 119/221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:08 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:08.538392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-84089fe7-059a-4aa5-8837-2d9a440a0c62 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:08.616492 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa89b6e0-5c70-437c-8cf6-76c52d303981 tempest-SecurityGroupsTestAdminJSON-1510758469 tempest-SecurityGroupsTestAdminJSON-1510758469-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0990835c-8132-4f03-8c88-01d4ec4df3c0" status: 202 len: 0 microversion: 2.1 time: 1.594319 Oct 02 01:01:08.617783 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 103/222] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:01:07 2022] DELETE /compute/v2.1/os-security-groups/0990835c-8132-4f03-8c88-01d4ec4df3c0 => generated 0 bytes in 1598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:08.619876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-84089fe7-059a-4aa5-8837-2d9a440a0c62 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.099138 Oct 02 01:01:08.629276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 120/223] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:08 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:08.632854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:08.633732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:08.634237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f8d3318-e079-4504-8ea9-5bf0436da530 tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] Calling method '.version_select at 0x7fb88205cd30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:08.648027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.648858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.649538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.653878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.654670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.655335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.823454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:08.836646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6767fe6-eae1-42c7-ba45-26c92f3753f2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1217 microversion: 2.1 time: 0.216382 Oct 02 01:01:08.837887 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 104/224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:08 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:08.852799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28cedbfe-d5bc-4e1e-bf2d-2984c7e78d3e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1515454280"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:08.868823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-28cedbfe-d5bc-4e1e-bf2d-2984c7e78d3e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid ab481930-f85d-417c-a34d-abfb0d0c9b77 for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:08.926641 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28cedbfe-d5bc-4e1e-bf2d-2984c7e78d3e tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085488 Oct 02 01:01:08.927558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 105/225] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:08.941758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42214de4-53f9-418f-96b4-105626010809 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:08.959718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42214de4-53f9-418f-96b4-105626010809 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.960556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42214de4-53f9-418f-96b4-105626010809 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.961283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42214de4-53f9-418f-96b4-105626010809 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.204966 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42214de4-53f9-418f-96b4-105626010809 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.269193 Oct 02 01:01:09.205746 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 106/226] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:08 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:09.217146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24cbd1af-3647-4b4e-9195-4488824481f9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:09.246033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24cbd1af-3647-4b4e-9195-4488824481f9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.246415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24cbd1af-3647-4b4e-9195-4488824481f9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.246878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24cbd1af-3647-4b4e-9195-4488824481f9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.479271 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24cbd1af-3647-4b4e-9195-4488824481f9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.265746 Oct 02 01:01:09.489558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 107/227] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:09.494732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26e102e4-7d84-473c-84a2-6cb364c28950 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.549700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26e102e4-7d84-473c-84a2-6cb364c28950 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.058868 Oct 02 01:01:09.557008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 108/228] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:09 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:09.569658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.574999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:09.599097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.599480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.599883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.600592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.601044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.601470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.805244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f8d3318-e079-4504-8ea9-5bf0436da530 tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c7090a21-8f95-4c48-b0d5-3ef8277e308f" status: 202 len: 0 microversion: 2.1 time: 1.180614 Oct 02 01:01:09.809830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 121/229] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:01:08 2022] DELETE /compute/v2.1/os-security-groups/c7090a21-8f95-4c48-b0d5-3ef8277e308f => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:09.817233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-171afd52-b24d-4e21-8b62-dcad52f32803 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1071495413"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:09.822636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-171afd52-b24d-4e21-8b62-dcad52f32803 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid af8b09da-ec32-4227-b15c-7a77cd393d87 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:09.840330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:09.853546 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-171afd52-b24d-4e21-8b62-dcad52f32803 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040845 Oct 02 01:01:09.853691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b4b3df8-67a5-45b1-8e7e-fae03f618ccb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.295197 Oct 02 01:01:09.854153 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 122/230] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:09.870287 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 109/231] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:09 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:09.878252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b78806c-6e9f-4f2a-902a-ee37b5dc72aa tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] Calling method '.version_select at 0x7fb881cf6a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.881545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e44f53b-9466-4601-b694-859c1e37df8a tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1612329080"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:09.889881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-2e44f53b-9466-4601-b694-859c1e37df8a tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid b8532d53-0955-47b8-a8bb-e36beba006ad for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:09.931433 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e44f53b-9466-4601-b694-859c1e37df8a tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063126 Oct 02 01:01:09.932039 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 123/232] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:09.946273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.947336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:09.961427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.962215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.962864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.963814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.964449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.968456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.168997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:10.177692 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27f93298-6eef-44e0-b74b-285e2a3fb4bd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1217 microversion: 2.1 time: 0.242706 Oct 02 01:01:10.191303 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 124/233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:09 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:10.196686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbfe16fa-ed33-4938-a2c7-808d0bf1d2c5 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:10.229651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbfe16fa-ed33-4938-a2c7-808d0bf1d2c5 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.036961 Oct 02 01:01:10.230501 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 125/234] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:10.241500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4b39956-6fba-4e5d-a708-93345fbff1b7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:10.267220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4b39956-6fba-4e5d-a708-93345fbff1b7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.268303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4b39956-6fba-4e5d-a708-93345fbff1b7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.269863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4b39956-6fba-4e5d-a708-93345fbff1b7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.549456 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4b39956-6fba-4e5d-a708-93345fbff1b7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.315025 Oct 02 01:01:10.551769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 126/235] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:10.575260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-760a3fdb-5508-4698-a8a6-cb29b29a811f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:10.595189 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-760a3fdb-5508-4698-a8a6-cb29b29a811f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-760a3fdb-5508-4698-a8a6-cb29b29a811f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Request method failure captured: Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKlsTstOdUFSm6tm4R82idQlNxVdQuN8Tr2oUTJ1iQ4ZH1qknAMd9o7AJgXYCwIvgyEqzPVodKma4X3FBZOpliBIqovgWM5nY-JgTXcFP5ufYKexgewe2GvCFjO8MYW_oPmq7mprXoG9lxMO0W-c_tzUIll-AxsHvcxXyRohrhpk3s Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:10.606751 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b46004885615411c9b157fa1b309fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b46004885615411c9b157fa1b309fc14"}]}] Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fd4f1f3bc32f4195a3f4c3bf6665588e Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: exception: Aggregate 5 could not be found. Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '5'} Oct 02 01:01:10.608015 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.608912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 02 01:01:10.610551 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.613035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-760a3fdb-5508-4698-a8a6-cb29b29a811f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:10.613035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-760a3fdb-5508-4698-a8a6-cb29b29a811f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.056110 Oct 02 01:01:10.613035 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 127/236] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:01:10 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:10.625180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:10.651929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.652495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.653024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.696757 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-master-1. Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 39 Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:10.743563 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: {"add_host": {"host": "n-h2-master-1"}} Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:10.745476 n-d-master-1 devstack@n-api.service[122355]: exception: Aggregate 6 already has host n-h2-master-1. Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result.read() Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:01:10.746364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi session.flush() Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 01:01:10.747650 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 01:01:10.749640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:01:10.752840 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result.read() Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 2, 1, 1, 10, 681246), 'updated_at': None, 'host': 'n-h2-master-1', 'aggregate_id': 6}] Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.759457 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-master-1. Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.761091 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-master-1. Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:10.762444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:10.763825 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-master-1. Oct 02 01:01:10.763825 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.763825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-master-1. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:10.763825 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec735322-cbb0-4af3-870a-682a8b0a4eb4 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.146181 Oct 02 01:01:10.763825 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 128/237] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 02 01:01:10.764218 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b78806c-6e9f-4f2a-902a-ee37b5dc72aa tempest-SecurityGroupsTestAdminJSON-1778299097 tempest-SecurityGroupsTestAdminJSON-1778299097-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1e157cc8-802a-4041-91bc-b7e518e852ed" status: 202 len: 0 microversion: 2.1 time: 0.899867 Oct 02 01:01:10.764218 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 110/238] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:01:09 2022] DELETE /compute/v2.1/os-security-groups/1e157cc8-802a-4041-91bc-b7e518e852ed => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:10.768827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0960e476-e749-4b29-b346-2cd04cf4da9e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:10.776568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2f369cb-1c4c-4d0e-8910-48848042f666 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:10.789509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0960e476-e749-4b29-b346-2cd04cf4da9e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.790002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0960e476-e749-4b29-b346-2cd04cf4da9e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.790502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0960e476-e749-4b29-b346-2cd04cf4da9e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.794222 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a2f369cb-1c4c-4d0e-8910-48848042f666 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2f369cb-1c4c-4d0e-8910-48848042f666 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Request method failure captured: Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKlsTstOdUFSm6tm4R82idQlNxVdQuN8Tr2oUTJ1iQ4ZH1qknAMd9o7AJgXYCwIvgyEqzPVodKma4X3FBZOpliBIqovgWM5nY-JgTXcFP5ufYKexgewe2GvCFjO8MYW_oPmq7mprXoG9lxMO0W-c_tzUIll-AxsHvcxXyRohrhpk3s Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:10.799008 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b46004885615411c9b157fa1b309fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b46004885615411c9b157fa1b309fc14"}]}] Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fd4f1f3bc32f4195a3f4c3bf6665588e Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: exception: Aggregate 5 could not be found. Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '5'} Oct 02 01:01:10.800671 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:10.801510 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:10.802648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:10.803813 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:10.803813 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:10.803813 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:10.803813 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 02 01:01:10.803813 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:10.807854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2f369cb-1c4c-4d0e-8910-48848042f666 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:10.809468 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2f369cb-1c4c-4d0e-8910-48848042f666 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.044121 Oct 02 01:01:10.810409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 129/239] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:10.820343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8073a80c-1594-446e-928b-d07bd173710a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1322305244", "name": "tempest-test_aggregate-854571618"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:10.835709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-8073a80c-1594-446e-928b-d07bd173710a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid d8cb5abe-9dd2-4be7-96e4-455a5f182b78 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:10.899693 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8073a80c-1594-446e-928b-d07bd173710a tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.083146 Oct 02 01:01:10.906675 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 130/240] 10.222.0.23 () {60 vars in 1165 bytes} [Sun Oct 2 01:01:10 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:10.912464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:10.917765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:10.935801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.936739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.937379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:10.938627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:10.939279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:10.939896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:11.096091 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0960e476-e749-4b29-b346-2cd04cf4da9e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.331034 Oct 02 01:01:11.102783 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 111/241] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:11.129988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-057ff46b-caaa-4f62-982f-5b0c8b2cb917 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.144943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:11.148007 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:11.166453 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a58f316b-2cb8-402e-a82f-5fc095c7373c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.254408 Oct 02 01:01:11.170129 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 131/242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:10 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:11.183886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4573b0d5-85bc-47cf-bc5a-3528509ab7c9 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.193399 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-057ff46b-caaa-4f62-982f-5b0c8b2cb917 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.088809 Oct 02 01:01:11.204927 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 112/243] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:11.213486 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=10 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:11.217986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2588053e-39fd-4401-8c54-c2b0c77098d9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.239226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4573b0d5-85bc-47cf-bc5a-3528509ab7c9 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.065029 Oct 02 01:01:11.241149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-2588053e-39fd-4401-8c54-c2b0c77098d9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 02 01:01:11.241313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 132/244] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2588053e-39fd-4401-8c54-c2b0c77098d9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Request method failure captured: Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKlsTstOdUFSm6tm4R82idQlNxVdQuN8Tr2oUTJ1iQ4ZH1qknAMd9o7AJgXYCwIvgyEqzPVodKma4X3FBZOpliBIqovgWM5nY-JgTXcFP5ufYKexgewe2GvCFjO8MYW_oPmq7mprXoG9lxMO0W-c_tzUIll-AxsHvcxXyRohrhpk3s Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:01:11.248420 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b46004885615411c9b157fa1b309fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b46004885615411c9b157fa1b309fc14"}]}] Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: fd4f1f3bc32f4195a3f4c3bf6665588e Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: exception: Aggregate 7 could not be found. Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7'} Oct 02 01:01:11.249796 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.251145 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 02 01:01:11.252666 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.255831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2588053e-39fd-4401-8c54-c2b0c77098d9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:11.257268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2588053e-39fd-4401-8c54-c2b0c77098d9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.050700 Oct 02 01:01:11.258392 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 113/245] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:01:11 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:11.263815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.269233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:11.273577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26738f1b-6711-4d0a-bdfb-bb658b7597a5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-792224957"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:11.283876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-26738f1b-6711-4d0a-bdfb-bb658b7597a5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid 8aa67be8-93af-40ae-a581-db1ce3a55ec8 for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:11.284304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:11.286865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:11.287561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:11.290237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:11.292220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:11.293108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:11.326065 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=78,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:11.357323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26738f1b-6711-4d0a-bdfb-bb658b7597a5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.096218 Oct 02 01:01:11.359739 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 114/246] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:11.379843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9d57a9ce-163c-46c5-8137-5a2372c568e9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:11.414622 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9d57a9ce-163c-46c5-8137-5a2372c568e9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9d57a9ce-163c-46c5-8137-5a2372c568e9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Request method failure captured: Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKlsTstOdUFSm6tm4R82idQlNxVdQuN8Tr2oUTJ1iQ4ZH1qknAMd9o7AJgXYCwIvgyEqzPVodKma4X3FBZOpliBIqovgWM5nY-JgTXcFP5ufYKexgewe2GvCFjO8MYW_oPmq7mprXoG9lxMO0W-c_tzUIll-AxsHvcxXyRohrhpk3s Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:01:11.424012 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b46004885615411c9b157fa1b309fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b46004885615411c9b157fa1b309fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b46004885615411c9b157fa1b309fc14"}]}] Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b46004885615411c9b157fa1b309fc14 Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1909171970 Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: fd4f1f3bc32f4195a3f4c3bf6665588e Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminTestJSON-1909171970-project-admin Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: exception: Aggregate 7 could not be found. Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7'} Oct 02 01:01:11.425493 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:11.426362 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:11.427644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:11.428999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:11.428999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:11.428999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:11.428999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 02 01:01:11.428999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:11.444930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9d57a9ce-163c-46c5-8137-5a2372c568e9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:11.448620 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9d57a9ce-163c-46c5-8137-5a2372c568e9 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.087232 Oct 02 01:01:11.463103 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 115/247] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:11.876307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:11.886007 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-970176e3-c15d-4ee8-a8ae-1ce45eaa6a5d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1217 microversion: 2.1 time: 0.640912 Oct 02 01:01:11.890612 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 133/248] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:11 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1217 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:11.903879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7c48b5a-7bc9-4327-a009-ed357aaeb77f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-284342475"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:11.915632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-e7c48b5a-7bc9-4327-a009-ed357aaeb77f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid 9e678ce5-e44c-4d57-a317-7d4fe6e55e58 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:11.968373 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7c48b5a-7bc9-4327-a009-ed357aaeb77f tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074277 Oct 02 01:01:11.977527 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 134/249] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:12.291854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c074c27-e414-4d7e-8c83-ddd78f08f447 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:12.297283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c074c27-e414-4d7e-8c83-ddd78f08f447 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'e7eb017337d54e9e890d47f3d49d4ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f840ff0244f47ed96619e4649b2b143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c074c27-e414-4d7e-8c83-ddd78f08f447 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Request method failure captured: Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 39 Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKkW9wa6JptlAFIsx9KvImTN2XozuZrCLnAiISJpV0Jcg40pIMLdn2d_VRlAxo2FRkolR9covaUydDiq5rHRR1oVPuLBHzmXP7SNDle_TXRie8bJ0PIjvg_X0qUMngURImcSJmYx8RhNTbF3zX8lrysTuDP20Ob_Q2YMtb6Bb3PZSo Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:12.307326 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f840ff0244f47ed96619e4649b2b143"}]}] Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e7eb017337d54e9e890d47f3d49d4ae5 Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: {"add_host": {"host": "n-h2-master-1"}} Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:12.308587 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:12.309313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 02 01:01:12.310426 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.313605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c074c27-e414-4d7e-8c83-ddd78f08f447 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:12.313605 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c074c27-e414-4d7e-8c83-ddd78f08f447 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.844602 Oct 02 01:01:12.313605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 116/250] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:11 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 846 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:12.336706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d02d52c-bf0b-423a-9079-384935200bfc tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:12.358551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d02d52c-bf0b-423a-9079-384935200bfc tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.047035 Oct 02 01:01:12.363203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 117/251] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:01:12 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:12.387585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:12.393073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:12.415523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:12.418819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:12.419518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:12.425156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:12.426026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:12.426986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:12.639931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03739b02-8735-4832-9662-20b9681ddc34 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:12.644261 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-03739b02-8735-4832-9662-20b9681ddc34 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03739b02-8735-4832-9662-20b9681ddc34 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin] Request method failure captured: Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLXXjGHp_4LV7lmhLAyFl0VTirsCHG39AtALx-oK5guwGkTxVJ4SiHuO7Ec5KaDX44uwVBApHnDIkEkmYCwc5_0lujmh-UeplW79mzSgVrKksUVULZER5LBbY-78cQ7lWQVlGUWGZqpTTOY9SSEOtUk-gujuoDry4zaC6UAP8_e4Ts Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0c71e34633874d01965f644532086b7b Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:12.655266 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0c71e34633874d01965f644532086b7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c71e34633874d01965f644532086b7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c71e34633874d01965f644532086b7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0c71e34633874d01965f644532086b7b"}]}] Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0c71e34633874d01965f644532086b7b Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: b8cea6fc9a4c4efc8f7c4de0b132f58e Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:12.657276 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid timestamp for date invalid_time Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'invalid_time'} Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:12.659285 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 02 01:01:12.660558 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.664797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03739b02-8735-4832-9662-20b9681ddc34 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:12.665904 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-03739b02-8735-4832-9662-20b9681ddc34 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589 tempest-InstanceUsageAuditLogNegativeTestJSON-1991616589-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.693080 Oct 02 01:01:12.673465 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 135/252] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 701 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:12.683871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-113aae83-2585-4d64-a4b6-3d8e9c95d08e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:12.725921 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-113aae83-2585-4d64-a4b6-3d8e9c95d08e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.049031 Oct 02 01:01:12.732118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 136/253] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:12 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:12.739076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a91f08ed-c8a5-44c9-9fd0-4e58cb5865f7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:12.784883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a91f08ed-c8a5-44c9-9fd0-4e58cb5865f7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.050197 Oct 02 01:01:12.786272 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 137/254] 10.222.0.23 () {60 vars in 1191 bytes} [Sun Oct 2 01:01:12 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:13.050931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:13.060019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6edb3c6-22bb-4606-95be-9e26d73c5b0e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1320 microversion: 2.1 time: 0.694180 Oct 02 01:01:13.065520 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 118/255] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:12 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:13.070275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea6f921d-df4e-489c-8bfd-9e86a6284be5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1984116540"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:13.074441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-ea6f921d-df4e-489c-8bfd-9e86a6284be5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid 2b59bc99-c8ab-4222-a765-5c2a4f046660 for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:13.133493 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea6f921d-df4e-489c-8bfd-9e86a6284be5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066634 Oct 02 01:01:13.159259 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 119/256] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:13.169036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-546d0dd7-5091-4ea1-8070-48357d41a1d4 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.197601 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-546d0dd7-5091-4ea1-8070-48357d41a1d4 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.036557 Oct 02 01:01:13.200218 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 120/257] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:01:13 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:13.218881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.224117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:13.242643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.246133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.248012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.249561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.253209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.253847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.305058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6052e20-fc39-4bdb-a709-0a9341a710ba tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.308490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6052e20-fc39-4bdb-a709-0a9341a710ba tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '292ec7b4a0074e398d23452899458532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a863fa9ef38b471dbb866f81c6fb0b37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6052e20-fc39-4bdb-a709-0a9341a710ba tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Request method failure captured: Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLVARPmfXbPcn2ypXPVlOIL5qRXhdtfcw0ZFG0ln024wXcKxU2eIgKJu2Ich-SGQj6dYfo_F-MbX_Ah_7q414YAbXIVdcvXSb2MAzkTVLFFQwQG_1iMyoPKe8FmydLmgiufjycDTxtsniamlKbqLPkTMkbmSssxE-pxtW-6ceNdWME Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: a863fa9ef38b471dbb866f81c6fb0b37 Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:13.312083 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a863fa9ef38b471dbb866f81c6fb0b37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a863fa9ef38b471dbb866f81c6fb0b37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a863fa9ef38b471dbb866f81c6fb0b37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a863fa9ef38b471dbb866f81c6fb0b37"}]}] Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: a863fa9ef38b471dbb866f81c6fb0b37 Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 292ec7b4a0074e398d23452899458532 Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project Oct 02 01:01:13.314220 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:13.314819 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 02 01:01:13.315901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.320264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6052e20-fc39-4bdb-a709-0a9341a710ba tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:13.322912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c6052e20-fc39-4bdb-a709-0a9341a710ba tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.534745 Oct 02 01:01:13.330331 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 138/258] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:01:12 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 543 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:13.344671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-212348013"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:13.368912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.369612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.370365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.382056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.382873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.383884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.393879 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-212348013 could not be found. Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 57 Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:13.396232 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: {"add_host": {"host": "tempest-nonexist_host-212348013"}} Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:13.397404 n-d-master-1 devstack@n-api.service[122355]: exception: Compute host tempest-nonexist_host-212348013 could not be found. Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '10', 'body': {'add_host': {'host': 'tempest-nonexist_host-212348013'}}} Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-212348013' is not mapped to any cell Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.398105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 02 01:01:13.399180 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-212348013 could not be found. Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-212348013 could not be found. Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.400229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-212348013 could not be found. Oct 02 01:01:13.401342 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.404437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-212348013 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:13.406238 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1e32a14e-4f44-4fc7-8371-a67b32b569df tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 110 microversion: 2.1 time: 0.071344 Oct 02 01:01:13.410791 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 139/259] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:01:13 2022] POST /compute/v2.1/os-aggregates/10/action => generated 110 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:13.416795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64d5323e-f9af-453b-853f-72d36ffc5165 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.468000 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64d5323e-f9af-453b-853f-72d36ffc5165 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.055837 Oct 02 01:01:13.468722 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 140/260] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:13 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:13.483064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12744066-4e5d-48b1-a05e-617c310e1e64 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.485402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-12744066-4e5d-48b1-a05e-617c310e1e64 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '292ec7b4a0074e398d23452899458532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a863fa9ef38b471dbb866f81c6fb0b37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12744066-4e5d-48b1-a05e-617c310e1e64 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Request method failure captured: Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-02%2001:01:13 HTTP/1.1 Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLVARPmfXbPcn2ypXPVlOIL5qRXhdtfcw0ZFG0ln024wXcKxU2eIgKJu2Ich-SGQj6dYfo_F-MbX_Ah_7q414YAbXIVdcvXSb2MAzkTVLFFQwQG_1iMyoPKe8FmydLmgiufjycDTxtsniamlKbqLPkTMkbmSssxE-pxtW-6ceNdWME Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: a863fa9ef38b471dbb866f81c6fb0b37 Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:13.487159 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a863fa9ef38b471dbb866f81c6fb0b37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a863fa9ef38b471dbb866f81c6fb0b37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a863fa9ef38b471dbb866f81c6fb0b37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a863fa9ef38b471dbb866f81c6fb0b37"}]}] Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: a863fa9ef38b471dbb866f81c6fb0b37 Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 292ec7b4a0074e398d23452899458532 Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project Oct 02 01:01:13.488337 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '2022-10-02 01:01:13'} Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:13.488874 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 02 01:01:13.490399 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.491303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12744066-4e5d-48b1-a05e-617c310e1e64 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:13.491303 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12744066-4e5d-48b1-a05e-617c310e1e64 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720 tempest-InstanceUsageAuditLogNegativeTestJSON-416699720-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-02 01:01:13" status: 403 len: 128 microversion: 2.1 time: 0.011397 Oct 02 01:01:13.491303 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 141/261] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:01:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-02%2001%3A01%3A13 => generated 128 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:13.495298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed12ead9-1682-42a8-a42c-806edbba0216 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.537445 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed12ead9-1682-42a8-a42c-806edbba0216 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.046996 Oct 02 01:01:13.538054 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 142/262] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:13 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:13.551613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-507cca37-893c-490e-bb21-16cd2cc8b079 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1361598210", "availability_zone": "tempest-test_az-2059919509"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:13.563971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-507cca37-893c-490e-bb21-16cd2cc8b079 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid 222e6d14-9090-485c-8c77-5c88757ebf85 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:13.605962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-507cca37-893c-490e-bb21-16cd2cc8b079 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.066832 Oct 02 01:01:13.610815 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 143/263] 10.222.0.23 () {60 vars in 1165 bytes} [Sun Oct 2 01:01:13 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:13.628363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ad336fd-d08a-412d-91f6-5754b78d029e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ad336fd-d08a-412d-91f6-5754b78d029e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 283 Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:13.643561 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:13.644879 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:01:13.645429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:13.646002 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.646923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.647724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:01:13.647724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:01:13.647724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:01:13.647724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.653768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ad336fd-d08a-412d-91f6-5754b78d029e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:13.660899 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9ad336fd-d08a-412d-91f6-5754b78d029e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.043703 Oct 02 01:01:13.665397 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 144/264] 10.222.0.23 () {60 vars in 1165 bytes} [Sun Oct 2 01:01:13 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:13.689850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-888e1675-df09-43e8-a85e-515e0cadda02 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1361598210_new", "availability_zone": "tempest-test_az-2059919509_new"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.006943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:14.020440 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-561d1b10-769b-4b21-ae49-8ec7b7d1b593 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1273 microversion: 2.1 time: 0.819101 Oct 02 01:01:14.021043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 121/265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:13 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1273 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:14.038786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-888e1675-df09-43e8-a85e-515e0cadda02 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.042724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd4a958e-f723-4892-8bba-15668c509d0f tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.043557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-888e1675-df09-43e8-a85e-515e0cadda02 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.044195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-888e1675-df09-43e8-a85e-515e0cadda02 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd4a958e-f723-4892-8bba-15668c509d0f tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 27 Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:01:14.060276 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: {"aggregate": {"name": ""}} Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:14.061512 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '' Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:14.062213 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:01:14.064355 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.067099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd4a958e-f723-4892-8bba-15668c509d0f tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:14.068135 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd4a958e-f723-4892-8bba-15668c509d0f tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.039078 Oct 02 01:01:14.069204 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 122/266] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:14.078676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f540d20-ed2f-4a0c-9875-b4a849addbad tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2108102992"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.090329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f540d20-ed2f-4a0c-9875-b4a849addbad tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'e7eb017337d54e9e890d47f3d49d4ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f840ff0244f47ed96619e4649b2b143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f540d20-ed2f-4a0c-9875-b4a849addbad tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Request method failure captured: Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 60 Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKkW9wa6JptlAFIsx9KvImTN2XozuZrCLnAiISJpV0Jcg40pIMLdn2d_VRlAxo2FRkolR9covaUydDiq5rHRR1oVPuLBHzmXP7SNDle_TXRie8bJ0PIjvg_X0qUMngURImcSJmYx8RhNTbF3zX8lrysTuDP20Ob_Q2YMtb6Bb3PZSo Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:14.092397 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f840ff0244f47ed96619e4649b2b143"}]}] Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e7eb017337d54e9e890d47f3d49d4ae5 Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: {"aggregate": {"name": "tempest-test_aggregate-2108102992"}} Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:14.093556 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2108102992'}}} Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:14.094339 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:14.095381 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 02 01:01:14.096467 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.100064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f540d20-ed2f-4a0c-9875-b4a849addbad tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:14.103664 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f540d20-ed2f-4a0c-9875-b4a849addbad tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029119 Oct 02 01:01:14.105847 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 123/267] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:14 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:14.162420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-888e1675-df09-43e8-a85e-515e0cadda02 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 337 microversion: 2.1 time: 0.495333 Oct 02 01:01:14.163647 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 145/268] 10.222.0.23 () {60 vars in 1173 bytes} [Sun Oct 2 01:01:13 2022] PUT /compute/v2.1/os-aggregates/11 => generated 337 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:14.176103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d77d08b-d3f0-4e26-8d44-b179b0d94d4e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1782769176"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.190875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-3d77d08b-d3f0-4e26-8d44-b179b0d94d4e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid ba0505f2-27e8-4e9f-8cc2-a325eb1edfe8 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:14.293941 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d77d08b-d3f0-4e26-8d44-b179b0d94d4e tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.128902 Oct 02 01:01:14.308744 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 146/269] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:14.323819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f2fabf2-28ee-46c0-a126-4c0f8b0dc3a7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.343276 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f2fabf2-28ee-46c0-a126-4c0f8b0dc3a7 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 555 microversion: 2.1 time: 0.032147 Oct 02 01:01:14.352792 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 147/270] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:01:14 2022] GET /compute/v2.1/os-aggregates => generated 555 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:14.357619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1968008b-3786-416e-98d1-b6051d9701e1 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1782769176"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.362878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-1968008b-3786-416e-98d1-b6051d9701e1 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid c5b2dcc1-efb9-4a74-8f42-258f4a0a725b for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:14.401835 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1968008b-3786-416e-98d1-b6051d9701e1 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1782769176 already exists. Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1968008b-3786-416e-98d1-b6051d9701e1 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 60 Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:14.412323 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: {"aggregate": {"name": "tempest-test_aggregate-1782769176"}} Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:14.413806 n-d-master-1 devstack@n-api.service[122355]: exception: Aggregate tempest-test_aggregate-1782769176 already exists. Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1782769176'}}} Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 02 01:01:14.414674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1782769176 already exists. Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:14.415914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1782769176 already exists. Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1782769176 already exists. Oct 02 01:01:14.417352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.422699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1968008b-3786-416e-98d1-b6051d9701e1 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1782769176 already exists. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:14.426476 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1968008b-3786-416e-98d1-b6051d9701e1 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.072539 Oct 02 01:01:14.437202 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 148/271] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:14 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:14.445145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6b2281a-e29e-4810-9eb2-12bbc6af2d74 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.478623 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a6b2281a-e29e-4810-9eb2-12bbc6af2d74 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.038947 Oct 02 01:01:14.479465 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 149/272] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:14.490766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8de6ee3-2d25-43ef-916b-d6af8bf92d4c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.533247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.533926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:14.540429 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8de6ee3-2d25-43ef-916b-d6af8bf92d4c tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.053554 Oct 02 01:01:14.541993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.542407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.542870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.543582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.544244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.544823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.549796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 150/273] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:14.558528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f7703ed-2806-478d-9fe3-3c1e2f66f2a1 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-926585017"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.569458 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-9f7703ed-2806-478d-9fe3-3c1e2f66f2a1 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Generated uuid 318e48f5-9ff5-4029-bfef-211d415fe88b for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:14.596716 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f7703ed-2806-478d-9fe3-3c1e2f66f2a1 tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045634 Oct 02 01:01:14.611476 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 151/274] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:14.624647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8196d1d-c766-402b-91e9-7f43e72048fc tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1411566860"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:14.633186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-c8196d1d-c766-402b-91e9-7f43e72048fc tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid e82f637f-123a-4853-a1f4-c10c191b8274 for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:14.691244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8196d1d-c766-402b-91e9-7f43e72048fc tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.075082 Oct 02 01:01:14.701962 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 152/275] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:14.720355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eff6c959-33ae-4a7f-87eb-f2eaa309c0ce tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.741597 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eff6c959-33ae-4a7f-87eb-f2eaa309c0ce tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.034494 Oct 02 01:01:14.748990 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 153/276] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:01:14 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:14.754486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efe8d4c9-0d5a-4043-88b5-acd16b4a1dc7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.772946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-efe8d4c9-0d5a-4043-88b5-acd16b4a1dc7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'e7eb017337d54e9e890d47f3d49d4ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f840ff0244f47ed96619e4649b2b143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efe8d4c9-0d5a-4043-88b5-acd16b4a1dc7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Request method failure captured: Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKkW9wa6JptlAFIsx9KvImTN2XozuZrCLnAiISJpV0Jcg40pIMLdn2d_VRlAxo2FRkolR9covaUydDiq5rHRR1oVPuLBHzmXP7SNDle_TXRie8bJ0PIjvg_X0qUMngURImcSJmYx8RhNTbF3zX8lrysTuDP20Ob_Q2YMtb6Bb3PZSo Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:14.775189 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f840ff0244f47ed96619e4649b2b143"}]}] Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: e7eb017337d54e9e890d47f3d49d4ae5 Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 02 01:01:14.776370 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '14'} Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:14.777045 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:14.778067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efe8d4c9-0d5a-4043-88b5-acd16b4a1dc7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:14.779848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-efe8d4c9-0d5a-4043-88b5-acd16b4a1dc7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.026582 Oct 02 01:01:14.779848 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 154/277] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:14.791259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dc400b1-2240-4f7a-8222-352697e9c8cd tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.843330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9dc400b1-2240-4f7a-8222-352697e9c8cd tempest-AggregatesAdminTestJSON-1909171970 tempest-AggregatesAdminTestJSON-1909171970-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.061205 Oct 02 01:01:14.844248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 155/278] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:14.858824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc458334-9520-47bb-82a1-92f5ba2588de tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.920702 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc458334-9520-47bb-82a1-92f5ba2588de tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.074901 Oct 02 01:01:14.921348 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 156/279] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:14.931831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:14.932337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:14.952777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.953821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.954361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:14.955106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:14.955561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:14.955987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.042199 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] HTTP exception thrown: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Request method failure captured: Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 HTTP/1.1 Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKjaVGkdfVLZDCQ0GBwhJ9VBEZC8Psu7WppWyDlBSldMaSzhZRACAKIOT4VuPtroRzbly1QrHuB-Pbcg1vcxitpvh6Oa5laINOlBfcCX33aa_at5IH7Azrc8FUwGG4TajMlkURDKRJw1SexbcGyRMChPV-4NCeI3EumOlVzGX97X5c Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2593cd49763c4c02ac5f7b30b03a0366 Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:15.052180 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2593cd49763c4c02ac5f7b30b03a0366"}]}] Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2593cd49763c4c02ac5f7b30b03a0366 Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminTestJSON-175002889-project Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: ae3c3aba9b784076beb1b6713a439f78 Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminTestJSON-175002889-project Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.053739 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0'} Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.054580 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.055908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.062082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Returning 404 to user: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.074281 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c90dff93-cff1-4bae-bcb0-b790f2f2c727 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 404 len: 111 microversion: 2.1 time: 0.148314 Oct 02 01:01:15.075093 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 157/280] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:14 2022] DELETE /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:15.091496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a8fa941-51c8-49fd-8f74-f8378c3ee286 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.129569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9a8fa941-51c8-49fd-8f74-f8378c3ee286 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a8fa941-51c8-49fd-8f74-f8378c3ee286 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:15.136514 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: exception: Aggregate -1 could not be found. Oct 02 01:01:15.138070 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '-1'} Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 02 01:01:15.138908 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.140222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.141797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a8fa941-51c8-49fd-8f74-f8378c3ee286 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.144151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:15.148888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a8fa941-51c8-49fd-8f74-f8378c3ee286 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.070851 Oct 02 01:01:15.153136 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 158/281] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:15 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:15.159650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-525f468b-d52b-43bc-8d45-068ad7ec578f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 1.049731 Oct 02 01:01:15.160105 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 124/282] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:14 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:15.164678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.173499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] [instance: c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:15.174016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.178522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:15.194299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.194823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.195263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.195865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.196000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.196365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.196491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.196805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.196912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.197523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.197983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.208191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.219255 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] HTTP exception thrown: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Request method failure captured: Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 HTTP/1.1 Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKjaVGkdfVLZDCQ0GBwhJ9VBEZC8Psu7WppWyDlBSldMaSzhZRACAKIOT4VuPtroRzbly1QrHuB-Pbcg1vcxitpvh6Oa5laINOlBfcCX33aa_at5IH7Azrc8FUwGG4TajMlkURDKRJw1SexbcGyRMChPV-4NCeI3EumOlVzGX97X5c Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2593cd49763c4c02ac5f7b30b03a0366 Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:15.220908 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2593cd49763c4c02ac5f7b30b03a0366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2593cd49763c4c02ac5f7b30b03a0366"}]}] Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2593cd49763c4c02ac5f7b30b03a0366 Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-175002889 Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminTestJSON-175002889-project Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: ae3c3aba9b784076beb1b6713a439f78 Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminTestJSON-175002889-project Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.222294 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0'} Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.223126 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. Oct 02 01:01:15.224388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.225612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] Returning 404 to user: Instance c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.231201 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3b6ed15-85fa-401a-a51d-6c61b67a4557 tempest-AggregatesAdminTestJSON-175002889 tempest-AggregatesAdminTestJSON-175002889-project] 10.222.0.23 "GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0" status: 404 len: 111 microversion: 2.1 time: 0.069955 Oct 02 01:01:15.231788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 125/283] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:15 2022] GET /compute/v2.1/servers/c526f6cb-2e69-4ea6-b5ca-33f0a82d33b0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:15.245964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8be13a66-f52f-49e1-9476-ea184cb833d8 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1875344293"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:15.259001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-8be13a66-f52f-49e1-9476-ea184cb833d8 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid 5b298da1-8be8-45f8-bb31-16f222da9189 for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:15.304485 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8be13a66-f52f-49e1-9476-ea184cb833d8 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062036 Oct 02 01:01:15.307776 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 126/284] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:15.321063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d785d184-c323-45e4-97d1-6165b3d1102a tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.322700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d785d184-c323-45e4-97d1-6165b3d1102a tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'e7eb017337d54e9e890d47f3d49d4ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f840ff0244f47ed96619e4649b2b143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d785d184-c323-45e4-97d1-6165b3d1102a tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Request method failure captured: Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKkW9wa6JptlAFIsx9KvImTN2XozuZrCLnAiISJpV0Jcg40pIMLdn2d_VRlAxo2FRkolR9covaUydDiq5rHRR1oVPuLBHzmXP7SNDle_TXRie8bJ0PIjvg_X0qUMngURImcSJmYx8RhNTbF3zX8lrysTuDP20Ob_Q2YMtb6Bb3PZSo Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:15.326628 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f840ff0244f47ed96619e4649b2b143"}]}] Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e7eb017337d54e9e890d47f3d49d4ae5 Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 02 01:01:15.327944 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '15'} Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:15.328958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.331365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d785d184-c323-45e4-97d1-6165b3d1102a tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.332384 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d785d184-c323-45e4-97d1-6165b3d1102a tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.013144 Oct 02 01:01:15.332586 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 127/285] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:15 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:01:15.344315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a09883e-8613-47a9-b9eb-192629518b27 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.395699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a09883e-8613-47a9-b9eb-192629518b27 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.055109 Oct 02 01:01:15.398210 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 128/286] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:15 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:15.416862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d0740c6-8550-41a0-a413-f2b6bd8f28f5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.429981 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8d0740c6-8550-41a0-a413-f2b6bd8f28f5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d0740c6-8550-41a0-a413-f2b6bd8f28f5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:01:15.432446 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: exception: Aggregate -1 could not be found. Oct 02 01:01:15.433747 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '-1'} Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.434659 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 02 01:01:15.435909 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.437151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d0740c6-8550-41a0-a413-f2b6bd8f28f5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.437151 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d0740c6-8550-41a0-a413-f2b6bd8f28f5 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031158 Oct 02 01:01:15.439212 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 129/287] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:01:15 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:15.451279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e34af7ad-10e3-45d1-8083-79a032c518e7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:15.455854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e34af7ad-10e3-45d1-8083-79a032c518e7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'e7eb017337d54e9e890d47f3d49d4ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f840ff0244f47ed96619e4649b2b143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e34af7ad-10e3-45d1-8083-79a032c518e7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Request method failure captured: Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKkW9wa6JptlAFIsx9KvImTN2XozuZrCLnAiISJpV0Jcg40pIMLdn2d_VRlAxo2FRkolR9covaUydDiq5rHRR1oVPuLBHzmXP7SNDle_TXRie8bJ0PIjvg_X0qUMngURImcSJmYx8RhNTbF3zX8lrysTuDP20Ob_Q2YMtb6Bb3PZSo Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:15.461362 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f840ff0244f47ed96619e4649b2b143"}]}] Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e7eb017337d54e9e890d47f3d49d4ae5 Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 02 01:01:15.462750 n-d-master-1 devstack@n-api.service[122354]: action_args: {} Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:15.463547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 02 01:01:15.465004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.468018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e34af7ad-10e3-45d1-8083-79a032c518e7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.472461 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e34af7ad-10e3-45d1-8083-79a032c518e7 tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.027125 Oct 02 01:01:15.474909 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 130/288] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:01:15 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:01:15.480663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:15.496482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b33619ab-8973-4e50-bc28-fe0b0d83dd7d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1271 microversion: 2.1 time: 0.341997 Oct 02 01:01:15.523738 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 159/289] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:15 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1271 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:15.530507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-239d4ab7-6b7a-4507-965a-0f6a985000fd tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-703285414"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:15.542527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-239d4ab7-6b7a-4507-965a-0f6a985000fd tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid 44c74ca5-cce8-4314-9bc1-29d9dbd0935e for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:15.589930 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-239d4ab7-6b7a-4507-965a-0f6a985000fd tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098490 Oct 02 01:01:15.592065 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 131/290] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:15.607948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-74d6346c-d7ad-4ac7-a8fb-b5ee5a4d0a41 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:15.616154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188f4b83-8e80-45f4-9be3-513a2f021e12", "tag": "ecdd37ff-a07b-4d5f-aa4c-04d4c5654386"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:15.643174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.648765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74d6346c-d7ad-4ac7-a8fb-b5ee5a4d0a41 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.649638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74d6346c-d7ad-4ac7-a8fb-b5ee5a4d0a41 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.651196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74d6346c-d7ad-4ac7-a8fb-b5ee5a4d0a41 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.651740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.652366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.671187 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=76,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:15.703068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Creating event network-changed:ecdd37ff-a07b-4d5f-aa4c-04d4c5654386 for instance 188f4b83-8e80-45f4-9be3-513a2f021e12 on n-h2-master-1 Oct 02 01:01:15.705282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:01:15.707623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89990c54-242b-478f-8133-728c6432097f req-33854bfd-0ea6-44cb-9e38-cbe59e69dafd service nova] Acquired lock "compute-rpcapi-router" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:01:15.709225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.712588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.713424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.736621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.737109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.737546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:15.778107 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.rpcapi [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 02 01:01:15.780035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] Releasing lock "compute-rpcapi-router" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:01:15.828297 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-966efb40-abc2-449a-8101-656ffcf5d4b0 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215216 Oct 02 01:01:15.829208 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 132/291] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:15.854985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-74d6346c-d7ad-4ac7-a8fb-b5ee5a4d0a41 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 242 microversion: 2.1 time: 0.254983 Oct 02 01:01:15.856251 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 160/292] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:01:15 2022] POST /compute/v2.1/os-aggregates/16/action => generated 242 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:15.872084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e89f87f8-b2b3-4a48-8555-3a1f1403124c tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:15.876501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e89f87f8-b2b3-4a48-8555-3a1f1403124c tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'e7eb017337d54e9e890d47f3d49d4ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f840ff0244f47ed96619e4649b2b143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e89f87f8-b2b3-4a48-8555-3a1f1403124c tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Request method failure captured: Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 42 Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOKkW9wa6JptlAFIsx9KvImTN2XozuZrCLnAiISJpV0Jcg40pIMLdn2d_VRlAxo2FRkolR9covaUydDiq5rHRR1oVPuLBHzmXP7SNDle_TXRie8bJ0PIjvg_X0qUMngURImcSJmYx8RhNTbF3zX8lrysTuDP20Ob_Q2YMtb6Bb3PZSo Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:01:15.878416 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f840ff0244f47ed96619e4649b2b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f840ff0244f47ed96619e4649b2b143"}]}] Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3f840ff0244f47ed96619e4649b2b143 Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875604651 Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e7eb017337d54e9e890d47f3d49d4ae5 Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875604651-project Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: {"remove_host": {"host": "n-h2-master-1"}} Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:01:15.879770 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h2-master-1'}}} Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:15.880475 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 02 01:01:15.881454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:01:15.890409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e89f87f8-b2b3-4a48-8555-3a1f1403124c tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:15.891632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e89f87f8-b2b3-4a48-8555-3a1f1403124c tempest-AggregatesAdminNegativeTestJSON-875604651 tempest-AggregatesAdminNegativeTestJSON-875604651-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.025823 Oct 02 01:01:15.892674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 133/293] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:01:15 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:15.901330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7360cef4-ccde-4feb-8686-ead7517ba231 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:15.921701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7360cef4-ccde-4feb-8686-ead7517ba231 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:15.923615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7360cef4-ccde-4feb-8686-ead7517ba231 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:15.924097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7360cef4-ccde-4feb-8686-ead7517ba231 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.190812 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7360cef4-ccde-4feb-8686-ead7517ba231 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 227 microversion: 2.1 time: 0.293500 Oct 02 01:01:16.192273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 161/294] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:01:15 2022] POST /compute/v2.1/os-aggregates/16/action => generated 227 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:16.196375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:16.202498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:16.248826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.249340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.250363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.250533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.250753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a918b9d-8dfe-467f-9f41-bd6f0d901a73 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:16.255383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.259069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.317697 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a918b9d-8dfe-467f-9f41-bd6f0d901a73 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.108279 Oct 02 01:01:16.321861 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 162/295] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:16 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:16.340620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c462f705-ebc3-476a-ae9f-9899152a905a tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-753431068"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:16.353152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.aggregate [None req-c462f705-ebc3-476a-ae9f-9899152a905a tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Generated uuid 34790c3d-9f54-4848-8895-d6fe832cd5db for aggregate {{(pid=122355) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:16.461395 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c462f705-ebc3-476a-ae9f-9899152a905a tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.134407 Oct 02 01:01:16.464711 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 163/296] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:01:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:16.483529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:16.522522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.523318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.523614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.559503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.571929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.572491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.606775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.compute.aggregates [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 02 01:01:16.607343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Request method failure captured: Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 42 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOKn5sq5WM9Qy9y3zdUtl4ftVjghUjBLvwFHfcaed9k4KlhC_00t36Fw5Mgd-02EF7qzgNyUDrdfVRNWLat6k2LiXo62y57F7elRPuQ98u8b7Y6wqSnaODY4qDtRti6hpON5b9ucO3-vi9tGHwaBq4SLprxag8SBdeHJWcDGfsjaLOk Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:01:16.609872 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a5c33d549154bfc943a09250e484448"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a5c33d549154bfc943a09250e484448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a5c33d549154bfc943a09250e484448"}]}] Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8a5c33d549154bfc943a09250e484448 Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-845661941 Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c5b747c0d24a4ab891f4e5b8e53ea707 Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: {"remove_host": {"host": "nonexist_host"}} Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:16.611299 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot remove host nonexist_host in aggregate 17 Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 02 01:01:16.612077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 02 01:01:16.613170 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.614291 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:16.619199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:16.619199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:16.619199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:16.619199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:16.619199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Oct 02 01:01:16.619199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:16.629195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:16.631997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-195e1b58-a53b-4e63-ab6d-da85fc7eace7 tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.160951 Oct 02 01:01:16.632756 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 164/297] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:01:16 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:01:16.663708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:16.665128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:16.682657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.683462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.684160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.685700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:16.686393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:16.689503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:16.875828 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=24 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:16.926444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:16.935913 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be0af9b8-c73e-47ed-8233-c6b39e176e4e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.752881 Oct 02 01:01:16.938848 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 134/298] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:16 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:16.949263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:16.977744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27a0b888-911a-478d-8c1e-28e4f39901bd tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:16.981273 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c6c34d7-3332-4bb9-81a1-91d4d0baaabd tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1271 microversion: 2.1 time: 0.340304 Oct 02 01:01:16.992202 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 165/299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:16 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:17.028120 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27a0b888-911a-478d-8c1e-28e4f39901bd tempest-AggregatesAdminNegativeTestJSON-845661941 tempest-AggregatesAdminNegativeTestJSON-845661941-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.088101 Oct 02 01:01:17.028724 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 135/300] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:01:16 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:01:17.369517 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:17.753839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1ffe97a-5cd9-483a-8278-22982f5a18fd tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2041819129", "id": 1065830201, "os-flavor-access:is_public": "True"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:17.792545 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1ffe97a-5cd9-483a-8278-22982f5a18fd tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.795983 Oct 02 01:01:17.793599 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 166/301] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:01:16 2022] POST /compute/v2.1/flavors => generated 449 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:17.966631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:17.967538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:17.980111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:17.983523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:17.985714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:17.987692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:17.989043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:17.989515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.478289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:18.494009 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a6b0eeca-ca82-4748-9f2e-198d4e2a8450 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.526253 Oct 02 01:01:18.495725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 167/302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:17 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:18.508517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:18.509513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:18.529680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:18.530177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:18.530636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.536147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:18.536624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:18.537058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.749477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac7185fb-06c2-4598-a015-7132e2b7e7a2 tempest-FlavorsV255TestJSON-1631887862 tempest-FlavorsV255TestJSON-1631887862-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:18.783989 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac7185fb-06c2-4598-a015-7132e2b7e7a2 tempest-FlavorsV255TestJSON-1631887862 tempest-FlavorsV255TestJSON-1631887862-project] 10.222.0.23 "GET /compute/v2.1/flavors/1065830201" status: 200 len: 449 microversion: 2.55 time: 0.974676 Oct 02 01:01:18.794457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 136/303] 10.222.0.23 () {60 vars in 1199 bytes} [Sun Oct 2 01:01:17 2022] GET /compute/v2.1/flavors/1065830201 => generated 449 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:18.800609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8e7c6b66-8b38-4824-9b80-052eac4c5330 req-01ba556c-ecf6-4400-b859-1773daa3f113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775f37dc-d601-4e83-a9ea-57791e2e7f18", "tag": "7eacb9f2-99c6-49e9-880b-595f501b106e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:18.815762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8e7c6b66-8b38-4824-9b80-052eac4c5330 req-01ba556c-ecf6-4400-b859-1773daa3f113 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:18.816408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8e7c6b66-8b38-4824-9b80-052eac4c5330 req-01ba556c-ecf6-4400-b859-1773daa3f113 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:18.817261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8e7c6b66-8b38-4824-9b80-052eac4c5330 req-01ba556c-ecf6-4400-b859-1773daa3f113 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:18.829748 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8e7c6b66-8b38-4824-9b80-052eac4c5330 req-01ba556c-ecf6-4400-b859-1773daa3f113 service nova] Creating event network-changed:7eacb9f2-99c6-49e9-880b-595f501b106e for instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 on n-h1-master-1 Oct 02 01:01:18.835407 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8e7c6b66-8b38-4824-9b80-052eac4c5330 req-01ba556c-ecf6-4400-b859-1773daa3f113 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039248 Oct 02 01:01:18.836508 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 137/304] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:18.841728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98566519-d440-432e-88f4-77b1396d38d8 tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] Action: 'update', calling method: .version_select at 0x7fb8831f65e0>, body: {"flavor": {"description": "new"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:18.883873 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-98566519-d440-432e-88f4-77b1396d38d8 tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1065830201" status: 200 len: 450 microversion: 2.55 time: 0.045806 Oct 02 01:01:18.884510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 138/305] 10.222.0.23 () {62 vars in 1219 bytes} [Sun Oct 2 01:01:18 2022] PUT /compute/v2.1/flavors/1065830201 => generated 450 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:18.902047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77de8785-b943-4866-9411-bc219604744a tempest-FlavorsV255TestJSON-1631887862 tempest-FlavorsV255TestJSON-1631887862-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:18.933242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77de8785-b943-4866-9411-bc219604744a tempest-FlavorsV255TestJSON-1631887862 tempest-FlavorsV255TestJSON-1631887862-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.039414 Oct 02 01:01:18.934405 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 139/306] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:01:18 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:18.956087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-228873a4-3182-491b-95a5-79c86396fabc tempest-FlavorsV255TestJSON-1631887862 tempest-FlavorsV255TestJSON-1631887862-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.013429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-228873a4-3182-491b-95a5-79c86396fabc tempest-FlavorsV255TestJSON-1631887862 tempest-FlavorsV255TestJSON-1631887862-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.058961 Oct 02 01:01:19.015979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 140/307] 10.222.0.23 () {60 vars in 1166 bytes} [Sun Oct 2 01:01:18 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:19.035271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03252296-1a80-430d-8fde-84cec0a813ee tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.069800 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03252296-1a80-430d-8fde-84cec0a813ee tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1065830201" status: 202 len: 0 microversion: 2.55 time: 0.042110 Oct 02 01:01:19.070396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 141/308] 10.222.0.23 () {60 vars in 1202 bytes} [Sun Oct 2 01:01:19 2022] DELETE /compute/v2.1/flavors/1065830201 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:01:19.078840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c2d7107a-cb2b-4191-9d35-2625a05469cb tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.103918 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c2d7107a-cb2b-4191-9d35-2625a05469cb tempest-FlavorsV255TestJSON-501422035 tempest-FlavorsV255TestJSON-501422035-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.029219 Oct 02 01:01:19.105148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 142/309] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:01:19 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:01:19.222308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:19.233785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-691d92fc-dcad-4b47-b222-244f7c42f559 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.733562 Oct 02 01:01:19.234974 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 168/310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:18 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:19.520443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:19.521189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:19.528453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.528949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.529382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:19.530104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:19.530567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:19.553391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.258493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:20.259731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:20.273188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:20.273912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:20.274494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.275363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:20.275989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:20.276559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:20.527401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:20.539188 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d4a96f94-7e17-4324-8b38-f3e48339e35d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 1.023774 Oct 02 01:01:20.540085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 143/311] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:19 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:20.729915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:20.747876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1337f7f-b3ff-490a-9300-8473799727e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.493406 Oct 02 01:01:20.748814 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 169/312] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:20 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:21.017659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1802879828", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:21.084025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:21.501267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:21.501712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:21.502176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:21.502585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:21.503033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:21.520258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:21.521036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:21.521834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:21.530899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:21.532904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:21.534295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:21.563301 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:21.568878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:21.570236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:21.586247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Getting quotas for project 9de523ba73a54067a287aa17f43cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:21.591456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:21.592316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:21.593005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:21.597544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Getting quotas for user 6d9e1b41a5ce40c292c45ab1bfacb020 and project 9de523ba73a54067a287aa17f43cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:21.598186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:21.601588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:21.603387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:21.618383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:21.624698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:21.745928 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc9e19a8-70d5-407c-a109-8119e6536f0c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204607 Oct 02 01:01:21.758711 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 144/313] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:21.772742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d2d5d75-fe45-4c6a-80ca-4a6aa227fb91 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:21.781659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d2d5d75-fe45-4c6a-80ca-4a6aa227fb91 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:22.039594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d2d5d75-fe45-4c6a-80ca-4a6aa227fb91 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:22.048491 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d2d5d75-fe45-4c6a-80ca-4a6aa227fb91 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1223 microversion: 2.1 time: 0.288572 Oct 02 01:01:22.049074 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 145/314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:21 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1223 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:22.086937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:22.087494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:22.114093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:22.114591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:22.115054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:22.115760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:22.116217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:22.116647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:22.170126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:22.189343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-079fc0d9-2db8-4d5f-87db-6bfb904c2495 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.626615 Oct 02 01:01:22.207691 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 170/315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:21 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:22.422243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:22.454121 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12a9428f-8edb-48fc-8fbe-fb0a1a57ccbe tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.370957 Oct 02 01:01:22.466622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 146/316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:22 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:22.547940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a726dbfe-3e73-45c1-be85-b87535b2120b req-62faeec9-c2dc-4b46-9dac-6dba0824e19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aed604a-438c-4186-8e6e-45b720522f75", "tag": "47d4705d-cc43-4595-8156-d2c4d5e30f47"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:22.565050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a726dbfe-3e73-45c1-be85-b87535b2120b req-62faeec9-c2dc-4b46-9dac-6dba0824e19a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:22.565534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a726dbfe-3e73-45c1-be85-b87535b2120b req-62faeec9-c2dc-4b46-9dac-6dba0824e19a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:22.565958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a726dbfe-3e73-45c1-be85-b87535b2120b req-62faeec9-c2dc-4b46-9dac-6dba0824e19a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:22.592391 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a726dbfe-3e73-45c1-be85-b87535b2120b req-62faeec9-c2dc-4b46-9dac-6dba0824e19a service nova] Creating event network-changed:47d4705d-cc43-4595-8156-d2c4d5e30f47 for instance 6aed604a-438c-4186-8e6e-45b720522f75 on n-h1-master-1 Oct 02 01:01:22.603548 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a726dbfe-3e73-45c1-be85-b87535b2120b req-62faeec9-c2dc-4b46-9dac-6dba0824e19a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393990 Oct 02 01:01:22.605391 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 171/317] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:23.076067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.076770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.092724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.095494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.096472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.097242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.097762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.098234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.223575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.224589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.238298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.240914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.241531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.242514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.244193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.245801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.337450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.353125 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f9e0cd1-011c-4b5f-b598-e03df7e3d801 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1275 microversion: 2.1 time: 0.281538 Oct 02 01:01:23.362380 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 147/318] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:23 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:23.480887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.481888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.488703 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=85,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:23.532233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.537546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.538080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.538927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.539617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.546099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.735956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.752804 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c81947c-36df-44fd-a87c-83b91069a354 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.535108 Oct 02 01:01:23.753390 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 172/319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:23 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:23.968424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-591cc0f1-485e-45e0-aa10-26d3d95f1e97 req-20513fbe-2ee8-4077-b39a-3b8b0ce68a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188f4b83-8e80-45f4-9be3-513a2f021e12", "name": "network-vif-plugged", "status": "completed", "tag": "ecdd37ff-a07b-4d5f-aa4c-04d4c5654386"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:23.990375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-591cc0f1-485e-45e0-aa10-26d3d95f1e97 req-20513fbe-2ee8-4077-b39a-3b8b0ce68a43 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.990886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-591cc0f1-485e-45e0-aa10-26d3d95f1e97 req-20513fbe-2ee8-4077-b39a-3b8b0ce68a43 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.993919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-591cc0f1-485e-45e0-aa10-26d3d95f1e97 req-20513fbe-2ee8-4077-b39a-3b8b0ce68a43 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.029041 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-591cc0f1-485e-45e0-aa10-26d3d95f1e97 req-20513fbe-2ee8-4077-b39a-3b8b0ce68a43 service nova] Creating event network-vif-plugged:ecdd37ff-a07b-4d5f-aa4c-04d4c5654386 for instance 188f4b83-8e80-45f4-9be3-513a2f021e12 on n-h2-master-1 Oct 02 01:01:24.047017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-591cc0f1-485e-45e0-aa10-26d3d95f1e97 req-20513fbe-2ee8-4077-b39a-3b8b0ce68a43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086766 Oct 02 01:01:24.052238 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 173/320] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:24.382013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:24.382758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:24.393441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.394855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.396581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.397963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.400370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.401051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.484849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:24.498078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9837504d-ed92-4b09-87f6-2ddb2f28957d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 1.021785 Oct 02 01:01:24.501382 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 148/321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:23 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:24.559861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:24.571192 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-936e76a4-143d-48dd-83a3-debc078628e5 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1281 microversion: 2.1 time: 0.193423 Oct 02 01:01:24.588058 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 174/322] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:24 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:24.777892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:24.778713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:24.794024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.799281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.799895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.800966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.804098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.804662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.241981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.252315 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b5aed7c-49cb-4284-919d-e8fffe99b749 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.478141 Oct 02 01:01:25.256094 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 149/323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:24 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:25.389234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5bebd9cf-2a78-4774-922e-2e2942e708ec tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Action: 'create', calling method: .version_select at 0x7fb881ea61f0>, body: {"keypair": {"name": "tempest-keypair-2097489864", "type": "ssh", "user_id": "85df35ef26914607834c5353899750ea", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP42RLSFHN/nKDifqPPWpwZEbxNosaPiHP05WW/qGcU1WyktOD61RL3BUbdWvPLNRUvYo1GrQJEnNMUP6zebOplP51FdntXtzrB/AgVAgChWg7RPrfCTvN4fhvaB7lCDOQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:25.435874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-5bebd9cf-2a78-4774-922e-2e2942e708ec tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Getting quotas for project 4b23486512c747eb8056cd09047996a4. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:25.448463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-5bebd9cf-2a78-4774-922e-2e2942e708ec tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Getting quotas for user 19e19fadf1ce42c9a6903b062e83a681 and project 4b23486512c747eb8056cd09047996a4. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:25.507589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5bebd9cf-2a78-4774-922e-2e2942e708ec tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.607133 Oct 02 01:01:25.508775 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 175/324] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:01:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 609 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 02 01:01:25.525077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b143bd4c-e48f-45ad-8d08-b3b34a57b955 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Action: 'create', calling method: .version_select at 0x7fb881dee940>, body: {"keypair": {"name": "tempest-keypair-1851492118", "type": "ssh", "user_id": "85df35ef26914607834c5353899750ea", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMd231cy56ztjyDWtzvE/vkrh6S+RWo0+lLZPdtTuJXCVpUqPQ+DSLJh3reQt1nU3lDDHAu1QO3R84eV2gFhW3hKtxMhudAWoEvO8ap1nem7uxTRpH1h+oOpawzX85xew=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:25.530955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:25.531792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:25.552552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.553115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.553569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.554325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.554811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.555242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.582394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b143bd4c-e48f-45ad-8d08-b3b34a57b955 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Getting quotas for project 4b23486512c747eb8056cd09047996a4. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:25.594283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b143bd4c-e48f-45ad-8d08-b3b34a57b955 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Getting quotas for user 19e19fadf1ce42c9a6903b062e83a681 and project 4b23486512c747eb8056cd09047996a4. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:25.663937 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b143bd4c-e48f-45ad-8d08-b3b34a57b955 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.142842 Oct 02 01:01:25.665120 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 150/325] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:01:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 02 01:01:25.672113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:25.675824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:25.693012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.697420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.697420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.697878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.699562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.703974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.963970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.986647 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-642f599c-2d3a-4a9b-a339-35d743eb37f7 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1281 microversion: 2.1 time: 0.307630 Oct 02 01:01:25.988184 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 151/326] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:25 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1281 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:25.993004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f4b2b219-5a49-4097-8bc3-865f0cdddd22 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Calling method '.version_select at 0x7fb881dd90d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.010946 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f4b2b219-5a49-4097-8bc3-865f0cdddd22 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-2097489864?user_id=85df35ef26914607834c5353899750ea" status: 200 len: 512 microversion: 2.10 time: 0.019026 Oct 02 01:01:26.019867 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 152/327] 10.222.0.23 () {60 vars in 1340 bytes} [Sun Oct 2 01:01:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2097489864?user_id=85df35ef26914607834c5353899750ea => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:26.324351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.339307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a470732-43cf-463a-92af-c1b2932f76cf tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.819199 Oct 02 01:01:26.340368 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 176/328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:25 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:26.360915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b50a33d3-b00c-4cce-bb98-44418f9f995e tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Action: 'create', calling method: .version_select at 0x7fb881c7e550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1781941769", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNlA9FEqRNW3O3xE6c8kKB30s1R37oS0/oS47cInB0NWcwypkRTmP7FYLjBsCmgBqSpGHiaFwTJlW7NkIHqF7czeP9hyJQOhQGwcyXwlIIO3hVTIf74w2h8A870P8fvSg=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:26.424580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b50a33d3-b00c-4cce-bb98-44418f9f995e tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Getting quotas for project 4b23486512c747eb8056cd09047996a4. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:26.442209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b50a33d3-b00c-4cce-bb98-44418f9f995e tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Getting quotas for user 19e19fadf1ce42c9a6903b062e83a681 and project 4b23486512c747eb8056cd09047996a4. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:26.493618 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b50a33d3-b00c-4cce-bb98-44418f9f995e tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.150788 Oct 02 01:01:26.496168 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 177/329] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:01:26 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:01:26.501508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.505903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.520604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.525297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.526043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.527431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.528078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.528838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.553054 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:26.559921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Calling method '.version_select at 0x7fb8832edee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.567973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.568626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.569536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.603237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.603737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.604180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.642021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.642519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.643725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.652768 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5746b60-6bea-46e5-8010-9577bb0a5af1 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.631837 Oct 02 01:01:26.669904 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 153/330] 10.222.0.23 () {60 vars in 1208 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:26.678948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5a3f856-c5d4-4d7f-81b1-3806dd83071b tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Calling method '.version_select at 0x7fb881d6d700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.684144 n-d-master-1 devstack@n-api.service[122354]: WARNING oslo_db.sqlalchemy.utils [None req-f5a3f856-c5d4-4d7f-81b1-3806dd83071b tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 02 01:01:26.694448 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5a3f856-c5d4-4d7f-81b1-3806dd83071b tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=85df35ef26914607834c5353899750ea" status: 200 len: 726 microversion: 2.10 time: 0.021039 Oct 02 01:01:26.695447 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 154/331] 10.222.0.23 () {60 vars in 1259 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/os-keypairs?user_id=85df35ef26914607834c5353899750ea => generated 726 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:26.702569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc07bb22-8bf6-421f-9f87-6095753b6921 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-655585686"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:26.711360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-fc07bb22-8bf6-421f-9f87-6095753b6921 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Generated uuid dff7566d-5ed2-47c7-aeb4-0a051dfdcf0f for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:01:26.754253 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc07bb22-8bf6-421f-9f87-6095753b6921 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.055800 Oct 02 01:01:26.754927 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 155/332] 10.222.0.23 () {62 vars in 1205 bytes} [Sun Oct 2 01:01:26 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:26.798101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a61c402-58db-4988-8b2d-ff2296620fc7 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Calling method '.version_select at 0x7fb881ce7790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.863987 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a61c402-58db-4988-8b2d-ff2296620fc7 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1781941769" status: 204 len: 0 microversion: 2.10 time: 0.100340 Oct 02 01:01:26.864599 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 156/333] 10.222.0.23 () {60 vars in 1325 bytes} [Sun Oct 2 01:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1781941769 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:01:26.872864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-accb9743-55b6-404e-b5d6-39e4b9502d7a tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-699649606"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:26.982158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.990088 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-edaff369-2359-45db-8afd-b61e19970e19 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.492743 Oct 02 01:01:26.995133 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 178/334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:27.002861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-217b2f5f-fc89-4aa1-9113-852a6ba0c086 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Calling method '.version_select at 0x7fb881bf2b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.051219 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-217b2f5f-fc89-4aa1-9113-852a6ba0c086 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851492118?user_id=85df35ef26914607834c5353899750ea" status: 204 len: 0 microversion: 2.10 time: 0.054900 Oct 02 01:01:27.056883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 179/335] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851492118?user_id=85df35ef26914607834c5353899750ea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:01:27.063482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.072237 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-accb9743-55b6-404e-b5d6-39e4b9502d7a tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.203115 Oct 02 01:01:27.072861 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 157/336] 10.222.0.23 () {62 vars in 1213 bytes} [Sun Oct 2 01:01:26 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:27.077677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:27.080109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3528156a-d74e-4d8b-815e-42dfdef35ff2 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] Calling method '.version_select at 0x7fb881d8b430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.103185 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3528156a-d74e-4d8b-815e-42dfdef35ff2 tempest-KeyPairsV210TestJSON-2084819888 tempest-KeyPairsV210TestJSON-2084819888-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097489864?user_id=85df35ef26914607834c5353899750ea" status: 204 len: 0 microversion: 2.10 time: 0.029152 Oct 02 01:01:27.103833 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 158/337] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:01:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097489864?user_id=85df35ef26914607834c5353899750ea => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:01:27.109921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.110577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.115987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ae57b57-ed84-4952-9feb-5bed4831640c tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.116751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.117824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.118459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.119083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.136618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ae57b57-ed84-4952-9feb-5bed4831640c tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.025775 Oct 02 01:01:27.137571 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 159/338] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:27.149912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a25e108-08d3-444d-a6f6-dcb465bb0f8f tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:27.175616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a25e108-08d3-444d-a6f6-dcb465bb0f8f tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.176122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a25e108-08d3-444d-a6f6-dcb465bb0f8f tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.176560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a25e108-08d3-444d-a6f6-dcb465bb0f8f tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.401244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a25e108-08d3-444d-a6f6-dcb465bb0f8f tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 314 microversion: 2.41 time: 0.255100 Oct 02 01:01:27.402643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 160/339] 10.222.0.23 () {62 vars in 1235 bytes} [Sun Oct 2 01:01:27 2022] POST /compute/v2.1/os-aggregates/18/action => generated 314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:27.407275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.409006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:27.418545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.419205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.419543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.421357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.421474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.422029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.651233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.659816 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 0.601038 Oct 02 01:01:27.663422 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 180/340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:27.664674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.665921 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90744780-4da6-4daa-a60b-1be26a56325d tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001546 Oct 02 01:01:27.674154 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 181/341] 10.222.0.23 () {56 vars in 886 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 02 01:01:27.681045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ed32024-208f-40ba-b1b7-6b025f4d9705 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:27.708421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ed32024-208f-40ba-b1b7-6b025f4d9705 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.709193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ed32024-208f-40ba-b1b7-6b025f4d9705 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.709771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ed32024-208f-40ba-b1b7-6b025f4d9705 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.919916 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ed32024-208f-40ba-b1b7-6b025f4d9705 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.244314 Oct 02 01:01:27.921752 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 182/342] 10.222.0.23 () {62 vars in 1235 bytes} [Sun Oct 2 01:01:27 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:01:27.933956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.938906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aeb6f6b9-25d3-40f0-9951-94d04e849702 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.947089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f587bc2-7d02-4d6b-bb16-ce9768d11266 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.544184 Oct 02 01:01:27.948199 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 161/343] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:27.998072 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aeb6f6b9-25d3-40f0-9951-94d04e849702 tempest-AggregatesAdminTestV241-989419019 tempest-AggregatesAdminTestV241-989419019-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.068604 Oct 02 01:01:28.004020 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 183/344] 10.222.0.23 () {60 vars in 1196 bytes} [Sun Oct 2 01:01:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:28.013582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:28.014648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:28.022065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.022254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.022645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.023330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.023775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.024194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.653628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:28.685743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-395b86ca-6f0a-42fc-9db8-5ce401aea50c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.675851 Oct 02 01:01:28.686869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c6e5eda0-aa3c-4d5e-9acf-cb2ba6a6d657 req-0d19c4ae-f35e-4f09-9354-baa5f28b8662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775f37dc-d601-4e83-a9ea-57791e2e7f18", "name": "network-vif-plugged", "status": "completed", "tag": "7eacb9f2-99c6-49e9-880b-595f501b106e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:28.690665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 162/345] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:28 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:28.706925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:28.707609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:28.709276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c6e5eda0-aa3c-4d5e-9acf-cb2ba6a6d657 req-0d19c4ae-f35e-4f09-9354-baa5f28b8662 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.712279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c6e5eda0-aa3c-4d5e-9acf-cb2ba6a6d657 req-0d19c4ae-f35e-4f09-9354-baa5f28b8662 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.713916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c6e5eda0-aa3c-4d5e-9acf-cb2ba6a6d657 req-0d19c4ae-f35e-4f09-9354-baa5f28b8662 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.727340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.728118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.729039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.729778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.730348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.730871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.751320 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c6e5eda0-aa3c-4d5e-9acf-cb2ba6a6d657 req-0d19c4ae-f35e-4f09-9354-baa5f28b8662 service nova] Creating event network-vif-plugged:7eacb9f2-99c6-49e9-880b-595f501b106e for instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 on n-h1-master-1 Oct 02 01:01:28.767076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c6e5eda0-aa3c-4d5e-9acf-cb2ba6a6d657 req-0d19c4ae-f35e-4f09-9354-baa5f28b8662 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090068 Oct 02 01:01:28.776260 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 184/346] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:28.973072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:28.973990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:28.987045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.991077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.992246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.994316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.995130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.996944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.052676 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:29.542681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.551718 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bc8c916-04d3-4d9e-a8a8-c8931dd0df6c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 0.859133 Oct 02 01:01:29.567161 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 163/347] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:28 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:29.715746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:29.716619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:29.729489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:29.730908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:29.731464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.733751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:29.736989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:29.737728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.791457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.815335 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b402e73c-f224-47ef-9f14-b7b407a65a8f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.848575 Oct 02 01:01:29.820937 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 185/348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:28 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:30.141598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.153809 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-62f96c68-51b4-4b3b-b3dd-50fcac996c9e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.441036 Oct 02 01:01:30.157080 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 164/349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:29 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:30.266021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b7848d0b-5ccb-4e77-9173-22b61a5b12c8 req-77b69105-0ca7-464a-bc8e-63db32bce016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd158cd-6153-4f53-8862-4700a0c11b14", "tag": "49bd8f90-db69-462f-9bf8-83116fdc85a9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:30.294986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7848d0b-5ccb-4e77-9173-22b61a5b12c8 req-77b69105-0ca7-464a-bc8e-63db32bce016 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.295776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7848d0b-5ccb-4e77-9173-22b61a5b12c8 req-77b69105-0ca7-464a-bc8e-63db32bce016 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.296496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7848d0b-5ccb-4e77-9173-22b61a5b12c8 req-77b69105-0ca7-464a-bc8e-63db32bce016 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.313549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b7848d0b-5ccb-4e77-9173-22b61a5b12c8 req-77b69105-0ca7-464a-bc8e-63db32bce016 service nova] Creating event network-changed:49bd8f90-db69-462f-9bf8-83116fdc85a9 for instance efd158cd-6153-4f53-8862-4700a0c11b14 on n-h2-master-1 Oct 02 01:01:30.337666 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b7848d0b-5ccb-4e77-9173-22b61a5b12c8 req-77b69105-0ca7-464a-bc8e-63db32bce016 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075472 Oct 02 01:01:30.341062 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 186/350] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:30.578131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:30.578799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:30.588222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.588709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.591095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.592007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.594745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.595345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.846399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:30.848042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:30.862921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.863773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.864409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.865889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.868292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.868997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.123122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.164889 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4344610c-86f5-4309-baa1-164464dffc83 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 0.588391 Oct 02 01:01:31.166130 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 165/351] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:30 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:31.190719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:31.193216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:31.238535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.241821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.243813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.246147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.249876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.251101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.293421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.302893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-730f7853-7ffd-48ba-b977-0ca5ebbca154 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.464149 Oct 02 01:01:31.324572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 187/352] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:30 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:31.561740 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:31.571901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.593397 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-94e96f25-9694-4fe8-ac87-e780b575800a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1387 microversion: 2.1 time: 0.411459 Oct 02 01:01:31.596389 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 166/353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:31 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1387 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:32.195888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:32.200081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:32.204073 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:32.215401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.215894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.216330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.223574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.224144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.224598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.331713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:32.332329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:32.350078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.350634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.351070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.351789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.354409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.355823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.803120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:32.813699 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5e359cf-f11c-4d31-b89e-56270fba29a6 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 0.623602 Oct 02 01:01:32.814843 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 188/354] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:32 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:32.820238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:32.821044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:32.840988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.845735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.846501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.848775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.850983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.852569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.869007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:32.878582 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fa9b8bb5-e76f-471f-8e39-94f6b2119a50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.550718 Oct 02 01:01:32.879436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 167/355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:32 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:33.011183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c317ec5e-61a0-4f6d-b737-7e7b6dc0957e req-6c4835c4-283e-42ad-95a4-522ec6b719a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aed604a-438c-4186-8e6e-45b720522f75", "name": "network-vif-plugged", "status": "completed", "tag": "47d4705d-cc43-4595-8156-d2c4d5e30f47"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:33.024235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c317ec5e-61a0-4f6d-b737-7e7b6dc0957e req-6c4835c4-283e-42ad-95a4-522ec6b719a0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.024957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c317ec5e-61a0-4f6d-b737-7e7b6dc0957e req-6c4835c4-283e-42ad-95a4-522ec6b719a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.025747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c317ec5e-61a0-4f6d-b737-7e7b6dc0957e req-6c4835c4-283e-42ad-95a4-522ec6b719a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:33.041014 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c317ec5e-61a0-4f6d-b737-7e7b6dc0957e req-6c4835c4-283e-42ad-95a4-522ec6b719a0 service nova] Creating event network-vif-plugged:47d4705d-cc43-4595-8156-d2c4d5e30f47 for instance 6aed604a-438c-4186-8e6e-45b720522f75 on n-h1-master-1 Oct 02 01:01:33.052050 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c317ec5e-61a0-4f6d-b737-7e7b6dc0957e req-6c4835c4-283e-42ad-95a4-522ec6b719a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045074 Oct 02 01:01:33.053410 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 168/356] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:33.481126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:33.496533 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3aecceca-912a-46b3-9f38-cc0ebd517761 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1587 microversion: 2.1 time: 0.680446 Oct 02 01:01:33.497145 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 189/357] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:32 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1587 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:33.521313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:33.522979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:33.557241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.557803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.562146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:33.564612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.566522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.567020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:33.847614 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dc95c586-d266-4731-bfc3-27b3426b95c0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330985 Oct 02 01:01:33.850551 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 169/358] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:01:33 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18/os-interface => generated 285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:33.858977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:33.860577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:33.883501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.884238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.884691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:33.889323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:33.889878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:33.890345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.015247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1556903820", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:34.085030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:34.668383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:34.682262 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-efdc235e-aa95-4cd8-a217-3ded25b31415 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 0.830458 Oct 02 01:01:34.703920 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 170/359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:33 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:34.719298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:34.722307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:34.738401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.739226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.742285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.745193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.745908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.746525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.859259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:34.859755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:34.860228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:34.860991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:34.861411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:34.894220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.896444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.899104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.900514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.902376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.904413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.928417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:34.934928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for user 739083b66f9b433889944e555b0aef23 and project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:34.955722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:34.964912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:35.050122 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a02f8d8e-5eeb-4af7-b40d-ab85aef5bd0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372432 Oct 02 01:01:35.057115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 190/360] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:01:35.210977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:35.213783 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:35.227993 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-494532e6-61c1-4cc0-b334-9a1f5770ff26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1313 microversion: 2.1 time: 0.521526 Oct 02 01:01:35.228620 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 171/361] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:34 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:35.238099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e985e18-b688-4334-822d-983e2e3273a9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.239116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e985e18-b688-4334-822d-983e2e3273a9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.285462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1722236814", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:35.390726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e985e18-b688-4334-822d-983e2e3273a9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:35.400281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e985e18-b688-4334-822d-983e2e3273a9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1213 microversion: 2.1 time: 0.168545 Oct 02 01:01:35.407032 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 172/362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:35 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:35.424043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:35.724287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.725796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.749776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.753335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.754803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.757370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.759129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.771919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.793768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:35.794371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:35.794955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:35.795348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:35.795774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:35.807810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.813974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.814656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.817198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.821314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.822017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.871732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Getting quotas for project ccda90f956d541b38c3e71181f397da9. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:35.883246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Getting quotas for user db88db7d7835406a91b0c0817126419a and project ccda90f956d541b38c3e71181f397da9. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:35.920207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:35.929012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:36.021486 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-694c1ccd-858d-4c40-bb46-057b79d20b5a tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963155 Oct 02 01:01:36.025711 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 191/363] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:36.037562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1457a557-01ae-462b-9cfb-cd6674a40712 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:36.038669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1457a557-01ae-462b-9cfb-cd6674a40712 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:36.472884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1457a557-01ae-462b-9cfb-cd6674a40712 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:36.486254 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1457a557-01ae-462b-9cfb-cd6674a40712 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1220 microversion: 2.1 time: 0.447491 Oct 02 01:01:36.487415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 192/364] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:36 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1220 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:36.504301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:36.505473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:36.522120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.525371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.528000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.543534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.544308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.546835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.701912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:36.721742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eef1d2de-385a-4434-b455-b84cb68f3cce tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 1.001414 Oct 02 01:01:36.723658 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 173/365] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:35 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:36.740461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:36.741820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:36.762372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.764717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.766359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.768960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.772492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.773170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.046532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:37.065752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-32697e72-33cc-43b1-beac-c7c2f342e294 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1265 microversion: 2.1 time: 0.338372 Oct 02 01:01:37.066974 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 174/366] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:36 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:37.120321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:37.147208 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5e23c04-7d48-4dd9-b6c8-7548fc836b60 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1463 microversion: 2.1 time: 0.658531 Oct 02 01:01:37.153154 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 193/367] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:36 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1463 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:37.185439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:37.187346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:37.196423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.197157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.197808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.198700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.199304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.200006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.520289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:37.523133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:37.549842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.550395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.550875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.551606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.552855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.554628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.576517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:37.586572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9641e32c-3a66-48e3-96f4-7f117166653f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1463 microversion: 2.1 time: 0.406011 Oct 02 01:01:37.593469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 175/368] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:37 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1463 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:37.735353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:37.752103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:37.753524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:37.766247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.767878 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2eb79d06-767c-453a-a4a1-de4de031f64c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1272 microversion: 2.1 time: 0.259450 Oct 02 01:01:37.768600 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 194/369] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:37 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:37.772491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.774077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.776147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.778756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.779863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.832575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-159805393", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "188f4b83-8e80-45f4-9be3-513a2f021e12"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:37.925659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:38.575734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:38.585370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8c69a75-a548-40ba-8a76-503ea94053b2 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 0.839037 Oct 02 01:01:38.598965 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 176/370] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:37 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:38.598965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:38.598965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:38.614209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.614769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.615205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.615915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.616372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.616796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.804706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:38.821932 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0019b358-fb6d-4293-8815-0676b4a88c53 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1271 microversion: 2.1 time: 0.229064 Oct 02 01:01:38.825473 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 177/371] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:38 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:38.837779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-fc790cfe-af4e-4e35-8a3f-09dac6c13312 req-9f995d7a-f0ad-4746-9aaa-e2c8c5843fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd158cd-6153-4f53-8862-4700a0c11b14", "name": "network-vif-plugged", "status": "completed", "tag": "49bd8f90-db69-462f-9bf8-83116fdc85a9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:38.865586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fc790cfe-af4e-4e35-8a3f-09dac6c13312 req-9f995d7a-f0ad-4746-9aaa-e2c8c5843fd9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.866380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fc790cfe-af4e-4e35-8a3f-09dac6c13312 req-9f995d7a-f0ad-4746-9aaa-e2c8c5843fd9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.867080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fc790cfe-af4e-4e35-8a3f-09dac6c13312 req-9f995d7a-f0ad-4746-9aaa-e2c8c5843fd9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.885489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-fc790cfe-af4e-4e35-8a3f-09dac6c13312 req-9f995d7a-f0ad-4746-9aaa-e2c8c5843fd9 service nova] Creating event network-vif-plugged:49bd8f90-db69-462f-9bf8-83116fdc85a9 for instance efd158cd-6153-4f53-8862-4700a0c11b14 on n-h2-master-1 Oct 02 01:01:38.895900 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-fc790cfe-af4e-4e35-8a3f-09dac6c13312 req-9f995d7a-f0ad-4746-9aaa-e2c8c5843fd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068087 Oct 02 01:01:38.897102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 178/372] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:38.907135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:38.908122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:38.927798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.928798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.929411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.931453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.932229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.932853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.991267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:38.991740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:38.992167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:38.992580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:38.992998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:39.013660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.014447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.021582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.022395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.022918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.023363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.081633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Getting quotas for project 683c16b60ba34123bf0175396dffaf83. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:39.089882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Getting quotas for user c42d04f7289e49ef950eeaf764c91216 and project 683c16b60ba34123bf0175396dffaf83. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:39.117032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:39.119889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:39.211971 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-79aea4cb-5362-4b6f-aa21-1c403cc02436 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385860 Oct 02 01:01:39.219764 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 195/373] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:01:39.225833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f05e5c0e-52cf-4249-a31a-2acb2fb35a14 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.226678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f05e5c0e-52cf-4249-a31a-2acb2fb35a14 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:39.676486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:39.685203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-69785026-3b3e-44a3-ad02-c027f2df59f1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1278 microversion: 2.1 time: 0.786635 Oct 02 01:01:39.687760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 179/374] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:38 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1278 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:39.705007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.705971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:39.723395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.724023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.725375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.727702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.728454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.731092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.879338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f05e5c0e-52cf-4249-a31a-2acb2fb35a14 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:39.899076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f05e5c0e-52cf-4249-a31a-2acb2fb35a14 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1213 microversion: 2.1 time: 0.677279 Oct 02 01:01:39.900336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 196/375] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1213 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:39.906366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d30cfc12-fd92-4d52-8389-29e90ef8c836 req-3407039f-cc73-416b-abf8-67996c7e6db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775f37dc-d601-4e83-a9ea-57791e2e7f18", "tag": "7eacb9f2-99c6-49e9-880b-595f501b106e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:39.937416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d30cfc12-fd92-4d52-8389-29e90ef8c836 req-3407039f-cc73-416b-abf8-67996c7e6db5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.938106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d30cfc12-fd92-4d52-8389-29e90ef8c836 req-3407039f-cc73-416b-abf8-67996c7e6db5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.938955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d30cfc12-fd92-4d52-8389-29e90ef8c836 req-3407039f-cc73-416b-abf8-67996c7e6db5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.965243 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d30cfc12-fd92-4d52-8389-29e90ef8c836 req-3407039f-cc73-416b-abf8-67996c7e6db5 service nova] Creating event network-changed:7eacb9f2-99c6-49e9-880b-595f501b106e for instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 on n-h1-master-1 Oct 02 01:01:39.978562 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d30cfc12-fd92-4d52-8389-29e90ef8c836 req-3407039f-cc73-416b-abf8-67996c7e6db5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076068 Oct 02 01:01:39.979652 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 197/376] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:39.993307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:39.994164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:40.004330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.011765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.012280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.013275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.013762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.014290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.620618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:40.629861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9cacd65-37da-4f21-b6d5-2e6e8c4f51fe tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 200 len: 1587 microversion: 2.1 time: 0.940384 Oct 02 01:01:40.635247 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 180/377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 1587 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:40.650400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:40.652523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:40.662194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.663098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.666321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.667774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:40.668477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:40.670626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:40.982779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:40.990958 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9fd28a51-a67b-45e8-942d-3eda8f744f94 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1323 microversion: 2.1 time: 1.009973 Oct 02 01:01:41.000240 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 198/378] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:39 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1323 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:41.016765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:41.025784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-398bfc56-cef9-4389-a6d1-3586943904ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1271 microversion: 2.1 time: 0.387702 Oct 02 01:01:41.028517 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 181/379] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:40 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1271 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:41.030719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:41.031738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:41.035777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:41.055865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:41.064332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.068048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.068610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.071178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.071751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.072572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.074073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.077989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.081137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.082001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:41.082576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:41.086320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:41.518462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:41.539831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18873b86-0c8d-45f7-bda0-438870064681 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1278 microversion: 2.1 time: 0.536719 Oct 02 01:01:41.540594 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 199/380] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:41 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1278 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:41.890135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:41.902504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f3cca2c4-e300-41ac-8284-421b5e9057d2 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1265 microversion: 2.1 time: 0.872454 Oct 02 01:01:41.919491 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 182/381] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:41 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1265 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:42.034842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:42.036826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:42.055365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:42.056222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:42.058124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:42.059439 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:42.060972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:42.062151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:42.066558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:42.067090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:42.067501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:42.068014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:42.068197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:42.069760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:42.071391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:42.079101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:42.079555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.304987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.315969 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-522b60a9-f3a6-46ab-a407-aa9b8cdb9df6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 1.265449 Oct 02 01:01:43.317089 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 183/382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:42 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:43.321847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:43.322447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:43.344660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.368343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-335add81-3f94-4f35-8500-e712b92c7fa0 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1473 microversion: 2.1 time: 1.347179 Oct 02 01:01:43.373265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.382230 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 200/383] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:42 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1473 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:43.384237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.384766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.388512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:43.389395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.389932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.390442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.393934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:43.417696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.420536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.421735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.423501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.423992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.425128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.638055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.662047 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-232b142c-3f60-41d5-bb3a-faf8f93b9939 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1271 microversion: 2.1 time: 0.278546 Oct 02 01:01:43.665043 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 201/384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:43 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:43.672897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:43.673605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:43.680731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.681777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.682379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.683282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.683871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.685159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.744775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Request method failure captured: Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14/diagnostics HTTP/1.1 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLe56O8UhRIvsVrlfg8tSil1hB4_TQvJVmlSXF2JjrtXssS4uH-YGIRoa85aR7v2_XAV6Vx7ylt0NrY5HXWW0w_Bqydt98roknr0YPpp80CSXH6iAmxm7yBvnwlGfiFQB06TOQS1nfjVey7I-j4vWwgB7hY0x_UGZLMIDKp91e8Pz0 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9de523ba73a54067a287aa17f43cec20 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1690093014 Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:43.746766 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9de523ba73a54067a287aa17f43cec20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9de523ba73a54067a287aa17f43cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9de523ba73a54067a287aa17f43cec20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9de523ba73a54067a287aa17f43cec20"}]}] Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1690093014 Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9de523ba73a54067a287aa17f43cec20 Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1690093014 Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerDiagnosticsNegativeTest-1690093014-project Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6d9e1b41a5ce40c292c45ab1bfacb020 Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1690093014-project Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:43.749127 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': 'efd158cd-6153-4f53-8862-4700a0c11b14'} Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:01:43.749857 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 02 01:01:43.751225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:43.756711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:43.764896 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed9cf60c-9407-48ed-bcde-a612fb671e70 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.098724 Oct 02 01:01:43.768202 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 202/385] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:01:43 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14/diagnostics => generated 117 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:43.781205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:43.781981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:43.796091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.797999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.798441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.799194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:43.800615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:43.801424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:43.861118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:44.038304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:44.053464 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c06f337c-2ee6-4f43-af9b-45d2b3f0eebb tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 0.735039 Oct 02 01:01:44.057604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 184/386] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:43 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:44.126820 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f366381-3be8-4c56-a9d5-5f8907238b3c tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 204 len: 0 microversion: 2.1 time: 0.350664 Oct 02 01:01:44.128651 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 203/387] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:43 2022] DELETE /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:44.142849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.143747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.161003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.161865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.162315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.163524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.163992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.164428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.270123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8f68b752-f9eb-4ec5-a476-4a59bf025f94 req-07835279-c6ec-4df5-a069-3d6ec34b22f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3ca6e4-3b33-4027-b567-e314d700580e", "tag": "0bf32f90-0b36-4c8f-8881-00ffbc8df822"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:44.314787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8f68b752-f9eb-4ec5-a476-4a59bf025f94 req-07835279-c6ec-4df5-a069-3d6ec34b22f6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.315286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8f68b752-f9eb-4ec5-a476-4a59bf025f94 req-07835279-c6ec-4df5-a069-3d6ec34b22f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.315915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8f68b752-f9eb-4ec5-a476-4a59bf025f94 req-07835279-c6ec-4df5-a069-3d6ec34b22f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.342682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8f68b752-f9eb-4ec5-a476-4a59bf025f94 req-07835279-c6ec-4df5-a069-3d6ec34b22f6 service nova] Creating event network-changed:0bf32f90-0b36-4c8f-8881-00ffbc8df822 for instance dc3ca6e4-3b33-4027-b567-e314d700580e on n-h1-master-1 Oct 02 01:01:44.360075 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8f68b752-f9eb-4ec5-a476-4a59bf025f94 req-07835279-c6ec-4df5-a069-3d6ec34b22f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100816 Oct 02 01:01:44.363116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 204/388] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:44.380483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.381306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.397404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.398798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.402810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.404204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.404877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.405497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.777379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:44.791448 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-52628815-2fe8-4a9b-8947-78edd652ed6f tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1479 microversion: 2.1 time: 0.657841 Oct 02 01:01:44.824307 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 185/389] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1479 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:44.837121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:44.843870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:44.856404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.864577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.865411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:44.868553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:44.869259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:44.871211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.368901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:45.381998 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87c95a35-b1b7-4373-8b16-5defc7eaeb93 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1271 microversion: 2.1 time: 0.552425 Oct 02 01:01:45.394776 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 186/390] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1271 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:45.406492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:45.407422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:45.414063 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=14 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:45.416930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.417895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.418825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.419761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.420422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.422313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.429646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:45.442180 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-232d58e2-ebe3-44b9-99ae-285723aad6ed tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 1.077628 Oct 02 01:01:45.448286 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 205/391] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:44 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:45.832503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:45.834076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:45.850910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.851893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.853170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.854527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:45.856995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:45.857852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:45.897272 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:46.672102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:46.680487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53c14c38-244e-4540-9721-7052f477ed57 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 1.281698 Oct 02 01:01:46.681076 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 187/392] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:45 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:46.689481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:46.690100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:46.710499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:46.714428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:46.715114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:46.716388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:46.717772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:46.719774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:46.795447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:46.817194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a135179e-7c4a-4e8c-a3c0-f5bed56a8e01 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1479 microversion: 2.1 time: 0.997096 Oct 02 01:01:46.819198 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 206/393] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:45 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1479 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:46.847568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:46.848204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:46.861028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:46.861785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:46.863172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:46.864293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:46.865224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:46.865837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.167017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:47.189394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-62464c34-56a9-445f-a8b7-2383ffa93ec3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1271 microversion: 2.1 time: 0.503556 Oct 02 01:01:47.191790 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 188/394] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:46 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1271 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:47.350313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:47.361551 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-651af8a2-6b08-408e-94d5-ff85cb3799bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.526946 Oct 02 01:01:47.366528 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 207/395] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:46 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:47.713464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:47.719177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:47.749306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.776119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.776841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.778730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.779389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.783698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.825420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b0b7895e-d781-4163-81cc-af16285ac0e2 req-a58ff963-957e-4e22-a5b5-727482a6ab00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd158cd-6153-4f53-8862-4700a0c11b14", "name": "network-vif-deleted", "tag": "49bd8f90-db69-462f-9bf8-83116fdc85a9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:47.848679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b0b7895e-d781-4163-81cc-af16285ac0e2 req-a58ff963-957e-4e22-a5b5-727482a6ab00 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.849414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b0b7895e-d781-4163-81cc-af16285ac0e2 req-a58ff963-957e-4e22-a5b5-727482a6ab00 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.864024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b0b7895e-d781-4163-81cc-af16285ac0e2 req-a58ff963-957e-4e22-a5b5-727482a6ab00 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.918018 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b0b7895e-d781-4163-81cc-af16285ac0e2 req-a58ff963-957e-4e22-a5b5-727482a6ab00 service nova] Creating event network-vif-deleted:49bd8f90-db69-462f-9bf8-83116fdc85a9 for instance efd158cd-6153-4f53-8862-4700a0c11b14 on n-h2-master-1 Oct 02 01:01:47.944890 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b0b7895e-d781-4163-81cc-af16285ac0e2 req-a58ff963-957e-4e22-a5b5-727482a6ab00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121702 Oct 02 01:01:47.945979 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 208/396] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:47.967251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:47.968772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:47.979294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.980108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.980782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:47.982951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:47.983955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:47.984700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.029708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.030517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.031222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.031913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lazy-loading 'fault' on Instance uuid efd158cd-6153-4f53-8862-4700a0c11b14 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:48.464492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e1b41a5ce40c292c45ab1bfacb020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de523ba73a54067a287aa17f43cec20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:48.480175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4ccdbd72-6bc1-48cf-993d-d01424b9774e tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 200 len: 1313 microversion: 2.1 time: 0.529522 Oct 02 01:01:48.482272 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 209/397] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:47 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:48.501709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6c345ffc-132f-4982-9203-6682b99218ca req-1af05ed2-99e5-42ae-b479-07ff1e380d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0530656d-9d5c-4a05-bfc3-94cf67b19dcf", "tag": "3e02bdab-8b46-4fdf-91fc-2e60947189c5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:48.535390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6c345ffc-132f-4982-9203-6682b99218ca req-1af05ed2-99e5-42ae-b479-07ff1e380d67 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.539677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6c345ffc-132f-4982-9203-6682b99218ca req-1af05ed2-99e5-42ae-b479-07ff1e380d67 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.540427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6c345ffc-132f-4982-9203-6682b99218ca req-1af05ed2-99e5-42ae-b479-07ff1e380d67 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.582100 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6c345ffc-132f-4982-9203-6682b99218ca req-1af05ed2-99e5-42ae-b479-07ff1e380d67 service nova] Creating event network-changed:3e02bdab-8b46-4fdf-91fc-2e60947189c5 for instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf on n-h1-master-1 Oct 02 01:01:48.596902 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6c345ffc-132f-4982-9203-6682b99218ca req-1af05ed2-99e5-42ae-b479-07ff1e380d67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111611 Oct 02 01:01:48.599881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:48.600702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 210/398] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:48.611674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:48.612657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:48.627480 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab532e97-3fae-4188-9d57-00289f24c22f tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 0.905752 Oct 02 01:01:48.628163 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 189/399] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:47 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:48.643330 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:48.645910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.657044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.658037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.659403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.661004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.663436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.674415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:48.681012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:48.698866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.702661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.704115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.707024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:48.713547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:48.720097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:48.731858 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:49.060406 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:49.307165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:49.323377 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8becc43b-6d23-402b-8249-7d292e3fdf0a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.720685 Oct 02 01:01:49.323975 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 211/400] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:48 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:49.509542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.510280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] [instance: efd158cd-6153-4f53-8862-4700a0c11b14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.530977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.532063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.532678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.533559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.534137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.537735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.570960 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] HTTP exception thrown: Instance efd158cd-6153-4f53-8862-4700a0c11b14 could not be found. Oct 02 01:01:49.571202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Request method failure captured: Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 HTTP/1.1 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLe56O8UhRIvsVrlfg8tSil1hB4_TQvJVmlSXF2JjrtXssS4uH-YGIRoa85aR7v2_XAV6Vx7ylt0NrY5HXWW0w_Bqydt98roknr0YPpp80CSXH6iAmxm7yBvnwlGfiFQB06TOQS1nfjVey7I-j4vWwgB7hY0x_UGZLMIDKp91e8Pz0 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9de523ba73a54067a287aa17f43cec20 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1690093014 Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:01:49.573746 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9de523ba73a54067a287aa17f43cec20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9de523ba73a54067a287aa17f43cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9de523ba73a54067a287aa17f43cec20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9de523ba73a54067a287aa17f43cec20"}]}] Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1690093014 Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9de523ba73a54067a287aa17f43cec20 Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1690093014 Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerDiagnosticsNegativeTest-1690093014-project Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6d9e1b41a5ce40c292c45ab1bfacb020 Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1690093014-project Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: exception: Instance efd158cd-6153-4f53-8862-4700a0c11b14 could not be found. Oct 02 01:01:49.576515 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'efd158cd-6153-4f53-8862-4700a0c11b14'} Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd158cd-6153-4f53-8862-4700a0c11b14 could not be found. Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:49.577715 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd158cd-6153-4f53-8862-4700a0c11b14 could not be found. Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd158cd-6153-4f53-8862-4700a0c11b14 could not be found. Oct 02 01:01:49.578850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:01:49.583719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] Returning 404 to user: Instance efd158cd-6153-4f53-8862-4700a0c11b14 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:49.584663 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-040601e3-5662-4e72-8118-4907e8bbb731 tempest-ServerDiagnosticsNegativeTest-1690093014 tempest-ServerDiagnosticsNegativeTest-1690093014-project] 10.222.0.23 "GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14" status: 404 len: 111 microversion: 2.1 time: 0.080138 Oct 02 01:01:49.585311 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85729f5f-fd7e-4e8b-a74e-c53970856a0e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.948278 Oct 02 01:01:49.586171 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 212/402] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:49 2022] GET /compute/v2.1/servers/efd158cd-6153-4f53-8862-4700a0c11b14 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:49.586323 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 190/402] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:48 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:49.657681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:49.658288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:49.669955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.670463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.674385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:49.675193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:49.675830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:49.676485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.222609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:50.235787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4368136c-d193-4652-a2d0-6ed560f7c6d3 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 0.583009 Oct 02 01:01:50.264252 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 191/403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:49 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:50.347152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:50.348365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:50.353598 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=30 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:50.356479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.357777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.358988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.359898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.360613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.361195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.615583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:50.617181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:50.625657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.626540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.627305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:50.628166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:50.630030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:50.630710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.501836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.514052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fa16ac66-0ce7-444e-8ec0-540a2e45a638 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.904352 Oct 02 01:01:51.515450 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 192/404] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:50 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:51.525730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:51.526583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:51.541974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.542708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.543339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.544376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:51.546011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:51.548674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:51.630586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.641817 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b30b3fe-0093-4d7d-abd2-9ce1d4967626 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 1.298331 Oct 02 01:01:51.654799 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 213/405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:50 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:51.827660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:51.860460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f3a184a1-16d3-4a0a-a0f1-11f0c2b9de63 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 0.339740 Oct 02 01:01:51.861314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 193/406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:51 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:52.475225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-01563c3b-b2d3-457f-85d5-db78dee0469c req-32e53d6c-7ce3-4f54-8f1d-6d71b1d3b88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539e1389-8245-4e0d-982c-5babbe7e5640", "tag": "853b586f-ceaa-4e4a-8bff-a2f941b444aa"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:52.500466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-01563c3b-b2d3-457f-85d5-db78dee0469c req-32e53d6c-7ce3-4f54-8f1d-6d71b1d3b88b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.501162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-01563c3b-b2d3-457f-85d5-db78dee0469c req-32e53d6c-7ce3-4f54-8f1d-6d71b1d3b88b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.502543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-01563c3b-b2d3-457f-85d5-db78dee0469c req-32e53d6c-7ce3-4f54-8f1d-6d71b1d3b88b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.537862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:52.539111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:52.541353 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-01563c3b-b2d3-457f-85d5-db78dee0469c req-32e53d6c-7ce3-4f54-8f1d-6d71b1d3b88b service nova] Creating event network-changed:853b586f-ceaa-4e4a-8bff-a2f941b444aa for instance 539e1389-8245-4e0d-982c-5babbe7e5640 on n-h2-master-1 Oct 02 01:01:52.552380 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-01563c3b-b2d3-457f-85d5-db78dee0469c req-32e53d6c-7ce3-4f54-8f1d-6d71b1d3b88b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082445 Oct 02 01:01:52.553294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.553830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.554587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.555649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.556272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.556724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 214/407] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:52.557074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.671315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:52.672696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:52.682664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.683744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.687422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:52.694130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:52.695104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:52.696832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.318466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:53.328921 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ffe4e7e-0ee4-48fa-88d3-69939938c0ea tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.795158 Oct 02 01:01:53.346532 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 194/408] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:52 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:53.363792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:53.368284 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:53.378798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.383905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.388421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.389419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:53.390103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:53.390751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:53.398956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:53.410112 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b740b69a-bec2-40f2-9339-844823fbc972 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.744595 Oct 02 01:01:53.423170 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 215/409] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:52 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:54.065207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-722603234", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "50e67603-d71e-41c6-898e-f46b864cbf22"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:54.110299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:54.121184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ea8d0f8-bcf2-458c-91c5-f7585150f915 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 0.766391 Oct 02 01:01:54.138477 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 195/410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:53 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:54.171837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] validate_networks() for [('50e67603-d71e-41c6-898e-f46b864cbf22', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:54.279193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e7d0d8ea-3d02-4241-b84e-2ae0fa7546ed req-6706b259-846c-4120-a8c7-48adbc90bf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3ca6e4-3b33-4027-b567-e314d700580e", "name": "network-vif-plugged", "status": "completed", "tag": "0bf32f90-0b36-4c8f-8881-00ffbc8df822"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:54.290119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e7d0d8ea-3d02-4241-b84e-2ae0fa7546ed req-6706b259-846c-4120-a8c7-48adbc90bf11 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.290801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e7d0d8ea-3d02-4241-b84e-2ae0fa7546ed req-6706b259-846c-4120-a8c7-48adbc90bf11 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.291383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e7d0d8ea-3d02-4241-b84e-2ae0fa7546ed req-6706b259-846c-4120-a8c7-48adbc90bf11 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.309365 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e7d0d8ea-3d02-4241-b84e-2ae0fa7546ed req-6706b259-846c-4120-a8c7-48adbc90bf11 service nova] Creating event network-vif-plugged:0bf32f90-0b36-4c8f-8881-00ffbc8df822 for instance dc3ca6e4-3b33-4027-b567-e314d700580e on n-h1-master-1 Oct 02 01:01:54.324223 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e7d0d8ea-3d02-4241-b84e-2ae0fa7546ed req-6706b259-846c-4120-a8c7-48adbc90bf11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048788 Oct 02 01:01:54.325500 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 196/411] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:54.366160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:54.367153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:54.376511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.377228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.377838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.378774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.379238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.379990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.987190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.000067 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f4484c29-09be-457a-9919-823368d1f722 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.645520 Oct 02 01:01:55.000662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 197/412] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:54 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:55.013051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:55.013934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:55.038512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.039352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.040071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.041104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.041772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.042335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.383626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.397561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53a4b4ab-73a1-4385-9b34-ea1cbf731ec5 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.395849 Oct 02 01:01:55.411330 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 198/413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:55 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:55.426019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:55.426968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:55.442704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.443208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.443645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.444359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.444813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.445264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.846136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.865712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09f7eb9b-2a02-4719-8b5a-756bf2c2be91 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1320 microversion: 2.1 time: 0.448292 Oct 02 01:01:55.869588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 199/414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:55 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:56.029626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.031716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.055430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.061026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.063049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.066965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.067742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.068707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.345276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:56.346508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:56.347156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:56.347714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:56.348301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:56.379950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.381163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.383852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.387125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.388712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.389880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.447026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:56.456976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for user 6da1976f703f402788953f3332a281de and project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:56.489839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:56.494837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:56.544888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:56.553294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef5fb355-467d-4225-87c2-a0a7c34626c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.528950 Oct 02 01:01:56.556554 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 200/415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:56.581704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.584122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.597567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.600537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.601176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.604419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.605073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.606589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.608612 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9fee5a5-153d-4f80-891e-13683dadfd67 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818335 Oct 02 01:01:56.618536 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 216/416] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:01:56.630064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-04034e9e-3f4a-4092-8c97-195295beadae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.631290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-04034e9e-3f4a-4092-8c97-195295beadae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.769526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-04034e9e-3f4a-4092-8c97-195295beadae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:56.784448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-04034e9e-3f4a-4092-8c97-195295beadae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1210 microversion: 2.1 time: 0.164393 Oct 02 01:01:56.806833 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 217/417] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:56.898756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.899382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.912526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.913411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.913850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.914555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.916697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.919594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.026938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:57.038992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc7102fe-2078-4e93-ad59-f33d88b6576c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.480301 Oct 02 01:01:57.055192 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 201/418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:57.336464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:57.362256 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2c2ad5ae-080e-4c2e-a09a-7b2ecae5e611 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1470 microversion: 2.1 time: 0.467509 Oct 02 01:01:57.367784 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 218/419] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:57.581488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:57.583034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:57.599189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.603584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.604583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.609465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.611717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.614091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.167881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.168580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:58.178813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.179567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.180179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.180994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.181558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.193352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.258066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.268033 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae1afde8-8dfb-4b61-a19f-f13e20122e4c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.690403 Oct 02 01:01:58.277409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 219/420] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:57 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:58.286106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:58.290053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.293657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:58.328106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.329917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.331279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.334321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.334853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.336694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.443994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.453497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed02dc6c-af40-4072-87c0-5d861b2b3ff1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1262 microversion: 2.1 time: 0.174776 Oct 02 01:01:58.456009 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 220/421] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:58 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1262 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:58.554299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.561499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.562806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.564136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.565183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.566192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.566365 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c4b8077a-4048-423d-811a-f451b945a9fa tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 204 len: 0 microversion: 2.1 time: 1.172180 Oct 02 01:01:58.567015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.568743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 202/422] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:57 2022] DELETE /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 0 bytes in 1175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:58.580923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.590085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:58.598372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3386c06a-edd8-4a61-b363-7cc747713483 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.129191 Oct 02 01:01:58.607885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.608459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.608695 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 221/423] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:01:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:58.609304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.612373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.613108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.614382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.614876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.615706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:58.625296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.626321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.626990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.627888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.628993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.629900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.900166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.919000 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-72024d20-9b71-4f70-905d-2b6cc687fda0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.348641 Oct 02 01:01:58.919607 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 203/424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:58 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:58.932926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:58.957391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.957907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.958349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.959161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:58.959618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:58.960040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.006137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:59.023535 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c6f22ee-964e-4d75-8106-493342329cf1 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1476 microversion: 2.1 time: 0.411392 Oct 02 01:01:59.027184 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 222/425] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:58 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:59.083230 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6567cf26-e2de-4521-80ef-f703620ebe0e tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.142300 Oct 02 01:01:59.083935 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 204/426] 10.222.0.23 () {58 vars in 1172 bytes} [Sun Oct 2 01:01:58 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:59.105819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.115389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.116261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.117815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.119051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.121652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.122679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.236895 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-86bb9474-36f2-416c-bffb-5673b32113bb tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.135991 Oct 02 01:01:59.238649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 223/427] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:59.252942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.256519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.257002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.257645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.264009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.271292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.271946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.309204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.310741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.322907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.326166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.327280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.329889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.331845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.332510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.349850 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdd7ebb8-21b4-451a-9d33-6e38a2570d04 tempest-ServicesAdminTestJSON-679504959 tempest-ServicesAdminTestJSON-679504959-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.101003 Oct 02 01:01:59.350552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 205/428] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:59.484276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.484889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.501778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.502289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.502744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.503512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.503914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.504337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.845183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:59.857060 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20a097d5-229e-4b1d-8311-dd5e73a10b5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1268 microversion: 2.1 time: 0.377170 Oct 02 01:01:59.859649 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 206/429] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1268 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:59.943954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.944573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.963183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.963888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.964860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.967676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.968159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.968600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.054073 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:00.332882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:00.357047 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-60ec43b6-057b-4cee-94d7-d987ac52a34f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 1.053200 Oct 02 01:02:00.358232 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 224/430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:00.363761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:00.364599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:00.373587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.374278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.374935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.375837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.376586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.377153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.982248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:00.996557 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9fbd08fa-ab53-494e-8c37-b64a0fc2e010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 1.055427 Oct 02 01:02:00.999678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 207/431] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:01.014043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:01.015056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:01.025217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.025719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.031188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.031887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.032362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.032799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.141229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:01.155530 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f1e400c-8133-43b6-bdaf-1df3744819a5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1476 microversion: 2.1 time: 0.795837 Oct 02 01:02:01.156776 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 225/432] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:00 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1476 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:01.248710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:01.263739 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1611ecab-551e-4d9f-988c-3982ed5e2b4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1268 microversion: 2.1 time: 0.262555 Oct 02 01:02:01.264967 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 208/433] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:00 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1268 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:01.387137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:01.387858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:01.395641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.400455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.400975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.403333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.403861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.405101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.774653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6221200-03de-41d3-b4b7-cfa1271c63f5 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Action: 'create', calling method: .version_select at 0x7fb881cca1f0>, body: {"pool": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:02.668649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:02.687367 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ea305a2-812c-456b-a40b-e08e170620b9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 1.295405 Oct 02 01:02:02.688134 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 226/434] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:01 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:02.693179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:02.693859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:02.704933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:02.705528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:02.706152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:02.707976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:02.708694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:02.709894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.268168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:03.276411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7971317e-114c-459c-b4a8-7f790ac8ddc3 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.586854 Oct 02 01:02:03.299177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 227/435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:02 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:03.307525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:03.313207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:03.326048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.329802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.330547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.331536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.332218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.332844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.389751 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:03.412293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.412778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.413303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.413661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lazy-loading 'fault' on Instance uuid dc3ca6e4-3b33-4027-b567-e314d700580e {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:03.624271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:03.632770 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-720aab38-f7a0-4578-8507-fb3376011c32 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 200 len: 1310 microversion: 2.1 time: 0.332044 Oct 02 01:02:03.633355 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 228/436] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:03 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 1310 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:03.638126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:03.638753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:03.662693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.670428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.671908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.673014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.674199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.674919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:04.188744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:04.197412 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70cb0631-1331-4d1b-8e82-a4901c3f6b29 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1310 microversion: 2.1 time: 0.562975 Oct 02 01:02:04.203250 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 229/437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:03 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1310 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:04.221322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-873aed65-f44f-4378-b281-89b5aba7e86e req-310ec232-950b-4e27-9a0e-d26a2b026a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3ca6e4-3b33-4027-b567-e314d700580e", "name": "network-vif-deleted", "tag": "0bf32f90-0b36-4c8f-8881-00ffbc8df822"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:04.246158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-873aed65-f44f-4378-b281-89b5aba7e86e req-310ec232-950b-4e27-9a0e-d26a2b026a8e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:04.254141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-873aed65-f44f-4378-b281-89b5aba7e86e req-310ec232-950b-4e27-9a0e-d26a2b026a8e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:04.254894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-873aed65-f44f-4378-b281-89b5aba7e86e req-310ec232-950b-4e27-9a0e-d26a2b026a8e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:04.283170 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-873aed65-f44f-4378-b281-89b5aba7e86e req-310ec232-950b-4e27-9a0e-d26a2b026a8e service nova] Creating event network-vif-deleted:0bf32f90-0b36-4c8f-8881-00ffbc8df822 for instance dc3ca6e4-3b33-4027-b567-e314d700580e on n-h1-master-1 Oct 02 01:02:04.291520 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-873aed65-f44f-4378-b281-89b5aba7e86e req-310ec232-950b-4e27-9a0e-d26a2b026a8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086689 Oct 02 01:02:04.292477 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 230/438] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:04.305406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-16eb3e28-a066-4e00-ac93-3684abe7b81b req-6cf5d847-76db-4772-9c0b-8b49c970ae92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0530656d-9d5c-4a05-bfc3-94cf67b19dcf", "name": "network-vif-plugged", "status": "completed", "tag": "3e02bdab-8b46-4fdf-91fc-2e60947189c5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:04.318915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-16eb3e28-a066-4e00-ac93-3684abe7b81b req-6cf5d847-76db-4772-9c0b-8b49c970ae92 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:04.321951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-16eb3e28-a066-4e00-ac93-3684abe7b81b req-6cf5d847-76db-4772-9c0b-8b49c970ae92 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:04.322782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-16eb3e28-a066-4e00-ac93-3684abe7b81b req-6cf5d847-76db-4772-9c0b-8b49c970ae92 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:04.353106 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-16eb3e28-a066-4e00-ac93-3684abe7b81b req-6cf5d847-76db-4772-9c0b-8b49c970ae92 service nova] Creating event network-vif-plugged:3e02bdab-8b46-4fdf-91fc-2e60947189c5 for instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf on n-h1-master-1 Oct 02 01:02:04.362100 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-16eb3e28-a066-4e00-ac93-3684abe7b81b req-6cf5d847-76db-4772-9c0b-8b49c970ae92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061555 Oct 02 01:02:04.380813 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 231/439] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:04.430549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:04.436491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:04.466554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:04.467465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:04.468657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:04.471354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:04.472151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:04.473104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:05.091037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:05.103689 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0fda072b-19fa-4b3c-b012-997529dc0342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1313 microversion: 2.1 time: 0.716921 Oct 02 01:02:05.106857 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 232/440] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:04 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:05.120012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:05.121530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:05.130849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:05.131630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:05.132889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:05.134199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:05.135655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:05.136359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:05.920468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:05.947466 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6fe6f05e-d5db-4322-b122-0bd4a03755b9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.838755 Oct 02 01:02:05.955900 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 233/441] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:05 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:05.965621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:05.966238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:05.984665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:05.985305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:05.985965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:05.986802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:05.987336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:05.987829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.004608 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] HTTP exception thrown: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Request method failure captured: Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e HTTP/1.1 Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLt91fTJqtwrzKDv-pMeezu1g56cbR6j6lNXTQhmCYBbZMJFrENQUaeyvA_TuO_rS9RjS1kOLB3Oa2Ums-Jp5deg6UR3FQrI2huUUlI6rKTQMosy49XULqY2YBKb-lH2HGMWiP1qNU0_qWHypKqTk-cb5MbFFnb_LV-C4PFBYX3LLE Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:02:06.006652 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccda90f956d541b38c3e71181f397da9"}]}] Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db88db7d7835406a91b0c0817126419a Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: exception: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:06.007907 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'dc3ca6e4-3b33-4027-b567-e314d700580e'} Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:06.008706 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:06.009804 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:06.010915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Returning 404 to user: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:06.010915 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8231664-bf66-4ab8-bd87-6cd27a1215ad tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 404 len: 111 microversion: 2.1 time: 0.052429 Oct 02 01:02:06.010915 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 234/442] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:05 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:06.015406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:06.016392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:06.025662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:06.027219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:06.027948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.035152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:06.036013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:06.036758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.733391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:06.741790 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3bb1c5bc-4078-4b5e-bff2-7a8463c87ef1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1310 microversion: 2.1 time: 0.729957 Oct 02 01:02:06.742246 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 235/443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:06 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1310 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:06.762471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:06.764224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:06.771123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:06.771623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:06.772064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.772776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:06.773232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:06.773664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:06.829426 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:07.292327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:07.301627 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf0613a8-711b-4580-bf4e-817e8552bb79 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1462 microversion: 2.1 time: 0.553955 Oct 02 01:02:07.319335 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 236/444] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:06 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1462 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:07.344427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1288538769", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:07.452938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:08.130580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6221200-03de-41d3-b4b7-cfa1271c63f5 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.605906 Oct 02 01:02:08.131740 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 209/445] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:02:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:08.140297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-78a97441-01aa-4935-bc38-ec69131af4a8 req-de4b4946-e032-4d3c-8fcc-c7f46dc04c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539e1389-8245-4e0d-982c-5babbe7e5640", "name": "network-vif-plugged", "status": "completed", "tag": "853b586f-ceaa-4e4a-8bff-a2f941b444aa"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:08.170438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78a97441-01aa-4935-bc38-ec69131af4a8 req-de4b4946-e032-4d3c-8fcc-c7f46dc04c99 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:08.173049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78a97441-01aa-4935-bc38-ec69131af4a8 req-de4b4946-e032-4d3c-8fcc-c7f46dc04c99 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:08.178946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:08.180093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:08.180793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:08.181502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:08.182131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:08.185974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78a97441-01aa-4935-bc38-ec69131af4a8 req-de4b4946-e032-4d3c-8fcc-c7f46dc04c99 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:08.193927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:08.194890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:08.195544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:08.196776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:08.197574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:08.198472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:08.222069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Getting quotas for project ccda90f956d541b38c3e71181f397da9. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:08.230967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Getting quotas for user db88db7d7835406a91b0c0817126419a and project ccda90f956d541b38c3e71181f397da9. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:08.232611 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-78a97441-01aa-4935-bc38-ec69131af4a8 req-de4b4946-e032-4d3c-8fcc-c7f46dc04c99 service nova] Creating event network-vif-plugged:853b586f-ceaa-4e4a-8bff-a2f941b444aa for instance 539e1389-8245-4e0d-982c-5babbe7e5640 on n-h2-master-1 Oct 02 01:02:08.244422 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-78a97441-01aa-4935-bc38-ec69131af4a8 req-de4b4946-e032-4d3c-8fcc-c7f46dc04c99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110868 Oct 02 01:02:08.250320 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 210/446] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:08.257650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:08.260473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:08.264854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0ece49d4-9eb4-48c5-a723-019a1a8269b1 req-4a3239b4-f260-41ba-a360-5fcae57bab44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4323b7a8-83c0-44c2-ab5a-d2af274f5731", "tag": "aeec07f9-b729-423e-876c-5cf7a45c459b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:08.293882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ece49d4-9eb4-48c5-a723-019a1a8269b1 req-4a3239b4-f260-41ba-a360-5fcae57bab44 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:08.294366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ece49d4-9eb4-48c5-a723-019a1a8269b1 req-4a3239b4-f260-41ba-a360-5fcae57bab44 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:08.299563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ece49d4-9eb4-48c5-a723-019a1a8269b1 req-4a3239b4-f260-41ba-a360-5fcae57bab44 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:08.331050 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0ece49d4-9eb4-48c5-a723-019a1a8269b1 req-4a3239b4-f260-41ba-a360-5fcae57bab44 service nova] Creating event network-changed:aeec07f9-b729-423e-876c-5cf7a45c459b for instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 on n-h2-master-1 Oct 02 01:02:08.336205 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26f8d08e-bb81-48cb-b5a2-e4dd0eb81106 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015481 Oct 02 01:02:08.344706 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 237/447] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:08.345793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0ece49d4-9eb4-48c5-a723-019a1a8269b1 req-4a3239b4-f260-41ba-a360-5fcae57bab44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093904 Oct 02 01:02:08.346571 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 211/448] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:08.359373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:08.360171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:08.372137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:08.374066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:08.374660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:08.376658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:08.377248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:08.380538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:09.181052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:09.204757 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1d9a355d-223f-42d4-9ae8-916d3a4b8d1c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1313 microversion: 2.1 time: 0.852915 Oct 02 01:02:09.205671 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 238/449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:08 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:09.236969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:09.237582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:09.244247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:09.246382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:09.262921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:09.272666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:09.274513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:09.279872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:09.280372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:09.286421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:09.288022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:09.294556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:09.298260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:09.303931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:09.304654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:09.306289 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:09.306946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:10.320725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:10.339564 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3397af68-42fa-4701-870f-105384551afb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1310 microversion: 2.1 time: 1.128116 Oct 02 01:02:10.344572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 239/450] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:09 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1310 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:10.360974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2c75ec2-a295-48de-ac13-c767d18360eb tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Action: 'create', calling method: .version_select at 0x7fb881bf2ee0>, body: {"pool": null} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:11.180331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d51dba8c-bca2-4617-b27a-0d43ef116997 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1613 microversion: 2.1 time: 2.829101 Oct 02 01:02:11.184082 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 212/451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:08 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1613 bytes in 2836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:11.196538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:11.203149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:11.221342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:11.222558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:11.224598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:11.228212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:11.232650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:11.234375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:11.869169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:11.910251 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ab80f3e-638b-4a5f-af21-3e23c9ffd5fd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1280 microversion: 2.1 time: 0.724638 Oct 02 01:02:11.914369 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 213/452] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:11 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1280 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:11.952809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:11.954568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:11.975562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:11.984684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:11.985146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:11.985897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:11.989318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:11.989966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:12.948755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:12.959437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24672912-5eda-4520-8db8-83cbd2d1b64c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1462 microversion: 2.1 time: 1.030019 Oct 02 01:02:12.966250 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 214/453] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:11 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1462 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:12.986274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:12.992656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:12.994698 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:13.014891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:13.017781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:13.018235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:13.020947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:13.024211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:13.025178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:13.281795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bfabe41ff3a6492b95dfcff64ffc38d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109446141724cb18793396cffef0f5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:13.284623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] flavor_id is None. Assuming migration. {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 02 01:02:13.288145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:02:13.706647 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cabd547f-2ecc-4379-ac26-eb24aca8727a tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf/action" status: 202 len: 0 microversion: 2.1 time: 0.726161 Oct 02 01:02:13.707921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 215/454] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:12 2022] POST /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:13.714530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:13.716992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:13.729248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:13.729762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:13.730164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:13.730903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:13.731341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:13.731763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:15.152083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:15.165043 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6660ad93-a858-41a3-be48-ca2c02ec2544 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1310 microversion: 2.1 time: 1.454895 Oct 02 01:02:15.166717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 216/455] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:13 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1310 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:15.179314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:15.180207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:15.194681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:15.195761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:15.196448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:15.202109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:15.203916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:15.204491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:16.416915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:16.430444 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-61a96c32-7b83-4015-b8f2-bff452ff6396 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 1.258863 Oct 02 01:02:16.434010 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 217/456] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:15 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:16.818987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:16.830061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'deleted': False, 'project_id': '6cdc0650facb49ac86c4f8f79c2751f8'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:16.846394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:16.847587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:16.849460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:16.852048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:16.852781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:16.855769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.147561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7106e59-ed23-46d0-8a31-a6abbeb3e7a0 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.711715 Oct 02 01:02:17.157148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 218/457] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:02:16 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:17.169376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:17.170032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:17.177051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.177504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.177950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.178682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.179703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.179703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.660549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2c75ec2-a295-48de-ac13-c767d18360eb tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.313473 Oct 02 01:02:17.662623 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 240/458] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:02:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:17.667989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f28a0b01-8796-46e8-b078-cdc1f7153fbb req-6e7e8d8c-b805-4064-8680-0c9655fe879f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323b7a8-83c0-44c2-ab5a-d2af274f5731", "name": "network-vif-plugged", "status": "completed", "tag": "aeec07f9-b729-423e-876c-5cf7a45c459b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:17.706302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f28a0b01-8796-46e8-b078-cdc1f7153fbb req-6e7e8d8c-b805-4064-8680-0c9655fe879f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.710713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f28a0b01-8796-46e8-b078-cdc1f7153fbb req-6e7e8d8c-b805-4064-8680-0c9655fe879f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.711624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f28a0b01-8796-46e8-b078-cdc1f7153fbb req-6e7e8d8c-b805-4064-8680-0c9655fe879f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.774704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f28a0b01-8796-46e8-b078-cdc1f7153fbb req-6e7e8d8c-b805-4064-8680-0c9655fe879f service nova] Creating event network-vif-plugged:aeec07f9-b729-423e-876c-5cf7a45c459b for instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 on n-h2-master-1 Oct 02 01:02:17.789413 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f28a0b01-8796-46e8-b078-cdc1f7153fbb req-6e7e8d8c-b805-4064-8680-0c9655fe879f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124913 Oct 02 01:02:17.790557 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 241/459] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:17.801758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:17.805491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:17.833776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.835726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.836467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.871257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.871756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.872203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:18.151951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:18.200103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd672385-b558-4b77-be3b-9cf8aca8be20 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1471 microversion: 2.1 time: 1.049813 Oct 02 01:02:18.212470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 219/460] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:17 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1471 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:18.212684 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:18.248643 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:18.356392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1425051651", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "f45f022a-328d-48ee-8bd2-7d2edf137424"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:18.456461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] validate_networks() for [('f45f022a-328d-48ee-8bd2-7d2edf137424', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:18.457266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:18.469369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24f43eab-5d70-4b0f-9f3b-afe78119a6e8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1310 microversion: 2.1 time: 0.676876 Oct 02 01:02:18.472179 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 242/461] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:17 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1310 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:18.502298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:18.509944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'deleted': False} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:18.540922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:18.542256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:18.542934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:18.543902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:18.544571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:18.545217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:18.879370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:02:19.277471 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:19.282431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:19.283239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:19.284187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:19.618702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:19.619394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:19.619709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:19.620351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:19.620820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:19.632438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:19.633214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:19.634279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:19.637919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:19.639145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:19.640122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:19.691903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Getting quotas for project b94d90c894bf4eac916e2ff32975efcd. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:19.699848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Getting quotas for user 25fbb294f2064ce386c25ce5e371a1dc and project b94d90c894bf4eac916e2ff32975efcd. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:19.714902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:19.720081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:19.782007 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d19af9c-6a2a-481d-930a-1ec15ed12747 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576295 Oct 02 01:02:19.784301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 220/462] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:19.787986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:19.788656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:19.797525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:19.798042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:19.798546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:19.799332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:19.799844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:19.800467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:20.866244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:20.892142 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd689ff7-fe22-4843-8206-e636000e4f4d tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 1.107375 Oct 02 01:02:20.893003 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 221/463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:19 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:20.905460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3feb72f6-4649-41e5-82bb-aff00ee36a08 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Action: 'create', calling method: .version_select at 0x7fb881ae4700>, body: {"pool": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:21.304670 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fcb04644-5847-43ad-81f8-7132a66a756a tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11195 microversion: 2.1 time: 2.812398 Oct 02 01:02:21.309912 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 243/464] 10.222.0.23 () {58 vars in 1171 bytes} [Sun Oct 2 01:02:18 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11195 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:02:21.311764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-80115de5-0f55-4e6f-957c-6463681980b3 req-87c13250-a80e-47bd-996f-544a56ee980d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa05284-39f3-42d0-b9b1-c5dce05d2a30", "tag": "11624355-5d12-4291-95fa-4403cd9e61ca"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:21.332544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-80115de5-0f55-4e6f-957c-6463681980b3 req-87c13250-a80e-47bd-996f-544a56ee980d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:21.333027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-80115de5-0f55-4e6f-957c-6463681980b3 req-87c13250-a80e-47bd-996f-544a56ee980d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:21.333448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-80115de5-0f55-4e6f-957c-6463681980b3 req-87c13250-a80e-47bd-996f-544a56ee980d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:21.353490 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-80115de5-0f55-4e6f-957c-6463681980b3 req-87c13250-a80e-47bd-996f-544a56ee980d service nova] Creating event network-changed:11624355-5d12-4291-95fa-4403cd9e61ca for instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 on n-h1-master-1 Oct 02 01:02:21.359913 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-80115de5-0f55-4e6f-957c-6463681980b3 req-87c13250-a80e-47bd-996f-544a56ee980d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052246 Oct 02 01:02:21.360507 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 244/465] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:21.367859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:21.368796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:21.401891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:21.402397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:21.402866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:21.406534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:21.407549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:21.408486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:21.746534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:21.758938 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d591ac12-7ff4-4795-8978-b0bdfd187f2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1471 microversion: 2.1 time: 0.396856 Oct 02 01:02:21.762960 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 245/466] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:21 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:21.782195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:21.783360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:21.791892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:21.792674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:21.793470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:21.794352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:21.795111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:21.795941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:22.331036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:22.341635 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c846172a-ec1b-429c-ad0f-a877f9138b16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1493 microversion: 2.1 time: 0.577185 Oct 02 01:02:22.345075 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 246/467] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:21 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1493 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:22.359313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:22.360272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:22.370500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:22.372002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:22.375133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:22.376432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:22.377011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:22.379244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:22.512816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:22.525501 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44bd0841-c969-419c-baf6-7c583dd61182 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1282 microversion: 2.1 time: 0.178806 Oct 02 01:02:22.526341 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 247/468] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:22 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:22.533685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:22.563010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'deleted': False, 'project_id': '6cdc0650facb49ac86c4f8f79c2751f8'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:22.575306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:22.575794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:22.576229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:22.576960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:22.577419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:22.577845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:22.810435 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a8a6597-fa6e-4584-8065-a64578237224 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=683c16b60ba34123bf0175396dffaf83" status: 200 len: 15 microversion: 2.1 time: 0.268843 Oct 02 01:02:22.811488 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 248/469] 10.222.0.23 () {58 vars in 1231 bytes} [Sun Oct 2 01:02:22 2022] GET /compute/v2.1/servers/detail?tenant_id=683c16b60ba34123bf0175396dffaf83 => generated 15 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:22.816198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:22.816813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:22.824521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:22.825012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:22.825450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:22.826161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:22.826634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:22.828188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:23.307321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:23.309905 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:23.320434 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9fe6899-8fa1-49f4-82e7-1862eb6c5dd0 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 0.507842 Oct 02 01:02:23.323961 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 249/470] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:22 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:23.675130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:23.676520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:23.690137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:23.691010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:23.691723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:23.692502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:23.693156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:23.693798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:23.699367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3feb72f6-4649-41e5-82bb-aff00ee36a08 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.804099 Oct 02 01:02:23.700464 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 222/471] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:02:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:23.705454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:23.706146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:23.727669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:23.729066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:23.731303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:23.733021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:23.733495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:23.733982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:24.019457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:24.032243 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0f06cab0-54be-4547-959f-c6247217c048 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1471 microversion: 2.1 time: 0.330704 Oct 02 01:02:24.035450 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 223/472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:23 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:24.046100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:24.069238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'tenant_id': '683c16b60ba34123bf0175396dffaf83', 'deleted': False} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:24.081637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:24.084886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:24.088505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:24.089547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:24.090993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:24.091609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:24.113135 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-851d8264-8ec1-40ed-8277-27e53282590b tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1644 microversion: 2.1 time: 0.781924 Oct 02 01:02:24.113825 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 250/473] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:23 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1644 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:24.135120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:24.136641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:24.153475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:24.168478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:24.170290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:24.173743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:24.176720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:24.177595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:24.179031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:02:24.489709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:24.490103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:24.495260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:24.730994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:24.746874 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bdbfa037-9106-4f36-8074-eecb2c564f6f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1324 microversion: 2.1 time: 0.629864 Oct 02 01:02:24.758637 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 251/474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:24 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1324 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:24.761758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d6741dd-c934-4870-b8ab-228eb15a002e tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Action: 'create', calling method: .version_select at 0x7fb881c7ef70>, body: {"pool": null} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:25.036654 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a64ab6b-b233-49af-892b-9c0f810f68a2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=683c16b60ba34123bf0175396dffaf83" status: 200 len: 4824 microversion: 2.1 time: 0.998207 Oct 02 01:02:25.037583 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 224/475] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:02:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=683c16b60ba34123bf0175396dffaf83 => generated 4824 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:25.060041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:25.061086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:25.079072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:25.079598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:25.080047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:25.083038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:25.083515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:25.083972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:25.493074 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df657cf7-6440-4b20-a055-1ed3bcb4e9db tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1644 microversion: 2.1 time: 0.452508 Oct 02 01:02:25.496704 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 225/476] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:25 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1644 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:25.505866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:25.522285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:25.536438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:25.536938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:25.538955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:25.543587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:25.544161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:25.544611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:25.600133 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:25.984891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:25.993097 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e3f3211-059e-4a2d-bdea-ff3e3333ab9c tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 0.495001 Oct 02 01:02:25.996806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 226/477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:25 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:26.015664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:26.017019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:26.028468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.036288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.036961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.038311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.038949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.039524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.317884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:26.329399 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06be2f57-8911-4dea-9d7c-eb3cabf276cd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.330485 Oct 02 01:02:26.332981 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 227/478] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:25 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:26.338732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:26.378020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'tenant_id': '6cdc0650facb49ac86c4f8f79c2751f8', 'deleted': False} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:26.383452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.383934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.385599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.386366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.387419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.387913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.435828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2472199-06a5-4cb4-a1c7-d99188f869d6 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6cdc0650facb49ac86c4f8f79c2751f8" status: 200 len: 15 microversion: 2.1 time: 0.103099 Oct 02 01:02:26.436788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 228/479] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:02:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6cdc0650facb49ac86c4f8f79c2751f8 => generated 15 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:26.441576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-92cc2215-96a1-47ad-88d7-09f0bb64328a req-a4e80fe9-d418-4e40-ad03-8af29a95f362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:26.459626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92cc2215-96a1-47ad-88d7-09f0bb64328a req-a4e80fe9-d418-4e40-ad03-8af29a95f362 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.460132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92cc2215-96a1-47ad-88d7-09f0bb64328a req-a4e80fe9-d418-4e40-ad03-8af29a95f362 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.460571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92cc2215-96a1-47ad-88d7-09f0bb64328a req-a4e80fe9-d418-4e40-ad03-8af29a95f362 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.473070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-92cc2215-96a1-47ad-88d7-09f0bb64328a req-a4e80fe9-d418-4e40-ad03-8af29a95f362 service nova] Creating event network-changed:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:02:26.480013 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-92cc2215-96a1-47ad-88d7-09f0bb64328a req-a4e80fe9-d418-4e40-ad03-8af29a95f362 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041897 Oct 02 01:02:26.490644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 229/480] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:26.496151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:26.500689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.501443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.502087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.503039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.503722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.505478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.551789 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05711ef8-0af3-481c-9c8b-20bf9fe61d12 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057626 Oct 02 01:02:26.554829 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 230/481] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:02:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:26.564525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:26.565535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:26.574814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.575288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.575724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.576480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.576898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.577321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.911476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:26.922155 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6ab4281-3af5-4723-a748-822db65e0db1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1324 microversion: 2.1 time: 0.366164 Oct 02 01:02:26.938301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 231/482] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:26 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:26.944377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f62d84db-3869-4cfd-a5e0-3c6181e1fdf3 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:26.950367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f62d84db-3869-4cfd-a5e0-3c6181e1fdf3 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010029 Oct 02 01:02:26.951251 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 232/483] 10.222.0.23 () {58 vars in 1189 bytes} [Sun Oct 2 01:02:26 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:26.974687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:26.979717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:26.986705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.987526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.988167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:26.989084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:26.989786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:26.990426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:27.111356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lazy-loading 'flavor' on Instance uuid 4323b7a8-83c0-44c2-ab5a-d2af274f5731 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:27.113832 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d6741dd-c934-4870-b8ab-228eb15a002e tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.364907 Oct 02 01:02:27.114440 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 252/484] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:02:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:27.119403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:27.125517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:27.138739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:27.139231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:27.139665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:27.140378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:27.140834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:27.141250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:27.174938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Going to try to live migrate instance to n-h1-master-1 {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:02:27.324379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac727abf-2c5d-46fa-b442-1114cc29a668 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 0 microversion: 2.1 time: 0.208701 Oct 02 01:02:27.325415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 253/485] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:27 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:27.335465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:27.336216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:27.343480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:27.344021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:27.344455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:27.345157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:27.345694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:27.346191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:27.779738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:27.788977 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d05acc68-990b-4304-a9da-a161911683b2 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 0.460729 Oct 02 01:02:27.803938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 254/486] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:27 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:27.803938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4185076f-0467-4e2f-92f6-60482271e203 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb881c7c0d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:28.076981 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4185076f-0467-4e2f-92f6-60482271e203 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/7b7b2cac-6481-4ba1-9a62-faeeefd41152" status: 200 len: 142 microversion: 2.1 time: 0.284505 Oct 02 01:02:28.077863 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 255/487] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:02:27 2022] GET /compute/v2.1/os-floating-ips/7b7b2cac-6481-4ba1-9a62-faeeefd41152 => generated 142 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:28.082655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:28.088653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:28.091493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '683c16b60ba34123bf0175396dffaf83'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:28.100471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.101178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.101956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.103918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.104563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.105341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.208403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:02:28.283689 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e9c77b8-0fae-4f43-a756-7b1e84b01272 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.203691 Oct 02 01:02:28.291355 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 256/488] 10.222.0.23 () {58 vars in 1150 bytes} [Sun Oct 2 01:02:28 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:28.291355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:28.291355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:28.297632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.298074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.298936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.299293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.299790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.300181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.592483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:28.600529 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6352e4c-5b25-42f3-926a-0104b1bf6868 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.314894 Oct 02 01:02:28.601300 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 257/489] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:28 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:28.606415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:28.607049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:28.613274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.615963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.615963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.616629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.617625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.617625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.822586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:28.831223 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7d3e714-19f9-4cb3-990c-7d34b2e4d879 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1324 microversion: 2.1 time: 0.229014 Oct 02 01:02:28.847339 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 258/490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:28 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:28.852255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5947a1c4-7be7-46b3-8a10-bf8ac62241e2 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb881938b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:29.270663 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:29.278232 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5d06686-c816-42d5-be4c-186511559054 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731/action" status: 202 len: 0 microversion: 2.1 time: 2.313651 Oct 02 01:02:29.279235 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 233/491] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:26 2022] POST /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731/action => generated 0 bytes in 2315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:29.289349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-00a44197-8fc9-4876-801c-c81c35dcd77b req-8caa3d37-44e0-4741-8b25-0066bfe1c65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa05284-39f3-42d0-b9b1-c5dce05d2a30", "name": "network-vif-plugged", "status": "completed", "tag": "11624355-5d12-4291-95fa-4403cd9e61ca"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:29.308105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-00a44197-8fc9-4876-801c-c81c35dcd77b req-8caa3d37-44e0-4741-8b25-0066bfe1c65f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.308871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-00a44197-8fc9-4876-801c-c81c35dcd77b req-8caa3d37-44e0-4741-8b25-0066bfe1c65f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.309775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-00a44197-8fc9-4876-801c-c81c35dcd77b req-8caa3d37-44e0-4741-8b25-0066bfe1c65f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.321733 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-00a44197-8fc9-4876-801c-c81c35dcd77b req-8caa3d37-44e0-4741-8b25-0066bfe1c65f service nova] Creating event network-vif-plugged:11624355-5d12-4291-95fa-4403cd9e61ca for instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 on n-h1-master-1 Oct 02 01:02:29.328634 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-00a44197-8fc9-4876-801c-c81c35dcd77b req-8caa3d37-44e0-4741-8b25-0066bfe1c65f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047983 Oct 02 01:02:29.329855 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 234/492] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:29.337592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:29.340457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:29.348888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.349746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.350392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.351326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.351980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.353487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.459543 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eb44f5dc-decb-457d-af0f-13025f53c6e7 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 0 microversion: 2.1 time: 0.126502 Oct 02 01:02:29.462906 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 235/493] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:29 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:29.472131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:29.473135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:29.479870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.480353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.480787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.481486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.481937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.482363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.759753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:29.769774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a10d11a-4d5c-4c50-9fc1-266c122acfe5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 0.305694 Oct 02 01:02:29.772104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 236/494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:29 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:29.778301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:29.779232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:29.785199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.785923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.786476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.787477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.788673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.789042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.019134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:30.031627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e70651e5-ddd9-4302-b23a-b6ab3314939f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.258431 Oct 02 01:02:30.032497 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 237/495] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:29 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:30.052406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:30.053037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:30.076216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.077986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.082495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.083483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.084113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.085145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.131264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5947a1c4-7be7-46b3-8a10-bf8ac62241e2 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/7b7b2cac-6481-4ba1-9a62-faeeefd41152" status: 202 len: 0 microversion: 2.1 time: 1.278695 Oct 02 01:02:30.132686 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 259/496] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:02:28 2022] DELETE /compute/v2.1/os-floating-ips/7b7b2cac-6481-4ba1-9a62-faeeefd41152 => generated 0 bytes in 1285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:30.145026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:30.146022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:30.153230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.154057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.154759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.156066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.156729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.157372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.336068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1989ccc-68ce-4520-a32f-155e66869c29 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1614 microversion: 2.1 time: 0.288200 Oct 02 01:02:30.351151 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 238/497] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1614 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:30.355775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:30.366867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:30.367471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:30.368352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80f714ee-d431-471f-8de4-cf9a3deea9c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.230106 Oct 02 01:02:30.368961 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 260/498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:30.373688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1099c9fe-be0c-4ccc-b7a8-aa98c67dcb2d tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb881938b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:30.381980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.382903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.383570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.386167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.386650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.387085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.700942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:30.706422 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1099c9fe-be0c-4ccc-b7a8-aa98c67dcb2d tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.336122 Oct 02 01:02:30.707031 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 261/499] 10.222.0.23 () {58 vars in 1164 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:30.711710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:30.713230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:30.719516 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d38dba20-eaca-4a8a-8acd-8dccf874f4e6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1324 microversion: 2.1 time: 0.366748 Oct 02 01:02:30.722203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.722203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.722203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.722501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.722967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.723706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.744727 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 239/500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:30.754002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-703badfa-2ea4-4665-be0b-1f6c2ef932b8 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb881bc4dc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.041290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e729559-dd53-4f29-bc56-24dbb88558f2 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1614 microversion: 2.1 time: 0.324219 Oct 02 01:02:31.052964 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 262/501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1614 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:31.064818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.066338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:31.073854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.074393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.074832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.075806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.076478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.076924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.107078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-703badfa-2ea4-4665-be0b-1f6c2ef932b8 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.359567 Oct 02 01:02:31.109742 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 240/502] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:31.125733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.126687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:31.134355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.135224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.135854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.136755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.137407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.137834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.341780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:31.351294 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3754236-ca02-4b8c-898b-4dea752453b4 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1320 microversion: 2.1 time: 0.296754 Oct 02 01:02:31.354012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 263/503] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:31 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:31.361580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.370772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:31.376404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'host': 'n-h2-master-1', 'deleted': False} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:31.381769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.382508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.383401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.384842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.385392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.388473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.389556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1afc06a-4bc2-44f0-9e19-c37271deffc5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.268527 Oct 02 01:02:31.390433 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 241/504] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:31 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:31.396174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2a774067-a3a9-474e-9563-da3abd88122a tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb88190c5e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.510979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:02:31.578158 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2abf41ea-4988-4e9b-a883-ed73b839f1ab tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1" status: 200 len: 1321 microversion: 2.1 time: 0.222115 Oct 02 01:02:31.579519 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 264/505] 10.222.0.23 () {58 vars in 1190 bytes} [Sun Oct 2 01:02:31 2022] GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:31.584412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.585131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:31.596759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.597496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.598736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.599493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.600032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.600500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.201574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:32.209889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0734c71e-ccf9-4e21-8458-34bdc1739cbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.629004 Oct 02 01:02:32.219460 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 265/506] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:31 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:32.224416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:32.245505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:02:32.254864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.255628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.256079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.256830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.257289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.257735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.292822 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58bf5f84-00ca-4f84-8565-ad9707660b5e tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.071903 Oct 02 01:02:32.293728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 266/507] 10.222.0.23 () {58 vars in 1196 bytes} [Sun Oct 2 01:02:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:32.298433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:32.299078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:32.305554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.306047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.306712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.307425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.308448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.309170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.620000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:32.633339 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-661bb210-1e4b-4a0d-bfaa-64a8278e6aa5 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1324 microversion: 2.1 time: 0.338523 Oct 02 01:02:32.635728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 267/508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:32 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:32.641152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1c507b7b-e5db-4f8a-a204-2d29cdc0f017 req-6fea4c93-958d-4bf7-8297-2bc3a3c06f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323b7a8-83c0-44c2-ab5a-d2af274f5731", "name": "network-vif-unplugged", "status": "completed", "tag": "aeec07f9-b729-423e-876c-5cf7a45c459b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:32.652705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c507b7b-e5db-4f8a-a204-2d29cdc0f017 req-6fea4c93-958d-4bf7-8297-2bc3a3c06f0f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.654411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c507b7b-e5db-4f8a-a204-2d29cdc0f017 req-6fea4c93-958d-4bf7-8297-2bc3a3c06f0f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.655059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c507b7b-e5db-4f8a-a204-2d29cdc0f017 req-6fea4c93-958d-4bf7-8297-2bc3a3c06f0f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.669589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1c507b7b-e5db-4f8a-a204-2d29cdc0f017 req-6fea4c93-958d-4bf7-8297-2bc3a3c06f0f service nova] Creating event network-vif-unplugged:aeec07f9-b729-423e-876c-5cf7a45c459b for instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 on n-h2-master-1 Oct 02 01:02:32.678288 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1c507b7b-e5db-4f8a-a204-2d29cdc0f017 req-6fea4c93-958d-4bf7-8297-2bc3a3c06f0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039560 Oct 02 01:02:32.679594 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 268/509] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:32.689876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:32.693559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:32.700770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.703728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.704388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.705278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.705888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.706531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.735389 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:32.823424 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2a774067-a3a9-474e-9563-da3abd88122a tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/47493523-345d-43a4-be96-3829a8c4f49b" status: 202 len: 0 microversion: 2.1 time: 1.431756 Oct 02 01:02:32.830940 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 242/510] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:02:31 2022] DELETE /compute/v2.1/os-floating-ips/47493523-345d-43a4-be96-3829a8c4f49b => generated 0 bytes in 1440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:32.837447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:32.838377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:32.846985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52929daf-93fa-40d7-b046-1af81bbf3412 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 0 microversion: 2.1 time: 0.161785 Oct 02 01:02:32.848033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 269/511] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:32 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:32.849920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.850610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.851426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.853723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.854377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.854999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.859475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:32.861484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:32.867493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.868193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.869299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.870139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.870764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.871300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.080235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:33.081855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:33.090748 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d8d931e3-54b0-4ba1-8c82-9a88c9f538ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.238215 Oct 02 01:02:33.091653 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 270/512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:32 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:33.096144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-23243dec-e41d-4809-987c-ce3251c14db8 req-309d46b8-d3a6-41b0-93e5-c18e1d584f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "name": "network-vif-plugged", "status": "completed", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:33.107870 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f4751639-c798-435a-9dca-d88540b2685b tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1470 microversion: 2.1 time: 0.275550 Oct 02 01:02:33.108460 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 243/513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:32 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:33.108624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-23243dec-e41d-4809-987c-ce3251c14db8 req-309d46b8-d3a6-41b0-93e5-c18e1d584f93 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.109362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-23243dec-e41d-4809-987c-ce3251c14db8 req-309d46b8-d3a6-41b0-93e5-c18e1d584f93 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.109890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-23243dec-e41d-4809-987c-ce3251c14db8 req-309d46b8-d3a6-41b0-93e5-c18e1d584f93 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.119765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ed8de4e-04d9-4b32-95c6-25166e2d5551 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb8817ecaf0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:33.129146 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-23243dec-e41d-4809-987c-ce3251c14db8 req-309d46b8-d3a6-41b0-93e5-c18e1d584f93 service nova] Creating event network-vif-plugged:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:02:33.135253 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-23243dec-e41d-4809-987c-ce3251c14db8 req-309d46b8-d3a6-41b0-93e5-c18e1d584f93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042484 Oct 02 01:02:33.136403 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 271/514] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:33.142781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:33.145794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:33.155499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.156144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.156680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.157598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.158385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.159010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.255398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:33.256076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:33.256704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:33.257286 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:33.257859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:33.395758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:33.418687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.419194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.419636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.420354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.420811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.421228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.483134 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1c5d4bd7-8772-40e7-93b0-438ea5565317 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 1067 microversion: 2.1 time: 0.345299 Oct 02 01:02:33.494692 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 272/515] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:33 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 1067 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 02 01:02:33.494692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:33.496375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:33.515351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.515835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.516289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.516990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.517447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.517875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.625985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1193c27b-10c7-4978-aaf3-049bd1391857 tempest-DeleteServersAdminTestJSON-1382524658 tempest-DeleteServersAdminTestJSON-1382524658-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30/action" status: 202 len: 0 microversion: 2.1 time: 0.138576 Oct 02 01:02:33.631161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 273/516] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:33 2022] POST /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:33.639756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:33.640385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:33.646494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.647010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.647447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.648313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.649228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.649663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.867565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:33.877124 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65735dad-f402-4902-8c6e-04c564767c6d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.244715 Oct 02 01:02:33.890626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 274/517] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:33 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:33.890626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:33.890626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:33.891448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.892003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.892838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.893604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:33.894350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:33.899018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.139072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:34.147274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-163aefd5-c433-4950-b2c4-d0c42a58dbc1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.267921 Oct 02 01:02:34.148140 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 275/518] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:33 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:34.163306 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ed8de4e-04d9-4b32-95c6-25166e2d5551 tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/9ed6924d-869e-4147-8f62-3debda982623" status: 202 len: 0 microversion: 2.1 time: 1.053483 Oct 02 01:02:34.164515 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 244/519] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:02:33 2022] DELETE /compute/v2.1/os-floating-ips/9ed6924d-869e-4147-8f62-3debda982623 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:34.169602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:34.170223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:34.171538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:34.172334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:34.176687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.177184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.177625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.178337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.178861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.179638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.187050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.189683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.190235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.194144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.194946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.195613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.212746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.213234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.213685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.214111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lazy-loading 'fault' on Instance uuid 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:34.437371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:34.443691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:34.443973 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:34.450109 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b21fbc0c-f9f6-49be-ab25-c1b6ad7f1521 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1324 microversion: 2.1 time: 0.283172 Oct 02 01:02:34.451320 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 245/520] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:34 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:34.456355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:34.457137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:34.466123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.467054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.467678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.468641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.469247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.469819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.471038 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61a86106-a6f1-4f78-a07e-9b863eb8ec80 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1453 microversion: 2.1 time: 0.307223 Oct 02 01:02:34.471626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 276/521] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:34 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1453 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:34.478544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80286d77-f553-4d43-9c74-338a0724edfb tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] Calling method '.version_select at 0x7fb881938040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:34.522222 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:34.759212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:34.776793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d54f547a-e6b5-4844-9528-6e7ab3118ac6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.324100 Oct 02 01:02:34.777909 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 246/522] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:34 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:34.788765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:34.789264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:34.798399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.799175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.799605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.800300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.801453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.802440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.836661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:02:34.978290 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76a9d32c-b5a3-4f31-b3c0-c4a1307302ef tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 204 len: 0 microversion: 2.1 time: 0.197997 Oct 02 01:02:34.981149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 247/523] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:02:34 2022] DELETE /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:02:34.993334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-15308f0c-af4b-40b9-ae3d-3249e2b478c8 req-2f1f451b-6822-4cd1-b72e-e76d230967da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4323b7a8-83c0-44c2-ab5a-d2af274f5731", "tag": "aeec07f9-b729-423e-876c-5cf7a45c459b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:35.002950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15308f0c-af4b-40b9-ae3d-3249e2b478c8 req-2f1f451b-6822-4cd1-b72e-e76d230967da service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.003430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15308f0c-af4b-40b9-ae3d-3249e2b478c8 req-2f1f451b-6822-4cd1-b72e-e76d230967da service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.003856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15308f0c-af4b-40b9-ae3d-3249e2b478c8 req-2f1f451b-6822-4cd1-b72e-e76d230967da service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.021108 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-15308f0c-af4b-40b9-ae3d-3249e2b478c8 req-2f1f451b-6822-4cd1-b72e-e76d230967da service nova] Creating event network-changed:aeec07f9-b729-423e-876c-5cf7a45c459b for instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 on n-h2-master-1 Oct 02 01:02:35.037442 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-15308f0c-af4b-40b9-ae3d-3249e2b478c8 req-2f1f451b-6822-4cd1-b72e-e76d230967da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054586 Oct 02 01:02:35.038675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 248/524] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:35.044607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:35.045515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:35.054070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.054755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.055885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.056592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.057044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.057489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.301411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:35.310985 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6c8e343-aa73-41d7-b27a-20952c0204f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.270807 Oct 02 01:02:35.312310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 249/525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:35 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:35.317222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:35.318140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:35.325973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.326583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.327153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.328073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.328549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.329090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.369383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.370026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.370551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.371151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lazy-loading 'fault' on Instance uuid 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:35.589121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:35.597215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a57779f-5c79-4e58-9216-780742289368 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1459 microversion: 2.1 time: 0.283546 Oct 02 01:02:35.613257 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 250/526] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:35 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1459 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:35.620377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:35.621118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:35.627046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.627937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.628602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.629523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.630182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.630912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.644343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80286d77-f553-4d43-9c74-338a0724edfb tempest-FloatingIPDetailsTestJSON-1881510777 tempest-FloatingIPDetailsTestJSON-1881510777-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/564d3510-5bcb-4cf7-abad-4f1de89c203c" status: 202 len: 0 microversion: 2.1 time: 1.171002 Oct 02 01:02:35.648288 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 277/527] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:02:34 2022] DELETE /compute/v2.1/os-floating-ips/564d3510-5bcb-4cf7-abad-4f1de89c203c => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:35.653168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:35.653758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:35.663754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.664599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.665302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.666158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.667272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.667976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.873834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:35.887059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ca2324b-1865-4594-b265-442ffdbdc7e9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.272274 Oct 02 01:02:35.903511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 251/528] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:35 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:35.910459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:35.915526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:35.932979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:35.942372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.942896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.943337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.943744 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62106361-ca7d-4c08-ba43-da9a2f273a8c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1520 microversion: 2.1 time: 0.296517 Oct 02 01:02:35.944058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.944505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.944936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.957271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 278/529] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:35 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:35.984095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0fc6e751-4137-4239-9f30-909153ec92d9 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'create', calling method: .version_select at 0x7fb881890430>, body: {"pool": null} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:36.223049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:36.232822 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b892df6-b0e2-4601-9968-c549fce0797c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.327733 Oct 02 01:02:36.233408 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 252/530] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:35 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:36.356394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb556136-8ec8-46f9-871a-6bc5edb316c9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Action: 'create', calling method: .version_select at 0x7fb8817fe160>, body: {"keypair": {"name": "tempest-keypair-455707336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6OaBb4o0p1ACaqBE1F3HaoMUuudcwRcI+v/Ky83ruilzhVlt5qrMbQl8X3A8Yp7LY3fgT6hyruvsiMDrzgKp3HSCqJp7iuUemqY6JbJypPicqAwltBC/yTMrvxUB4M+w=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:36.365984 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:36.378505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-cb556136-8ec8-46f9-871a-6bc5edb316c9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Getting quotas for project 8fa7bf422e16441498c97377ae1b7a85. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:36.386714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-cb556136-8ec8-46f9-871a-6bc5edb316c9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Getting quotas for user 9632b1b483dd442f88e8898ef29eb257 and project 8fa7bf422e16441498c97377ae1b7a85. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:36.417011 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb556136-8ec8-46f9-871a-6bc5edb316c9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181884 Oct 02 01:02:36.424602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 253/531] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:02:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:36.424602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:36.424602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:36.430710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.431745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.431745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.432758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.433317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.434230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.522837 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:36.694201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:36.703616 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-824c40ce-7ffb-406f-b0fc-fc8edf7f88a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.284792 Oct 02 01:02:36.704624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 254/532] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:36 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:36.725350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:36.730552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:36.737543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.738044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.738488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.740036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.740673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.741107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.778560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.779114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.779560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.780016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lazy-loading 'fault' on Instance uuid 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:37.286408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:37.294475 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bad2a410-411a-4bf0-8397-ab3c4dc163ce tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1459 microversion: 2.1 time: 0.573756 Oct 02 01:02:37.295220 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 255/533] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:36 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1459 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:37.313018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:37.313843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:37.320112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.321734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.323063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.324011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.324600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.325124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.622281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:37.635893 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27b67c5a-9ab8-400d-95c2-63618d1e63f9 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.339352 Oct 02 01:02:37.636592 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 256/534] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:37 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:37.641850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:37.649310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:37.668274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.669579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.670176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.672373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.673291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.673788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.227919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:38.254698 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57cc683e-e0e8-41f1-9205-3639fb2960d4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.615373 Oct 02 01:02:38.255649 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 257/535] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:37 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:38.272208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-343c2341-3984-4e7a-80dd-f114e5d7273d req-55466dd3-66ad-4e6b-bb4c-0facc99c0cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa05284-39f3-42d0-b9b1-c5dce05d2a30", "name": "network-vif-deleted", "tag": "11624355-5d12-4291-95fa-4403cd9e61ca"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:38.298771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-343c2341-3984-4e7a-80dd-f114e5d7273d req-55466dd3-66ad-4e6b-bb4c-0facc99c0cb9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.300832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-343c2341-3984-4e7a-80dd-f114e5d7273d req-55466dd3-66ad-4e6b-bb4c-0facc99c0cb9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.301510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-343c2341-3984-4e7a-80dd-f114e5d7273d req-55466dd3-66ad-4e6b-bb4c-0facc99c0cb9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.319972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-343c2341-3984-4e7a-80dd-f114e5d7273d req-55466dd3-66ad-4e6b-bb4c-0facc99c0cb9 service nova] Creating event network-vif-deleted:11624355-5d12-4291-95fa-4403cd9e61ca for instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 on n-h1-master-1 Oct 02 01:02:38.326884 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-343c2341-3984-4e7a-80dd-f114e5d7273d req-55466dd3-66ad-4e6b-bb4c-0facc99c0cb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068964 Oct 02 01:02:38.328374 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 258/536] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:38.335271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:38.336826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:38.346803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.347982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.348671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.349910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.350559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.351217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.359642 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0fc6e751-4137-4239-9f30-909153ec92d9 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.380258 Oct 02 01:02:38.360744 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 279/537] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:02:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:38.365741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:38.366574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:38.396772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.397278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.397720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.398438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.401226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.401677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.452067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.452803 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.453389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.454579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lazy-loading 'fault' on Instance uuid 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:38.642066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db88db7d7835406a91b0c0817126419a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccda90f956d541b38c3e71181f397da9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:38.666957 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61651523-9d9a-4f51-9efd-c003b4b3fccd tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 200 len: 1310 microversion: 2.1 time: 0.304234 Oct 02 01:02:38.684708 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 280/538] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:38 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 1310 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:38.690360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1252119752", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "f45f022a-328d-48ee-8bd2-7d2edf137424"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:38.751654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] validate_networks() for [('f45f022a-328d-48ee-8bd2-7d2edf137424', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:38.759907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:38.769385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f52e0b64-0385-4a84-97f5-e4c7ba49e952 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.439167 Oct 02 01:02:38.769892 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 259/539] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:38 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:38.775957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:38.776751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:38.783407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.784058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.784808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.785802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.786394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.787051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.087845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:39.099099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a27daa41-d58f-4045-aeba-ce3b0251caea tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.327960 Oct 02 01:02:39.100511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 260/540] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:38 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:39.286682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.287299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:39.295973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.296340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.296895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.297607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.298139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.298563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.738988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:39.747145 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6df1c3c-fb62-42e9-b61a-173a4301a79f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.467203 Oct 02 01:02:39.747731 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 261/541] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:39 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:39.759199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.759199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:39.759199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.760225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.760225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.760874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.760970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.761350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.768727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:39.769877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:39.770315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:39.770787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:39.771204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:39.792387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.792787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.793222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.793943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.794396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.794848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.797223 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] HTTP exception thrown: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Request method failure captured: Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 HTTP/1.1 Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLt91fTJqtwrzKDv-pMeezu1g56cbR6j6lNXTQhmCYBbZMJFrENQUaeyvA_TuO_rS9RjS1kOLB3Oa2Ums-Jp5deg6UR3FQrI2huUUlI6rKTQMosy49XULqY2YBKb-lH2HGMWiP1qNU0_qWHypKqTk-cb5MbFFnb_LV-C4PFBYX3LLE Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:02:39.798905 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccda90f956d541b38c3e71181f397da9"}]}] Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db88db7d7835406a91b0c0817126419a Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.800438 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '2aa05284-39f3-42d0-b9b1-c5dce05d2a30'} Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:39.801547 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.802902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.805187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Returning 404 to user: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:39.805939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03dfdfb0-bc2e-40e3-8ca2-85d0d82f69c5 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 404 len: 111 microversion: 2.1 time: 0.057134 Oct 02 01:02:39.806540 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 262/542] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:39 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:39.816577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.817396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:39.824149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.824854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.825460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.826314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.826939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.827560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.830913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Getting quotas for project b94d90c894bf4eac916e2ff32975efcd. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:39.832596 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:39.847366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Getting quotas for user 25fbb294f2064ce386c25ce5e371a1dc and project b94d90c894bf4eac916e2ff32975efcd. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:39.860842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:39.863195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:39.911197 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8ef2dc9-f90e-4286-932d-8daa178e8714 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225056 Oct 02 01:02:39.912043 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 281/543] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:39.917363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.917855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:39.925720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.926214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.926684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.927452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.927852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.928270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.947770 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] HTTP exception thrown: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Request method failure captured: Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 HTTP/1.1 Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLt91fTJqtwrzKDv-pMeezu1g56cbR6j6lNXTQhmCYBbZMJFrENQUaeyvA_TuO_rS9RjS1kOLB3Oa2Ums-Jp5deg6UR3FQrI2huUUlI6rKTQMosy49XULqY2YBKb-lH2HGMWiP1qNU0_qWHypKqTk-cb5MbFFnb_LV-C4PFBYX3LLE Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:02:39.949479 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccda90f956d541b38c3e71181f397da9"}]}] Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db88db7d7835406a91b0c0817126419a Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.951021 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '2aa05284-39f3-42d0-b9b1-c5dce05d2a30'} Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:39.951870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:39.953244 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:39.955673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Returning 404 to user: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:39.956526 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b87d3ba8-e588-4dfa-b590-5971d33ddb58 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 404 len: 111 microversion: 2.1 time: 0.043395 Oct 02 01:02:39.959408 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 282/544] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:02:39 2022] DELETE /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:39.971828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-717e0162-7806-4253-9aa2-5da070dd53cc tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.972978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-717e0162-7806-4253-9aa2-5da070dd53cc tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.073218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-717e0162-7806-4253-9aa2-5da070dd53cc tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:40.082927 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-717e0162-7806-4253-9aa2-5da070dd53cc tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1224 microversion: 2.1 time: 0.121867 Oct 02 01:02:40.084037 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 283/545] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:39 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:40.090393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:40.091236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: 2aa05284-39f3-42d0-b9b1-c5dce05d2a30] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.100482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.101274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.103490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.104833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.105290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.105822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.122055 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] HTTP exception thrown: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Request method failure captured: Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 HTTP/1.1 Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLt91fTJqtwrzKDv-pMeezu1g56cbR6j6lNXTQhmCYBbZMJFrENQUaeyvA_TuO_rS9RjS1kOLB3Oa2Ums-Jp5deg6UR3FQrI2huUUlI6rKTQMosy49XULqY2YBKb-lH2HGMWiP1qNU0_qWHypKqTk-cb5MbFFnb_LV-C4PFBYX3LLE Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:02:40.123693 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccda90f956d541b38c3e71181f397da9"}]}] Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db88db7d7835406a91b0c0817126419a Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:40.125177 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '2aa05284-39f3-42d0-b9b1-c5dce05d2a30'} Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:40.126028 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. Oct 02 01:02:40.127518 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.128783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Returning 404 to user: Instance 2aa05284-39f3-42d0-b9b1-c5dce05d2a30 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:40.128783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-16a60e7e-c6a1-4438-89fc-ffce9a63ec12 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30" status: 404 len: 111 microversion: 2.1 time: 0.041362 Oct 02 01:02:40.128957 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 284/546] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:40 2022] GET /compute/v2.1/servers/2aa05284-39f3-42d0-b9b1-c5dce05d2a30 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:40.137069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:40.137869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.145515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.146162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.146930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.147710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.148387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.149501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.307658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:40.321897 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d1d21627-5fb2-448b-b97f-0c77335866f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.508874 Oct 02 01:02:40.323042 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 263/547] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:39 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:40.328321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:40.329040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.338182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.338960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.339826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.340714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.341667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.342358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.363842 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] HTTP exception thrown: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Request method failure captured: Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e HTTP/1.1 Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLt91fTJqtwrzKDv-pMeezu1g56cbR6j6lNXTQhmCYBbZMJFrENQUaeyvA_TuO_rS9RjS1kOLB3Oa2Ums-Jp5deg6UR3FQrI2huUUlI6rKTQMosy49XULqY2YBKb-lH2HGMWiP1qNU0_qWHypKqTk-cb5MbFFnb_LV-C4PFBYX3LLE Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:02:40.366329 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccda90f956d541b38c3e71181f397da9"}]}] Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db88db7d7835406a91b0c0817126419a Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: exception: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.367860 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'dc3ca6e4-3b33-4027-b567-e314d700580e'} Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:40.368587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.370030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.371364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Returning 404 to user: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:40.371364 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ce2830ca-6ecf-437b-8fa0-adc2b15bc168 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 404 len: 111 microversion: 2.1 time: 0.043505 Oct 02 01:02:40.371364 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 264/548] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:02:40 2022] DELETE /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:40.376341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1107606819", "imageRef": "4cb98e87-dc93-40d2-8432-650a2116b1f9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "80b60993-e558-4aa4-9fa5-56497ecaef2f"}], "security_groups": [{"name": "tempest-securitygroup--1984177403"}], "key_name": "tempest-keypair-455707336", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:40.451909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:40.463558 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1ac58e8-a4ec-46f2-96c4-d9d3a169250c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.333447 Oct 02 01:02:40.478876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 285/549] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:40 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:40.478876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:40.478876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] [instance: dc3ca6e4-3b33-4027-b567-e314d700580e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.486577 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:40.486577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.486577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.486577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.487050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.487140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.487676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.496075 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:40.513467 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] HTTP exception thrown: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Request method failure captured: Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e HTTP/1.1 Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLt91fTJqtwrzKDv-pMeezu1g56cbR6j6lNXTQhmCYBbZMJFrENQUaeyvA_TuO_rS9RjS1kOLB3Oa2Ums-Jp5deg6UR3FQrI2huUUlI6rKTQMosy49XULqY2YBKb-lH2HGMWiP1qNU0_qWHypKqTk-cb5MbFFnb_LV-C4PFBYX3LLE Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:02:40.515661 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccda90f956d541b38c3e71181f397da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccda90f956d541b38c3e71181f397da9"}]}] Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ccda90f956d541b38c3e71181f397da9 Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1180528980 Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db88db7d7835406a91b0c0817126419a Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersAdminTestJSON-1180528980-project Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: exception: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.517236 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'dc3ca6e4-3b33-4027-b567-e314d700580e'} Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:40.517914 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. Oct 02 01:02:40.519640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:02:40.520720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] Returning 404 to user: Instance dc3ca6e4-3b33-4027-b567-e314d700580e could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:40.520720 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae8264b5-3566-4f3a-9b5a-faad87a4a740 tempest-DeleteServersAdminTestJSON-1180528980 tempest-DeleteServersAdminTestJSON-1180528980-project] 10.222.0.23 "GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e" status: 404 len: 111 microversion: 2.1 time: 0.048304 Oct 02 01:02:40.520720 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 286/550] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:40 2022] GET /compute/v2.1/servers/dc3ca6e4-3b33-4027-b567-e314d700580e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:40.620114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] validate_networks() for [('80b60993-e558-4aa4-9fa5-56497ecaef2f', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:40.792408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:40.794288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:40.812051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.812929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.814087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.818176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:40.819046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:40.820211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.081920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:41.100299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a534d377-a2ff-43db-adf2-b48b0d3a3548 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.324349 Oct 02 01:02:41.119626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 287/551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:40 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:41.127755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:41.128373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:41.141750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.142244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.145050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.146181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.146790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.147359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.222754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:41.231890 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbe9642f-d90e-4052-b586-eba621241dc3 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1276 microversion: 2.1 time: 0.110893 Oct 02 01:02:41.247340 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 288/552] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:41 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:41.350978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:41.352482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:41.359951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.360449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.361023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.362012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.362785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.363221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.653660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:41.654205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:41.654729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:41.655290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:41.655815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:41.672673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.673190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.673632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.674796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.675450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.675885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.698771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Getting quotas for project 8fa7bf422e16441498c97377ae1b7a85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:41.705352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Getting quotas for user 9632b1b483dd442f88e8898ef29eb257 and project 8fa7bf422e16441498c97377ae1b7a85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:41.726579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:41.730559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4cb98e87-dc93-40d2-8432-650a2116b1f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:41.763128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:41.783219 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-655b67e2-bd30-4e5c-895b-65b49b9b9dec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.436848 Oct 02 01:02:41.786020 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 289/553] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:41 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:41.809748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:41.811307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:41.832693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.833204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.837105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.839379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.840243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.841114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-104ba753-8d9a-4cfd-b890-1015039c3f93 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.470767 Oct 02 01:02:41.846149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.846387 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 265/554] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:41.869330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09251e28-eebb-4710-9121-ef45189d4e01 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:41.870115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-09251e28-eebb-4710-9121-ef45189d4e01 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:42.061845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-09251e28-eebb-4710-9121-ef45189d4e01 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:42.071581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09251e28-eebb-4710-9121-ef45189d4e01 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1245 microversion: 2.1 time: 0.215152 Oct 02 01:02:42.088862 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 266/555] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:41 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1245 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:42.132591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:42.134252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:42.147659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.148159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.151662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:42.152828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.153627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.154088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.154750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.167758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e1af4f9-d778-4af4-ab7a-79583e273f6f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.376468 Oct 02 01:02:42.183963 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 290/556] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:41 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:42.263117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:42.265014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:42.284719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.285858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.287190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.289603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.290938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.292411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.517457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:42.534719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a8425c4-902c-4b2e-9138-92778b386620 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1503 microversion: 2.1 time: 0.409365 Oct 02 01:02:42.537991 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 267/557] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:42 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1503 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:42.564936 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:42.580259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1d7db39-1465-4b29-9a0e-973596c3f68e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1282 microversion: 2.1 time: 0.326892 Oct 02 01:02:42.604785 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 291/558] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:42 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:42.812238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:42.813527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:42.828837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.829347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.829787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.830517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.830991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.831426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.101487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:43.105941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:43.119698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.122178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.122667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.123399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.124365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.124990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.263719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:43.271551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c875193-6592-4239-b92b-d835769c5153 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.464849 Oct 02 01:02:43.283167 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 268/559] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:42 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:43.283529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:43.295613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:43.296541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e5d8435-7499-45df-8ac9-f716af26ed28 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1297 microversion: 2.1 time: 0.204331 Oct 02 01:02:43.296668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:43.302569 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 292/560] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:43 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1297 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:43.304439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.305665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.306508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.307200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.307648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.308336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.564954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:43.566218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:43.580798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.582809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.584937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.593933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.596478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.598058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.642285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:43.654440 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-524dd22f-1b8c-4c01-ab05-282f5754dc26 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.376936 Oct 02 01:02:43.687821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 269/561] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:43 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:43.709705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:43.710338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:43.739848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.740367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.743719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:43.746454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:43.747956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:43.748819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.189043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:44.232190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7e5c33a-0411-4cab-8e38-c72222ba9a1d tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.543020 Oct 02 01:02:44.232819 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 270/562] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:43 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:44.252970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:44.271225 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62e04262-ed6b-468e-806f-d8be6a88c2f2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1493 microversion: 2.1 time: 0.710809 Oct 02 01:02:44.276830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 293/563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:43 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1493 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:44.319249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.321157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-266b6bc9-277f-4c9e-b94d-a6a05cbe2ad3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '.version_select at 0x7fb88179b790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.321426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:44.330571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-266b6bc9-277f-4c9e-b94d-a6a05cbe2ad3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.333131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-266b6bc9-277f-4c9e-b94d-a6a05cbe2ad3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.335575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-266b6bc9-277f-4c9e-b94d-a6a05cbe2ad3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.337289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.337973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.338793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.340377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.345738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.346338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.389637 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-266b6bc9-277f-4c9e-b94d-a6a05cbe2ad3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.082729 Oct 02 01:02:44.392017 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 294/564] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:44.423585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.428404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:44.447417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.448269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.451696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.452676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.453424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.453950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.599144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:44.611633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac66d93e-3244-451a-9671-7787dafd46f9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1303 microversion: 2.1 time: 0.218441 Oct 02 01:02:44.625382 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 295/565] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:44.644236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.645142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:44.656832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.657586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.658770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.660043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.660620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.661102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.813583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:44.824664 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a18d4bf-9ae1-44c4-936e-36a1a8e4e0d5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.529680 Oct 02 01:02:44.839733 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 271/566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:44.859771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4f77d217-fb3f-48ee-8d0e-5d8e52775c59 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb88190ab80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.937198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4f77d217-fb3f-48ee-8d0e-5d8e52775c59 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a" status: 200 len: 636 microversion: 2.1 time: 0.096050 Oct 02 01:02:44.937774 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 272/567] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a => generated 636 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:44.960128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:44.960824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:44.986054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.986710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.987222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:44.987961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:44.988409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:44.996151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:45.082967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1367962d-0368-4f01-b23b-0d02893be315 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1644 microversion: 2.1 time: 0.456177 Oct 02 01:02:45.083563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 296/568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1644 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:45.090401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae0849a9-a7f0-4cae-99da-cf055f540b1e tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb88179bf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:45.163018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ae0849a9-a7f0-4cae-99da-cf055f540b1e tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:45.176914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ae0849a9-a7f0-4cae-99da-cf055f540b1e tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:45.517186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:45.526872 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90a9858d-6707-4da8-94a8-1de9c994ec06 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.582675 Oct 02 01:02:45.528352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 273/569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:44 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:45.534661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:45.535461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:45.543545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:45.544251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:45.544945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:45.546522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:45.547744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:45.548317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:45.696302 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae0849a9-a7f0-4cae-99da-cf055f540b1e tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.610739 Oct 02 01:02:45.696983 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 297/570] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:45 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:45.783829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:45.802254 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc858f99-9cde-4402-afb0-aa2a10bcfeea tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.272099 Oct 02 01:02:45.805516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 274/571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:45 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:45.811391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-800257776", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "50e67603-d71e-41c6-898e-f46b864cbf22"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:45.826049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db49c1ff-e25a-4bce-b2ad-dce4cd774f47 tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1293476328", "id": 23648062, "os-flavor-access:is_public": "True"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:45.846083 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db49c1ff-e25a-4bce-b2ad-dce4cd774f47 tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.147634 Oct 02 01:02:45.846688 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 298/572] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:02:45 2022] POST /compute/v2.1/flavors => generated 465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:02:45.852540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:45.853148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:45.860191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:45.860686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:45.861131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:45.861940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:45.862400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:45.862950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:45.868383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] validate_networks() for [('50e67603-d71e-41c6-898e-f46b864cbf22', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:46.072114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:46.079924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d280fc4-130e-4a2e-b64d-72172821e80a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.232176 Oct 02 01:02:46.080571 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 299/573] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:45 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:46.099558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-750cb217-931c-4708-a1d9-a706fd00c2e6 req-0a0b3b68-8b27-427c-b4b4-3ecd1671044f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9a72a6-4011-4b04-b574-f7d1405479e1", "tag": "82b77f64-8e73-4f66-9f30-32b40e50f529"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:46.110135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-750cb217-931c-4708-a1d9-a706fd00c2e6 req-0a0b3b68-8b27-427c-b4b4-3ecd1671044f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.110833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-750cb217-931c-4708-a1d9-a706fd00c2e6 req-0a0b3b68-8b27-427c-b4b4-3ecd1671044f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.111079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-750cb217-931c-4708-a1d9-a706fd00c2e6 req-0a0b3b68-8b27-427c-b4b4-3ecd1671044f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.123883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-750cb217-931c-4708-a1d9-a706fd00c2e6 req-0a0b3b68-8b27-427c-b4b4-3ecd1671044f service nova] Creating event network-changed:82b77f64-8e73-4f66-9f30-32b40e50f529 for instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 on n-h1-master-1 Oct 02 01:02:46.129255 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-750cb217-931c-4708-a1d9-a706fd00c2e6 req-0a0b3b68-8b27-427c-b4b4-3ecd1671044f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033260 Oct 02 01:02:46.130234 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 300/574] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:46.135907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed11a4aa-a4d6-4362-a50f-ea74efd43305 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb881938430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:46.404495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:46.405077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:46.405566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:46.405976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:46.406392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:46.419486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.420012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.420449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.421181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.421642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.422071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.456113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:46.465193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for user 6da1976f703f402788953f3332a281de and project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:46.486177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:46.488900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:46.498439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed11a4aa-a4d6-4362-a50f-ea74efd43305 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "DELETE /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.366824 Oct 02 01:02:46.499513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 301/575] 10.222.0.23 () {58 vars in 1296 bytes} [Sun Oct 2 01:02:46 2022] DELETE /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata/os_version => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:02:46.504527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:46.505397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:46.515389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.515973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.519302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.520592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.521326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.522013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.555939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a78a8b15-bb67-4062-bfa8-f7720e049bc2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749028 Oct 02 01:02:46.557012 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 275/576] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:46.562811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-894d70b3-d144-439f-8fae-1599fe5fe165 tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:46.736292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:46.746710 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-282f361c-206e-44e2-9cc0-dcf230f0a0eb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.245985 Oct 02 01:02:46.747412 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 302/577] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:46 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:46.755622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6d8e3f83-25ee-436a-a237-24c2e7d64771 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb88173e280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:46.822835 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6d8e3f83-25ee-436a-a237-24c2e7d64771 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074237 Oct 02 01:02:46.823805 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 303/578] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:02:46 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:46.831818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:46.836216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:46.843236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.844064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.844837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.845937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:46.850003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:46.850738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:46.905699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-894d70b3-d144-439f-8fae-1599fe5fe165 tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/23648062/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.347377 Oct 02 01:02:46.907657 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 276/579] 10.222.0.23 () {62 vars in 1259 bytes} [Sun Oct 2 01:02:46 2022] POST /compute/v2.1/flavors/23648062/os-extra_specs => generated 62 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:46.916063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-78488b2e-14f8-419e-a16e-da8b7b0ded59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:46.916963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-78488b2e-14f8-419e-a16e-da8b7b0ded59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:46.920464 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:46.997289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-78488b2e-14f8-419e-a16e-da8b7b0ded59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:47.009246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-78488b2e-14f8-419e-a16e-da8b7b0ded59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1210 microversion: 2.1 time: 0.099211 Oct 02 01:02:47.018706 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 277/580] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:46 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:47.020757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:47.021453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:47.033651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.034147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.034581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.035328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.035776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.036208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.065923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:47.076929 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa8667f7-c006-4c41-a7bd-a4013521c0ba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.251966 Oct 02 01:02:47.077908 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 304/581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:46 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:47.083988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8cd4c85e-05ac-41a3-baa0-efd6d4d22a36 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb881938af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:47.170036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8cd4c85e-05ac-41a3-baa0-efd6d4d22a36 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:47.175928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8cd4c85e-05ac-41a3-baa0-efd6d4d22a36 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:47.285666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:47.303969 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53689d27-f331-4136-90c0-8198e2bff5c8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.292700 Oct 02 01:02:47.306107 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 278/582] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:47 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:47.328997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdbd1b94-ebfd-4997-add9-6e4e37141fd1 tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:47.352962 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdbd1b94-ebfd-4997-add9-6e4e37141fd1 tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/23648062" status: 202 len: 0 microversion: 2.86 time: 0.031000 Oct 02 01:02:47.353723 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 279/583] 10.222.0.23 () {60 vars in 1196 bytes} [Sun Oct 2 01:02:47 2022] DELETE /compute/v2.1/flavors/23648062 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:02:47.363056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:47.363819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:47.373506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.374359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.375046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.376107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.376930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.377610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.586084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8cd4c85e-05ac-41a3-baa0-efd6d4d22a36 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.505386 Oct 02 01:02:47.586681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:47.587760 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 305/584] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:47 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:47.595300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40427025-9ec6-44e7-9c15-71bb9c78898c tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:47.599779 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a40f02f5-e2b5-4fd6-a32c-c3433296db60 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.244741 Oct 02 01:02:47.600371 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 280/585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:47 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:47.623438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e067875-6fe1-4aa1-8f88-7564189ac1d4 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb8817bc280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:47.652478 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40427025-9ec6-44e7-9c15-71bb9c78898c tempest-FlavorMetadataValidation-501854871 tempest-FlavorMetadataValidation-501854871-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6679 microversion: 2.86 time: 0.063449 Oct 02 01:02:47.653052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 306/586] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:02:47 2022] GET /compute/v2.1/flavors/detail => generated 6679 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:02:47.689220 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e067875-6fe1-4aa1-8f88-7564189ac1d4 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.075815 Oct 02 01:02:47.696101 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 281/587] 10.222.0.23 () {58 vars in 1290 bytes} [Sun Oct 2 01:02:47 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata/os_distro => generated 33 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:47.704397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0544bd02-1cdc-4d3b-ba67-c41667bfbfc2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb881ad8040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:47.775428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:47.777015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:47.790891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.791416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.792155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.792902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:47.793591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:47.794212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:47.794579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0544bd02-1cdc-4d3b-ba67-c41667bfbfc2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:47.806764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0544bd02-1cdc-4d3b-ba67-c41667bfbfc2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:48.039989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:48.050143 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-345f5df0-de75-4466-813a-1a282f0505d6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.280284 Oct 02 01:02:48.051133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 282/588] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:47 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:48.057566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:48.058587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:48.066430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.067245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.067922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.068907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.069586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.071087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.133330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0544bd02-1cdc-4d3b-ba67-c41667bfbfc2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.434993 Oct 02 01:02:48.134449 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 307/589] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:47 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:48.139662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:48.140409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:48.149415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:48.158956 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7057c05c-caa9-4e4e-99b4-c49e6778e356 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1262 microversion: 2.1 time: 0.106468 Oct 02 01:02:48.159750 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 283/590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:48 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:48.161299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.162198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.163522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.164700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.166455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b96f5dc-ca75-4e96-8d02-6835d7851e5b tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb8817bc940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:48.167229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.167851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.231345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b96f5dc-ca75-4e96-8d02-6835d7851e5b tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.070145 Oct 02 01:02:48.242318 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 284/591] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:02:48 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:48.260316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c55b7cb-d382-4c92-b887-1c258dfc5de3 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb8817b8550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:48.359437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c55b7cb-d382-4c92-b887-1c258dfc5de3 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:48.373062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c55b7cb-d382-4c92-b887-1c258dfc5de3 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:48.444846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:48.460676 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7a3e121-2e6a-4483-bc12-760bc280e721 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.325073 Oct 02 01:02:48.461930 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 308/592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:48 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:48.472174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:48.472840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:48.488816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.489320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.489760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.490469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.490953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.500581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.677839 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c55b7cb-d382-4c92-b887-1c258dfc5de3 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.427455 Oct 02 01:02:48.679103 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 285/593] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:48 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:48.685378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:48.697456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:48.710347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:48.720935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.724074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5da2f0dc-ab5f-4904-ad5c-b1ff47351438 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.256197 Oct 02 01:02:48.724452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.725636 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 309/594] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:48 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:48.731492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2892c86-8728-4cd3-b776-b96ea16bddd5 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb88189d820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:48.743570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.746873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:48.748239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:48.750829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:48.798956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b2892c86-8728-4cd3-b776-b96ea16bddd5 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:48.807342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b2892c86-8728-4cd3-b776-b96ea16bddd5 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:49.046070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:49.061190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4cbc6dd6-4b0e-4c3b-bc37-183d89ece9dc tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.377560 Oct 02 01:02:49.061814 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 286/595] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:48 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:49.083608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:49.084339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:49.096432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.098720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:49.099241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:49.101217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.102414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:49.102887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:49.293638 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2892c86-8728-4cd3-b776-b96ea16bddd5 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.565639 Oct 02 01:02:49.294815 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 310/596] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:48 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 64 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:49.303564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:49.305444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:49.320141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.320776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:49.321283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:49.322234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.322740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:49.323928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:49.466084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:49.475908 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-174fd383-b1b4-4a9e-9f61-136ed0c0c2c5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.397089 Oct 02 01:02:49.479000 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 287/597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:49 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:49.515501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5e65069-ddf7-4d44-8319-d2c61cc6b99d tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb88176ec10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:49.543026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:49.573363 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-889f978b-2371-433d-9990-61e5a8cd0d2d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1268 microversion: 2.1 time: 0.273987 Oct 02 01:02:49.577062 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 311/598] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:49 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1268 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:49.578219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5e65069-ddf7-4d44-8319-d2c61cc6b99d tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.096161 Oct 02 01:02:49.581472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 288/599] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:02:49 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 64 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:49.593636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:49.596932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:49.604281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8bd6cf2-e3cf-472c-b550-c079ba092237 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb8819178b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:49.611315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.614722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:49.621683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:49.624555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.625473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:49.627154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:49.698354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f8bd6cf2-e3cf-472c-b550-c079ba092237 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:49.707967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f8bd6cf2-e3cf-472c-b550-c079ba092237 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:49.820498 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:49.917333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:49.922232 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:49.934988 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c561a329-2c2e-4ab7-87c5-11b36fb5a81d tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.354490 Oct 02 01:02:49.936856 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 312/600] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:49 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:49.983055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:49.984139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:49.998902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:49.999650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.000280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.001149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.001991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.002740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.279353 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8bd6cf2-e3cf-472c-b550-c079ba092237 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.688774 Oct 02 01:02:50.279961 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 289/601] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:49 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:50.285533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:50.286353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:50.303354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:50.309030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.312931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.313380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.318808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.319340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.319819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.327087 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8983d3fe-01b3-480b-99cf-539a1af31779 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.353239 Oct 02 01:02:50.327749 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 313/602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:49 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:50.343301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0530656d-9d5c-4a05-bfc3-94cf67b19dcf", "name": "network-vif-unplugged", "status": "completed", "tag": "3e02bdab-8b46-4fdf-91fc-2e60947189c5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:50.385954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.386438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.391883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.442986 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] Creating event network-vif-unplugged:3e02bdab-8b46-4fdf-91fc-2e60947189c5 for instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf on n-h1-master-1 Oct 02 01:02:50.452773 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:02:50.494900 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7004ea6c-661f-4370-bab0-fa748a685a73 req-7605d9bb-d488-4995-82fd-a5d3a0f65728 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162054 Oct 02 01:02:50.496256 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 314/603] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:50.509456 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8fb28ae8-face-4e26-b13e-1304cc482bc0 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update', calling method: .version_select at 0x7fb881938820>, body: {"meta": {"os_version": "alt"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:50.615255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8fb28ae8-face-4e26-b13e-1304cc482bc0 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:50.624857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8fb28ae8-face-4e26-b13e-1304cc482bc0 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:50.840935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:50.868059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ff5930d-d87a-4ca6-8637-06922237421b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.580941 Oct 02 01:02:50.868813 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 290/604] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:50 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:50.888230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:50.891347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:50.908800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.909712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.911387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:50.912628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:50.915351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:50.916236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.000076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8fb28ae8-face-4e26-b13e-1304cc482bc0 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.501810 Oct 02 01:02:51.000828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 315/605] 10.222.0.23 () {60 vars in 1313 bytes} [Sun Oct 2 01:02:50 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata/os_version => generated 31 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:51.012140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:51.013062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:51.021168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.022021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.023024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.024340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.025032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.025681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.324571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:51.328319 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:51.333809 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4b61ce8-bc1c-415c-847e-e95aa2040523 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.463757 Oct 02 01:02:51.342139 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 291/606] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:50 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:51.348372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:51.356175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:51.360691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:51.365817 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64d8bda3-2c97-4c3f-9e86-1988ba70ba3a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.358961 Oct 02 01:02:51.366834 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 316/607] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:51 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:51.373109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.373882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.374507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.375560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.376269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.376856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.398682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1208693-e1bf-484d-87cc-7f42a91ed0a3 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb8817470d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:51.477086 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1208693-e1bf-484d-87cc-7f42a91ed0a3 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.107772 Oct 02 01:02:51.484507 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 317/608] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:02:51 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 58 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:51.522270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:51.530205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:51.552429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.556147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.561615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.569830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:51.572636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:51.573546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:51.929868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:51.942199 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1902158-87a6-48d8-a5fe-1bd84bd77aba tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1471 microversion: 2.1 time: 0.598544 Oct 02 01:02:51.959492 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 292/609] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:51 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1471 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:51.975276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-baebc543-fda2-4fde-b1ad-545163977c64 req-7b94d687-0b94-461b-bc9a-514a004842bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9b6852-851e-4c47-bd2f-93dc631f2581", "tag": "0f4fa885-d86a-49bd-943d-0ec893b75c7e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:52.015539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-baebc543-fda2-4fde-b1ad-545163977c64 req-7b94d687-0b94-461b-bc9a-514a004842bf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.019047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-baebc543-fda2-4fde-b1ad-545163977c64 req-7b94d687-0b94-461b-bc9a-514a004842bf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.019783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-baebc543-fda2-4fde-b1ad-545163977c64 req-7b94d687-0b94-461b-bc9a-514a004842bf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.065607 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.077034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-baebc543-fda2-4fde-b1ad-545163977c64 req-7b94d687-0b94-461b-bc9a-514a004842bf service nova] Creating event network-changed:0f4fa885-d86a-49bd-943d-0ec893b75c7e for instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 on n-h2-master-1 Oct 02 01:02:52.077670 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0b3c4c8-bbbc-4cd1-ab55-d251071d669e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.597151 Oct 02 01:02:52.095617 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 318/610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:51 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:52.103099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-baebc543-fda2-4fde-b1ad-545163977c64 req-7b94d687-0b94-461b-bc9a-514a004842bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141943 Oct 02 01:02:52.106179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a200b821-42b3-4b53-a9af-803bfbc2c2c2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'update_all', calling method: .version_select at 0x7fb88184d790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:52.110859 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 293/611] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:52.117849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:52.123200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:52.132950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.134291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.134991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.135904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.137019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.137913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.184235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a200b821-42b3-4b53-a9af-803bfbc2c2c2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:52.191625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a200b821-42b3-4b53-a9af-803bfbc2c2c2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:52.384219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.396685 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2b09e64-fa09-4ee1-b126-703bd9191069 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.284104 Oct 02 01:02:52.397613 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 294/612] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:52 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:52.409876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:52.410738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:52.417893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.418701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.419322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.420191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.420801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.421389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.541903 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a200b821-42b3-4b53-a9af-803bfbc2c2c2 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.444941 Oct 02 01:02:52.542504 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 319/613] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:02:52 2022] PUT /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 61 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:52.552620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:52.553409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:52.562407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.563018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.564129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.564870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.565269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.565701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.691827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.702626 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee3b290c-fede-444d-bf3f-aa8a9703d63d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.303362 Oct 02 01:02:52.703535 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 295/614] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:52 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:52.710719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-076921fe-de01-4278-89b4-367572dc903f tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Action: 'create', calling method: .version_select at 0x7fb8819178b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:52.781638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:52.794423 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7aa291cc-53a9-41b2-9096-6245a5351134 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.246315 Oct 02 01:02:52.795044 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 320/615] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:52 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:52.805281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-076921fe-de01-4278-89b4-367572dc903f tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:52.812238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-076921fe-de01-4278-89b4-367572dc903f tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Getting quotas for user e7a94e3bcf294afc9a33e907fd5205ee and project 6de56413032b40df98e028d42179977d. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:52.972512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:52.973407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:52.993867 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:52.999776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.000290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.000914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.001654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.002456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.002939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.324167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:53.344399 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e735af0f-6044-4f73-a8fa-e5f77d9cef90 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1477 microversion: 2.1 time: 0.374690 Oct 02 01:02:53.347523 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 321/616] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:52 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1477 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:53.357255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:53.358220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:53.378870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.379558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.380159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.381038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.382493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.383096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.451037 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-076921fe-de01-4278-89b4-367572dc903f tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "POST /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.745368 Oct 02 01:02:53.451753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 296/617] 10.222.0.23 () {60 vars in 1281 bytes} [Sun Oct 2 01:02:52 2022] POST /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 85 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:53.456987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:53.457971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:53.474104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.477301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.477984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.480978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.481952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.483266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.627557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:53.644040 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9e68e43-2c6b-4dd0-9c7f-4a9f88068936 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.293733 Oct 02 01:02:53.646661 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 322/618] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:53 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:53.653088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e43eaa08-94d9-411e-a1b3-461116908145 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] Calling method '.version_select at 0x7fb8817629d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:53.683889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:53.693950 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75cdd8b9-a5d5-405a-a594-173dc7bb4c2b tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.239305 Oct 02 01:02:53.718638 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e43eaa08-94d9-411e-a1b3-461116908145 tempest-ImagesMetadataTestJSON-1314421792 tempest-ImagesMetadataTestJSON-1314421792-project] 10.222.0.23 "GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.070674 Oct 02 01:02:53.722257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 323/619] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:02:53 2022] GET /compute/v2.1/images/9c684878-04a2-4d0e-ab3e-b9c536fb196a/metadata => generated 85 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:02:53.722743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 297/620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:53 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:53.738842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:53.739564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:53.754174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.755224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.756356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.758202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.759994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.760446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.821078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:53.821687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:53.830618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.831138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.831576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.832280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:53.832724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:53.834897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.029043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:54.044663 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c17fcae4-6613-4033-a384-62eebda6a2a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.314901 Oct 02 01:02:54.045928 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 324/621] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:53 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:54.093194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:54.101631 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd8a99ab-5da1-48f4-88f7-058a77b1ec49 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.286400 Oct 02 01:02:54.102214 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 298/622] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:53 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:54.220497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb881762dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.223191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.224283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.224283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.241940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.242555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.243382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.262161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.262671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.263108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.269197 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-33592338-dcf8-4fb8-a23f-b160f2a629fb tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.221939 Oct 02 01:02:54.269775 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 325/623] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:54.282167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb88176e820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.284209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.284688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.285142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.301915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.302402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.302872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.315721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.316420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.316954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.326533 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4e07746-dc9e-42e4-ba69-04baca703db7 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.048254 Oct 02 01:02:54.327835 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 299/624] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:54.345640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb88189d790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.352886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.353652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.355105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.373313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.374362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:54.381128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.381433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.381617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.382673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.382872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.383628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.384736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.385255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.385909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.394190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.394948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.395536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.402847 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-997a1373-88e1-4457-8e3b-0e2c4ed7e204 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061777 Oct 02 01:02:54.403940 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 326/625] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:54.423604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb8819c0af0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.426871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.427590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.427985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.447741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.448228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.448656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.456026 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1bbcd591-978a-416e-8bc0-569308c1317a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044702 Oct 02 01:02:54.457016 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 327/626] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:02:54.474277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a3a98b8b-7115-4588-9a42-12cb7bd3671f tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb88189d0d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.478734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3a98b8b-7115-4588-9a42-12cb7bd3671f tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.479248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3a98b8b-7115-4588-9a42-12cb7bd3671f tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.479696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3a98b8b-7115-4588-9a42-12cb7bd3671f tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.518831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a3a98b8b-7115-4588-9a42-12cb7bd3671f tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 266 microversion: 2.1 time: 0.049619 Oct 02 01:02:54.520177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 328/627] 10.222.0.23 () {58 vars in 1179 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 266 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:54.532418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb8818900d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.549786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.550358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.550873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.566507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.567050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.567512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.583893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:54.594153 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0fd08ce-58c0-4f3d-b36b-3aa627bbd9ee tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1477 microversion: 2.1 time: 0.224299 Oct 02 01:02:54.596785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.597285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.597728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.603783 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 300/628] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:54.607147 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1c368e51-d1fa-4f3d-92df-f34bcf1de881 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078462 Oct 02 01:02:54.613599 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 329/629] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:02:54.619728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb8819178b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.621607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.622154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.622919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.644218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.644994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.645848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.655130 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4c8092e1-01b1-49ba-acde-38b5e24ca5df tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039681 Oct 02 01:02:54.656651 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 301/630] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:54.670985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.671789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:54.673199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb88190cee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.675417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.676127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.676603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.690681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.690681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.690681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.690681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.691301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.691301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.699846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.700449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.700886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.715821 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-300617ea-1510-4538-ba83-0b6cd25e1e2a tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.046127 Oct 02 01:02:54.726658 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 302/631] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:54.726916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.727734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:54.734364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.734883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.735317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.736148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.736853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.737008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.922648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:54.931968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa16819f-5fb2-46ba-9992-1bc596d3c105 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.266151 Oct 02 01:02:54.932664 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 330/632] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:54.938123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Calling method '.version_select at 0x7fb88179b3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.940159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.940758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.941459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.963909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:54.972220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.972611 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-609f158d-d26d-42ad-8906-d4bb5861f79d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.253645 Oct 02 01:02:54.972949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.973392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.983241 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 303/633] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:54.994064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.994577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.995063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.059571 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b1fce12-c057-4a41-a7d2-f4f7e62e3888 tempest-HypervisorAdminTestJSON-735394639 tempest-HypervisorAdminTestJSON-735394639-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.125285 Oct 02 01:02:55.060710 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 331/634] 10.222.0.23 () {58 vars in 1173 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:55.072016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.072635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.080078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.080879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.081498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.082241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.082792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.083215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.129624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.130336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.147230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.153086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.153671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.154355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.154843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.155340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.504954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:55.516720 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3e8cf03f-773e-48d3-8e26-e491d12222ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.390868 Oct 02 01:02:55.542954 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 332/635] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:55.597361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:55.609562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1fa61fa-e903-4fe7-8a22-bebdb1ebf15f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.542349 Oct 02 01:02:55.613101 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 304/636] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:55.626576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.627397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.649220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.649782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.650236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.650976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.651439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.652913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.943171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:55.954194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ea2528c-899f-4bbc-aee6-3329f7fd861c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1463 microversion: 2.1 time: 0.333732 Oct 02 01:02:55.955214 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 333/637] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:55.965465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.966081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.977705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.979321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.980033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.981014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.982077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.983127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.983834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.984513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.991245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.991746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.992233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.992991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.993737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.994489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.432669 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:56.473053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:56.481576 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:56.487211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:56.492502 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-54234be3-47d3-4ed4-9fe7-7a03494b8281 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1463 microversion: 2.1 time: 0.511842 Oct 02 01:02:56.493107 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 334/638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1463 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:56.498084 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-035f34fd-be42-4ccf-b94c-f00660818caa tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.545272 Oct 02 01:02:56.508801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:56.509960 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:56.510712 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 305/639] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:56.518358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.518886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.519705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.519846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:56.521504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.522130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.522811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.524185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:56.533346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.533836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.534268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.535470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.535926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.536431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.666234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:56.667835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:56.668910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:56.669557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:56.670177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:56.724666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:56.744848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f12d60b-2f90-4b8b-b092-eef2e762ee6c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.250188 Oct 02 01:02:56.746709 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 335/640] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:56 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:56.753482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:56.754359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:56.766890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.768527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.769591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.770529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.771219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.771888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.804730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:56.812802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.813380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.813878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.814705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.815230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.816045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.848489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d46c497-b741-4299-a21c-4fb89d489056 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 1067 microversion: 2.1 time: 0.336190 Oct 02 01:02:56.849782 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 306/641] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:02:56 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 1067 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 02 01:02:56.855061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6af64de4-2e63-4751-aa0f-aaa5def5b0ce req-23603e1b-dece-4235-9daa-d978e7930dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188f4b83-8e80-45f4-9be3-513a2f021e12", "name": "network-vif-unplugged", "status": "completed", "tag": "ecdd37ff-a07b-4d5f-aa4c-04d4c5654386"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:56.864583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6af64de4-2e63-4751-aa0f-aaa5def5b0ce req-23603e1b-dece-4235-9daa-d978e7930dd7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.865382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6af64de4-2e63-4751-aa0f-aaa5def5b0ce req-23603e1b-dece-4235-9daa-d978e7930dd7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.866071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6af64de4-2e63-4751-aa0f-aaa5def5b0ce req-23603e1b-dece-4235-9daa-d978e7930dd7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.880312 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6af64de4-2e63-4751-aa0f-aaa5def5b0ce req-23603e1b-dece-4235-9daa-d978e7930dd7 service nova] Creating event network-vif-unplugged:ecdd37ff-a07b-4d5f-aa4c-04d4c5654386 for instance 188f4b83-8e80-45f4-9be3-513a2f021e12 on n-h2-master-1 Oct 02 01:02:56.887155 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6af64de4-2e63-4751-aa0f-aaa5def5b0ce req-23603e1b-dece-4235-9daa-d978e7930dd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034281 Oct 02 01:02:56.894077 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 307/642] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:56.901467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:56.902306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:56.909304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.910028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.910737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.911791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:56.912480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:56.913537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:56.994950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:57.005734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bd06385d-be41-4fab-88f3-9608a7e3539c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.256929 Oct 02 01:02:57.006626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 336/643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:56 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:57.013820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:57.014434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:57.020784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.021260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.021688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.023717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.024212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.025123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.151957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:57.166906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56c4b214-2c54-4f93-9987-4765bf6bda9e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.270748 Oct 02 01:02:57.167887 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 308/644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:56 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:57.282013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:57.295218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70b44f77-bdcd-42d8-bf45-62098f04df89 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.285590 Oct 02 01:02:57.297810 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 337/645] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:57 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:57.525375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:57.526243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:57.538840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.539748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.540286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.541128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.541684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.544268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.599348 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:57.775626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:57.776425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:57.787377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.790878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.792022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.793241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.795342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.796384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.803191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:57.814009 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c79491f-a287-4609-8b9a-e526e214acf7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.293359 Oct 02 01:02:57.830358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 309/646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:57 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:58.029675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:58.030240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:58.038545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.043349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.044148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.044890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.047880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.048317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.103518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:58.118237 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a1ffe97-add2-460e-85c8-6dacbe0b8611 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.347042 Oct 02 01:02:58.120124 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 338/647] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:57 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:58.134876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:58.135619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:58.149112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.149890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.152409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.153335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.153980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.155971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.216697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:02:58.370533 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-130262f3-bef9-40fc-b94d-26a12d5cc6a3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 204 len: 0 microversion: 2.1 time: 0.244220 Oct 02 01:02:58.372115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 339/648] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:02:58 2022] DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:02:58.390440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:58.395093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:58.414753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.419296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.421083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.422475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.425355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.425910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.807880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:58.819730 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f05e0eb-c07c-4365-b8a0-020b641b3849 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.793207 Oct 02 01:02:58.823305 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 310/649] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:58 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:58.851831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:58.853461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:58.872501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.873374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.873975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.877537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.878260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.880042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:59.291842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:59.301215 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dca18497-6bf6-48f9-934e-d6f6962a1f50 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1476 microversion: 2.1 time: 0.927167 Oct 02 01:02:59.320182 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 340/650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:58 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1476 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:59.327273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-745177518", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "1126982761", "adminPass": "***", "networks": [{"uuid": "af3b4624-1c74-447f-bf99-fef286c20b75"}], "security_groups": [{"name": "tempest-securitygroup--429819099"}], "key_name": "tempest-keypair-469006903", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:59.395105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:59.407419 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2d6e2bf-6251-476c-a7f9-0d7d1c316b9c tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.570771 Oct 02 01:02:59.408002 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 311/651] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:58 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:59.418995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:59.418995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:59.429600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:59.430102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:59.430537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:59.431264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:59.431714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:59.432208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:59.692523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] validate_networks() for [('af3b4624-1c74-447f-bf99-fef286c20b75', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:59.912714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:59.925149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06e20fdc-4b16-40b5-bae3-fa2d67a8e03e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.515916 Oct 02 01:02:59.926341 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 312/652] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:59 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:59.933218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3b015a3a-bffe-4a30-88a7-605971f047b7 req-b8a02681-5dd1-405d-9756-5af6375d7ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b9b23c-04cc-48a2-a899-6bad90818950", "tag": "34b11d27-94e5-4bbe-a6f1-08508f199f5f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:59.946137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b015a3a-bffe-4a30-88a7-605971f047b7 req-b8a02681-5dd1-405d-9756-5af6375d7ed2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:59.947282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b015a3a-bffe-4a30-88a7-605971f047b7 req-b8a02681-5dd1-405d-9756-5af6375d7ed2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:59.952330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b015a3a-bffe-4a30-88a7-605971f047b7 req-b8a02681-5dd1-405d-9756-5af6375d7ed2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:59.971760 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3b015a3a-bffe-4a30-88a7-605971f047b7 req-b8a02681-5dd1-405d-9756-5af6375d7ed2 service nova] Creating event network-changed:34b11d27-94e5-4bbe-a6f1-08508f199f5f for instance 84b9b23c-04cc-48a2-a899-6bad90818950 on n-h1-master-1 Oct 02 01:02:59.982262 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3b015a3a-bffe-4a30-88a7-605971f047b7 req-b8a02681-5dd1-405d-9756-5af6375d7ed2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054379 Oct 02 01:02:59.983016 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 313/653] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:59.988662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:59.989721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:59.993080 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:59.997325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:59.998039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:59.998472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:59.999232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:59.999686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:00.000106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:00.512944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:00.531722 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a14574e0-34ce-45bb-86ef-79fb31df91da tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.542181 Oct 02 01:03:00.533070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 314/654] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:59 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:00.791932 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9890da23-3593-4883-98c7-0041cbb7db3a tempest-InstanceUsageAuditLogTestJSON-1539380864 tempest-InstanceUsageAuditLogTestJSON-1539380864-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:00.851774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9890da23-3593-4883-98c7-0041cbb7db3a tempest-InstanceUsageAuditLogTestJSON-1539380864 tempest-InstanceUsageAuditLogTestJSON-1539380864-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-02 01:02:59" status: 200 len: 318 microversion: 2.1 time: 0.317124 Oct 02 01:03:00.853928 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 315/655] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:03:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-02%2001%3A02%3A59 => generated 318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:00.870247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:00.871009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:00.878072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:00.878739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:00.879347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:00.880204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:00.880865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:00.881387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.417463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:01.434881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-763a576c-5ece-454f-9b26-c14458d4cca8 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.571163 Oct 02 01:03:01.439544 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 316/656] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:00 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:01.453922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:01.456495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:01.466086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.466884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.467457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.468276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.468864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.469402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.708481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:01.708995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:01.709361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:01.710108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:01.710717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:01.721963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.722860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.723539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.724474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.725142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.726261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.745148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Getting quotas for project 1906af62eccb4a4d9e533a763a3e2018. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:01.750627 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Getting quotas for user 0533d6c52e394ecc980d67c7d985076e and project 1906af62eccb4a4d9e533a763a3e2018. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:01.768111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:01.770992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:01.838079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7568a86f-6f5a-42df-8c69-84e556bf02c3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.516152 Oct 02 01:03:01.845799 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 341/657] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:03:01.851550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:01.852475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:01.859835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.860650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.861299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.862229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.862966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.863624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.886095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:01.896191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ef0e52f-cc21-4674-a6dd-d0af3dca24e7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1475 microversion: 2.1 time: 0.454525 Oct 02 01:03:01.911237 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 317/658] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:01 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1475 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:01.921451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0581bbe-c95d-4aa0-a86c-f740a6f5dcda tempest-InstanceUsageAuditLogTestJSON-1539380864 tempest-InstanceUsageAuditLogTestJSON-1539380864-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:01.953405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0581bbe-c95d-4aa0-a86c-f740a6f5dcda tempest-InstanceUsageAuditLogTestJSON-1539380864 tempest-InstanceUsageAuditLogTestJSON-1539380864-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.040248 Oct 02 01:03:01.954411 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 318/659] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:03:01 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:01.973365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:01.974143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:01.993613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.993846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.994569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:01.995345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:01.995764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:01.996875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.249897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:02.257924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-57c50d85-9ea8-4deb-9615-78dcffe89381 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.410634 Oct 02 01:03:02.265439 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 342/660] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:01 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:02.270134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c1b2b54b-d584-49ea-bca2-c026fe38f7c8 req-1346dee5-326d-493b-8978-6087946bd377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9b6852-851e-4c47-bd2f-93dc631f2581", "name": "network-vif-plugged", "status": "completed", "tag": "0f4fa885-d86a-49bd-943d-0ec893b75c7e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:02.298576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c1b2b54b-d584-49ea-bca2-c026fe38f7c8 req-1346dee5-326d-493b-8978-6087946bd377 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.301956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c1b2b54b-d584-49ea-bca2-c026fe38f7c8 req-1346dee5-326d-493b-8978-6087946bd377 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.302632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c1b2b54b-d584-49ea-bca2-c026fe38f7c8 req-1346dee5-326d-493b-8978-6087946bd377 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.330088 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c1b2b54b-d584-49ea-bca2-c026fe38f7c8 req-1346dee5-326d-493b-8978-6087946bd377 service nova] Creating event network-vif-plugged:0f4fa885-d86a-49bd-943d-0ec893b75c7e for instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 on n-h2-master-1 Oct 02 01:03:02.340079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c1b2b54b-d584-49ea-bca2-c026fe38f7c8 req-1346dee5-326d-493b-8978-6087946bd377 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073179 Oct 02 01:03:02.341185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 343/661] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:02.349583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:02.354056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:02.377589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.378105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.378537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.379312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.379827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.388915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.462406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:02.478106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2710ae42-22d6-469f-9c70-c4dd958d35a7 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.520531 Oct 02 01:03:02.479352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 319/662] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:01 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:02.494681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42142a5f-69bf-43c4-a7b9-1aa42a8897e0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:02.495563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42142a5f-69bf-43c4-a7b9-1aa42a8897e0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:02.714214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42142a5f-69bf-43c4-a7b9-1aa42a8897e0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:02.726374 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42142a5f-69bf-43c4-a7b9-1aa42a8897e0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1263 microversion: 2.1 time: 0.242549 Oct 02 01:03:02.727444 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 320/663] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:02 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1263 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:02.737867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0530656d-9d5c-4a05-bfc3-94cf67b19dcf", "tag": "3e02bdab-8b46-4fdf-91fc-2e60947189c5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:02.776926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.778007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.778712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.797955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] Creating event network-changed:3e02bdab-8b46-4fdf-91fc-2e60947189c5 for instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf on n-h2-master-1 Oct 02 01:03:02.819218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:03:02.831085 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-80e75a3d-4265-42d8-b269-d855ab14c2eb req-2905df4f-e1db-49df-b907-d83717e374b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102147 Oct 02 01:03:02.832784 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 321/664] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:02.839153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:02.840001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:02.847421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.848056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.848592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.849427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.849992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.851472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.918185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:02.928633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-436d8a5c-09c6-481c-8f73-4cf1b88072e0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.584799 Oct 02 01:03:02.929227 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 344/665] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:02 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:02.937443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:02.938242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:02.945464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.946194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.946836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:02.947702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:02.948308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:02.949681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.409007 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:03.428988 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f5a3673-efd3-42d8-985f-136e2c9648b4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1475 microversion: 2.1 time: 0.494533 Oct 02 01:03:03.433943 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 345/666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:02 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1475 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:03.441668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:03.454898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.455902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:03.467908 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42f787f9-b865-4236-9460-7dfacce81020 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1310 microversion: 2.1 time: 0.632113 Oct 02 01:03:03.468549 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 322/667] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:02 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1310 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:03.481115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.486411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.487191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.490314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.491962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.492859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.508830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:03.509458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:03.529165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.536871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.538261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.539223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:03.540302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:03.540895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:03.999124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:04.008461 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e269520f-01a6-4ba6-8533-ac8552bc6c29 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.568110 Oct 02 01:03:04.019697 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 346/668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:03 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:04.025468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:04.026179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:04.037180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:04.048867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.050088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.051717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.055005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.056851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c70629b-1fc7-4ce9-beac-f284ebb4b478 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.552997 Oct 02 01:03:04.059964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.060989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.061381 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 323/669] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:03 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:04.094996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:04.097938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:04.121076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.121943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.122586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.125170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.125952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.126700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.260188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:04.275338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-917d6b69-924a-4a73-bd8c-5355bfed9b4a tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1315 microversion: 2.1 time: 0.254014 Oct 02 01:03:04.297022 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 347/670] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:04 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:04.358321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ccf9168f-9aaf-4554-a9a6-81d8cae46674 req-a01812aa-dfef-46ed-95a0-96c650603000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188f4b83-8e80-45f4-9be3-513a2f021e12", "name": "network-vif-plugged", "status": "completed", "tag": "ecdd37ff-a07b-4d5f-aa4c-04d4c5654386"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:04.401345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ccf9168f-9aaf-4554-a9a6-81d8cae46674 req-a01812aa-dfef-46ed-95a0-96c650603000 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.406137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ccf9168f-9aaf-4554-a9a6-81d8cae46674 req-a01812aa-dfef-46ed-95a0-96c650603000 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.408831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ccf9168f-9aaf-4554-a9a6-81d8cae46674 req-a01812aa-dfef-46ed-95a0-96c650603000 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.484441 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ccf9168f-9aaf-4554-a9a6-81d8cae46674 req-a01812aa-dfef-46ed-95a0-96c650603000 service nova] Creating event network-vif-plugged:ecdd37ff-a07b-4d5f-aa4c-04d4c5654386 for instance 188f4b83-8e80-45f4-9be3-513a2f021e12 on n-h2-master-1 Oct 02 01:03:04.509524 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ccf9168f-9aaf-4554-a9a6-81d8cae46674 req-a01812aa-dfef-46ed-95a0-96c650603000 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151876 Oct 02 01:03:04.512326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 348/671] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:04.532465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:04.534134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:04.535331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:04.545197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a780f35b-236a-40c0-81b3-31a4e6f151cb tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.472724 Oct 02 01:03:04.546105 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 324/672] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:04 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:04.551045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:04.551832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:04.554969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.555457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.556067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.557993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.559504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.559633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.562110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.567040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.567495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:04.568242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:04.568700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:04.569654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.142457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:05.160273 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc7d6ea3-a18a-40ce-a8fa-fa241e26b727 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1473 microversion: 2.1 time: 0.640865 Oct 02 01:03:05.160948 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 349/673] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:04 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1473 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.173424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:05.181633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-bcd8c5e2-a2dd-474f-bb34-5068cc133e73 req-b0ea045e-c153-4c84-bfe2-48ad327e4593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775f37dc-d601-4e83-a9ea-57791e2e7f18", "name": "network-vif-deleted", "tag": "7eacb9f2-99c6-49e9-880b-595f501b106e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:05.189792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3837cf31-8418-4d31-9d20-735812294f6f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1493 microversion: 2.1 time: 0.642415 Oct 02 01:03:05.190396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 325/674] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:04 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1493 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.200869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bcd8c5e2-a2dd-474f-bb34-5068cc133e73 req-b0ea045e-c153-4c84-bfe2-48ad327e4593 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.201170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.201773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bcd8c5e2-a2dd-474f-bb34-5068cc133e73 req-b0ea045e-c153-4c84-bfe2-48ad327e4593 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.202335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bcd8c5e2-a2dd-474f-bb34-5068cc133e73 req-b0ea045e-c153-4c84-bfe2-48ad327e4593 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.210048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.218808 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-bcd8c5e2-a2dd-474f-bb34-5068cc133e73 req-b0ea045e-c153-4c84-bfe2-48ad327e4593 service nova] Creating event network-vif-deleted:7eacb9f2-99c6-49e9-880b-595f501b106e for instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 on n-h1-master-1 Oct 02 01:03:05.227831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.230501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.232233 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-bcd8c5e2-a2dd-474f-bb34-5068cc133e73 req-b0ea045e-c153-4c84-bfe2-48ad327e4593 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068326 Oct 02 01:03:05.232471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.233617 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 350/675] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:05.234449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.236373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.237176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.248822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.251548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.270450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.270971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.271487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.272745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.273195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.273613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.572327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:05.582154 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0932b43-3141-4be6-9cff-d3c8c6d7df6a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.386584 Oct 02 01:03:05.583848 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 326/676] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.591310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.592207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.593710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:05.601169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.601849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.602289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.603032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.604117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.604702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.609637 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3199264a-ce02-44dc-98a4-bc0f04d43ab2 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.373171 Oct 02 01:03:05.610391 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 351/677] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.622009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.622826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.635115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.635609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.636104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.636840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.637306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.637726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.663506 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:05.792663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:05.827251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58c6b260-8c82-44ae-90a9-281886660cc3 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1323 microversion: 2.1 time: 0.215601 Oct 02 01:03:05.831275 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 352/678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.846746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.846746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.853783 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5356633-0131-405b-ba1a-2cacfd0ff090 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1644 microversion: 2.1 time: 0.267894 Oct 02 01:03:05.855818 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 327/679] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1644 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:05.866221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.866895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.867423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.868404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.868956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.869555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.884259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:05.886717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:05.912970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.913460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.913895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:05.914639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:05.915084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:05.915511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:06.988058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:06.998572 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e712c350-d906-486f-808c-fcfec4f6e07d tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 1.165736 Oct 02 01:03:07.004175 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 353/680] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:07.011534 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f016e55-07d3-418c-a830-fb947b130761 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1644 microversion: 2.1 time: 1.133451 Oct 02 01:03:07.012727 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 328/681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:05 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1644 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:07.028638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:07.029444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.044844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:07.049881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.052562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.053873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.054734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.055761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.056536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.057333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.068957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.071098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.071572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.072315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.072776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.073206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.527224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:07.534877 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8587f954-999f-40bb-a1c1-8c32f580b38f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.519500 Oct 02 01:03:07.535460 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 329/682] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:07.546918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:07.548638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.558286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.559570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.561112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.561424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:07.562296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.563082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.563867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.570084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1653fa65-d17f-457f-a38a-1d666ee076ec tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1470 microversion: 2.1 time: 0.557941 Oct 02 01:03:07.570508 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 354/683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1470 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:07.579929 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:07.580151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:07.580725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.594301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.594838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.595366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.596129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.596832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.597495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.757483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:07.767554 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-990a97ab-6e10-4707-8e15-d7a1602c9573 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1321 microversion: 2.1 time: 0.195574 Oct 02 01:03:07.784316 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 355/684] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:07.790807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:07.795144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.795819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.796465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.797384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.798031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.798677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.826554 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2132327a-5e68-4bf3-a789-041a41317bc6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040754 Oct 02 01:03:07.827790 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 356/685] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:07.841625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:07.843352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.850530 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:07.853615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.854388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.855088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.856008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.856645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.857285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.937411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c31b0de-b81d-4736-88ac-9fc51a32b469 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf/action" status: 204 len: 0 microversion: 2.1 time: 0.108181 Oct 02 01:03:07.938297 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 357/686] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:07 2022] POST /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf/action => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:07.943842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:07.944933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:07.951418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.951751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:07.951905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.952590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.953644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:07.954171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:07.954744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:07.977469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-189147ff-613b-4844-8be8-ac14bdb56fae tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 0.434178 Oct 02 01:03:07.978062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 330/687] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:08.005153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:08.005859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:08.013959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.014619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.014887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.024120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.024948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.025538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.082081 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ccc51111-f5df-4a05-a832-22573439eeae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581/action" status: 202 len: 0 microversion: 2.1 time: 0.141989 Oct 02 01:03:08.083528 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 358/688] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:07 2022] POST /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:08.095035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:08.096122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:08.115289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.117552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.119781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.120789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.122235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.127376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.476355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:08.491699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7bfc3aa6-c2eb-4b55-ab16-15705f5e1413 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1470 microversion: 2.1 time: 0.496581 Oct 02 01:03:08.492338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 331/689] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:07 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1470 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:08.504941 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:08.506913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:08.526237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.527680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.530021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.531149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.534000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.534832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.804311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:08.817878 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7731dc2e-42a4-4953-98e0-3f93a05a39e2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.730939 Oct 02 01:03:08.822386 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 359/690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:08 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:08.839877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:08.840781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:08.851499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.855824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.857823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.859950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.862128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.862820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.208043 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-561ae2bd-204d-4dc1-8980-81ea33e90e54 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1649 microversion: 2.1 time: 0.714398 Oct 02 01:03:09.219174 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 332/691] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:08 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1649 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:09.225742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:09.226367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:09.238793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:09.239668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:09.240270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.246141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:09.246878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:09.247583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.591585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:09.603514 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-808f1c70-05c8-4ef1-a2d0-53d0c32eeb11 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.775900 Oct 02 01:03:09.614463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 360/692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:08 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:09.878882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0dac99eb-7ef2-4cf2-bf5e-37f45ef92b09 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Action: 'create', calling method: .version_select at 0x7fb88166be50>, body: {"keypair": {"name": "tempest-keypair-366302206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhO0orcRipWpfhuuy2bzuHX+ANj5liRMQioMEUs/WUXDIYi9oTiOUhYNm8oLpp9OGSxFqvDOGQzLJ6CsB/HcnfDE3YmEehhiqPFSixA3u3WJLsmConLRc7JzNuvHCNb9A=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:09.909991 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=39 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:09.918191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0dac99eb-7ef2-4cf2-bf5e-37f45ef92b09 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Getting quotas for project 4ad7cba3465048b195bfe5d870860bdf. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:09.937601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0dac99eb-7ef2-4cf2-bf5e-37f45ef92b09 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Getting quotas for user 0db18eb48be64e72a9419d4e7452ca5b and project 4ad7cba3465048b195bfe5d870860bdf. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:09.942812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:09.961945 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6432f78e-3dc2-42bb-9195-3f10f3a58a5f tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1388 microversion: 2.1 time: 0.736870 Oct 02 01:03:09.963198 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 333/693] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:09 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1388 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:09.979178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:09.981947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:10.002920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.010071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.011755 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0dac99eb-7ef2-4cf2-bf5e-37f45ef92b09 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.394600 Oct 02 01:03:10.012134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.012523 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 361/694] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:03:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:10.014215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.015822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.017245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f442eacd-a940-4b25-9047-998e9d587998 req-194f881b-ebf4-494f-a82f-180e94a85ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9a72a6-4011-4b04-b574-f7d1405479e1", "name": "network-vif-plugged", "status": "completed", "tag": "82b77f64-8e73-4f66-9f30-32b40e50f529"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:10.017525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.039207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f442eacd-a940-4b25-9047-998e9d587998 req-194f881b-ebf4-494f-a82f-180e94a85ec7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.042990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f442eacd-a940-4b25-9047-998e9d587998 req-194f881b-ebf4-494f-a82f-180e94a85ec7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.043656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f442eacd-a940-4b25-9047-998e9d587998 req-194f881b-ebf4-494f-a82f-180e94a85ec7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.072086 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f442eacd-a940-4b25-9047-998e9d587998 req-194f881b-ebf4-494f-a82f-180e94a85ec7 service nova] Creating event network-vif-plugged:82b77f64-8e73-4f66-9f30-32b40e50f529 for instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 on n-h1-master-1 Oct 02 01:03:10.081860 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f442eacd-a940-4b25-9047-998e9d587998 req-194f881b-ebf4-494f-a82f-180e94a85ec7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066950 Oct 02 01:03:10.091069 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 362/695] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:10.096706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:10.097663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:10.120972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.121577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.122040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.122902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.123377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.140654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.773722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:10.795044 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d18e781-ccda-4e70-a0f2-e5228c51ead1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1470 microversion: 2.1 time: 0.702199 Oct 02 01:03:10.800086 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 363/696] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:10 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1470 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:10.821925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:10.833736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:10.870324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.873435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.883408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.884520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.885240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.885889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.628515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:11.643079 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e36dd64-dac6-4798-ab53-f8537b72d974 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1324 microversion: 2.1 time: 1.672570 Oct 02 01:03:11.645930 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 334/697] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:09 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1324 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:11.670875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:11.672876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:11.685970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.686466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.692796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.694316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.694983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.695856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.764201 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:11.775284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c2029b9f-cdf4-4cdd-bc67-5c16483ed198 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.972459 Oct 02 01:03:11.777285 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 364/698] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:10 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:11.782317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:11.783119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:11.796620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.797410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.798195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.799135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.799800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.800412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.017623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c78ce8b8-0e4b-4665-a46f-f448b1a6dec3 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1629 microversion: 2.1 time: 0.369653 Oct 02 01:03:12.041098 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 335/699] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:11 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1629 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:12.060358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:12.061010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:12.069022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.070144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.070609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.079191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.079690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.082112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.347561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:12.361540 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e98cfb7-f726-470d-a587-11d48180f47b tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.582815 Oct 02 01:03:12.362172 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 365/700] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:11 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:12.370084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:12.370521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:12.394202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.399327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.399870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.400538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.401003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.420300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.719450 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=42 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:12.941867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:12.985688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:12.989806 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9989d9a-fa1a-4ff4-94de-15bd4fb60bb2 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1388 microversion: 2.1 time: 0.945574 Oct 02 01:03:13.002711 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 336/701] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:12 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1388 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.012459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:13.025094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:13.029372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-94df0479-ca44-41f7-8771-4d447e733cd1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1470 microversion: 2.1 time: 0.664284 Oct 02 01:03:13.030175 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 366/702] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:12 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1470 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.034420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b9b23c-04cc-48a2-a899-6bad90818950", "name": "network-vif-plugged", "status": "completed", "tag": "34b11d27-94e5-4bbe-a6f1-08508f199f5f"}, {"server_uuid": "0530656d-9d5c-4a05-bfc3-94cf67b19dcf", "name": "network-vif-plugged", "status": "completed", "tag": "3e02bdab-8b46-4fdf-91fc-2e60947189c5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:13.061232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.061739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.062181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.063349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.064702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.065325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.065623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.066267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.066900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.100653 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] Creating event network-vif-plugged:34b11d27-94e5-4bbe-a6f1-08508f199f5f for instance 84b9b23c-04cc-48a2-a899-6bad90818950 on n-h1-master-1 Oct 02 01:03:13.105207 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] Creating event network-vif-plugged:3e02bdab-8b46-4fdf-91fc-2e60947189c5 for instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf on n-h2-master-1 Oct 02 01:03:13.132502 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-620d4d1a-f0ce-4a95-a2e2-906a50681f0d req-b6c3617e-01c1-4b46-bbe2-1caa0fc47350 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101273 Oct 02 01:03:13.133404 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 367/703] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:13.142108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1c4c8c16-c662-4e9c-a1f8-9d826bec8848 req-d85bc589-dc42-4046-882b-60290cf96095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c70ae7-69f8-4bfd-86cc-3278c090e269", "tag": "b4bf032d-680a-4210-a9a3-44800f4bb515"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:13.175252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c4c8c16-c662-4e9c-a1f8-9d826bec8848 req-d85bc589-dc42-4046-882b-60290cf96095 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.176064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c4c8c16-c662-4e9c-a1f8-9d826bec8848 req-d85bc589-dc42-4046-882b-60290cf96095 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.176664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c4c8c16-c662-4e9c-a1f8-9d826bec8848 req-d85bc589-dc42-4046-882b-60290cf96095 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.223581 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1c4c8c16-c662-4e9c-a1f8-9d826bec8848 req-d85bc589-dc42-4046-882b-60290cf96095 service nova] Creating event network-changed:b4bf032d-680a-4210-a9a3-44800f4bb515 for instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 on n-h2-master-1 Oct 02 01:03:13.245226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1c4c8c16-c662-4e9c-a1f8-9d826bec8848 req-d85bc589-dc42-4046-882b-60290cf96095 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108316 Oct 02 01:03:13.246982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 368/704] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:13.259987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:13.260987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:13.270158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.271041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.273153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.274382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.276146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.276781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.481239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lazy-loading 'flavor' on Instance uuid 4b9b6852-851e-4c47-bd2f-93dc631f2581 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:13.494872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Going to try to live migrate instance to n-h1-master-1 {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:03:13.668851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:13.679293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8d420af4-f747-41f1-a98e-971f1378a838 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 200 len: 1520 microversion: 2.1 time: 0.429495 Oct 02 01:03:13.696299 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 369/705] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:13 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.710527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:13.711481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:13.717831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.718549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.719217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.720086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.720701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.721274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.910417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:13.918237 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:13.928201 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58a3db85-9911-4b41-8178-45a9a0091dfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1371 microversion: 2.1 time: 0.230619 Oct 02 01:03:13.929212 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 370/706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:13 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.934854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:13.935956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:13.942391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.943210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.944180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.945121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.945786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.946414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:14.121108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:14.137204 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56d1c8d8-b351-43ba-b6a6-22e09a107221 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.206727 Oct 02 01:03:14.155271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 371/707] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:13 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:14.166314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'action', calling method: .version_select at 0x7fb883a6f8b0>, body: {"addFloatingIp": {"address": "172.35.4.224"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:14.170154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:14.179612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:14.180386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:14.181000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:14.182393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:14.183275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:14.183858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:14.296604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:03:14.297205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquired lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:03:16.986444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Building network info cache for instance {{(pid=122355) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:03:17.143903 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-69d48500-5638-4e40-9706-d8e232859ed0 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581/action" status: 202 len: 0 microversion: 2.1 time: 4.139561 Oct 02 01:03:17.148500 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 337/708] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:13 2022] POST /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581/action => generated 0 bytes in 4141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:17.151625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:17.152364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:17.176061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.177068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.191350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.192509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.193509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.195475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.804634 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:17.935566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:17.962452 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49c4e695-d38f-46c1-9389-ff7dfb3d6090 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1388 microversion: 2.1 time: 0.816558 Oct 02 01:03:17.963078 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 338/709] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:17 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1388 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:17.990422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:17.993959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:18.018108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.018924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.023248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.024219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.024837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.025418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.501388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:18.511876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9fff356-4755-49e7-bf2b-0af44e8e5c32 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1462 microversion: 2.1 time: 0.536776 Oct 02 01:03:18.512764 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 339/710] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:17 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1462 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:18.522253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-309315885", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ce77e8f1-2d11-45bb-bd6f-d139d7a64860"}], "security_groups": [{"name": "tempest-securitygroup--1878054219"}], "key_name": "tempest-keypair-366302206", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:18.596949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Updating instance_info_cache with network_info: [{"id": "f238cf4a-a01b-4be0-80a6-0b3552b30d79", "address": "fa:16:3e:56:75:48", "network": {"id": "f45f022a-328d-48ee-8bd2-7d2edf137424", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1380637593-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b94d90c894bf4eac916e2ff32975efcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf238cf4a-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:03:18.658145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Releasing lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:03:18.659775 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd13fef9-3eba-4c9c-94e9-a3592bb32217 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action" status: 202 len: 0 microversion: 2.1 time: 4.500754 Oct 02 01:03:18.668005 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 372/711] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:14 2022] POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action => generated 0 bytes in 4512 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:03:18.697619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:18.702252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:18.716058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.717368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.718191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.719113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.719793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.720737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:19.352387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] validate_networks() for [('ce77e8f1-2d11-45bb-bd6f-d139d7a64860', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:19.703810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:19.717304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-692fbf56-9c2e-4ebf-b8c8-c6179e74f1d0 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1558 microversion: 2.1 time: 1.047315 Oct 02 01:03:19.741573 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 373/712] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:18 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1558 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:19.750078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:19.753425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:19.772866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:19.773697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:19.774418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:19.775378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:19.781198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:19.782963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:19.950966 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:21.136925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:21.154294 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ec00e18-b0ca-4264-9e2f-1a9307680c22 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 1.411582 Oct 02 01:03:21.155177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 374/713] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:19 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:21.173839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ecb88068-7eec-436c-afbc-2315ca1430e2 req-608cd280-c0d3-44e5-995c-b8ddd687470e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:21.197292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ecb88068-7eec-436c-afbc-2315ca1430e2 req-608cd280-c0d3-44e5-995c-b8ddd687470e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.201389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ecb88068-7eec-436c-afbc-2315ca1430e2 req-608cd280-c0d3-44e5-995c-b8ddd687470e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.202326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ecb88068-7eec-436c-afbc-2315ca1430e2 req-608cd280-c0d3-44e5-995c-b8ddd687470e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.311835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Getting quotas for project 4ad7cba3465048b195bfe5d870860bdf. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:21.327544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Getting quotas for user 0db18eb48be64e72a9419d4e7452ca5b and project 4ad7cba3465048b195bfe5d870860bdf. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:21.367342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:21.368022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:21.368660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:21.369213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:21.369769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:21.393108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.393824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.394435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.395369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.396561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.397170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.439215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Getting quotas for project 4ad7cba3465048b195bfe5d870860bdf. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:21.453815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Getting quotas for user 0db18eb48be64e72a9419d4e7452ca5b and project 4ad7cba3465048b195bfe5d870860bdf. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:21.484223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:21.487142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:21.563000 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ecb88068-7eec-436c-afbc-2315ca1430e2 req-608cd280-c0d3-44e5-995c-b8ddd687470e service nova] Creating event network-changed:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:03:21.579480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ecb88068-7eec-436c-afbc-2315ca1430e2 req-608cd280-c0d3-44e5-995c-b8ddd687470e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421742 Oct 02 01:03:21.580699 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 375/714] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:21.596477 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ebe337b-c712-4175-80be-6d3fea6fb08c tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.082403 Oct 02 01:03:21.598254 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 340/715] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 3085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:03:21.605819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:21.609290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:21.611721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:21.615392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:21.622738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.625222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.625761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.626215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.626443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.626986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.628189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.628739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.629033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:21.629673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:21.630270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.630542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.496084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:22.528816 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80ad3fb3-c270-44f3-ae90-9930ca3c84e7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.937977 Oct 02 01:03:22.531560 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 376/716] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:21 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:22.554916 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e7766e97-a811-4eae-8378-b79084f2a211 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1613 microversion: 2.1 time: 0.954046 Oct 02 01:03:22.564526 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 341/717] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:21 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1613 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:22.576538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.224"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:22.603779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:22.609352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:22.618862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:22.634737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.635492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.636979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.639535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.640910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.642405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.642577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.644697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.645366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.646348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.663289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.664322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.722222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "refresh_cache-4f9a72a6-4011-4b04-b574-f7d1405479e1" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:03:22.723396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquired lock "refresh_cache-4f9a72a6-4011-4b04-b574-f7d1405479e1" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:03:23.329092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:23.338686 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67432166-cdd4-4765-8f40-22f7461ed222 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1388 microversion: 2.1 time: 0.764883 Oct 02 01:03:23.343525 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 342/718] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:22 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1388 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:23.358024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:23.358827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:23.369935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.372679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.373300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.377392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.378073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.378705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.551300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87f68391-5eb6-4cbe-a60a-a4ce6e78d1be tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206375 Oct 02 01:03:23.552839 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 343/719] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:03:23 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:23.559078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b71d4318-f9a5-42ac-84a4-64ff29a09b78 req-fa85f541-9dfe-4793-a89c-011c622ab7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c70ae7-69f8-4bfd-86cc-3278c090e269", "name": "network-vif-plugged", "status": "completed", "tag": "b4bf032d-680a-4210-a9a3-44800f4bb515"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:23.590357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b71d4318-f9a5-42ac-84a4-64ff29a09b78 req-fa85f541-9dfe-4793-a89c-011c622ab7ef service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.591128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b71d4318-f9a5-42ac-84a4-64ff29a09b78 req-fa85f541-9dfe-4793-a89c-011c622ab7ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.593197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b71d4318-f9a5-42ac-84a4-64ff29a09b78 req-fa85f541-9dfe-4793-a89c-011c622ab7ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.628322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b71d4318-f9a5-42ac-84a4-64ff29a09b78 req-fa85f541-9dfe-4793-a89c-011c622ab7ef service nova] Creating event network-vif-plugged:b4bf032d-680a-4210-a9a3-44800f4bb515 for instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 on n-h2-master-1 Oct 02 01:03:23.637298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b71d4318-f9a5-42ac-84a4-64ff29a09b78 req-fa85f541-9dfe-4793-a89c-011c622ab7ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082659 Oct 02 01:03:23.638457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 344/720] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:23.652754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:23.654382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:23.662873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.663580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.664428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.666080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.666785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.680570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.307542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:24.317982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8dfbd269-d40c-4232-8903-03e5eaa360c4 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1320 microversion: 2.1 time: 0.677905 Oct 02 01:03:24.324788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 345/721] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:23 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1320 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:24.334807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:24.337375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:24.349317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.352568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.355361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.356395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.357080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.358539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.391332 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:24.814308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:24.824551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a43e45fb-f4a6-42c1-a55e-9ee53734da83 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1472 microversion: 2.1 time: 0.498386 Oct 02 01:03:24.825144 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 346/722] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:24 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:24.848474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de77dccb-5c51-4673-9b6b-7cbd15ab7baa tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '.version_select at 0x7fb8817ec0d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:24.854921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de77dccb-5c51-4673-9b6b-7cbd15ab7baa tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.856568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de77dccb-5c51-4673-9b6b-7cbd15ab7baa tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.857293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de77dccb-5c51-4673-9b6b-7cbd15ab7baa tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.885867 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de77dccb-5c51-4673-9b6b-7cbd15ab7baa tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.041358 Oct 02 01:03:24.888041 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 347/723] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:03:24 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:24.908099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:24.908960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:24.925195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.927968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.928759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.937563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.938329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.938877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.421785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:25.430918 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f107b0d4-f26d-4264-bf63-2685b7ba2248 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.541518 Oct 02 01:03:25.448069 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 348/724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:24 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:25.453583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9b6852-851e-4c47-bd2f-93dc631f2581", "name": "network-vif-unplugged", "status": "completed", "tag": "0f4fa885-d86a-49bd-943d-0ec893b75c7e"}, {"name": "network-changed", "server_uuid": "4b9b6852-851e-4c47-bd2f-93dc631f2581", "tag": "0f4fa885-d86a-49bd-943d-0ec893b75c7e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:25.464622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.465453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.466116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.480285 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] Creating event network-vif-unplugged:0f4fa885-d86a-49bd-943d-0ec893b75c7e for instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 on n-h2-master-1 Oct 02 01:03:25.481138 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] Creating event network-changed:0f4fa885-d86a-49bd-943d-0ec893b75c7e for instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 on n-h2-master-1 Oct 02 01:03:25.487247 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-09f554fe-21d5-4483-9fff-5fe9ab85fc2e req-8262c79a-0b40-42c8-91f0-14bb416d683b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037432 Oct 02 01:03:25.489182 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 349/725] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:25.663819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1518696310", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "9a195c53-3350-481b-9278-75a22d79ccc3"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:25.762628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] validate_networks() for [('9a195c53-3350-481b-9278-75a22d79ccc3', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:27.456256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:27.456976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:27.456976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:27.457281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:27.457885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:27.477508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.478000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.478453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.479219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.479681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.480108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.520431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:27.522838 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:27.527322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for user d44f8d053e07440699d217cd63c94d0d and project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:27.543826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:27.546892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:27.621183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21d5aa86-9212-4524-9075-4be6cc4919f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.127748 Oct 02 01:03:27.621183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 350/726] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:03:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:03:27.637189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:27.638201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:27.655024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.655821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.656435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.657317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.659425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.660049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.122882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:28.131744 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f78959c0-be2e-4f64-a182-b957eb8e358d tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1587 microversion: 2.1 time: 0.509591 Oct 02 01:03:28.149964 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 351/727] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:27 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1587 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:28.154964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-105459912", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:28.214986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:28.541265 n-d-master-1 devstack@n-api.service[122355]: INFO nova.network.neutron [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] re-assign floating IP 172.35.4.224 from instance 1d186a0b-6561-4806-bc2d-02d041abe214 Oct 02 01:03:28.621535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Building network info cache for instance {{(pid=122355) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:03:28.741301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:28.741813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:28.742222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:28.742653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:28.743232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:28.765497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.766244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.766882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.767782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.768408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.769000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.816950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:28.829906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for user 739083b66f9b433889944e555b0aef23 and project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:28.862245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:28.864531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:28.983087 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a061045f-ef6d-48bb-8e09-64429cb83d9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831788 Oct 02 01:03:28.983756 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 352/728] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:03:28.996386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a6d4d193-3df3-44e6-8be4-b8b6c4eb36f9 req-c49011cc-d43e-4201-938f-d9beacc28885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b9b23c-04cc-48a2-a899-6bad90818950", "tag": "34b11d27-94e5-4bbe-a6f1-08508f199f5f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:29.013641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a6d4d193-3df3-44e6-8be4-b8b6c4eb36f9 req-c49011cc-d43e-4201-938f-d9beacc28885 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.019308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a6d4d193-3df3-44e6-8be4-b8b6c4eb36f9 req-c49011cc-d43e-4201-938f-d9beacc28885 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.019933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a6d4d193-3df3-44e6-8be4-b8b6c4eb36f9 req-c49011cc-d43e-4201-938f-d9beacc28885 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.054677 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a6d4d193-3df3-44e6-8be4-b8b6c4eb36f9 req-c49011cc-d43e-4201-938f-d9beacc28885 service nova] Creating event network-changed:34b11d27-94e5-4bbe-a6f1-08508f199f5f for instance 84b9b23c-04cc-48a2-a899-6bad90818950 on n-h1-master-1 Oct 02 01:03:29.061903 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a6d4d193-3df3-44e6-8be4-b8b6c4eb36f9 req-c49011cc-d43e-4201-938f-d9beacc28885 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071396 Oct 02 01:03:29.065439 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 353/729] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:29.078886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:29.081422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:29.094531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.095543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.096209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.097612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.101202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.102426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.654571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:29.667391 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1f012f8-d82f-409c-a185-17721e12260f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1394 microversion: 2.1 time: 0.600791 Oct 02 01:03:29.671847 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 354/730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:29 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1394 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:29.696117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:29.696956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:29.704010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.704909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.705503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.706581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.707242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.708545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.364515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:30.386634 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3ca93e6-b609-444a-9963-afc9144e0c50 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1478 microversion: 2.1 time: 0.696998 Oct 02 01:03:30.387605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 355/731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:29 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1478 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:30.410098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:30.411029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:30.417993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.418717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.419320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.420241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.420850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.421428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.553540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Updating instance_info_cache with network_info: [{"id": "f238cf4a-a01b-4be0-80a6-0b3552b30d79", "address": "fa:16:3e:56:75:48", "network": {"id": "f45f022a-328d-48ee-8bd2-7d2edf137424", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1380637593-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b94d90c894bf4eac916e2ff32975efcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf238cf4a-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:03:30.568332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Building network info cache for instance {{(pid=122355) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:03:31.083001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.093381 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d588076-4e30-4e20-82c2-1ed5fba37008 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.687248 Oct 02 01:03:31.093915 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 356/732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:30 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:31.112728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.113438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.121822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.122559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.123219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.124122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.124735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.125329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.286032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.326476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.338115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.339353 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-46fb805c-7def-414d-b9c9-1823c6bcacfe tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1320 microversion: 2.25 time: 0.242687 Oct 02 01:03:31.354100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 357/733] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:31.373603 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.374133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.391137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.391665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.392091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.392805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.393264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.398373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.547182 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-300734a7-e737-4e85-904d-1f800597cecb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191734 Oct 02 01:03:31.551282 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 358/734] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:31.562929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-15be5bbd-5253-466c-bf84-45daeadcdabe req-6d7d703e-0fff-4a7f-967e-30dcaf472b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:31.591620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15be5bbd-5253-466c-bf84-45daeadcdabe req-6d7d703e-0fff-4a7f-967e-30dcaf472b72 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.592363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15be5bbd-5253-466c-bf84-45daeadcdabe req-6d7d703e-0fff-4a7f-967e-30dcaf472b72 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.592954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15be5bbd-5253-466c-bf84-45daeadcdabe req-6d7d703e-0fff-4a7f-967e-30dcaf472b72 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.613074 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-15be5bbd-5253-466c-bf84-45daeadcdabe req-6d7d703e-0fff-4a7f-967e-30dcaf472b72 service nova] Creating event network-changed:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:03:31.625509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-15be5bbd-5253-466c-bf84-45daeadcdabe req-6d7d703e-0fff-4a7f-967e-30dcaf472b72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068808 Oct 02 01:03:31.626149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 359/735] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:31.634588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.635329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.647321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.648052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.648667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.649536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.650153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.650779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.765690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.777936 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f532049f-477d-4223-8b3a-b097dafb0228 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1264 microversion: 2.1 time: 0.147597 Oct 02 01:03:31.779675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 360/736] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:31.792305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.793179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.801385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.802973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.803621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.804688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.805454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.806575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.083302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Updating instance_info_cache with network_info: [{"id": "82b77f64-8e73-4f66-9f30-32b40e50f529", "address": "fa:16:3e:5e:c9:a4", "network": {"id": "f45f022a-328d-48ee-8bd2-7d2edf137424", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1380637593-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b94d90c894bf4eac916e2ff32975efcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap82b77f64-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:03:32.102996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Releasing lock "refresh_cache-4f9a72a6-4011-4b04-b574-f7d1405479e1" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:03:32.104034 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81883ee1-589a-45b1-929d-06e2fcc54ca1 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1/action" status: 202 len: 0 microversion: 2.1 time: 9.570191 Oct 02 01:03:32.108444 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 377/737] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:22 2022] POST /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1/action => generated 0 bytes in 9573 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:03:32.116646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.117495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.129233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.133856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.135010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:32.135172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.136750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.140037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.140487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.149480 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3f69371-57b3-4194-949f-96c99e826833 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1394 microversion: 2.1 time: 0.364479 Oct 02 01:03:32.163340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 361/738] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1394 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.191870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'action', calling method: .version_select at 0x7fb8836490d0>, body: {"removeFloatingIp": {"address": "172.35.4.224"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:32.417067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.427161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.428031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.428708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.429925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.430772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.431434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.433182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:32.447454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3b82495-caf7-4347-99ec-4c934d5fcf4e tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1478 microversion: 2.1 time: 0.337666 Oct 02 01:03:32.465904 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 378/739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1478 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.473993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.484725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.502048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.502536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.502997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.503701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.504150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.505104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.775489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:32.795857 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ef6b2b8d-be8b-4e98-a18b-cf11ffb5bfc6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.328582 Oct 02 01:03:32.804277 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 379/740] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.810536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] HTTP exception thrown: Floating IP 172.35.4.224 is not associated with instance 1d186a0b-6561-4806-bc2d-02d041abe214. Oct 02 01:03:32.811856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.812641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Request method failure captured: Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action HTTP/1.1 Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 49 Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOMYSij7ZNZd_P7is3Pu_yq2XcHqY1yORXg9vkDA_o-A6seZoRiqprjOCR4_vSmgaPK2VFOgyt-W6YCvS5FQE76H06_4256ApycgoFx0ltT1z8t2wJAPzLIZ5awMurnSSOsRgTgjZXDNp_NzJ6ouCQRPblbS7HmNlsoL__Oz0TlxFUk Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:03:32.818330 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b94d90c894bf4eac916e2ff32975efcd"}]}] Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 25fbb294f2064ce386c25ce5e371a1dc Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: {"removeFloatingIp": {"address": "172.35.4.224"}} Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:03:32.819868 n-d-master-1 devstack@n-api.service[122354]: exception: Floating IP 172.35.4.224 is not associated with instance 1d186a0b-6561-4806-bc2d-02d041abe214. Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1d186a0b-6561-4806-bc2d-02d041abe214', 'body': {'removeFloatingIp': {'address': '172.35.4.224'}}} Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.224 is not associated with instance 1d186a0b-6561-4806-bc2d-02d041abe214. Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:32.820705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.224 is not associated with instance 1d186a0b-6561-4806-bc2d-02d041abe214. Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:32.822546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Returning 409 to user: Floating IP 172.35.4.224 is not associated with instance 1d186a0b-6561-4806-bc2d-02d041abe214. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:32.823037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.823037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.823195 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-edb3536c-a423-4fef-8266-b0f9bfd3e4b8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action" status: 409 len: 146 microversion: 2.1 time: 0.654276 Oct 02 01:03:32.823281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.823364 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 362/741] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:32 2022] POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action => generated 146 bytes in 656 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:03:32.823439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.823439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.823439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.825944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.826544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.832655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.833908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.834499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.835225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.835805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.836235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.923731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:32.947220 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9546a9d6-091b-4f04-89ba-80cdf7e056ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1264 microversion: 2.1 time: 0.125646 Oct 02 01:03:32.948424 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 363/742] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1264 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.955199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.224"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:33.077743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.089928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.092139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.096667 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a65801d8-0bb1-4ce2-bc10-ce6f1933f8a0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1362 microversion: 2.25 time: 0.287809 Oct 02 01:03:33.097883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 380/743] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:33.138416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:33.145986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.146999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.147688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.148662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.149348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.150031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.180719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:33.181489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:33.191169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.191755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.201129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.202274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.202899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.203418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.553558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.562655 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88e199f9-dac8-4a82-bec9-11c1e87cc9cb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1394 microversion: 2.1 time: 0.387366 Oct 02 01:03:33.563427 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 381/744] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:33 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1394 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:33.571589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:33.573320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:33.580941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.581747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.582384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.583154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.583739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.584135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.626104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "refresh_cache-4f9a72a6-4011-4b04-b574-f7d1405479e1" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:03:33.627374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquired lock "refresh_cache-4f9a72a6-4011-4b04-b574-f7d1405479e1" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:03:34.252508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:34.265424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1989672c-ffca-4661-9b30-f8a59540dfa1 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1463 microversion: 2.1 time: 0.700290 Oct 02 01:03:34.266909 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 382/745] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:33 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1463 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:34.273890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:34.274851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:34.282772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.283621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.284332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.285494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.286455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.287253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.749335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:34.761436 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-477ac47f-f9d6-4469-bb1a-4531c25f81e4 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1587 microversion: 2.1 time: 0.492640 Oct 02 01:03:34.763545 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 383/746] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:34 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1587 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:34.770725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f596a4bb-c150-4ecd-a37d-00941af2669f req-fef004d5-dd1b-4a52-b667-4d3e4a2c27e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c70ae7-69f8-4bfd-86cc-3278c090e269", "tag": "b4bf032d-680a-4210-a9a3-44800f4bb515"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:34.784320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f596a4bb-c150-4ecd-a37d-00941af2669f req-fef004d5-dd1b-4a52-b667-4d3e4a2c27e3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.784892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f596a4bb-c150-4ecd-a37d-00941af2669f req-fef004d5-dd1b-4a52-b667-4d3e4a2c27e3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.785519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f596a4bb-c150-4ecd-a37d-00941af2669f req-fef004d5-dd1b-4a52-b667-4d3e4a2c27e3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.803157 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f596a4bb-c150-4ecd-a37d-00941af2669f req-fef004d5-dd1b-4a52-b667-4d3e4a2c27e3 service nova] Creating event network-changed:b4bf032d-680a-4210-a9a3-44800f4bb515 for instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 on n-h2-master-1 Oct 02 01:03:34.814135 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f596a4bb-c150-4ecd-a37d-00941af2669f req-fef004d5-dd1b-4a52-b667-4d3e4a2c27e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048936 Oct 02 01:03:34.815348 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 384/747] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:34.830157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9a72a6-4011-4b04-b574-f7d1405479e1", "tag": "82b77f64-8e73-4f66-9f30-32b40e50f529"}, {"name": "network-changed", "server_uuid": "0dfd9835-627c-451d-b86e-1115b727db28", "tag": "72f94aae-1dc8-4f1a-84c8-2e35e6b5d419"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:34.843183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.843959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.844774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.876330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] Creating event network-changed:82b77f64-8e73-4f66-9f30-32b40e50f529 for instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 on n-h1-master-1 Oct 02 01:03:34.877415 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] Creating event network-changed:72f94aae-1dc8-4f1a-84c8-2e35e6b5d419 for instance 0dfd9835-627c-451d-b86e-1115b727db28 on n-h1-master-1 Oct 02 01:03:34.885445 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-566b1d64-324a-47d2-b37d-70b7f06bf5db req-7e064737-ce0e-44f4-87ae-0ea324caa4f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066043 Oct 02 01:03:34.886754 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 385/748] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:34.893229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:34.894175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:34.902269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.903098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.903706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.904598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.905804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.906417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.911936 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:35.431455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:35.440712 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8ebdd7e-4ae2-4c0c-966d-a195fff0200a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.552171 Oct 02 01:03:35.451022 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 386/749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:34 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:35.451022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7e934dfe-699e-4069-85ae-946edb1bd5f3 req-4a9af382-9830-49d0-a848-73b5b0509bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188f4b83-8e80-45f4-9be3-513a2f021e12", "name": "network-vif-plugged", "status": "completed", "tag": "ecdd37ff-a07b-4d5f-aa4c-04d4c5654386"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:35.458278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7e934dfe-699e-4069-85ae-946edb1bd5f3 req-4a9af382-9830-49d0-a848-73b5b0509bf6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.459444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7e934dfe-699e-4069-85ae-946edb1bd5f3 req-4a9af382-9830-49d0-a848-73b5b0509bf6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.459950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7e934dfe-699e-4069-85ae-946edb1bd5f3 req-4a9af382-9830-49d0-a848-73b5b0509bf6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.473148 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7e934dfe-699e-4069-85ae-946edb1bd5f3 req-4a9af382-9830-49d0-a848-73b5b0509bf6 service nova] Creating event network-vif-plugged:ecdd37ff-a07b-4d5f-aa4c-04d4c5654386 for instance 188f4b83-8e80-45f4-9be3-513a2f021e12 on n-h2-master-1 Oct 02 01:03:35.478399 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7e934dfe-699e-4069-85ae-946edb1bd5f3 req-4a9af382-9830-49d0-a848-73b5b0509bf6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Oct 02 01:03:35.479534 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 387/750] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:35.484934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.486176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:35.494070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.495178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.495815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.496695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.497839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.498432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.817618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:35.826006 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed0226b9-0f56-4476-a9e4-855058c96ee9 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.345625 Oct 02 01:03:35.826674 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 388/751] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:35 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:35.831435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.832039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:35.839533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.840343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.841002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.841771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.842462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.843100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.915977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Building network info cache for instance {{(pid=122354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:03:36.181626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:36.190344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:36.191823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:36.193657 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba683053-518e-48e1-a6aa-60aa255c73cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1362 microversion: 2.25 time: 0.365832 Oct 02 01:03:36.194223 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 389/752] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:35 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:36.199416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:36.202208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:36.209284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.210064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.210733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.211676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.212334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.212838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.290144 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d7925b9-2f20-4ef6-af3e-153b3ba3ef1b tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 0 microversion: 2.1 time: 0.094404 Oct 02 01:03:36.291564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 390/753] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:36 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:36.297255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:36.298370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:36.305635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.306374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.307023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.308118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.308879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.309454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.867266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:36.875898 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e63e7d26-1a83-409c-8194-997f1d83ebf6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1394 microversion: 2.1 time: 0.582341 Oct 02 01:03:36.891045 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 391/754] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:36 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1394 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:36.891045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:36.891045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:36.891418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.891970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.892579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.893610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.894230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.894839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.932509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.933136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.933576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.934304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lazy-loading 'fault' on Instance uuid 188f4b83-8e80-45f4-9be3-513a2f021e12 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:37.242152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f9d85d7-cf14-4b25-a447-a345295227fc tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1597 microversion: 2.1 time: 0.364164 Oct 02 01:03:37.259009 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 392/755] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:36 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1597 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:37.264741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.265369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.272232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.272728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.273170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.273882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.274343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.276966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Updating instance_info_cache with network_info: [{"id": "82b77f64-8e73-4f66-9f30-32b40e50f529", "address": "fa:16:3e:5e:c9:a4", "network": {"id": "f45f022a-328d-48ee-8bd2-7d2edf137424", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1380637593-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b94d90c894bf4eac916e2ff32975efcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap82b77f64-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:03:37.285411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.293405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Releasing lock "refresh_cache-4f9a72a6-4011-4b04-b574-f7d1405479e1" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:03:37.294667 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39cc791d-55eb-4cca-b9a0-f88179ec25b0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1/action" status: 202 len: 0 microversion: 2.1 time: 4.344821 Oct 02 01:03:37.295278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 364/756] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:32 2022] POST /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1/action => generated 0 bytes in 4346 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:03:37.300811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2bf3cbf1-06a4-43cf-85a5-a929c4408659 req-189311ee-6994-46fe-baa6-fc349b1ca645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471c5f8c-5276-47e4-a319-754d03b65941", "tag": "49cd68b5-8534-47fa-9f97-121682028281"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:37.313233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2bf3cbf1-06a4-43cf-85a5-a929c4408659 req-189311ee-6994-46fe-baa6-fc349b1ca645 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.313804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2bf3cbf1-06a4-43cf-85a5-a929c4408659 req-189311ee-6994-46fe-baa6-fc349b1ca645 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.314321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2bf3cbf1-06a4-43cf-85a5-a929c4408659 req-189311ee-6994-46fe-baa6-fc349b1ca645 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.327104 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2bf3cbf1-06a4-43cf-85a5-a929c4408659 req-189311ee-6994-46fe-baa6-fc349b1ca645 service nova] Creating event network-changed:49cd68b5-8534-47fa-9f97-121682028281 for instance 471c5f8c-5276-47e4-a319-754d03b65941 on n-h1-master-1 Oct 02 01:03:37.332002 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2bf3cbf1-06a4-43cf-85a5-a929c4408659 req-189311ee-6994-46fe-baa6-fc349b1ca645 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035303 Oct 02 01:03:37.332828 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 365/757] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:37.341047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.341749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.348001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.348547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.348974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.349699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.350153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.350654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.559832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.569219 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-906018dc-b0e8-4394-82cf-82066e257483 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.308985 Oct 02 01:03:37.570209 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 393/758] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:37.574449 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ce43a325-2e07-4885-bb29-249ed0c65850 req-db9258b9-5ed6-4b19-a88e-8bd4ac30519a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9a72a6-4011-4b04-b574-f7d1405479e1", "tag": "82b77f64-8e73-4f66-9f30-32b40e50f529"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:37.584416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce43a325-2e07-4885-bb29-249ed0c65850 req-db9258b9-5ed6-4b19-a88e-8bd4ac30519a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.584820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce43a325-2e07-4885-bb29-249ed0c65850 req-db9258b9-5ed6-4b19-a88e-8bd4ac30519a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.585254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce43a325-2e07-4885-bb29-249ed0c65850 req-db9258b9-5ed6-4b19-a88e-8bd4ac30519a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.596597 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ce43a325-2e07-4885-bb29-249ed0c65850 req-db9258b9-5ed6-4b19-a88e-8bd4ac30519a service nova] Creating event network-changed:82b77f64-8e73-4f66-9f30-32b40e50f529 for instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 on n-h1-master-1 Oct 02 01:03:37.599457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.602142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ce43a325-2e07-4885-bb29-249ed0c65850 req-db9258b9-5ed6-4b19-a88e-8bd4ac30519a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031102 Oct 02 01:03:37.602923 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 394/759] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:37.607981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.608580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ce66a6d-4f54-437a-a139-9efa07fafce4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.271876 Oct 02 01:03:37.608730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.609470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 366/760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:37.615158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:37.615462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.615956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.616397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.617099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.617555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.617981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.618082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.624058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.624815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.625328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.626326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.626816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.627309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.653886 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:37.705053 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd64e130-5b28-48db-81cc-03d07c20821f tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action" status: 202 len: 0 microversion: 2.1 time: 0.094227 Oct 02 01:03:37.708643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 367/761] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:37 2022] POST /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:37.712082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.712588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.718443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.719011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.719454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.720149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.720616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.721042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.753503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:37.862446 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97db49ee-c12e-4769-8f9f-65ee04c5e544 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 204 len: 0 microversion: 2.1 time: 0.155160 Oct 02 01:03:37.867008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 368/762] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:37 2022] DELETE /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:37.876145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.877295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.883676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.884138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.884579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.885401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.885710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.886556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.928720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.937289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.938750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.939874 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b09836b7-5a81-474b-b19e-13fd4e90d16a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1362 microversion: 2.25 time: 0.336021 Oct 02 01:03:37.940448 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 395/763] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:37.945345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.224"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:37.947962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.950862 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:37.954358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.955044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.955479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.956168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.956814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.958015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.985928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:03:37.986330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquired lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:03:38.268173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c5d8a01-8f19-4a71-832f-bacb42978215 tempest-ServersAdminTestJSON-1894681939 tempest-ServersAdminTestJSON-1894681939-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1614 microversion: 2.1 time: 0.399867 Oct 02 01:03:38.268749 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 369/764] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1614 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:38.273878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:38.274478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:38.280352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.280942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.281240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.281922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.282369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.282823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.640396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:38.648639 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0c79a7c-12c1-46da-beb1-4cdc6d1d8e84 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1394 microversion: 2.1 time: 0.378751 Oct 02 01:03:38.649211 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 370/765] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:38 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1394 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:38.653654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:38.654285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:38.660005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.660493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.660932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.662634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.662634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.662634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.688202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:38.773335 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-622e3377-35e9-437b-a791-9d727584a372 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "DELETE /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 204 len: 0 microversion: 2.1 time: 0.122813 Oct 02 01:03:38.773927 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 371/766] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:38 2022] DELETE /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:38.779105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:38.779800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:38.781605 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:38.787027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.787561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.787994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.788700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.789161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.789590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.843707 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=22 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:39.004300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:39.014232 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd6e12f9-2ccc-44e2-a8a7-b9e5ebbacd30 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1503 microversion: 2.1 time: 0.239040 Oct 02 01:03:39.015051 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 372/767] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:38 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:39.036911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:39.037531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:39.044527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:39.045018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:39.045452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:39.046434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:39.046991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:39.047420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:39.275257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:39.283569 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af6ecd09-6724-415b-a238-91a11dace5e6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.250924 Oct 02 01:03:39.284413 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 373/768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:39 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:39.289571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:39.290189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:39.297269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:39.297767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:39.298222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:39.298937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:39.299398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:39.299832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:39.982371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:39.992691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7a4e39c-cf73-42d0-a21c-ac7fbe6b1080 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1468 microversion: 2.1 time: 0.707251 Oct 02 01:03:39.993345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 374/769] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:39 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1468 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:39.997992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:39.998628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.004939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.005431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.005865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.006816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.007437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.008018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.272800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Building network info cache for instance {{(pid=122355) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:03:40.303727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.317790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.319287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.320427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c85ec86a-88c1-4e82-a2eb-a5bf52ce39dc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1362 microversion: 2.25 time: 0.325989 Oct 02 01:03:40.335243 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 375/770] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:39 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:40.343711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-12cdbba0-62eb-4a66-ac0e-d6321b0d733e req-1f2ccf32-6d8b-431f-9077-7aa9b02ecd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfd9835-627c-451d-b86e-1115b727db28", "name": "network-vif-plugged", "status": "completed", "tag": "72f94aae-1dc8-4f1a-84c8-2e35e6b5d419"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:40.354460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-12cdbba0-62eb-4a66-ac0e-d6321b0d733e req-1f2ccf32-6d8b-431f-9077-7aa9b02ecd9b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.354982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-12cdbba0-62eb-4a66-ac0e-d6321b0d733e req-1f2ccf32-6d8b-431f-9077-7aa9b02ecd9b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.356014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-12cdbba0-62eb-4a66-ac0e-d6321b0d733e req-1f2ccf32-6d8b-431f-9077-7aa9b02ecd9b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.367349 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-12cdbba0-62eb-4a66-ac0e-d6321b0d733e req-1f2ccf32-6d8b-431f-9077-7aa9b02ecd9b service nova] Creating event network-vif-plugged:72f94aae-1dc8-4f1a-84c8-2e35e6b5d419 for instance 0dfd9835-627c-451d-b86e-1115b727db28 on n-h1-master-1 Oct 02 01:03:40.372470 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-12cdbba0-62eb-4a66-ac0e-d6321b0d733e req-1f2ccf32-6d8b-431f-9077-7aa9b02ecd9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035804 Oct 02 01:03:40.373265 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 376/771] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:40.378497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:40.379260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.385934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.386709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.387293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.388157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.388775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.389348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.781346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.791670 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c149a7d4-098a-48ef-9432-edd3b28d2988 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1394 microversion: 2.1 time: 0.417161 Oct 02 01:03:40.792279 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 377/772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:40 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1394 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:40.814686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cbd91322-d27f-4942-af75-76e9a743717f req-c1383c4e-e1c7-4e5e-85b0-761e1bccd5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3", "tag": "34aae495-9601-4a7f-99a5-d4398c461a60"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:40.828577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cbd91322-d27f-4942-af75-76e9a743717f req-c1383c4e-e1c7-4e5e-85b0-761e1bccd5cd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.829347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cbd91322-d27f-4942-af75-76e9a743717f req-c1383c4e-e1c7-4e5e-85b0-761e1bccd5cd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.829927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cbd91322-d27f-4942-af75-76e9a743717f req-c1383c4e-e1c7-4e5e-85b0-761e1bccd5cd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.844619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cbd91322-d27f-4942-af75-76e9a743717f req-c1383c4e-e1c7-4e5e-85b0-761e1bccd5cd service nova] Creating event network-changed:34aae495-9601-4a7f-99a5-d4398c461a60 for instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 on n-h2-master-1 Oct 02 01:03:40.859454 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cbd91322-d27f-4942-af75-76e9a743717f req-c1383c4e-e1c7-4e5e-85b0-761e1bccd5cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061692 Oct 02 01:03:40.860954 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 378/773] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:40.868735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:40.869705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.876521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.877026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.877625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.878149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.878625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.879071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.145127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:41.159906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad8e7a6a-3234-4289-b5a3-506f9f526581 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1478 microversion: 2.1 time: 0.297155 Oct 02 01:03:41.160834 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 379/774] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:40 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1478 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:41.165773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.166633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:41.173227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.173880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.174491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.175358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.175968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.177151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.505034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:41.509292 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:41.515722 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84abc187-3917-44c2-b626-a8e8ccb2ab8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.353045 Oct 02 01:03:41.518673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Updating instance_info_cache with network_info: [{"id": "f238cf4a-a01b-4be0-80a6-0b3552b30d79", "address": "fa:16:3e:56:75:48", "network": {"id": "f45f022a-328d-48ee-8bd2-7d2edf137424", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1380637593-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b94d90c894bf4eac916e2ff32975efcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf238cf4a-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:03:41.525267 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 380/775] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:41.534898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Releasing lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:03:41.535083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f7235a80-5d77-458a-be5c-dcfd210c054f req-624fdd42-eb3b-4e10-8f83-1d2c83d8a85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9a72a6-4011-4b04-b574-f7d1405479e1", "name": "network-vif-deleted", "tag": "82b77f64-8e73-4f66-9f30-32b40e50f529"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:41.538310 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65863628-7776-4df0-b6ca-211b1b48905f tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action" status: 202 len: 0 microversion: 2.1 time: 3.595511 Oct 02 01:03:41.539649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 396/776] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:37 2022] POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action => generated 0 bytes in 3598 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:03:41.550287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7235a80-5d77-458a-be5c-dcfd210c054f req-624fdd42-eb3b-4e10-8f83-1d2c83d8a85c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.551753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7235a80-5d77-458a-be5c-dcfd210c054f req-624fdd42-eb3b-4e10-8f83-1d2c83d8a85c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.552307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7235a80-5d77-458a-be5c-dcfd210c054f req-624fdd42-eb3b-4e10-8f83-1d2c83d8a85c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.553830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.555080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:41.569167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.570005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.570862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.571757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.572372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.573115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.576212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f7235a80-5d77-458a-be5c-dcfd210c054f req-624fdd42-eb3b-4e10-8f83-1d2c83d8a85c service nova] Creating event network-vif-deleted:82b77f64-8e73-4f66-9f30-32b40e50f529 for instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 on n-h1-master-1 Oct 02 01:03:41.582013 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f7235a80-5d77-458a-be5c-dcfd210c054f req-624fdd42-eb3b-4e10-8f83-1d2c83d8a85c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055295 Oct 02 01:03:41.583557 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 381/777] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:41.588769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b14d4f5-2053-47ae-aa95-cc360559c1ae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '.version_select at 0x7fb8816789d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.592822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b14d4f5-2053-47ae-aa95-cc360559c1ae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.593683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b14d4f5-2053-47ae-aa95-cc360559c1ae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.594731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b14d4f5-2053-47ae-aa95-cc360559c1ae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.606494 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b14d4f5-2053-47ae-aa95-cc360559c1ae tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.021373 Oct 02 01:03:41.607601 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 382/778] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:41.612389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.614208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:41.621197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.622023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.622712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.623872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.624446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.625236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.201678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.213360 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c7ff7e26-1a47-4fdd-be9c-ec6314fbe160 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1468 microversion: 2.1 time: 0.671942 Oct 02 01:03:42.217686 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 397/779] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1468 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:42.225740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2617a1d0-adeb-4f15-abfa-5da596385b0c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '.version_select at 0x7fb881c00d30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:42.303012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.316078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.320241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.329149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2611907e-8249-4520-8147-4392115670ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1362 microversion: 2.25 time: 0.720317 Oct 02 01:03:42.330260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 383/780] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:42.339565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:42.340834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:42.352458 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:42.372078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.372710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.373304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.374755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.375901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.376894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.172658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-74611ca5-7eaa-4765-99f1-65a27499894e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1629 microversion: 2.1 time: 0.840540 Oct 02 01:03:43.175635 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 384/781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:42 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1629 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.198830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.201408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.212159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.217175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.217175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.217891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.218447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.219596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.307669 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2617a1d0-adeb-4f15-abfa-5da596385b0c tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/7ac99609-8251-4530-ad9a-bee03d89e2a4" status: 200 len: 184 microversion: 2.1 time: 1.085765 Oct 02 01:03:43.308651 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 398/782] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:03:42 2022] GET /compute/v2.1/os-floating-ips/7ac99609-8251-4530-ad9a-bee03d89e2a4 => generated 184 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:43.315348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.318041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.329856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.330486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.331194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.332194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.332871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.333518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.568435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:43.576309 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8b8bbd9-77a1-4276-a21a-def88eaa0cd6 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1575 microversion: 2.1 time: 0.399557 Oct 02 01:03:43.576983 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 385/783] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1575 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.581363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-49792b65-6697-4aa5-bb36-eefe7d2736aa req-9ece963d-e0bc-4c8c-9251-67a1a3daa64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:43.591457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-49792b65-6697-4aa5-bb36-eefe7d2736aa req-9ece963d-e0bc-4c8c-9251-67a1a3daa64a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.592206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-49792b65-6697-4aa5-bb36-eefe7d2736aa req-9ece963d-e0bc-4c8c-9251-67a1a3daa64a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.592694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-49792b65-6697-4aa5-bb36-eefe7d2736aa req-9ece963d-e0bc-4c8c-9251-67a1a3daa64a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.606899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-49792b65-6697-4aa5-bb36-eefe7d2736aa req-9ece963d-e0bc-4c8c-9251-67a1a3daa64a service nova] Creating event network-changed:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:03:43.612352 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-49792b65-6697-4aa5-bb36-eefe7d2736aa req-9ece963d-e0bc-4c8c-9251-67a1a3daa64a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034175 Oct 02 01:03:43.613090 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 386/784] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:43.616206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:43.619057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-852ab68b-d760-4e60-9f92-af2b7e05fbf0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Action: 'create', calling method: .version_select at 0x7fb88190c160>, body: {"keypair": {"name": "tempest-keypair-1428944896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwQCAGGm4GPGUeKObtEUfMTEcS8D83m6Nxv0sBnRyGVi+h3ob1HVvSnu47Jq/r39OokrByeHvzdUheMgRkkyK60eruMrR6HqvXcyZa4K3TJogaagPevo95b01lJfX5QPQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:43.624088 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0528651-3426-4950-9ab4-dc28978a90f1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.313912 Oct 02 01:03:43.624844 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 399/785] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.630209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.631061 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.635924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-852ab68b-d760-4e60-9f92-af2b7e05fbf0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:43.637372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.638032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.638662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.639525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.640138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.640751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.642420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-852ab68b-d760-4e60-9f92-af2b7e05fbf0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for user 6da1976f703f402788953f3332a281de and project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:43.668241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-852ab68b-d760-4e60-9f92-af2b7e05fbf0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052934 Oct 02 01:03:43.668992 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 387/786] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:03:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:43.673919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.674614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.674976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.224"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:43.675405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.676323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lazy-loading 'fault' on Instance uuid 539e1389-8245-4e0d-982c-5babbe7e5640 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:43.758950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:43.767373 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0c826e6d-d036-4336-a47f-03390d9255a0 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 200 len: 1303 microversion: 2.1 time: 0.141382 Oct 02 01:03:43.768494 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 400/787] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.774451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.775343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.782440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.783380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.784153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.785123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.785888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.786774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.962577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.970318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.970826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.971261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.971965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.972415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.972873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.205865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:44.217024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:44.218668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:44.219922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d60b7c0-9b91-4afb-a5ee-ca0d35231e63 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1362 microversion: 2.25 time: 0.450270 Oct 02 01:03:44.220496 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 401/788] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1362 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:44.226012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-cb5d6161-1c02-4026-a127-03443c64a429 req-58873c2e-6893-481f-8f95-0debb56da043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c5f8c-5276-47e4-a319-754d03b65941", "name": "network-vif-plugged", "status": "completed", "tag": "49cd68b5-8534-47fa-9f97-121682028281"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:44.237040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cb5d6161-1c02-4026-a127-03443c64a429 req-58873c2e-6893-481f-8f95-0debb56da043 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.237742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cb5d6161-1c02-4026-a127-03443c64a429 req-58873c2e-6893-481f-8f95-0debb56da043 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.238171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cb5d6161-1c02-4026-a127-03443c64a429 req-58873c2e-6893-481f-8f95-0debb56da043 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.243310 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:44.255392 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-cb5d6161-1c02-4026-a127-03443c64a429 req-58873c2e-6893-481f-8f95-0debb56da043 service nova] Creating event network-vif-plugged:49cd68b5-8534-47fa-9f97-121682028281 for instance 471c5f8c-5276-47e4-a319-754d03b65941 on n-h1-master-1 Oct 02 01:03:44.263431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-cb5d6161-1c02-4026-a127-03443c64a429 req-58873c2e-6893-481f-8f95-0debb56da043 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041230 Oct 02 01:03:44.264060 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 402/789] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:44.270917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:44.271710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:44.280403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.281083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.281516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.282223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.282708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.283130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.531629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:03:44.532575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquired lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:03:44.565738 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f8d6028-be22-44ca-877c-878c8a114d56 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299998 Oct 02 01:03:44.568774 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 403/790] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:03:44 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:44.577400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1c504530-ca1f-43b7-a73d-897112dd11c3 req-83bdfa4e-38e1-400d-a0b2-6011263c3436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539e1389-8245-4e0d-982c-5babbe7e5640", "name": "network-vif-deleted", "tag": "853b586f-ceaa-4e4a-8bff-a2f941b444aa"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:44.597783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c504530-ca1f-43b7-a73d-897112dd11c3 req-83bdfa4e-38e1-400d-a0b2-6011263c3436 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.599531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c504530-ca1f-43b7-a73d-897112dd11c3 req-83bdfa4e-38e1-400d-a0b2-6011263c3436 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.600358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c504530-ca1f-43b7-a73d-897112dd11c3 req-83bdfa4e-38e1-400d-a0b2-6011263c3436 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.628217 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1c504530-ca1f-43b7-a73d-897112dd11c3 req-83bdfa4e-38e1-400d-a0b2-6011263c3436 service nova] Creating event network-vif-deleted:853b586f-ceaa-4e4a-8bff-a2f941b444aa for instance 539e1389-8245-4e0d-982c-5babbe7e5640 on n-h2-master-1 Oct 02 01:03:44.636558 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1c504530-ca1f-43b7-a73d-897112dd11c3 req-83bdfa4e-38e1-400d-a0b2-6011263c3436 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064606 Oct 02 01:03:44.637912 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 404/791] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:44.653987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:44.655417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:44.666653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.667280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.667968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.668928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.669620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.670399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:45.234951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:45.251149 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c6bba914-e9f5-4ab0-9593-4dc91bb3c1fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.603539 Oct 02 01:03:45.251745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 405/792] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:44 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:45.256568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:45.257182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 539e1389-8245-4e0d-982c-5babbe7e5640] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:45.263244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:45.263913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:45.264355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:45.265234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:45.265704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:45.266136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:45.280732 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] HTTP exception thrown: Instance 539e1389-8245-4e0d-982c-5babbe7e5640 could not be found. Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Request method failure captured: Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 HTTP/1.1 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLOaPiYbb15_19mLAAASKsqqWKd06QQIuQ-um2X7uOXL5PltxXn4u5T7mMloVCGem00pgpIWLTi3CYIHsFKpZDP7V87vqICRRWrKcqzu5kKwVuweUDTe0kbK1aYHLdcZsCJbERbynawIEfVDo_LPHDJVre1xIbGEhp-vH6YSJ_hu04 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 683c16b60ba34123bf0175396dffaf83 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:03:45.282423 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_683c16b60ba34123bf0175396dffaf83"}]}] Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 683c16b60ba34123bf0175396dffaf83 Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersAdminTestJSON-339067741-project Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c42d04f7289e49ef950eeaf764c91216 Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersAdminTestJSON-339067741-project Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 539e1389-8245-4e0d-982c-5babbe7e5640 could not be found. Oct 02 01:03:45.283967 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '539e1389-8245-4e0d-982c-5babbe7e5640'} Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539e1389-8245-4e0d-982c-5babbe7e5640 could not be found. Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:45.284947 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539e1389-8245-4e0d-982c-5babbe7e5640 could not be found. Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539e1389-8245-4e0d-982c-5babbe7e5640 could not be found. Oct 02 01:03:45.288218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:45.289831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Returning 404 to user: Instance 539e1389-8245-4e0d-982c-5babbe7e5640 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:45.289831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66eb8b17-3423-4f2f-85bb-458c178a9693 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640" status: 404 len: 111 microversion: 2.1 time: 0.031011 Oct 02 01:03:45.289831 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 406/793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:45 2022] GET /compute/v2.1/servers/539e1389-8245-4e0d-982c-5babbe7e5640 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:45.289831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1131442702", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "50e67603-d71e-41c6-898e-f46b864cbf22"}], "security_groups": [{"name": "tempest-securitygroup--892217979"}], "key_name": "tempest-keypair-1428944896", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:45.852840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] validate_networks() for [('50e67603-d71e-41c6-898e-f46b864cbf22', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:46.826025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Building network info cache for instance {{(pid=122354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:03:46.898542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:46.899751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:46.901641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:46.902158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:46.902702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:46.914537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.915160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.915806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.916772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.917239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.917833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.935998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:46.941261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for user 6da1976f703f402788953f3332a281de and project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:46.958376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:46.960768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:47.019207 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24f93bad-3ce9-4fdc-b3ce-bdc7eef3f24f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.733630 Oct 02 01:03:47.026287 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 407/794] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:03:47.031310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:47.031925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:47.039261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.039753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.040191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.040900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.041342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.041764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.687224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:47.695720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:47.697293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:47.698709 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc85de7d-0d3c-41dc-aed0-1f64c00145a8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1557 microversion: 2.25 time: 0.671278 Oct 02 01:03:47.711377 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 408/795] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:47 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1557 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:47.726655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:47.727354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:47.733528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.734223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.734851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.740096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.740993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.741630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.794522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:47.941635 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22307581-830f-4a28-8788-2120cb27834a tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 204 len: 0 microversion: 2.1 time: 0.228631 Oct 02 01:03:47.942679 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 409/796] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:47 2022] DELETE /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:47.952142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:47.952889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:47.976925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.977430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.977868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.978582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.979118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.979550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.095177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Updating instance_info_cache with network_info: [{"id": "f238cf4a-a01b-4be0-80a6-0b3552b30d79", "address": "fa:16:3e:56:75:48", "network": {"id": "f45f022a-328d-48ee-8bd2-7d2edf137424", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1380637593-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b94d90c894bf4eac916e2ff32975efcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf238cf4a-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:03:48.118342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Releasing lock "refresh_cache-1d186a0b-6561-4806-bc2d-02d041abe214" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:03:48.119585 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac375064-827f-417c-a95e-78e36ad34ad8 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action" status: 202 len: 0 microversion: 2.1 time: 4.449311 Oct 02 01:03:48.120403 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 388/797] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:43 2022] POST /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214/action => generated 0 bytes in 4451 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:03:48.128432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-533bdf6c-b41d-413c-8478-406734df9b24 req-fe9059f2-7a16-48ec-be02-5e84353acb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3", "name": "network-vif-plugged", "status": "completed", "tag": "34aae495-9601-4a7f-99a5-d4398c461a60"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:48.142581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-533bdf6c-b41d-413c-8478-406734df9b24 req-fe9059f2-7a16-48ec-be02-5e84353acb0e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.143076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-533bdf6c-b41d-413c-8478-406734df9b24 req-fe9059f2-7a16-48ec-be02-5e84353acb0e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.143502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-533bdf6c-b41d-413c-8478-406734df9b24 req-fe9059f2-7a16-48ec-be02-5e84353acb0e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.155306 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-533bdf6c-b41d-413c-8478-406734df9b24 req-fe9059f2-7a16-48ec-be02-5e84353acb0e service nova] Creating event network-vif-plugged:34aae495-9601-4a7f-99a5-d4398c461a60 for instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 on n-h2-master-1 Oct 02 01:03:48.161145 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-533bdf6c-b41d-413c-8478-406734df9b24 req-fe9059f2-7a16-48ec-be02-5e84353acb0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039040 Oct 02 01:03:48.162368 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 389/798] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:48.167678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0d0bf2df-97f7-4e51-912a-fff3c73e4103 req-d2679f37-8e10-46e2-bba7-692176107af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:48.172263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:48.179579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0d0bf2df-97f7-4e51-912a-fff3c73e4103 req-d2679f37-8e10-46e2-bba7-692176107af9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.180058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0d0bf2df-97f7-4e51-912a-fff3c73e4103 req-d2679f37-8e10-46e2-bba7-692176107af9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.180482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0d0bf2df-97f7-4e51-912a-fff3c73e4103 req-d2679f37-8e10-46e2-bba7-692176107af9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.185648 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-afe8b56b-b72b-4c5e-a5ac-366e75e9a48c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.241560 Oct 02 01:03:48.186220 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 410/799] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:47 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:48.190897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.192131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.198174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.199084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.199838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.201185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.202040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.202727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.224767 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0d0bf2df-97f7-4e51-912a-fff3c73e4103 req-d2679f37-8e10-46e2-bba7-692176107af9 service nova] Creating event network-changed:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:03:48.239135 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0d0bf2df-97f7-4e51-912a-fff3c73e4103 req-d2679f37-8e10-46e2-bba7-692176107af9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075005 Oct 02 01:03:48.239892 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 390/800] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:48.292606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:48.301599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.302307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.303873 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-290b8814-151b-421b-a857-d452321a2f5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1287 microversion: 2.1 time: 0.116427 Oct 02 01:03:48.305509 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 411/801] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:48.312546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.314007 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.324391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.324591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.324888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.325541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.325682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.326178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.326793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.327400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.327697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.328162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.328675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.329208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.528940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:48.533049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 471c5f8c-5276-47e4-a319-754d03b65941 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:48.537620 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e8a71443-d956-463d-abfb-920d4f0c45b5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1575 microversion: 2.1 time: 0.230901 Oct 02 01:03:48.551358 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 412/802] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:48.551358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.551358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.551358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.551358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.551894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.551894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.552583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.555526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.592884 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6a9d1b3-5d6f-4e33-ae5c-bfe93245cdff tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 2050 microversion: 2.25 time: 0.348423 Oct 02 01:03:48.594278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 391/803] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 2050 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:48.599535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.600248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.606790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.607500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.608103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.608972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.609584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.610173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.626003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] HTTP exception thrown: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Request method failure captured: Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 HTTP/1.1 Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOMYSij7ZNZd_P7is3Pu_yq2XcHqY1yORXg9vkDA_o-A6seZoRiqprjOCR4_vSmgaPK2VFOgyt-W6YCvS5FQE76H06_4256ApycgoFx0ltT1z8t2wJAPzLIZ5awMurnSSOsRgTgjZXDNp_NzJ6ouCQRPblbS7HmNlsoL__Oz0TlxFUk Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:03:48.627715 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b94d90c894bf4eac916e2ff32975efcd"}]}] Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 25fbb294f2064ce386c25ce5e371a1dc Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.629865 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '4f9a72a6-4011-4b04-b574-f7d1405479e1'} Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:48.631985 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.633529 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.635012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Returning 404 to user: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:48.635012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf860663-0d09-4059-aeea-f6421374dd41 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 404 len: 111 microversion: 2.1 time: 0.033723 Oct 02 01:03:48.635012 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 392/804] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:48 2022] DELETE /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:48.638835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.639457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.658201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.658752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.659153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.659947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.660443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.660907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.830874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:48.845192 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7724d54a-b114-48e4-a759-c898ab3d1010 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1469 microversion: 2.1 time: 0.305825 Oct 02 01:03:48.846794 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 413/805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1469 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:48.854192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.855140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 4f9a72a6-4011-4b04-b574-f7d1405479e1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.862191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.863043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.864378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.865317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.866012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.866674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.882897 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] HTTP exception thrown: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Request method failure captured: Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 HTTP/1.1 Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOMYSij7ZNZd_P7is3Pu_yq2XcHqY1yORXg9vkDA_o-A6seZoRiqprjOCR4_vSmgaPK2VFOgyt-W6YCvS5FQE76H06_4256ApycgoFx0ltT1z8t2wJAPzLIZ5awMurnSSOsRgTgjZXDNp_NzJ6ouCQRPblbS7HmNlsoL__Oz0TlxFUk Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:03:48.884979 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b94d90c894bf4eac916e2ff32975efcd"}]}] Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 25fbb294f2064ce386c25ce5e371a1dc Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.886277 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '4f9a72a6-4011-4b04-b574-f7d1405479e1'} Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:48.887414 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. Oct 02 01:03:48.888556 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:48.891000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Returning 404 to user: Instance 4f9a72a6-4011-4b04-b574-f7d1405479e1 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:48.892892 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40ce2b48-9d80-4e83-a46b-b1f722fd9cd6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1" status: 404 len: 111 microversion: 2.1 time: 0.043249 Oct 02 01:03:48.893686 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 414/806] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/4f9a72a6-4011-4b04-b574-f7d1405479e1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:48.900936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 471c5f8c-5276-47e4-a319-754d03b65941 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:48.903893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f838579d-0649-4d13-88f1-1bd077280c4b tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '.version_select at 0x7fb8816ce430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.918826 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18eb71a3-6367-4ae8-8c4b-c7d410bfe0ed tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 2050 microversion: 2.25 time: 0.283447 Oct 02 01:03:48.919736 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 393/807] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 2050 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:48.944013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.947990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.948472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.949109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.949842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.950298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.950760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.979034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae9731d1-de66-4f1b-b16c-2fa75206c67b tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038886 Oct 02 01:03:48.982680 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 394/808] 10.222.0.23 () {60 vars in 1217 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:03:48.992953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:48.995501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:49.001458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:49.001945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:49.002382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:49.003169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:49.003627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:49.004081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:49.029176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'flavor' on Instance uuid 471c5f8c-5276-47e4-a319-754d03b65941 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:49.042316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Going to try to live migrate instance to n-h2-master-1 {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:03:49.796434 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f838579d-0649-4d13-88f1-1bd077280c4b tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/7ac99609-8251-4530-ad9a-bee03d89e2a4" status: 202 len: 0 microversion: 2.1 time: 0.897958 Oct 02 01:03:49.802224 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 415/809] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:03:48 2022] DELETE /compute/v2.1/os-floating-ips/7ac99609-8251-4530-ad9a-bee03d89e2a4 => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:03:49.810870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:49.811964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:49.819758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:49.820675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:49.822360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:49.823475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:49.824284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:49.824953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.063326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:50.087894 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-16212a70-31a6-4ce0-9a37-830e5921a76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1312 microversion: 2.1 time: 0.281029 Oct 02 01:03:50.089701 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 416/810] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:49 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:50.099384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:50.101569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:50.115232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.116233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.117960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.119847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.120415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.120920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.208030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:50.230639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6f26a249-efe1-4f42-8bea-5ea8a431099f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1293 microversion: 2.1 time: 0.132299 Oct 02 01:03:50.234540 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 417/811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:50 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:50.239883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:50.240761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:50.247853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.248798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.249444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.250392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.251195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.252108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.288863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:50.438124 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-48556ccb-efc8-4b65-b29c-8a93d91b4d38 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 204 len: 0 microversion: 2.1 time: 0.201867 Oct 02 01:03:50.439280 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 418/812] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:50 2022] DELETE /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:50.450262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:50.451021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:50.459812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.460494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.461150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.462555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.463459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.464188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.593472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:50.605735 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e641b902-b0c9-46b1-996c-58e4b6e72251 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 200 len: 1427 microversion: 2.1 time: 0.164965 Oct 02 01:03:50.621317 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 419/813] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:50 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:50.632527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9b867b4d-59c6-4cee-87a0-7ae824462a3d req-08f36146-25ef-4eab-98e0-9b12211d763d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfd9835-627c-451d-b86e-1115b727db28", "tag": "72f94aae-1dc8-4f1a-84c8-2e35e6b5d419"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:50.656277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9b867b4d-59c6-4cee-87a0-7ae824462a3d req-08f36146-25ef-4eab-98e0-9b12211d763d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.656528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9b867b4d-59c6-4cee-87a0-7ae824462a3d req-08f36146-25ef-4eab-98e0-9b12211d763d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.656976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9b867b4d-59c6-4cee-87a0-7ae824462a3d req-08f36146-25ef-4eab-98e0-9b12211d763d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.675016 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:50.700444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9b867b4d-59c6-4cee-87a0-7ae824462a3d req-08f36146-25ef-4eab-98e0-9b12211d763d service nova] Creating event network-changed:72f94aae-1dc8-4f1a-84c8-2e35e6b5d419 for instance 0dfd9835-627c-451d-b86e-1115b727db28 on n-h1-master-1 Oct 02 01:03:50.711734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9b867b4d-59c6-4cee-87a0-7ae824462a3d req-08f36146-25ef-4eab-98e0-9b12211d763d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088917 Oct 02 01:03:50.713245 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 420/814] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:50.719682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:50.720452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:50.728250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.728847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.729339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.730437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.730905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.731434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.073266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.083575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3dd1ada4-3a59-4306-b9db-d734064b97f0 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1526 microversion: 2.1 time: 0.368598 Oct 02 01:03:51.094913 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 421/815] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:50 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1526 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:51.114685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:51.115300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.121899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.122387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.122849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.123550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.124009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.124431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.349960 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-151d93ad-4fa1-4411-aa9a-9e9ee7fcbfe3 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941/action" status: 202 len: 0 microversion: 2.25 time: 2.360937 Oct 02 01:03:51.351462 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 395/816] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:03:48 2022] POST /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941/action => generated 0 bytes in 2363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:51.357436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:51.358368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.361097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.367828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.368318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.368756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.369468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.369925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.370353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.370784 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b04c17a1-fbd4-4119-9396-ceec547bc613 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1462 microversion: 2.1 time: 0.259664 Oct 02 01:03:51.389775 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 422/817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:51 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1462 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:51.396149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:51.396987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.403506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.404231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.404850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.405720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.406333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.406967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.664513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.672405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c355663a-aed5-4563-9c94-6234b3e2318e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.319718 Oct 02 01:03:51.672981 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 396/818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:51 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:51.693590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:51.695895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.696994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.702970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.703640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.704229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.705105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.705524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.705742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.706136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.707046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.708589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-497612f5-d99c-448d-9700-71384f378f70 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.317280 Oct 02 01:03:51.720895 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 423/819] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:51 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:51.720895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:51.720895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 6aed604a-438c-4186-8e6e-45b720522f75] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.720895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.720895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.721391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.721724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.722192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.722808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.739579 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] HTTP exception thrown: Instance 6aed604a-438c-4186-8e6e-45b720522f75 could not be found. Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Request method failure captured: Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 HTTP/1.1 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLOaPiYbb15_19mLAAASKsqqWKd06QQIuQ-um2X7uOXL5PltxXn4u5T7mMloVCGem00pgpIWLTi3CYIHsFKpZDP7V87vqICRRWrKcqzu5kKwVuweUDTe0kbK1aYHLdcZsCJbERbynawIEfVDo_LPHDJVre1xIbGEhp-vH6YSJ_hu04 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 683c16b60ba34123bf0175396dffaf83 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:03:51.741650 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_683c16b60ba34123bf0175396dffaf83"}]}] Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 683c16b60ba34123bf0175396dffaf83 Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersAdminTestJSON-339067741-project Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c42d04f7289e49ef950eeaf764c91216 Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersAdminTestJSON-339067741-project Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 6aed604a-438c-4186-8e6e-45b720522f75 could not be found. Oct 02 01:03:51.743288 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '6aed604a-438c-4186-8e6e-45b720522f75'} Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aed604a-438c-4186-8e6e-45b720522f75 could not be found. Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:51.744223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aed604a-438c-4186-8e6e-45b720522f75 could not be found. Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aed604a-438c-4186-8e6e-45b720522f75 could not be found. Oct 02 01:03:51.746159 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:03:51.747497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Returning 404 to user: Instance 6aed604a-438c-4186-8e6e-45b720522f75 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:51.747497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0838c31-6c3e-4d19-9fd9-6fd77e444a76 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75" status: 404 len: 111 microversion: 2.1 time: 0.034563 Oct 02 01:03:51.747497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 424/820] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:51 2022] GET /compute/v2.1/servers/6aed604a-438c-4186-8e6e-45b720522f75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:51.753367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:51.754665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.762005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.762509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.762996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.763706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.764169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.764602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.799967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:51.831653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.840659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:03:51.852856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:51.853356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:51.853829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:51.854236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:51.854662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:51.898292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6452c194-f826-4f29-851a-db7f5e941c9f tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "DELETE /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 204 len: 0 microversion: 2.1 time: 0.148360 Oct 02 01:03:51.902318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 425/821] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:51 2022] DELETE /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:51.908278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:51.908997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:51.916032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.917336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.917787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.918502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.919165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.919756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.009753 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2bccf4a7-9e96-434a-9f61-d8303c2b41f5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3/action" status: 202 len: 0 microversion: 2.1 time: 0.320566 Oct 02 01:03:52.011078 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 397/822] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:03:51 2022] POST /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:52.019753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:52.020773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:52.028613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.029315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.029935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.030923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.031581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.032013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.063655 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:52.604819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:52.623045 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d2d0151-b7d3-40cf-9521-dc2046324558 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1469 microversion: 2.1 time: 0.719151 Oct 02 01:03:52.623649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 426/823] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:51 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1469 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:52.628112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:52.629420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:52.645362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.646049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.646493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.647233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.647699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.648126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.649726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:52.659519 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7246ca28-fdce-4050-9906-3cb51966ee8f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1471 microversion: 2.1 time: 0.644244 Oct 02 01:03:52.675985 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 398/824] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:52 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1471 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:52.675985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-76945f80-e438-49e5-8f29-a551e8336c72 req-b6e92889-dc7a-450f-9478-ed94c9e47b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb1a15c-d52b-476c-a4e3-50bbdbaef041", "tag": "08aace31-2f62-4fd1-ab2a-13fc3014b4c9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:52.685328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-76945f80-e438-49e5-8f29-a551e8336c72 req-b6e92889-dc7a-450f-9478-ed94c9e47b8a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.685884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-76945f80-e438-49e5-8f29-a551e8336c72 req-b6e92889-dc7a-450f-9478-ed94c9e47b8a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.686392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-76945f80-e438-49e5-8f29-a551e8336c72 req-b6e92889-dc7a-450f-9478-ed94c9e47b8a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.701618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-76945f80-e438-49e5-8f29-a551e8336c72 req-b6e92889-dc7a-450f-9478-ed94c9e47b8a service nova] Creating event network-changed:08aace31-2f62-4fd1-ab2a-13fc3014b4c9 for instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 on n-h2-master-1 Oct 02 01:03:52.706535 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-76945f80-e438-49e5-8f29-a551e8336c72 req-b6e92889-dc7a-450f-9478-ed94c9e47b8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037874 Oct 02 01:03:52.710973 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 399/825] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:52.715895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:52.716612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:52.723333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.723845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.724280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.724974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.725426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.725889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.832859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:52.843257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-628fa906-3d6d-4fc6-b373-42b69778407e tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1526 microversion: 2.1 time: 0.218572 Oct 02 01:03:52.844231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 427/826] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:52 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1526 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:52.849562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:52.850288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:52.856598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.857197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.857732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.861647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.862572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.862837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.895014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:52.902925 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01c51f7a-33ae-4eb7-a362-e9dad6428ef5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.190866 Oct 02 01:03:52.903502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 400/827] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:52 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:52.907952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-84f9db24-268e-4f55-af16-4450db0d8690 req-915602c4-fd47-45b5-9aa8-979b776eafc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aed604a-438c-4186-8e6e-45b720522f75", "name": "network-vif-deleted", "tag": "47d4705d-cc43-4595-8156-d2c4d5e30f47"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:52.918754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-84f9db24-268e-4f55-af16-4450db0d8690 req-915602c4-fd47-45b5-9aa8-979b776eafc7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.919447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-84f9db24-268e-4f55-af16-4450db0d8690 req-915602c4-fd47-45b5-9aa8-979b776eafc7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.920223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-84f9db24-268e-4f55-af16-4450db0d8690 req-915602c4-fd47-45b5-9aa8-979b776eafc7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.932126 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-84f9db24-268e-4f55-af16-4450db0d8690 req-915602c4-fd47-45b5-9aa8-979b776eafc7 service nova] Creating event network-vif-deleted:47d4705d-cc43-4595-8156-d2c4d5e30f47 for instance 6aed604a-438c-4186-8e6e-45b720522f75 on n-h1-master-1 Oct 02 01:03:52.937541 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-84f9db24-268e-4f55-af16-4450db0d8690 req-915602c4-fd47-45b5-9aa8-979b776eafc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032498 Oct 02 01:03:52.938146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 401/828] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:53.007526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:53.016439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:53.017897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:53.019106 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43a14c98-8226-4055-bbeb-10d23b55a9f3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.173821 Oct 02 01:03:53.019676 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 428/829] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:52 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:53.647103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:53.647881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:53.650431 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:53.656229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:53.656708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:53.657228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:53.657998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:53.659030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:53.659251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:53.684631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:53.685299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:53.694050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:53.694775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:53.695086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:53.695804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:53.696266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:53.696694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.070840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:54.078891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5c4046e-28de-4fe6-ad36-8ae6aeb65c98 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1469 microversion: 2.1 time: 0.436642 Oct 02 01:03:54.080113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 402/830] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:53 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1469 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:54.087172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:54.087881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:54.094276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.094997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.095695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.096471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.096995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.098433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.112605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:54.124232 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-25faacb4-985a-4e9a-a3da-73237eb6e026 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1471 microversion: 2.1 time: 0.444301 Oct 02 01:03:54.153830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 429/831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:53 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:54.161807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:54.162524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:54.166573 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:54.171138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.171740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.172246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.173024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.173550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.174212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.591676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:54.608583 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0c54ba9-8f7a-4dc5-9754-e48aa5aa5a96 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1526 microversion: 2.1 time: 0.526452 Oct 02 01:03:54.609997 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 403/832] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:54 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1526 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:54.618498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:54.619271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:54.626542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.627138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.627538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.628301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.629114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.629609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.693448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:54.708804 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb3a2e4d-9585-430b-a914-1ffa0c1feb96 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.553270 Oct 02 01:03:54.710118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 430/833] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:54 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:54.761941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4ff4f1fb-3daa-463a-bfc2-ed5c607f167f req-b833c47d-0b7e-43e2-9dd9-f303c0de46f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d186a0b-6561-4806-bc2d-02d041abe214", "name": "network-vif-deleted", "tag": "f238cf4a-a01b-4be0-80a6-0b3552b30d79"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:54.782312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4ff4f1fb-3daa-463a-bfc2-ed5c607f167f req-b833c47d-0b7e-43e2-9dd9-f303c0de46f6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.788019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4ff4f1fb-3daa-463a-bfc2-ed5c607f167f req-b833c47d-0b7e-43e2-9dd9-f303c0de46f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.790455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4ff4f1fb-3daa-463a-bfc2-ed5c607f167f req-b833c47d-0b7e-43e2-9dd9-f303c0de46f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.820081 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4ff4f1fb-3daa-463a-bfc2-ed5c607f167f req-b833c47d-0b7e-43e2-9dd9-f303c0de46f6 service nova] Creating event network-vif-deleted:f238cf4a-a01b-4be0-80a6-0b3552b30d79 for instance 1d186a0b-6561-4806-bc2d-02d041abe214 on n-h2-master-1 Oct 02 01:03:54.828533 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4ff4f1fb-3daa-463a-bfc2-ed5c607f167f req-b833c47d-0b7e-43e2-9dd9-f303c0de46f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076637 Oct 02 01:03:54.829430 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 431/834] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:55.003140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.012186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.014169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.015382 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58a9b306-4cf2-4793-9452-a160052e3f95 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.404161 Oct 02 01:03:55.015957 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 404/835] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:54 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:55.107389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:55.108344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:55.116779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.117278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.117716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.118429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.118909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.119334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.146588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3b257f7b-d2a3-4925-898a-db06dc55845d req-72caeb53-8e54-4536-a248-d33709286e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188f4b83-8e80-45f4-9be3-513a2f021e12", "name": "network-vif-deleted", "tag": "ecdd37ff-a07b-4d5f-aa4c-04d4c5654386"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:55.157036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b257f7b-d2a3-4925-898a-db06dc55845d req-72caeb53-8e54-4536-a248-d33709286e5c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.157797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b257f7b-d2a3-4925-898a-db06dc55845d req-72caeb53-8e54-4536-a248-d33709286e5c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.158345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b257f7b-d2a3-4925-898a-db06dc55845d req-72caeb53-8e54-4536-a248-d33709286e5c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.172204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3b257f7b-d2a3-4925-898a-db06dc55845d req-72caeb53-8e54-4536-a248-d33709286e5c service nova] Creating event network-vif-deleted:ecdd37ff-a07b-4d5f-aa4c-04d4c5654386 for instance 188f4b83-8e80-45f4-9be3-513a2f021e12 on n-h2-master-1 Oct 02 01:03:55.177857 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3b257f7b-d2a3-4925-898a-db06dc55845d req-72caeb53-8e54-4536-a248-d33709286e5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035440 Oct 02 01:03:55.178663 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 405/836] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:55.184298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:55.185319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:55.190475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.192654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.193267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.193575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.194279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.194779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.195208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.201655 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1eab4e0e-da41-4feb-a601-5f7bb6409628 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1427 microversion: 2.1 time: 0.101463 Oct 02 01:03:55.202254 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 432/837] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:55 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:55.332861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.340339 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95df692c-e5a8-446c-8ea6-e43a9b4eb55d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1471 microversion: 2.1 time: 0.160269 Oct 02 01:03:55.340909 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 406/838] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:55 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:55.633267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:55.633874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:55.639862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.640339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.640767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.641454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.641904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.642325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.672071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.672539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.672992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.673430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lazy-loading 'fault' on Instance uuid 1d186a0b-6561-4806-bc2d-02d041abe214 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:55.713510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fbb294f2064ce386c25ce5e371a1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94d90c894bf4eac916e2ff32975efcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.721036 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cebf7767-de80-4140-ba1c-899aa92919a6 tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 200 len: 1314 microversion: 2.1 time: 0.091632 Oct 02 01:03:55.721599 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 433/839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:55 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:55.736026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:55.736632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:55.743841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.744319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.744749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.745427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.745899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.746318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.874199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.882342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4bcd06c-47a3-473e-a3cb-58e36ad8230b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.150040 Oct 02 01:03:55.883106 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 407/840] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:55 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:56.044783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:56.045604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:56.056777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.057824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.058501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.061489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.063860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.064654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.225509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:56.226154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:56.232093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.232569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.233016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.233690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.234141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.234562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.265020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.265495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.265924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.266367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lazy-loading 'fault' on Instance uuid 188f4b83-8e80-45f4-9be3-513a2f021e12 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:56.306457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:56.314889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:56.317045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:56.318314 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8308a28c-2a54-451a-b891-955bc97a287c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.277650 Oct 02 01:03:56.319112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 434/841] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:56 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:56.323753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42d04f7289e49ef950eeaf764c91216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683c16b60ba34123bf0175396dffaf83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:56.333124 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0185db7-0772-4f73-9c0e-da16fa6ff717 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 200 len: 1303 microversion: 2.1 time: 0.110929 Oct 02 01:03:56.333792 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 408/842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:56 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:56.363891 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:56.364902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:56.371681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.372179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.372620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.373350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.373812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.374244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.648829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:56.669564 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac3defa0-e857-48d5-97f0-61ff66035cf2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1471 microversion: 2.1 time: 0.298562 Oct 02 01:03:56.673513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 435/843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:56 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:56.745181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:56.745828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] [instance: 1d186a0b-6561-4806-bc2d-02d041abe214] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:56.752221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.752700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.753127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.754643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.754643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.754967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.768215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] HTTP exception thrown: Instance 1d186a0b-6561-4806-bc2d-02d041abe214 could not be found. Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Request method failure captured: Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 HTTP/1.1 Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOMYSij7ZNZd_P7is3Pu_yq2XcHqY1yORXg9vkDA_o-A6seZoRiqprjOCR4_vSmgaPK2VFOgyt-W6YCvS5FQE76H06_4256ApycgoFx0ltT1z8t2wJAPzLIZ5awMurnSSOsRgTgjZXDNp_NzJ6ouCQRPblbS7HmNlsoL__Oz0TlxFUk Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:03:56.770481 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94d90c894bf4eac916e2ff32975efcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b94d90c894bf4eac916e2ff32975efcd"}]}] Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b94d90c894bf4eac916e2ff32975efcd Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-353079256 Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 25fbb294f2064ce386c25ce5e371a1dc Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-353079256-project Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 1d186a0b-6561-4806-bc2d-02d041abe214 could not be found. Oct 02 01:03:56.771865 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1d186a0b-6561-4806-bc2d-02d041abe214'} Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d186a0b-6561-4806-bc2d-02d041abe214 could not be found. Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:56.772594 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d186a0b-6561-4806-bc2d-02d041abe214 could not be found. Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d186a0b-6561-4806-bc2d-02d041abe214 could not be found. Oct 02 01:03:56.773747 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:56.775590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] Returning 404 to user: Instance 1d186a0b-6561-4806-bc2d-02d041abe214 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:56.775590 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42d3ad97-5508-4fe5-9c57-3df752c7471a tempest-FloatingIPsAssociationTestJSON-353079256 tempest-FloatingIPsAssociationTestJSON-353079256-project] 10.222.0.23 "GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214" status: 404 len: 111 microversion: 2.1 time: 0.030638 Oct 02 01:03:56.775966 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 409/844] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:56 2022] GET /compute/v2.1/servers/1d186a0b-6561-4806-bc2d-02d041abe214 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:56.905390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:56.906077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:56.913636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.914356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.915027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.915931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.916451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.916941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.933359 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:56.952764 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:57.078995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:57.096440 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:57.110160 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f73c09c1-f5bf-44ff-a478-7fbaf79635eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.208576 Oct 02 01:03:57.112250 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 436/845] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:56 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:57.198778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c5f8c-5276-47e4-a319-754d03b65941", "name": "network-vif-unplugged", "status": "completed", "tag": "49cd68b5-8534-47fa-9f97-121682028281"}, {"name": "network-changed", "server_uuid": "471c5f8c-5276-47e4-a319-754d03b65941", "tag": "49cd68b5-8534-47fa-9f97-121682028281"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:57.216066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.216957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.217892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.240462 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] Creating event network-vif-unplugged:49cd68b5-8534-47fa-9f97-121682028281 for instance 471c5f8c-5276-47e4-a319-754d03b65941 on n-h1-master-1 Oct 02 01:03:57.241678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] Creating event network-changed:49cd68b5-8534-47fa-9f97-121682028281 for instance 471c5f8c-5276-47e4-a319-754d03b65941 on n-h1-master-1 Oct 02 01:03:57.247953 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-099013d1-e8a6-4f4b-af29-f90ed7deee95 req-4b941846-f409-47f3-8623-6de881a18d54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053888 Oct 02 01:03:57.249087 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 410/846] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:57.343907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:57.344525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:57.356559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:57.357257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] [instance: 188f4b83-8e80-45f4-9be3-513a2f021e12] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:57.364158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.367367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.367855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.368307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.369451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.369886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.370605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.371065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.371490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.373163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.374235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.374880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.393658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] HTTP exception thrown: Instance 188f4b83-8e80-45f4-9be3-513a2f021e12 could not be found. Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Request method failure captured: Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 HTTP/1.1 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLOaPiYbb15_19mLAAASKsqqWKd06QQIuQ-um2X7uOXL5PltxXn4u5T7mMloVCGem00pgpIWLTi3CYIHsFKpZDP7V87vqICRRWrKcqzu5kKwVuweUDTe0kbK1aYHLdcZsCJbERbynawIEfVDo_LPHDJVre1xIbGEhp-vH6YSJ_hu04 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 683c16b60ba34123bf0175396dffaf83 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:03:57.396459 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/683c16b60ba34123bf0175396dffaf83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_683c16b60ba34123bf0175396dffaf83"}]}] Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 683c16b60ba34123bf0175396dffaf83 Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminTestJSON-339067741 Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminTestJSON-339067741-project Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c42d04f7289e49ef950eeaf764c91216 Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminTestJSON-339067741-project Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 188f4b83-8e80-45f4-9be3-513a2f021e12 could not be found. Oct 02 01:03:57.398021 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '188f4b83-8e80-45f4-9be3-513a2f021e12'} Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188f4b83-8e80-45f4-9be3-513a2f021e12 could not be found. Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:57.398923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188f4b83-8e80-45f4-9be3-513a2f021e12 could not be found. Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188f4b83-8e80-45f4-9be3-513a2f021e12 could not be found. Oct 02 01:03:57.400406 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:03:57.402243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] Returning 404 to user: Instance 188f4b83-8e80-45f4-9be3-513a2f021e12 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:57.403341 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02e0a44f-7262-4ed0-91a5-be1b36c9d6a8 tempest-ServersAdminTestJSON-339067741 tempest-ServersAdminTestJSON-339067741-project] 10.222.0.23 "GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12" status: 404 len: 111 microversion: 2.1 time: 0.050963 Oct 02 01:03:57.404386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 411/847] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:57 2022] GET /compute/v2.1/servers/188f4b83-8e80-45f4-9be3-513a2f021e12 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:03:57.557583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:57.568035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:57.569821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:57.571180 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24be9f42-6687-4f6d-95ea-fb86da020c24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.231430 Oct 02 01:03:57.572435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 437/848] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:57 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:57.694846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:57.695797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:57.707383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.710965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.711885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.712572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.713151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.715253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:58.024667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:58.041674 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1f16984-de99-4bad-bdd9-14b2ff85b06b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.351677 Oct 02 01:03:58.047756 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 412/849] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:57 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:58.135923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:58.136617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:58.151096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:58.151770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:58.152319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:58.154888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:58.155516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:58.158262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:58.437804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:58.447482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71b7798a-1c4b-471c-9dad-58a6195285c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.315410 Oct 02 01:03:58.448386 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 438/850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:58 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:58.601211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:58.602518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:58.609364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:58.610146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:58.611009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:58.611933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:58.612748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:58.614520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:58.833835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:58.855711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:58.858328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:58.859798 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-22dbd391-d38c-4937-b83d-a30d3632e4bf tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.264003 Oct 02 01:03:58.882105 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 413/851] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:58 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:03:59.071949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:59.074279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:59.084975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.086209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.087036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.088522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.089244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.089923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.471149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:59.472271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:59.482177 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:59.485798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.486748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.487519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.488511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.489182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.490368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.516211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:59.524981 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4d10fa6-c2b4-4157-bb73-28e0eac82df8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.461863 Oct 02 01:03:59.530038 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 439/852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:59 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:59.734865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:59.745695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8d22747-eeba-4fe1-a3ff-2b11ff36ae3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.279126 Oct 02 01:03:59.746457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 414/853] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:59 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:59.893109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:59.893722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:59.900196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.900698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.901183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.901978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.902350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.902811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.220245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:00.231810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:00.234656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:00.244363 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-faa9a05a-5de0-4f1a-a70d-5d74eac5f5e7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.348047 Oct 02 01:04:00.246486 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 440/854] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:03:59 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:00.553058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:00.562328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:00.571487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.572432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.573335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.574517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.575212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.576755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.770286 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:00.771179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:00.780804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.782173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.782634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.783362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.788360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.789352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.843359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:00.853346 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-30d1b4c3-92bc-4eb2-9eff-5ad472cd8ed2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.306467 Oct 02 01:04:00.864886 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 415/855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:00 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:01.038465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-433366715", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:01.083338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:01.094825 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eb227467-9944-467d-a430-11b6368c68cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.329181 Oct 02 01:04:01.096758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 441/856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:00 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:01.105207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:01.150463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a0da221b-c9ba-4a3c-a9fa-fa2c463a96d9 req-086c51b0-ffa2-4f66-8837-825ef8252dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb1a15c-d52b-476c-a4e3-50bbdbaef041", "name": "network-vif-plugged", "status": "completed", "tag": "08aace31-2f62-4fd1-ab2a-13fc3014b4c9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:01.172586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a0da221b-c9ba-4a3c-a9fa-fa2c463a96d9 req-086c51b0-ffa2-4f66-8837-825ef8252dbc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.173658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a0da221b-c9ba-4a3c-a9fa-fa2c463a96d9 req-086c51b0-ffa2-4f66-8837-825ef8252dbc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.174457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a0da221b-c9ba-4a3c-a9fa-fa2c463a96d9 req-086c51b0-ffa2-4f66-8837-825ef8252dbc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.188829 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a0da221b-c9ba-4a3c-a9fa-fa2c463a96d9 req-086c51b0-ffa2-4f66-8837-825ef8252dbc service nova] Creating event network-vif-plugged:08aace31-2f62-4fd1-ab2a-13fc3014b4c9 for instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 on n-h2-master-1 Oct 02 01:04:01.194716 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a0da221b-c9ba-4a3c-a9fa-fa2c463a96d9 req-086c51b0-ffa2-4f66-8837-825ef8252dbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048312 Oct 02 01:04:01.195862 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 442/857] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:04:01.274019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:01.275153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:01.300989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.301776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.302392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.303319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.303936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.305624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.662210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:01.662915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:01.663524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:01.663878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:01.664424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:01.673729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.674191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.674656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.676923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.677328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.677783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.696412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:01.701791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:01.710989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:01.716067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:01.718709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:01.725752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:01.728321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:01.729520 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec44c8c5-feb5-4a2c-a3a3-991cf8b0a504 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.460211 Oct 02 01:04:01.730119 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 443/858] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:01 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:04:01.781078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be75a855-1d8e-4267-9c08-57d8a04cea40 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914430 Oct 02 01:04:01.782747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 416/859] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:04:01.793839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae1bd39c-92f0-47c7-9823-1359146b696b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:01.794498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae1bd39c-92f0-47c7-9823-1359146b696b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:01.855147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae1bd39c-92f0-47c7-9823-1359146b696b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:01.867084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae1bd39c-92f0-47c7-9823-1359146b696b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1216 microversion: 2.1 time: 0.077003 Oct 02 01:04:01.868256 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 444/860] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:01 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:01.887663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:01.889375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:01.898080 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:01.899862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.900582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.901220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.901943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.902577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.903312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:02.093111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:02.101603 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a40c40a9-5cbd-4793-b787-ede1d085a956 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.218254 Oct 02 01:04:02.102301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 417/861] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:01 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:02.122828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:02.123439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:02.132259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:02.132753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:02.133190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:02.134115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:02.134589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:02.135084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:02.307746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:02.316194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-496a4895-f68c-4a18-b1ab-353d29fe0dae tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1360 microversion: 2.1 time: 0.197676 Oct 02 01:04:02.317058 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 445/862] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:02 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:02.763363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:02.765261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:02.775735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:02.776667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:02.777664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:02.778535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:02.779033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:02.779463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:02.892800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:02.893414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:02.900405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:02.900898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:02.901717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:02.902686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:02.903348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:02.903778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.000754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:03.010432 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-caa65f15-74e1-43d8-ada3-ac3b4c1b514f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1212 microversion: 2.1 time: 0.121377 Oct 02 01:04:03.014775 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 446/863] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:02 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:03.077928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:03.088056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:03.089510 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:03.090712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb1895c1-5c6a-4833-aaf0-992f936fb76f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.332685 Oct 02 01:04:03.091275 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 418/864] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:02 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:03.127005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.128541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:03.134935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:03.135456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:03.135846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.136543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:03.137128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:03.137694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.164814 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:03.167698 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6db7734b-18d9-4195-ac6c-18c3e3a47550 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.154728 Oct 02 01:04:03.168257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 447/865] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:04:03 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 01:04:03.177517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fbefa34-78cf-4b8e-97b7-4def65926336 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Calling method '.version_select at 0x7fb882020160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.230506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2fbefa34-78cf-4b8e-97b7-4def65926336 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] HTTP exception thrown: Image not found. Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fbefa34-78cf-4b8e-97b7-4def65926336 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Request method failure captured: Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOCqLJ7p4zOkLYBR0Ail85GEXFQY9RLjKtm0B1pd68eIo65t_WqVUM5RzrHwNeD2LmbOpodSoE2IqH3dbbeehwDcghL6bR2Z7IVLyzT-9T02EYpXzv3iUKKxVBjfSDlxBsfeSSMohzfzw0F0uCcqreB0TcXE73_osS0lMUU3e84ZZk Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:04:03.263385 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64100f586037490fa194996c7c160628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64100f586037490fa194996c7c160628"}]}] Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 2841e887f45d4f46af80665b781893e7 Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '-1'} Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:03.265036 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.266310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:03.267710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:04:03.270278 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.272692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fbefa34-78cf-4b8e-97b7-4def65926336 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:03.273778 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2fbefa34-78cf-4b8e-97b7-4def65926336 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.100271 Oct 02 01:04:03.274575 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 448/866] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:04:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:04:03.287414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-beb27bcf-e273-4d4d-946e-56c95d40d01f tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Calling method '.version_select at 0x7fb881cdd820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.326688 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-beb27bcf-e273-4d4d-946e-56c95d40d01f tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] HTTP exception thrown: Image not found. Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-beb27bcf-e273-4d4d-946e-56c95d40d01f tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Request method failure captured: Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/7449f6e0-c471-4a4e-a961-b06e3f214baj HTTP/1.1 Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOCqLJ7p4zOkLYBR0Ail85GEXFQY9RLjKtm0B1pd68eIo65t_WqVUM5RzrHwNeD2LmbOpodSoE2IqH3dbbeehwDcghL6bR2Z7IVLyzT-9T02EYpXzv3iUKKxVBjfSDlxBsfeSSMohzfzw0F0uCcqreB0TcXE73_osS0lMUU3e84ZZk Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:04:03.328460 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64100f586037490fa194996c7c160628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64100f586037490fa194996c7c160628"}]}] Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 2841e887f45d4f46af80665b781893e7 Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7449f6e0-c471-4a4e-a961-b06e3f214baj'} Oct 02 01:04:03.329965 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7449f6e0-c471-4a4e-a961-b06e3f214baj to delete Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.330846 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7449f6e0-c471-4a4e-a961-b06e3f214baj could not be found. Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:03.332627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-beb27bcf-e273-4d4d-946e-56c95d40d01f tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:03.334023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-beb27bcf-e273-4d4d-946e-56c95d40d01f tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] 10.222.0.23 "DELETE /compute/v2.1/images/7449f6e0-c471-4a4e-a961-b06e3f214baj" status: 404 len: 62 microversion: 2.1 time: 0.049835 Oct 02 01:04:03.335020 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 449/867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:03 2022] DELETE /compute/v2.1/images/7449f6e0-c471-4a4e-a961-b06e3f214baj => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:04:03.340467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.341143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:03.344341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:03.348258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:03.349026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:03.349638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.350514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:03.351151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:03.351927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.353717 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-59f50f7d-ab48-4784-a4b9-2853f0b52b02 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.233441 Oct 02 01:04:03.355091 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 419/868] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:03 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:03.367573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3303b1e7-957d-4c1d-b14c-70a646a7f665 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Calling method '.version_select at 0x7fb88190cd30>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.394951 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3303b1e7-957d-4c1d-b14c-70a646a7f665 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] HTTP exception thrown: Image not found. Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3303b1e7-957d-4c1d-b14c-70a646a7f665 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Request method failure captured: Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/images/91925c7d-6bb0-4fbe-b7ac-481a3dc0ecf91 HTTP/1.1 Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOCqLJ7p4zOkLYBR0Ail85GEXFQY9RLjKtm0B1pd68eIo65t_WqVUM5RzrHwNeD2LmbOpodSoE2IqH3dbbeehwDcghL6bR2Z7IVLyzT-9T02EYpXzv3iUKKxVBjfSDlxBsfeSSMohzfzw0F0uCcqreB0TcXE73_osS0lMUU3e84ZZk Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:03.399289 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64100f586037490fa194996c7c160628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64100f586037490fa194996c7c160628"}]}] Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2841e887f45d4f46af80665b781893e7 Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '91925c7d-6bb0-4fbe-b7ac-481a3dc0ecf91'} Oct 02 01:04:03.400785 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 91925c7d-6bb0-4fbe-b7ac-481a3dc0ecf91 to delete Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.401685 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91925c7d-6bb0-4fbe-b7ac-481a3dc0ecf91 could not be found. Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:03.403131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3303b1e7-957d-4c1d-b14c-70a646a7f665 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:03.404678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3303b1e7-957d-4c1d-b14c-70a646a7f665 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] 10.222.0.23 "DELETE /compute/v2.1/images/91925c7d-6bb0-4fbe-b7ac-481a3dc0ecf91" status: 404 len: 62 microversion: 2.1 time: 0.044527 Oct 02 01:04:03.405720 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 420/869] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:03 2022] DELETE /compute/v2.1/images/91925c7d-6bb0-4fbe-b7ac-481a3dc0ecf91 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:04:03.411655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2dc06e85-39f4-4d46-b065-f9f903a731d1 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Calling method '.version_select at 0x7fb88154ba60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.438570 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-2dc06e85-39f4-4d46-b065-f9f903a731d1 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] HTTP exception thrown: Image not found. Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2dc06e85-39f4-4d46-b065-f9f903a731d1 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Request method failure captured: Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/images/tempest-invalid-1956687486 HTTP/1.1 Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOCqLJ7p4zOkLYBR0Ail85GEXFQY9RLjKtm0B1pd68eIo65t_WqVUM5RzrHwNeD2LmbOpodSoE2IqH3dbbeehwDcghL6bR2Z7IVLyzT-9T02EYpXzv3iUKKxVBjfSDlxBsfeSSMohzfzw0F0uCcqreB0TcXE73_osS0lMUU3e84ZZk Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:03.440606 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64100f586037490fa194996c7c160628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64100f586037490fa194996c7c160628"}]}] Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2841e887f45d4f46af80665b781893e7 Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'tempest-invalid-1956687486'} Oct 02 01:04:03.443306 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1956687486 to delete Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.444383 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1956687486 could not be found. Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:03.446618 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2dc06e85-39f4-4d46-b065-f9f903a731d1 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:03.448116 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2dc06e85-39f4-4d46-b065-f9f903a731d1 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-1956687486" status: 404 len: 62 microversion: 2.1 time: 0.035818 Oct 02 01:04:03.449280 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 421/870] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:04:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1956687486 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:04:03.453437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e8d9ef76-1a42-4551-b3e0-568a249f3184 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Calling method '.version_select at 0x7fb881d8b4c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.473592 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e8d9ef76-1a42-4551-b3e0-568a249f3184 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] HTTP exception thrown: Image not found. Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e8d9ef76-1a42-4551-b3e0-568a249f3184 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Request method failure captured: Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/images/2ccaf7d6-10ce-4621-bcdb-9d807e55f1d2 HTTP/1.1 Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOCqLJ7p4zOkLYBR0Ail85GEXFQY9RLjKtm0B1pd68eIo65t_WqVUM5RzrHwNeD2LmbOpodSoE2IqH3dbbeehwDcghL6bR2Z7IVLyzT-9T02EYpXzv3iUKKxVBjfSDlxBsfeSSMohzfzw0F0uCcqreB0TcXE73_osS0lMUU3e84ZZk Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:03.475359 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64100f586037490fa194996c7c160628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64100f586037490fa194996c7c160628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64100f586037490fa194996c7c160628"}]}] Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 64100f586037490fa194996c7c160628 Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033 Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2841e887f45d4f46af80665b781893e7 Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1238609033-project Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '2ccaf7d6-10ce-4621-bcdb-9d807e55f1d2'} Oct 02 01:04:03.477178 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ccaf7d6-10ce-4621-bcdb-9d807e55f1d2 to delete Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.478701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ccaf7d6-10ce-4621-bcdb-9d807e55f1d2 could not be found. Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:03.479959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e8d9ef76-1a42-4551-b3e0-568a249f3184 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:03.481992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e8d9ef76-1a42-4551-b3e0-568a249f3184 tempest-ImagesDeleteNegativeTestJSON-1238609033 tempest-ImagesDeleteNegativeTestJSON-1238609033-project] 10.222.0.23 "DELETE /compute/v2.1/images/2ccaf7d6-10ce-4621-bcdb-9d807e55f1d2" status: 404 len: 62 microversion: 2.1 time: 0.027015 Oct 02 01:04:03.483961 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 422/871] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:03 2022] DELETE /compute/v2.1/images/2ccaf7d6-10ce-4621-bcdb-9d807e55f1d2 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:04:03.555474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:03.564494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-28900f8f-2d64-4cd9-a531-eb99a0e9bae0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1542 microversion: 2.1 time: 0.227923 Oct 02 01:04:03.579309 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 450/872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:03 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:03.589139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:03.589713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:03.596439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:03.597028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:03.597796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.598504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:03.599200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:03.599765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:03.678178 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28276849-7a9b-44c0-bae7-0a945a9cfd70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093074 Oct 02 01:04:03.678888 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 423/873] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:04:03 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:04.036108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:04.037971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:04.047512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.048344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.049269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.050973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.051668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.053267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.116861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:04.118239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:04.128925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.130890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.131534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.132677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.133574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.134407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.167071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:04.176460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e03cfd9-f511-4ea7-bbb5-4b1f7d7632d3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1276 microversion: 2.1 time: 0.145644 Oct 02 01:04:04.178137 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 451/874] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:04 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:04.380946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:04.381761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:04.388402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.389117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.389558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.390259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.390744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.391355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.576671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:04.586582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:04.588675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:04.590049 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a24348cb-d709-4046-931c-6506489ff0df tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1567 microversion: 2.25 time: 0.477872 Oct 02 01:04:04.590815 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 424/875] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:04 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:04.726568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:04.740304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52f41e22-ebdb-403d-a288-49bccb359b7c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.364872 Oct 02 01:04:04.742271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 452/876] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:04 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:04.813503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-df2eb05b-e94a-4129-84bd-f9540ce5ca18 req-e8132cdc-784d-45d8-a627-1d4eebb76bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb1a15c-d52b-476c-a4e3-50bbdbaef041", "tag": "08aace31-2f62-4fd1-ab2a-13fc3014b4c9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:04.854060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df2eb05b-e94a-4129-84bd-f9540ce5ca18 req-e8132cdc-784d-45d8-a627-1d4eebb76bea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:04.854531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df2eb05b-e94a-4129-84bd-f9540ce5ca18 req-e8132cdc-784d-45d8-a627-1d4eebb76bea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:04.869523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df2eb05b-e94a-4129-84bd-f9540ce5ca18 req-e8132cdc-784d-45d8-a627-1d4eebb76bea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:04.899924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-df2eb05b-e94a-4129-84bd-f9540ce5ca18 req-e8132cdc-784d-45d8-a627-1d4eebb76bea service nova] Creating event network-changed:08aace31-2f62-4fd1-ab2a-13fc3014b4c9 for instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 on n-h2-master-1 Oct 02 01:04:04.905697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-df2eb05b-e94a-4129-84bd-f9540ce5ca18 req-e8132cdc-784d-45d8-a627-1d4eebb76bea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096025 Oct 02 01:04:04.906828 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 425/877] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:05.202501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:05.203154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:05.212303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:05.213098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:05.213544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:05.214626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:05.215168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:05.216403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:05.605826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:05.621494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e6e63a5-38ce-48a0-9132-7aa57ecb019f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1274 microversion: 2.1 time: 0.422649 Oct 02 01:04:05.623004 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 453/878] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:05 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1274 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:05.630504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:05.631830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:05.640851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:05.641743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:05.642743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:05.643294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1112104647", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:05.644448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:05.644752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:05.645181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:05.708166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:06.167055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:06.175418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:06.177102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:06.178555 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c890ba4c-0539-4b0b-8238-0d7d3e79b2e4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1557 microversion: 2.25 time: 0.555060 Oct 02 01:04:06.179177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 454/879] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:05 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1557 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:06.184251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:06.185104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:06.192102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.192887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.193528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.194416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.195084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.195964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.378915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:06.379333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:06.379799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:06.380199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:06.381322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:06.390412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.390921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.391348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.392316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.392773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.393196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.412607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Getting quotas for project 73b489bd5bcd454da7e49c89f35f711f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:06.418040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Getting quotas for user 30185488a8864d5abae55abd94a7322e and project 73b489bd5bcd454da7e49c89f35f711f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:06.432411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:06.434799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:06.481932 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25d4cdd1-9808-4265-8518-29438960b55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987075 Oct 02 01:04:06.489104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 426/880] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:04:06.494086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42b9d0d9-6ce0-4a92-ac17-6331dc54fb42 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '.version_select at 0x7fb8817ce790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:06.498697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b9d0d9-6ce0-4a92-ac17-6331dc54fb42 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.499321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b9d0d9-6ce0-4a92-ac17-6331dc54fb42 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.499873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b9d0d9-6ce0-4a92-ac17-6331dc54fb42 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.516141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42b9d0d9-6ce0-4a92-ac17-6331dc54fb42 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.031828 Oct 02 01:04:06.517058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 427/881] 10.222.0.23 () {60 vars in 1184 bytes} [Sun Oct 2 01:04:06 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:06.537632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d847c04c-7376-4aa8-9eb8-665713dfbba2 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:06.539651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d847c04c-7376-4aa8-9eb8-665713dfbba2 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:06.608258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:06.620046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-93aeb402-c6a3-45b9-8984-5f30cf81c4ce tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.439631 Oct 02 01:04:06.621186 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 455/882] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:06 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:06.641685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d847c04c-7376-4aa8-9eb8-665713dfbba2 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:06.644976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:06.645603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:06.651599 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d847c04c-7376-4aa8-9eb8-665713dfbba2 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1217 microversion: 2.1 time: 0.125198 Oct 02 01:04:06.653150 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 428/883] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:06 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:06.671411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.672102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.672697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.673585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.674196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.675524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.684626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:06.687017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:06.700251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.700759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.701457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:06.702023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:06.702475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:06.702930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:07.017366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 471c5f8c-5276-47e4-a319-754d03b65941 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:07.023380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:07.035437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c6fa110-faa6-4039-82c0-dc7cfba859b2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.379373 Oct 02 01:04:07.042399 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 429/884] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:06 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:07.107073 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-00f3d67e-2386-4b86-8921-a0a738d5ab4f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 2050 microversion: 2.25 time: 0.477253 Oct 02 01:04:07.107829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 456/885] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:06 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 2050 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:07.234703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-670455327", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "9a195c53-3350-481b-9278-75a22d79ccc3"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:07.297710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] validate_networks() for [('9a195c53-3350-481b-9278-75a22d79ccc3', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:07.647945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:07.649255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:07.656186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:07.656676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:07.657127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:07.657852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:07.658326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:07.658984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:07.969385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:07.973562 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:07.989737 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe1dd36e-5031-4aae-b178-d12b01cca7a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.343232 Oct 02 01:04:07.990273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 457/886] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:07 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:07.995306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:07.996258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:08.002164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.002676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.003471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.004431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.005138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.005547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.142444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:08.152236 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d7a6052-332f-4285-ab08-c04ebd3c4e85 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1269 microversion: 2.1 time: 0.159897 Oct 02 01:04:08.153717 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 458/887] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:07 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:08.158778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2ea252f2-1d76-4bd2-8249-9ddd988cd4eb req-d0a7ea7d-b88b-4ec5-8ff2-043cbcea5443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3d7159-ba16-41d9-8d7b-c87ac671ad0a", "tag": "41489c6e-295b-41a6-ac6e-ebde228cebf1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:08.162756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:08.163238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:08.163780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:08.164348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:08.164765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:08.170513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2ea252f2-1d76-4bd2-8249-9ddd988cd4eb req-d0a7ea7d-b88b-4ec5-8ff2-043cbcea5443 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.171325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2ea252f2-1d76-4bd2-8249-9ddd988cd4eb req-d0a7ea7d-b88b-4ec5-8ff2-043cbcea5443 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.172385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2ea252f2-1d76-4bd2-8249-9ddd988cd4eb req-d0a7ea7d-b88b-4ec5-8ff2-043cbcea5443 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.179838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.180330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.180764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.181501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.182211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.182662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.187783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2ea252f2-1d76-4bd2-8249-9ddd988cd4eb req-d0a7ea7d-b88b-4ec5-8ff2-043cbcea5443 service nova] Creating event network-changed:41489c6e-295b-41a6-ac6e-ebde228cebf1 for instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a on n-h2-master-1 Oct 02 01:04:08.194389 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2ea252f2-1d76-4bd2-8249-9ddd988cd4eb req-d0a7ea7d-b88b-4ec5-8ff2-043cbcea5443 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039048 Oct 02 01:04:08.195983 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 459/888] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:08.203928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:08.205494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:08.207006 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:08.209830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for user d44f8d053e07440699d217cd63c94d0d and project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:08.214105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.214845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.215508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.216415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:08.217185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:08.217818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:08.224078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:08.226242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:08.279141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53c264cd-f3d1-4da5-a4d7-653d241fc6a7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.048270 Oct 02 01:04:08.280493 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 430/889] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:04:08.292831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81a9da11-af44-4d16-8574-8813ddd1cc43 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:08.293477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81a9da11-af44-4d16-8574-8813ddd1cc43 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:08.402389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81a9da11-af44-4d16-8574-8813ddd1cc43 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:08.411608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81a9da11-af44-4d16-8574-8813ddd1cc43 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:08.413373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81a9da11-af44-4d16-8574-8813ddd1cc43 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:08.414637 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81a9da11-af44-4d16-8574-8813ddd1cc43 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1261 microversion: 2.25 time: 0.125731 Oct 02 01:04:08.415610 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 431/890] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:08 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1261 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:08.578875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:08.588240 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47bd28b3-b2ce-41ea-ab6c-953ec661ed35 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.387403 Oct 02 01:04:08.588909 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 460/891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:08 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:09.015958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.016579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.024890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.025540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.026094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.027078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.027859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.028514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.028699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.029157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.037934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.038442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.038974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.039701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.040163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.040602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.071335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:04:09.162419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59de1c39-959e-455d-a0c7-d7079e9a3b40 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 204 len: 0 microversion: 2.1 time: 0.137494 Oct 02 01:04:09.163044 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 461/892] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:09 2022] DELETE /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:04:09.171806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.174200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.180856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.181354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.182045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.182781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.183236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.183662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.484615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.486378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.497110 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5718f19-1278-4ed3-aa9e-82106efdf1bc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.485106 Oct 02 01:04:09.510855 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6484b720-1bc6-4fe6-ba6d-4c594374721c tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1712 microversion: 2.1 time: 0.329938 Oct 02 01:04:09.510855 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 462/893] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:09 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1712 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:09.511117 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 432/894] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:09 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:09.511117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.511292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.514386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.517975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.521985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.522472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.522941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.523641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.524092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.524515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.535247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.535732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.536167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.536874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.537323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.537747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.686130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.689207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.694218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3939523-52ea-493e-8720-f5f4f7c42cb9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1275 microversion: 2.1 time: 0.194720 Oct 02 01:04:09.695206 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 463/895] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:09 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:09.699694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:09.700504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:09.702124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.703608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:09.704828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20079bc4-d6c1-4a35-97b9-d69b54457c5e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1321 microversion: 2.25 time: 0.203842 Oct 02 01:04:09.705499 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 433/896] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:09 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:09.707730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.708373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.708950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:09.709784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:09.710412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:09.711017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.003759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:10.011749 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ddf7de6d-5a95-46db-846e-a820aceb558d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.315454 Oct 02 01:04:10.012338 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 464/897] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:09 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:10.523763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:10.524392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:10.525465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:10.526201 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:10.531254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.531941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.532373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.532634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.533116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.533469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.533678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.534924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.535342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.535789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.536373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.536802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.939857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:10.948188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:10.949779 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3e70f036-f555-4d1a-baaf-f4ddab86e418 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1712 microversion: 2.1 time: 0.427657 Oct 02 01:04:10.966122 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 465/898] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:10 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1712 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:10.972857 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a14b8692-104d-44e4-88d7-950620f07398 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.455177 Oct 02 01:04:10.974111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:10.974315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:10.980320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.980815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.981247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.981946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:10.982396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:10.982922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:10.989143 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 434/899] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:10 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:10.993068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:10.993682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:11.000153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:11.000712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:11.001186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.001980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:11.002462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:11.003111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.434943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:11.444001 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db43b4c8-7ca3-45db-973d-3bfc81882990 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.476544 Oct 02 01:04:11.444334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:11.453747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:11.455883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:11.457282 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e95ee54d-9059-45e9-ac98-104e6538d636 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.468231 Oct 02 01:04:11.457909 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 435/900] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:10 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:11.459049 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 466/901] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:10 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:11.463211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:11.464067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:11.470370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:11.471138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:11.472291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.473049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:11.473722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:11.474208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.853092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:11.860876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b5a54e8-b46b-48c8-af95-0e251caefd98 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.401731 Oct 02 01:04:11.861496 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 436/902] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:11 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:11.979032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:11.979662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:11.982078 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:11.987501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:11.987994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:11.988433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.989132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:11.989597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:11.990025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:11.997492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:12.000241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:12.007152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:12.007848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:12.008431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:12.009322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:12.010009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:12.010794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:12.974726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:12.981563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:12.985370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f624b0b5-2e17-4bf3-ada6-a5f8c5e38b2f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.991271 Oct 02 01:04:13.000456 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 437/903] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:11 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:13.001138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81178fc7-9f57-4b19-9059-ecfb3ab1c1cb tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1712 microversion: 2.1 time: 1.017403 Oct 02 01:04:13.001138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 467/904] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:11 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1712 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:13.001750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:13.001750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:13.001923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:13.001923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:13.009217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.009886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.010421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.011395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.012106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.012625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.012732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.013171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.013655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.014437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.014934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.015398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.660357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:13.667957 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a83f47d0-b966-4d83-9d79-5957b295bb82 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.678135 Oct 02 01:04:13.669568 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 438/905] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:12 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:13.674070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-626ea0d6-c53c-4fed-85b1-a1fcb05be619 req-31fd52ea-413c-4fd7-b473-7f9972f6eff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:13.680225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:13.685714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-626ea0d6-c53c-4fed-85b1-a1fcb05be619 req-31fd52ea-413c-4fd7-b473-7f9972f6eff9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.686398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-626ea0d6-c53c-4fed-85b1-a1fcb05be619 req-31fd52ea-413c-4fd7-b473-7f9972f6eff9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.686815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-626ea0d6-c53c-4fed-85b1-a1fcb05be619 req-31fd52ea-413c-4fd7-b473-7f9972f6eff9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.692137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:13.693702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:13.694983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c7f32ba7-a069-4c81-ad7b-03166dc22930 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.700453 Oct 02 01:04:13.695626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 468/906] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:12 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:13.699698 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-626ea0d6-c53c-4fed-85b1-a1fcb05be619 req-31fd52ea-413c-4fd7-b473-7f9972f6eff9 service nova] Creating event network-changed:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:04:13.702845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:13.703720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:13.710367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.710897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.711331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.712050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:13.712672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:13.713099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:13.715334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-626ea0d6-c53c-4fed-85b1-a1fcb05be619 req-31fd52ea-413c-4fd7-b473-7f9972f6eff9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044464 Oct 02 01:04:13.716159 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 439/907] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:14.015794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:14.016583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:14.022895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.023390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.023835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.024544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.025005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.025438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.144599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:14.152430 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22b9cc34-0019-4efc-97b4-1996e65df24d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.455207 Oct 02 01:04:14.153281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 469/908] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:13 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:14.158225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:14.159077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:14.165883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.166559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.167206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.168082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.168533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.169171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.444654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:14.452649 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd75f2c2-25a9-4e69-bd5c-fe2a6faa514f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.441076 Oct 02 01:04:14.453369 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 440/909] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:14 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:14.556552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:14.572991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32cd7e5b-bd13-4a87-9b30-d9c037056fab tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1712 microversion: 2.1 time: 0.418203 Oct 02 01:04:14.573743 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 470/910] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:14 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1712 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:14.693944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:14.694469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:14.702666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.703164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.703593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.704295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.704747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.705166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.721130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:14.723118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:14.734657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.736080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.736965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:14.737953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:14.738705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:14.739370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.167159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.176557 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0f08846-4737-40ab-bb20-d0b992dbb521 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.487127 Oct 02 01:04:15.177155 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 441/911] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:14 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:15.178369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.182526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-75d19bfd-e3ce-4113-9df7-601ba716a379 req-3177e011-de9e-4a5a-9492-6a16fd52bf70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3d7159-ba16-41d9-8d7b-c87ac671ad0a", "name": "network-vif-plugged", "status": "completed", "tag": "41489c6e-295b-41a6-ac6e-ebde228cebf1"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:15.193206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-75d19bfd-e3ce-4113-9df7-601ba716a379 req-3177e011-de9e-4a5a-9492-6a16fd52bf70 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.193966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-75d19bfd-e3ce-4113-9df7-601ba716a379 req-3177e011-de9e-4a5a-9492-6a16fd52bf70 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.194664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-75d19bfd-e3ce-4113-9df7-601ba716a379 req-3177e011-de9e-4a5a-9492-6a16fd52bf70 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.195532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.197275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.198767 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ef0731ea-800f-4669-8662-2be9fc488ccb tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.481991 Oct 02 01:04:15.199515 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 471/912] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:14 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:04:15.207134 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-75d19bfd-e3ce-4113-9df7-601ba716a379 req-3177e011-de9e-4a5a-9492-6a16fd52bf70 service nova] Creating event network-vif-plugged:41489c6e-295b-41a6-ac6e-ebde228cebf1 for instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a on n-h2-master-1 Oct 02 01:04:15.212037 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-75d19bfd-e3ce-4113-9df7-601ba716a379 req-3177e011-de9e-4a5a-9492-6a16fd52bf70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033593 Oct 02 01:04:15.212975 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 442/913] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:15.219590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:15.220213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:15.226759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.227321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.227829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.228685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.229226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.229736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.432746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.440867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f0b65f9-bd95-4261-81ad-71fccec1c96a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.228742 Oct 02 01:04:15.441450 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 472/914] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:15 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:15.479909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:15.481275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:15.490427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.491223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.491660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.492364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.492973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.493399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.597937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:15.598664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:15.605067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.605386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.605829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.606534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.607061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.607489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.627555 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:15.640432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.646139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.646655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.647101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.647558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lazy-loading 'fault' on Instance uuid d1c70ae7-69f8-4bfd-86cc-3278c090e269 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:15.651001 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e5fda28-5899-4160-a46d-bb2211e85057 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.176744 Oct 02 01:04:15.652164 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 443/915] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:15 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:15.696988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:15.706272 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a3988b2-7db1-4bd5-80c6-a99316e44b53 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1353 microversion: 2.1 time: 0.112649 Oct 02 01:04:15.706964 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 473/916] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:15 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:15.752775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8d0527-6134-4260-829e-1a3c714713a3", "tag": "328c8fa1-2bb1-40ea-89ce-8c35f58d851e"}, {"server_uuid": "d1c70ae7-69f8-4bfd-86cc-3278c090e269", "name": "network-vif-deleted", "tag": "b4bf032d-680a-4210-a9a3-44800f4bb515"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:15.763445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:15.764027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:15.764525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:15.776924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] Creating event network-changed:328c8fa1-2bb1-40ea-89ce-8c35f58d851e for instance 5d8d0527-6134-4260-829e-1a3c714713a3 on n-h1-master-1 Oct 02 01:04:15.777425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] Creating event network-vif-deleted:b4bf032d-680a-4210-a9a3-44800f4bb515 for instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 on n-h2-master-1 Oct 02 01:04:15.786305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4a4e4632-5d3d-4071-9d43-5333504ea9de req-8a370503-da1f-4aa3-8f9e-4fdbb980fe6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037262 Oct 02 01:04:15.786938 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 444/917] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:16.201606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:16.202219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:16.208707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.209191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.209626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.210316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.210800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.211225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.228639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:16.229336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:16.235987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.236502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.237427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.238131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.238764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.239226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.397634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.406276 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1792cf91-eee6-4e26-aefb-914dc4bdc64d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.208615 Oct 02 01:04:16.406912 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 474/918] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:16 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:16.425119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.433563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.435070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.436248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f654c627-90b5-40c4-8c27-bf1fb4f4ed0e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.211958 Oct 02 01:04:16.436852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 445/919] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:16 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:04:16.463646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:16.464288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:16.470170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.470678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.471115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.471875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.472327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.472745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.604427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.612706 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec28d4a4-4b69-4dff-b67f-900a257daf9a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1316 microversion: 2.1 time: 0.152248 Oct 02 01:04:16.613278 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 475/920] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:16 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:16.674067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:16.675508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:16.681535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.682261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.682721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.683403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.683853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.684273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.686867 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:16.732480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:16.733293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:16.740390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.740882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.741333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.742044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.743320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.743760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.773488 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:16.779008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:16.779867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:16.780430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:16.780798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lazy-loading 'fault' on Instance uuid d1c70ae7-69f8-4bfd-86cc-3278c090e269 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:16.838252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533d6c52e394ecc980d67c7d985076e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1906af62eccb4a4d9e533a763a3e2018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.845706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:16.847702 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8412f52-62c4-4899-80ad-a9497d5d23ff tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 200 len: 1353 microversion: 2.1 time: 0.120710 Oct 02 01:04:16.848296 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 476/921] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:16 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 1353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:16.854209 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d02c187-d411-45f8-8c12-4dc97a591aee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.183903 Oct 02 01:04:16.854830 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 446/922] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:16 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:17.431412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:17.432503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:17.439696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.440887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.441341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.442023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.442649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.443081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.463905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:17.465177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:17.472052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.472817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.473424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.474162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.474646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.475087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.828542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:17.836694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:17.838104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:17.839223 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dbebe9e0-e48f-483e-9113-9c7de2a540ed tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.380952 Oct 02 01:04:17.839780 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 447/923] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:17 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:04:17.854318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:17.855172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:17.861072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.861747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.863128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.863252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:17.864127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.864734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.865307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.876811 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1f89fed-7610-4030-b868-b24b2f903e19 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.448598 Oct 02 01:04:17.878144 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 477/924] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:17 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:17.884076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:17.884770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:17.890815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.891426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.891900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.892721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.893530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.894028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.909825 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 HTTP/1.1 Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:04:17.911618 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: exception: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:17.913334 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'd1c70ae7-69f8-4bfd-86cc-3278c090e269'} Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:17.914119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:17.915527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:17.916845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:17.916845 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0514d801-d600-46df-b760-56b3c853b955 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 404 len: 111 microversion: 2.1 time: 0.034698 Oct 02 01:04:17.916845 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 478/925] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:17 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:17.922175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:17.922910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:17.931130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.931971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.932639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:17.933484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:17.934017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:17.934519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.168366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:18.176853 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-790db5c6-c968-420b-8071-97b37566e978 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1465 microversion: 2.1 time: 0.336118 Oct 02 01:04:18.177438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 448/926] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:17 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1465 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:18.190789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:18.190789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:18.190789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.190789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.191176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.191176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.191176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.191425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.196574 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:18.198770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:18.206805 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.207625 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5b8295e8-d149-4815-9beb-3c16276c158b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.289176 Oct 02 01:04:18.208648 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 479/927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:17 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 HTTP/1.1 Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:18.216515 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.217814 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '775f37dc-d601-4e83-a9ea-57791e2e7f18'} Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:18.218587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.219845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.221035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:18.221035 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bef2a786-d1a3-4f67-86b3-56da17a80bf1 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 404 len: 111 microversion: 2.1 time: 0.039804 Oct 02 01:04:18.221035 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 449/928] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:18 2022] DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:18.232868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:18.233766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:18.240612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.241217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.241883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.242694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.243486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.244008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.259386 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 HTTP/1.1 Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:18.260988 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.262550 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '775f37dc-d601-4e83-a9ea-57791e2e7f18'} Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:18.263489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:18.264896 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:18.266252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:18.266252 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9f73549-47b4-4a25-9c3c-62a0aa450db7 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 404 len: 111 microversion: 2.1 time: 0.034009 Oct 02 01:04:18.267119 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 450/929] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:18 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:18.271723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a10f02e5-665b-41af-88d8-44e694dd58f0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '.version_select at 0x7fb881cca4c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:18.293953 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a10f02e5-665b-41af-88d8-44e694dd58f0 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469006903" status: 202 len: 0 microversion: 2.1 time: 0.025642 Oct 02 01:04:18.294781 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 451/930] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469006903 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:04:18.342527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:18.343173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:18.350336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.350858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.351301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.352040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.352507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.352937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.619323 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-73139f0d-4605-47a4-a11a-3e9dbb9c4b64 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1616 microversion: 2.1 time: 0.409520 Oct 02 01:04:18.621482 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 480/931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:18 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1616 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:18.638289 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=22 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:18.644258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-59cffa0f-4d15-45fe-85f5-041537e452f7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: .version_select at 0x7fb8814b2940>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1203212519", "policies": ["affinity"]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:18.672632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-59cffa0f-4d15-45fe-85f5-041537e452f7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:18.678718 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:18.679809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-59cffa0f-4d15-45fe-85f5-041537e452f7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:18.738251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-59cffa0f-4d15-45fe-85f5-041537e452f7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:18.744119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-59cffa0f-4d15-45fe-85f5-041537e452f7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:18.757694 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-59cffa0f-4d15-45fe-85f5-041537e452f7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.120035 Oct 02 01:04:18.758279 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 452/932] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:04:18 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:18.859737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-455356476", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "23f2eb95-85c2-4c3b-9c8a-3b01b3751d28"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:18.866936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:18.868504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:18.876663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.877972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.879188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.880170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:18.881776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:18.882367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:18.918229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:19.109427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.117675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.119134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.120238 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac6c71cf-af33-48f0-bd7e-5eabaef62f3f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.258567 Oct 02 01:04:19.120796 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 453/933] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:18 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:19.125100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.125690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.132005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.132482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.132922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.133592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.134041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.134463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.228307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:19.228731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:19.229234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:19.229843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:19.230371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:19.260678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.261160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.261792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.262724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.263187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.263614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.281975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:19.288890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:19.297587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.303894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Going to run 2 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:19.306044 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-071a5167-76f3-46dd-bfb4-b842be31911a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.184247 Oct 02 01:04:19.306309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:19.318659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 454/934] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:19.318659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60b124ad-6e07-40c5-86ad-ac77030e3328 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.332240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60b124ad-6e07-40c5-86ad-ac77030e3328 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/404378477" status: 202 len: 0 microversion: 2.1 time: 0.023688 Oct 02 01:04:19.333205 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 455/935] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:04:19 2022] DELETE /compute/v2.1/flavors/404378477 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:04:19.339657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.340330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.347618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.348134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.348582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.349257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.349711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.350204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.350327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122355) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 02 01:04:19.372486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:19.377997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:19.431502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:19.436848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:19.452098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=e2f6a611-31a5-4996-9a30-67917ff14bf7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:19.498294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.505855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eef6f34e-5545-49d7-80ab-8a74221b69c2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.171595 Oct 02 01:04:19.506418 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 456/936] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:19.507983 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:19.513116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:19.520546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7d11a891-ac8b-4cd9-95e4-29d07b935dc6 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.543145 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7d11a891-ac8b-4cd9-95e4-29d07b935dc6 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.026835 Oct 02 01:04:19.543735 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 457/937] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:19.550209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:19.555640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:19.563140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c73e6ea-30eb-41d2-9217-593abe143067 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.581412 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c73e6ea-30eb-41d2-9217-593abe143067 tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1126982761" status: 202 len: 0 microversion: 2.1 time: 0.021305 Oct 02 01:04:19.581977 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 458/938] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:04:19 2022] DELETE /compute/v2.1/flavors/1126982761 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:04:19.589413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9fad5d06-53ce-4a33-be62-65acc2d735db tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.592721 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8f12e681-eb4c-43ab-9fef-7abc535c825e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.737184 Oct 02 01:04:19.593701 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 481/939] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:18 2022] POST /compute/v2.1/servers => generated 32 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:04:19.601379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.606064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.606924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Searching by: {'deleted': False, 'project_id': '70c6b40e739146e8b98b38971b879e85'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:04:19.609133 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9fad5d06-53ce-4a33-be62-65acc2d735db tempest-ServersWithSpecificFlavorTestJSON-2071026189 tempest-ServersWithSpecificFlavorTestJSON-2071026189-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022985 Oct 02 01:04:19.609815 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 459/940] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:19.623538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.624061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.624433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.625149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.625798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.626384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.634218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.634840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.642737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.644426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.644988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.645691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.646149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.646836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.661952 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 HTTP/1.1 Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:19.663740 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.665060 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd1c70ae7-69f8-4bfd-86cc-3278c090e269'} Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:19.669132 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.670672 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.673839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:19.673839 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7945afa-2811-49ae-b08b-52ae5e0f9dd6 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 404 len: 111 microversion: 2.1 time: 0.034703 Oct 02 01:04:19.673839 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 460/941] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:19 2022] DELETE /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:19.674331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.674860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: d1c70ae7-69f8-4bfd-86cc-3278c090e269] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.681545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.682945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.683454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.684224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.684797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.685930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.700198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 HTTP/1.1 Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:19.702079 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.703687 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd1c70ae7-69f8-4bfd-86cc-3278c090e269'} Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:19.704489 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. Oct 02 01:04:19.706775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.712188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance d1c70ae7-69f8-4bfd-86cc-3278c090e269 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:19.712188 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dc8f8804-053e-4ec8-b80c-89455fecef1e tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269" status: 404 len: 111 microversion: 2.1 time: 0.036615 Oct 02 01:04:19.712188 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 461/942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers/d1c70ae7-69f8-4bfd-86cc-3278c090e269 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:19.716280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.716835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.723195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.723752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.724315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.725115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.725667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.726192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.726320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:04:19.741104 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 HTTP/1.1 Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:19.742757 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.744390 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '775f37dc-d601-4e83-a9ea-57791e2e7f18'} Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:19.748545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.750080 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.751540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:19.751540 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-065a3035-b596-4940-9fdb-b3c755131f64 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 404 len: 111 microversion: 2.1 time: 0.031696 Oct 02 01:04:19.751540 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 462/943] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:19 2022] DELETE /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:19.753066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.754147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] [instance: 775f37dc-d601-4e83-a9ea-57791e2e7f18] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.759302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.759845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.760278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.760964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:19.761409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:19.761825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:19.775984 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] HTTP exception thrown: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Request method failure captured: Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 HTTP/1.1 Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOK2fQcPO7A2BKwuTixWwCONQ1x2fLA14K8MKNFoXrcvuOoNtBbYH4-VsZQ6eIy7JzQUsHSTuu-QeuceCR13XX2XaIu3huky0ualr_WIDE3B-U0griwvqZK-FwF9zC9OgB6Eup359Tuqn1ObrA-KzXuO5FlW_NaLqVSgOp5G0-BlB-g Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:19.779210 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1906af62eccb4a4d9e533a763a3e2018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1906af62eccb4a4d9e533a763a3e2018"}]}] Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1906af62eccb4a4d9e533a763a3e2018 Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639 Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0533d6c52e394ecc980d67c7d985076e Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-221213639-project Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.780666 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '775f37dc-d601-4e83-a9ea-57791e2e7f18'} Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:19.781600 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. Oct 02 01:04:19.783196 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:19.784699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] Returning 404 to user: Instance 775f37dc-d601-4e83-a9ea-57791e2e7f18 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:19.784699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9ea0f9d-a03c-44e0-8cd3-9af33eded916 tempest-ServersWithSpecificFlavorTestJSON-221213639 tempest-ServersWithSpecificFlavorTestJSON-221213639-project] 10.222.0.23 "GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18" status: 404 len: 111 microversion: 2.1 time: 0.031904 Oct 02 01:04:19.784699 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 463/944] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers/775f37dc-d601-4e83-a9ea-57791e2e7f18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:19.803896 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c24bbcd5-4ad2-4e76-a495-7416fce65aa1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.206082 Oct 02 01:04:19.804622 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 482/945] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers => generated 1001 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:19.817290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72bb46f3-4530-4fb5-b63f-dddfef15489e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:19.817759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-72bb46f3-4530-4fb5-b63f-dddfef15489e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:19.874834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72bb46f3-4530-4fb5-b63f-dddfef15489e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:19.882743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-72bb46f3-4530-4fb5-b63f-dddfef15489e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1218 microversion: 2.1 time: 0.069818 Oct 02 01:04:19.883741 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 464/946] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:19 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:20.147158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:20.147900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:20.154579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.155217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.156322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.157117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.157700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.158210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.309959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:20.319271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:20.320718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:20.322197 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f20fac7-2a38-4047-8f8d-bafe15223927 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.180314 Oct 02 01:04:20.322947 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 483/947] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:20 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:20.334826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:20.335805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:20.343366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.344131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.344572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.345274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.345883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.346272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.507468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:20.515898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3474671d-7d22-4686-ad53-31258bd5885d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.186905 Oct 02 01:04:20.516470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 465/948] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:20 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:20.529431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:20.530200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:20.537650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.538228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.538868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.539576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.540043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.540479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.686845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:20.695111 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66b885ae-6e27-47ab-b3cb-6c0d1f0da8b8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.169720 Oct 02 01:04:20.710852 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 484/949] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:20 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:20.905449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:20.906118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:20.917433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.918537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.920561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:20.921292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:20.921746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:20.922495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.001518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:21.013688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4da13ca3-f0ae-460d-96d9-19d0136eeec6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1214 microversion: 2.1 time: 0.112112 Oct 02 01:04:21.014326 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 466/950] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:20 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:21.343513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-82a5ffdb-adfb-4010-8d66-356baf2d311f req-d48d8e57-5be6-4f47-aa36-ab70b25151a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "name": "network-vif-plugged", "status": "completed", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:21.349389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:21.350010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:21.361609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-82a5ffdb-adfb-4010-8d66-356baf2d311f req-d48d8e57-5be6-4f47-aa36-ab70b25151a7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.363109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-82a5ffdb-adfb-4010-8d66-356baf2d311f req-d48d8e57-5be6-4f47-aa36-ab70b25151a7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.364083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-82a5ffdb-adfb-4010-8d66-356baf2d311f req-d48d8e57-5be6-4f47-aa36-ab70b25151a7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.370306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.382749 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-82a5ffdb-adfb-4010-8d66-356baf2d311f req-d48d8e57-5be6-4f47-aa36-ab70b25151a7 service nova] Creating event network-vif-plugged:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:04:21.384058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.384613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.385379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.385859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.386410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.390770 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-82a5ffdb-adfb-4010-8d66-356baf2d311f req-d48d8e57-5be6-4f47-aa36-ab70b25151a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052010 Oct 02 01:04:21.391993 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 485/951] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:21.542085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:21.544005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:21.558805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.559306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.559900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.561070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.561538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.561968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.856271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:21.865945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:21.868085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:21.869594 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-edd74ab7-4ae1-438c-ad47-51581439c8b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.524154 Oct 02 01:04:21.889729 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 467/952] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:21 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:21.896253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:21.897147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:21.907217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.911749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.912763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:21.914083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:21.916439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:21.917194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:22.019004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:22.027723 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de681d2b-89dc-450d-bccd-19fcac756070 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.492875 Oct 02 01:04:22.039545 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 486/953] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:21 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:22.050086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:22.050933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:22.057591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:22.058272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:22.058935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:22.060433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:22.061041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:22.061613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:22.167324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:22.176110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:22.178501 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4da32b2d-b69f-48c3-b7c8-e40e9f61f147 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1270 microversion: 2.1 time: 0.137580 Oct 02 01:04:22.179212 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 487/954] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:22 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:22.199319 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc591f64-fd34-43f4-bc0f-23a4cd0210cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.307755 Oct 02 01:04:22.199934 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 468/955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:21 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:22.896172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:22.896796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:22.912383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:22.913719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:22.914141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:22.914894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:22.916017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:22.916454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.060467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:23.061105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:23.086760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.087262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.087703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.092459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.093009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.093458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.774120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:23.782527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:23.791711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:23.792938 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02b6179e-db7e-442a-bba7-a7d8a34596ca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.901276 Oct 02 01:04:23.818505 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 488/956] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:22 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:23.824588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:23.826488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:23.833837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.834330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.834825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.835534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.836166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.836596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.869735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:23.877700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2cdf27ad-820b-447b-acb9-4beb8a4843c4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1317 microversion: 2.1 time: 0.825814 Oct 02 01:04:23.878283 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 469/957] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:23 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:23.893383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:23.893997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:23.902866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.903725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.904347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.905213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:23.905915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:23.906512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:23.932454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:23.945037 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0bcfd55-95e2-451d-9dc5-f3c7e20261cf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1276 microversion: 2.1 time: 0.125104 Oct 02 01:04:23.945778 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 489/958] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:23 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:24.191046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:24.207162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ec8a3da-df48-4b13-bc31-0190921812c8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.322505 Oct 02 01:04:24.209965 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 470/959] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:23 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:24.822812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:24.824473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:24.843245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:24.843757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:24.844242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:24.845739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:24.846435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:24.847140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:24.901523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:24.902409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:24.911865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:24.912609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:24.913038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:24.913742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:24.914198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:24.914647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.267425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.280274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.284550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.286130 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b201dade-1ce1-41c9-b16c-dddd71b2bae1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.471397 Oct 02 01:04:25.287383 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 490/960] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:24 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:25.294681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:25.296025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:25.300845 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:25.305911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.306920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.308348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.309330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.309796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.310529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.319569 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:25.355275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.389487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3631c167-f713-48a2-af85-8a516193c3ba tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1466 microversion: 2.1 time: 0.490724 Oct 02 01:04:25.399812 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 471/961] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:24 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1466 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:25.416423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:25.417036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:25.435459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.436222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.437134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.438104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.438746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.440697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.721596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.733619 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-51ba404f-8a6c-42bb-8dfc-c419e918707c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.444760 Oct 02 01:04:25.735065 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 491/962] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:25 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:25.743693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1455339848", "metadata": {"image_type": "test"}}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:25.747584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:25.759928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.761237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.761924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.764590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.765679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.766449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.851005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Getting quotas for project 73b489bd5bcd454da7e49c89f35f711f. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:25.854736 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:25.865354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Getting quotas for user 30185488a8864d5abae55abd94a7322e and project 73b489bd5bcd454da7e49c89f35f711f. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:25.868122 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84db36c6-6d5e-49b5-932f-5a6e69e9c9e1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.465280 Oct 02 01:04:25.869244 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 472/963] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:25 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:25.874256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f618d20f-95e0-44b2-a134-2b0403b8d6fe req-b56992ad-ea81-4bbb-8e20-d55753bedfbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d0527-6134-4260-829e-1a3c714713a3", "name": "network-vif-plugged", "status": "completed", "tag": "328c8fa1-2bb1-40ea-89ce-8c35f58d851e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:25.900103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f618d20f-95e0-44b2-a134-2b0403b8d6fe req-b56992ad-ea81-4bbb-8e20-d55753bedfbd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.900588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f618d20f-95e0-44b2-a134-2b0403b8d6fe req-b56992ad-ea81-4bbb-8e20-d55753bedfbd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.901029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f618d20f-95e0-44b2-a134-2b0403b8d6fe req-b56992ad-ea81-4bbb-8e20-d55753bedfbd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:25.921911 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f618d20f-95e0-44b2-a134-2b0403b8d6fe req-b56992ad-ea81-4bbb-8e20-d55753bedfbd service nova] Creating event network-vif-plugged:328c8fa1-2bb1-40ea-89ce-8c35f58d851e for instance 5d8d0527-6134-4260-829e-1a3c714713a3 on n-h1-master-1 Oct 02 01:04:25.941013 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f618d20f-95e0-44b2-a134-2b0403b8d6fe req-b56992ad-ea81-4bbb-8e20-d55753bedfbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069780 Oct 02 01:04:25.942022 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 473/964] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:25.947202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d4b9b593-2f9a-4796-a19d-dd5f508ec19f req-1be269fb-e7c9-41cc-bff4-3da21099361f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f6a611-31a5-4996-9a30-67917ff14bf7", "tag": "b4d4d444-09c5-486d-a0c2-b659585eb9af"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:25.991280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d4b9b593-2f9a-4796-a19d-dd5f508ec19f req-1be269fb-e7c9-41cc-bff4-3da21099361f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:25.991780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d4b9b593-2f9a-4796-a19d-dd5f508ec19f req-1be269fb-e7c9-41cc-bff4-3da21099361f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:25.992218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d4b9b593-2f9a-4796-a19d-dd5f508ec19f req-1be269fb-e7c9-41cc-bff4-3da21099361f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.018385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d4b9b593-2f9a-4796-a19d-dd5f508ec19f req-1be269fb-e7c9-41cc-bff4-3da21099361f service nova] Creating event network-changed:b4d4d444-09c5-486d-a0c2-b659585eb9af for instance e2f6a611-31a5-4996-9a30-67917ff14bf7 on n-h2-master-1 Oct 02 01:04:26.040500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d4b9b593-2f9a-4796-a19d-dd5f508ec19f req-1be269fb-e7c9-41cc-bff4-3da21099361f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096867 Oct 02 01:04:26.041727 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 474/965] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:26.201161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5dadc184-0d12-4485-ae7a-f4e1c792671a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "POST /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55/action" status: 202 len: 0 microversion: 2.1 time: 0.461974 Oct 02 01:04:26.216840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-353c7491-32cb-46cd-87ac-408f395949e9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88146d430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:26.223098 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 492/966] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:04:25 2022] POST /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:04:26.300306 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-353c7491-32cb-46cd-87ac-408f395949e9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.089758 Oct 02 01:04:26.301119 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 475/967] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:26 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:26.317663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:26.318363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:26.333323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.334029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.334478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.335476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.335719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.336143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.716452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:26.727668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:26.729100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:26.730217 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b015236b-5d51-47aa-acfd-575ff0888f81 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.418196 Oct 02 01:04:26.731234 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 493/968] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:26 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:26.765332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:26.766368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:26.775916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.776807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.777606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.778542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.779575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.780604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.787132 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:26.902984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:26.905312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:26.916172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.918071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.920631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:26.921411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:26.921902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:26.922396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.167379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:27.181536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d172291d-aa79-40a9-84f4-c5dfaf4ed02e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.419072 Oct 02 01:04:27.185743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 476/969] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:26 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:27.212645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:27.223841 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0122fb48-7667-4c50-94d6-abe34d6a078a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.332052 Oct 02 01:04:27.234924 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 494/970] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:26 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:27.318778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3d24d239-e6d5-48ae-8b32-7ff0c0608acc tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88158f9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:27.366040 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3d24d239-e6d5-48ae-8b32-7ff0c0608acc tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.052341 Oct 02 01:04:27.366808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 477/971] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:27 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:27.758077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:27.759035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:27.766081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.767017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.767805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.768987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:27.769689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:27.770523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:27.912221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:27.920290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:27.921711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:27.922852 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8bc68e88-6983-4e61-b7bd-d477f2dd41e9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1361 microversion: 2.25 time: 0.169101 Oct 02 01:04:27.923423 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 495/972] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:27 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:28.070664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-93761017-7026-4200-8326-b4af8ff6f126 req-d393e765-bf5d-4c59-a54a-06c3bbc8b990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd5fc9e-d301-46f7-b01c-80b93bbb172b", "tag": "b58f567d-6585-487c-aff1-48b1fa50116d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:28.081525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-93761017-7026-4200-8326-b4af8ff6f126 req-d393e765-bf5d-4c59-a54a-06c3bbc8b990 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.082186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-93761017-7026-4200-8326-b4af8ff6f126 req-d393e765-bf5d-4c59-a54a-06c3bbc8b990 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.083139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-93761017-7026-4200-8326-b4af8ff6f126 req-d393e765-bf5d-4c59-a54a-06c3bbc8b990 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.097399 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-93761017-7026-4200-8326-b4af8ff6f126 req-d393e765-bf5d-4c59-a54a-06c3bbc8b990 service nova] Creating event network-changed:b58f567d-6585-487c-aff1-48b1fa50116d for instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b on n-h2-master-1 Oct 02 01:04:28.102563 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-93761017-7026-4200-8326-b4af8ff6f126 req-d393e765-bf5d-4c59-a54a-06c3bbc8b990 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035480 Oct 02 01:04:28.103361 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 478/973] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:28.218662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:28.219292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:28.226356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.226882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.227331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.228038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.228491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.228917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.248861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:28.249612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:28.256389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.256856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.257469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.258506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.259148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.259834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.486124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:28.492853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:28.493739 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba255bc0-bb40-4896-8e65-4765f7fb35e3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.291336 Oct 02 01:04:28.494890 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 496/974] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:28 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:28.499686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4bd2baf-4a3f-4955-baaa-63408952b550 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881555280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:28.511815 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96a869ab-bda1-492a-8f9b-b9423024cc94 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.267236 Oct 02 01:04:28.512918 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 479/975] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:28 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:28.552434 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4bd2baf-4a3f-4955-baaa-63408952b550 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.056278 Oct 02 01:04:28.553010 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 497/976] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:28 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:28.949604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:28.950542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:28.958335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.959117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.959720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:28.960627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:28.961111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:28.961538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.133371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.142208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.144006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.145165 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7891d46-9920-49d2-a062-ceb8f56bf216 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1556 microversion: 2.25 time: 0.200177 Oct 02 01:04:29.145725 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 480/977] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:28 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:29.169373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.170123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.176756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.177243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.177682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.178384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.178846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.179266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.313723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 5d8d0527-6134-4260-829e-1a3c714713a3 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:29.330357 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f912a2f-7a22-4e6b-b92a-763ccbdd6974 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 2048 microversion: 2.25 time: 0.164652 Oct 02 01:04:29.331084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 498/978] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 2048 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:29.355013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.355724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.363261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.364000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.364708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.365620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.366139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.366650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.501059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 5d8d0527-6134-4260-829e-1a3c714713a3 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:29.514621 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81c98351-c5ab-4ff0-a682-0ae2e18c7e72 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 2048 microversion: 2.25 time: 0.163438 Oct 02 01:04:29.515402 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 481/979] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 2048 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:29.517322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.517978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.524102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.524582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.525015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.525717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.526191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.526680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.540487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.541105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.547430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.548142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.548591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.549855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.550317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.550777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.567556 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=22 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.655626 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.730101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.741293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ce8181b-d6db-423b-b932-60807eac1b3c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.227679 Oct 02 01:04:29.741879 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 499/980] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:29.747191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.748109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:29.753029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.754217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.754980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.756091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.756853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.757578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.759267 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0f7cab63-1b81-4636-bbe8-af553f00b0a0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.226332 Oct 02 01:04:29.760009 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 482/981] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:29.767420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f643bba-e741-45d1-8e34-7a713c303b75 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881496ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.786337 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac7dfa1b-a002-4f99-9df1-37b8574bf368 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042854 Oct 02 01:04:29.787146 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 500/982] 10.222.0.23 () {60 vars in 1217 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:04:29.798509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:29.799798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.807241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.807966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.808405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.809104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.809552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.810232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.818700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f643bba-e741-45d1-8e34-7a713c303b75 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.057714 Oct 02 01:04:29.819515 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 483/983] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:29.877177 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90025251-3b94-47a6-a5c9-233ea3897d31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3/action" status: 202 len: 0 microversion: 2.25 time: 0.081841 Oct 02 01:04:29.877910 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 501/984] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:04:29 2022] POST /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:04:29.882979 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.887383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:29.888066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:29.895813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.896535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.897138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:29.898054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:29.898499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:29.899123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:30.031919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 5d8d0527-6134-4260-829e-1a3c714713a3 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:30.046295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f128efc-9d97-4f87-bb5e-962521579d06 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 2053 microversion: 2.25 time: 0.164108 Oct 02 01:04:30.047111 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 484/985] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:29 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 2053 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:30.072528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5492fe6c-55e0-4e2f-ba84-58387a4f2aa9 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1091592627", "ram": 512, "vcpus": 1, "disk": 10, "id": 1669715536, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.091442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5492fe6c-55e0-4e2f-ba84-58387a4f2aa9 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.149392 Oct 02 01:04:30.092050 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 502/986] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:29 2022] POST /compute/v2.1/flavors => generated 416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:04:30.210875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3027493-b3ce-442a-8b4d-35591fec05c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.219148 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b3027493-b3ce-442a-8b4d-35591fec05c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] HTTP exception thrown: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3027493-b3ce-442a-8b4d-35591fec05c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Request method failure captured: Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/flavors/1669715536/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOdCm9vSIekkinIUrGve9nlGYyCz7n5QZrbfSkQ1dRyXE-o4aitIVFMJoworJEcj4Lbkx6Xl15Ub-YPuA8pb6eKi5Xa8-QLAyUQ1yUFfo5fPgB-m9DDVBymbO6-TQ1OI0eMMLigYEljpb6eF-U9o7mBFpRh3JWh2yNLVPqjN_-CrjE Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:30.227990 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0860aeb7708d4fd8a341e9ba0e36edf7"}]}] Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 3fce043f23844debb1521fc81f33def7 Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:30.229479 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: action_args: {'flavor_id': '1669715536', 'id': 'hw:cpu_thread_policy'} Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.230200 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3027493-b3ce-442a-8b4d-35591fec05c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Returning 404 to user: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3027493-b3ce-442a-8b4d-35591fec05c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] 10.222.0.23 "GET /compute/v2.1/flavors/1669715536/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.127960 Oct 02 01:04:30.231595 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 485/987] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:04:30 2022] GET /compute/v2.1/flavors/1669715536/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:30.242260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d21e505-b05e-48d9-8cbb-fc613460a8f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.245774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d21e505-b05e-48d9-8cbb-fc613460a8f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '3fce043f23844debb1521fc81f33def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0860aeb7708d4fd8a341e9ba0e36edf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d21e505-b05e-48d9-8cbb-fc613460a8f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Request method failure captured: Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/flavors/1669715536/os-extra_specs HTTP/1.1 Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 66 Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOdCm9vSIekkinIUrGve9nlGYyCz7n5QZrbfSkQ1dRyXE-o4aitIVFMJoworJEcj4Lbkx6Xl15Ub-YPuA8pb6eKi5Xa8-QLAyUQ1yUFfo5fPgB-m9DDVBymbO6-TQ1OI0eMMLigYEljpb6eF-U9o7mBFpRh3JWh2yNLVPqjN_-CrjE Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:04:30.247829 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0860aeb7708d4fd8a341e9ba0e36edf7"}]}] Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 3fce043f23844debb1521fc81f33def7 Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 02 01:04:30.249357 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: action_args: {'flavor_id': '1669715536', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:04:30.250232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 02 01:04:30.251869 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.253841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d21e505-b05e-48d9-8cbb-fc613460a8f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.253841 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d21e505-b05e-48d9-8cbb-fc613460a8f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] 10.222.0.23 "POST /compute/v2.1/flavors/1669715536/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.012475 Oct 02 01:04:30.253841 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 503/988] 10.222.0.23 () {60 vars in 1224 bytes} [Sun Oct 2 01:04:30 2022] POST /compute/v2.1/flavors/1669715536/os-extra_specs => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:30.262083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81f94b47-3f7c-45d5-8d0b-f42bec1dc253 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.278046 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:30.294534 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81f94b47-3f7c-45d5-8d0b-f42bec1dc253 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1669715536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036240 Oct 02 01:04:30.295181 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 486/989] 10.222.0.23 () {60 vars in 1224 bytes} [Sun Oct 2 01:04:30 2022] POST /compute/v2.1/flavors/1669715536/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:04:30.307387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13812472-acb8-4a61-b66b-88596fa852dc tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.308850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13812472-acb8-4a61-b66b-88596fa852dc tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '3fce043f23844debb1521fc81f33def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0860aeb7708d4fd8a341e9ba0e36edf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13812472-acb8-4a61-b66b-88596fa852dc tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Request method failure captured: Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOdCm9vSIekkinIUrGve9nlGYyCz7n5QZrbfSkQ1dRyXE-o4aitIVFMJoworJEcj4Lbkx6Xl15Ub-YPuA8pb6eKi5Xa8-QLAyUQ1yUFfo5fPgB-m9DDVBymbO6-TQ1OI0eMMLigYEljpb6eF-U9o7mBFpRh3JWh2yNLVPqjN_-CrjE Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:04:30.310362 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0860aeb7708d4fd8a341e9ba0e36edf7"}]}] Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 3fce043f23844debb1521fc81f33def7 Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:04:30.312062 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: action_args: {'flavor_id': '1669715536', 'id': 'hw:numa_nodes'} Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:04:30.313088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.315567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13812472-acb8-4a61-b66b-88596fa852dc tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.318471 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13812472-acb8-4a61-b66b-88596fa852dc tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009994 Oct 02 01:04:30.318471 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 504/990] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:04:30 2022] DELETE /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:30.321553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05c64f6b-2ce9-453e-8074-482ee1078a1a tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.348581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05c64f6b-2ce9-453e-8074-482ee1078a1a tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1669715536/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031030 Oct 02 01:04:30.349184 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 487/991] 10.222.0.23 () {60 vars in 1224 bytes} [Sun Oct 2 01:04:30 2022] POST /compute/v2.1/flavors/1669715536/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:04:30.362277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1565170d-4cbf-4cbc-b0e6-2a79124c10e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.368638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1565170d-4cbf-4cbc-b0e6-2a79124c10e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '3fce043f23844debb1521fc81f33def7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0860aeb7708d4fd8a341e9ba0e36edf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1565170d-4cbf-4cbc-b0e6-2a79124c10e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Request method failure captured: Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 22 Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOdCm9vSIekkinIUrGve9nlGYyCz7n5QZrbfSkQ1dRyXE-o4aitIVFMJoworJEcj4Lbkx6Xl15Ub-YPuA8pb6eKi5Xa8-QLAyUQ1yUFfo5fPgB-m9DDVBymbO6-TQ1OI0eMMLigYEljpb6eF-U9o7mBFpRh3JWh2yNLVPqjN_-CrjE Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:04:30.371490 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0860aeb7708d4fd8a341e9ba0e36edf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0860aeb7708d4fd8a341e9ba0e36edf7"}]}] Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 0860aeb7708d4fd8a341e9ba0e36edf7 Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 3fce043f23844debb1521fc81f33def7 Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: {"hw:numa_nodes": "1"} Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:04:30.372977 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: action_args: {'flavor_id': '1669715536', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:04:30.373858 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 02 01:04:30.375438 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.377476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1565170d-4cbf-4cbc-b0e6-2a79124c10e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.379023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1565170d-4cbf-4cbc-b0e6-2a79124c10e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804 tempest-FlavorsExtraSpecsNegativeTestJSON-1230550804-project] 10.222.0.23 "PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021080 Oct 02 01:04:30.380030 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 505/992] 10.222.0.23 () {60 vars in 1265 bytes} [Sun Oct 2 01:04:30 2022] PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:30.389508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29c66c03-041c-4c3f-a6c2-f3611e425af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.398678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-29c66c03-041c-4c3f-a6c2-f3611e425af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] HTTP exception thrown: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29c66c03-041c-4c3f-a6c2-f3611e425af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Request method failure captured: Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/flavors/1669715536/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOdGrs6K30zAgVwW__lDkpkEM8hzvVtsLwOjsSfiGCri4XNT3FSjRFHNys_UgG6X-eG_TkwDoQUYd7DsbeCKJxhj--BpSM2QU2YpQ8ibkQZNSOaanPY3si7DmH_1_4OGpCzdG377qm54JRrVzWOy2ttaPQpzK5GBvbxpSoiy4GWbaw Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 38be01e8870946c793ab7d7fe7e8ffef Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:04:30.400198 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38be01e8870946c793ab7d7fe7e8ffef"}]}] Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 38be01e8870946c793ab7d7fe7e8ffef Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a11b067a724a418f99854f61699811d8 Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:30.401611 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: action_args: {'flavor_id': '1669715536', 'id': 'hw:cpu_thread_policy'} Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.402338 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29c66c03-041c-4c3f-a6c2-f3611e425af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Returning 404 to user: Flavor 1669715536 has no extra specs with key hw:cpu_thread_policy. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29c66c03-041c-4c3f-a6c2-f3611e425af7 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1669715536/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.016033 Oct 02 01:04:30.403784 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 488/993] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:04:30 2022] DELETE /compute/v2.1/flavors/1669715536/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:30.412728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69b276d2-b9a2-4461-91ec-c3824fe9dd9f tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.416470 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-69b276d2-b9a2-4461-91ec-c3824fe9dd9f tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69b276d2-b9a2-4461-91ec-c3824fe9dd9f tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Request method failure captured: Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 27 Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOdGrs6K30zAgVwW__lDkpkEM8hzvVtsLwOjsSfiGCri4XNT3FSjRFHNys_UgG6X-eG_TkwDoQUYd7DsbeCKJxhj--BpSM2QU2YpQ8ibkQZNSOaanPY3si7DmH_1_4OGpCzdG377qm54JRrVzWOy2ttaPQpzK5GBvbxpSoiy4GWbaw Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 38be01e8870946c793ab7d7fe7e8ffef Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:04:30.417790 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38be01e8870946c793ab7d7fe7e8ffef"}]}] Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 38be01e8870946c793ab7d7fe7e8ffef Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a11b067a724a418f99854f61699811d8 Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: {"hw:cpu_policy": "shared"} Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:04:30.419430 n-d-master-1 devstack@n-api.service[122355]: exception: Request body and URI mismatch Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: action_args: {'flavor_id': '1669715536', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.420670 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69b276d2-b9a2-4461-91ec-c3824fe9dd9f tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-69b276d2-b9a2-4461-91ec-c3824fe9dd9f tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011284 Oct 02 01:04:30.422263 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 506/994] 10.222.0.23 () {60 vars in 1265 bytes} [Sun Oct 2 01:04:30 2022] PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes => generated 73 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:30.428989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7cb05318-8d98-4199-a985-2032bd862a01 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7cb05318-8d98-4199-a985-2032bd862a01 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Request method failure captured: Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 49 Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOdGrs6K30zAgVwW__lDkpkEM8hzvVtsLwOjsSfiGCri4XNT3FSjRFHNys_UgG6X-eG_TkwDoQUYd7DsbeCKJxhj--BpSM2QU2YpQ8ibkQZNSOaanPY3si7DmH_1_4OGpCzdG377qm54JRrVzWOy2ttaPQpzK5GBvbxpSoiy4GWbaw Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 38be01e8870946c793ab7d7fe7e8ffef Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:04:30.434467 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38be01e8870946c793ab7d7fe7e8ffef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38be01e8870946c793ab7d7fe7e8ffef"}]}] Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 38be01e8870946c793ab7d7fe7e8ffef Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a11b067a724a418f99854f61699811d8 Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 02 01:04:30.436140 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: action_args: {'flavor_id': '1669715536', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance: Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 02 01:04:30.440770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.442521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7cb05318-8d98-4199-a985-2032bd862a01 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7cb05318-8d98-4199-a985-2032bd862a01 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010758 Oct 02 01:04:30.443974 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 489/995] 10.222.0.23 () {60 vars in 1265 bytes} [Sun Oct 2 01:04:30 2022] PUT /compute/v2.1/flavors/1669715536/os-extra_specs/hw:numa_nodes => generated 117 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:04:30.447716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6588a126-e04a-4efc-8d65-cb52e48ae747 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.466683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6588a126-e04a-4efc-8d65-cb52e48ae747 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1669715536" status: 202 len: 0 microversion: 2.1 time: 0.022573 Oct 02 01:04:30.467272 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 507/996] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:04:30 2022] DELETE /compute/v2.1/flavors/1669715536 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:04:30.475704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6da97f6-2fae-48b7-bc37-c65dbd5f08a5 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.494868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6da97f6-2fae-48b7-bc37-c65dbd5f08a5 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825 tempest-FlavorsExtraSpecsNegativeTestJSON-1223650825-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022779 Oct 02 01:04:30.495454 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 490/997] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:04:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:30.771380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.772133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:30.780244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:30.780932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:30.781556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:30.782301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:30.782791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:30.783775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:30.785798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:30.786617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:30.798014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:30.798504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:30.799193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:30.799920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:30.800378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:30.800811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.028275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:31.032174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:31.042355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ecc3968-3130-4ceb-9a13-b7618fde0d78 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.280450 Oct 02 01:04:31.042966 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 508/998] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:30 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:31.043520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f223446e-cc80-436f-8ddd-c9764b827b38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1476 microversion: 2.1 time: 0.261965 Oct 02 01:04:31.050726 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 491/999] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:30 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:31.051427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a682af79-2687-4516-be7b-5ae14b791cd5 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881412ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:31.076686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:31.078005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:31.086453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.087094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.087793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.088703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.089188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.090035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.107712 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a682af79-2687-4516-be7b-5ae14b791cd5 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.063200 Oct 02 01:04:31.108471 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 509/1000] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:31 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:31.274062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 5d8d0527-6134-4260-829e-1a3c714713a3 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:31.305075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e2e03f5-b974-423e-9ef2-882a5db2de4c tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 2033 microversion: 2.25 time: 0.232991 Oct 02 01:04:31.318218 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 492/1001] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:31 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 2033 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:31.333834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:31.336246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:31.347304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.349524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.349965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.350901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:31.351824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:31.352265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:31.433040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'flavor' on Instance uuid 5d8d0527-6134-4260-829e-1a3c714713a3 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:31.480406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Going to try to live migrate instance to n-h2-master-1 {{(pid=122355) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:04:32.080502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:32.081378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:32.089374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.089877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.090627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.091393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.092011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.092498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.471345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:32.480695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fbeb1cf8-54c6-4444-b541-51fe86ad312c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1475 microversion: 2.1 time: 0.414547 Oct 02 01:04:32.481275 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 493/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:32 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1475 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:32.485905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:32.487143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:32.493216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.493690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.494307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.495025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.495819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:32.496396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:32.865613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:32.882180 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87f9d0b8-b81b-4678-a70e-14a414fda7c6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.399543 Oct 02 01:04:32.883154 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 494/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:32 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:32.891382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-831e6b32-d036-4ff6-a2cb-b06cd07ce7ab tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88142f790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:32.953204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-831e6b32-d036-4ff6-a2cb-b06cd07ce7ab tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.068341 Oct 02 01:04:32.954674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 495/1004] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:32 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:32.963189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3", "name": "network-vif-unplugged", "status": "completed", "tag": "34aae495-9601-4a7f-99a5-d4398c461a60"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:32.996347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:32.998348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.000018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.034505 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] Creating event network-vif-unplugged:34aae495-9601-4a7f-99a5-d4398c461a60 for instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 on n-h1-master-1 Oct 02 01:04:33.042009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:04:33.059227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-463be769-8948-4e0b-aa12-be9d3f2572cc req-f99cf0d8-c066-4273-ad83-3da5c1b0d68a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102533 Oct 02 01:04:33.060474 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 496/1005] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:33.068508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ace75c7a-3102-4cb9-b1e5-495c91e19b08 req-7be1bc08-bdf7-4fc5-b09b-d1bf6a5eb56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f6a611-31a5-4996-9a30-67917ff14bf7", "name": "network-vif-plugged", "status": "completed", "tag": "b4d4d444-09c5-486d-a0c2-b659585eb9af"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:33.083643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ace75c7a-3102-4cb9-b1e5-495c91e19b08 req-7be1bc08-bdf7-4fc5-b09b-d1bf6a5eb56a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.084446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ace75c7a-3102-4cb9-b1e5-495c91e19b08 req-7be1bc08-bdf7-4fc5-b09b-d1bf6a5eb56a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.085803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ace75c7a-3102-4cb9-b1e5-495c91e19b08 req-7be1bc08-bdf7-4fc5-b09b-d1bf6a5eb56a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.105518 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ace75c7a-3102-4cb9-b1e5-495c91e19b08 req-7be1bc08-bdf7-4fc5-b09b-d1bf6a5eb56a service nova] Creating event network-vif-plugged:b4d4d444-09c5-486d-a0c2-b659585eb9af for instance e2f6a611-31a5-4996-9a30-67917ff14bf7 on n-h2-master-1 Oct 02 01:04:33.114331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ace75c7a-3102-4cb9-b1e5-495c91e19b08 req-7be1bc08-bdf7-4fc5-b09b-d1bf6a5eb56a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051828 Oct 02 01:04:33.115871 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 497/1006] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:33.517256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:33.520116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:33.525834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-94e79a28-4fdb-451d-a532-9838db5b5bf0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3/action" status: 202 len: 0 microversion: 2.25 time: 2.196566 Oct 02 01:04:33.529618 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 510/1007] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:04:31 2022] POST /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3/action => generated 0 bytes in 2198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:04:33.529769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.530157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.530621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.531376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.531842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.532273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.544706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:33.547959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:33.578015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.581053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.583125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.584677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.587499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.590965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.634148 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:33.872325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:33.880204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6cecd5b2-37e6-4446-ba40-a1cdbc3bf76d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1475 microversion: 2.1 time: 0.376525 Oct 02 01:04:33.880790 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 498/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:33 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:33.906221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:33.920269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:33.927745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:33.929304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5cd294cf-311b-4809-b4e2-51f7620e146d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.398668 Oct 02 01:04:33.929894 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 511/1009] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:33 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:33.947395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:33.948644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:33.955563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.956351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.957003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:33.958299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:33.959459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:33.959929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.053069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb881542820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.056849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.057479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.058116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.058870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.059323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.059750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.085697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6aed8c9a-128b-4480-a821-1984e698106a tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.203563 Oct 02 01:04:34.086831 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 499/1010] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:04:33 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:34.092464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7a2f4d3-ba56-459f-ad0f-2fda0c892f70 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8814b2940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.137745 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7a2f4d3-ba56-459f-ad0f-2fda0c892f70 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.049550 Oct 02 01:04:34.138641 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 500/1011] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:34.143300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb881bc4550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.146828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.147304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.147737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.148469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.148896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.149311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.176022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05e65b59-cd61-4475-97c7-405c2be08a22 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.036584 Oct 02 01:04:34.176625 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 501/1012] 10.222.0.23 () {58 vars in 1139 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:34.187764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb881542700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.191590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.191773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.192206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.192918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.193365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.193782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.197722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:34.205851 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4d508c2b-b694-44c2-b520-652fddae865a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.274064 Oct 02 01:04:34.206750 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 512/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:33 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:34.218241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17be9193-530d-47f9-84d8-fe04c9a9b5b5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.033879 Oct 02 01:04:34.219091 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 502/1014] 10.222.0.23 () {58 vars in 1145 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:04:34.231514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb881412820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.234956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.235440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.235877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.236813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.237277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.237711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.264184 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b3452df-46ed-450d-a440-ad7ecb06b81d tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.036081 Oct 02 01:04:34.264705 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 513/1015] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:34.275688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb88158f9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.279152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.279629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.280060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.281492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.281929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.282533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.309790 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-902eb2e0-1185-41a0-b793-85f92dd1f0e8 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.037580 Oct 02 01:04:34.310422 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 503/1016] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:34.322399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb8813b6790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.326115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.326704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.327136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.328126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.328595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.329018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.354440 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5f414d89-0767-47d6-9cfa-e1f9e40024f0 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.035851 Oct 02 01:04:34.355377 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 514/1017] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:34.365327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb881542790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.372162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.372643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.373079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.386331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.386848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.387399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.417439 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0321818e-f197-4e19-902e-343bb8e1145f tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 860 microversion: 2.1 time: 0.055825 Oct 02 01:04:34.418012 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 504/1018] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 860 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:34.427505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Calling method '.version_select at 0x7fb8814128b0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.434691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.435258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.435797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.448638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.449207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.449716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.479137 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-08ca8f75-7451-419a-b57b-250afedb8ce5 tempest-HostsAdminTestJSON-1444570874 tempest-HostsAdminTestJSON-1444570874-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 1121 microversion: 2.1 time: 0.055532 Oct 02 01:04:34.479731 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 515/1019] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 1121 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:34.958305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.959529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:34.969027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:34.969821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:34.985805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.987153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.987668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.988797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.989108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.989518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.989723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.990165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.990304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:34.991029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:34.991553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:34.992093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:35.371222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:35.380698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:35.384442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:35.384780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:35.385990 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7fb51c09-c542-4daa-b4e3-b324f8712969 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.432548 Oct 02 01:04:35.386559 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 505/1020] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:35.401998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3", "tag": "34aae495-9601-4a7f-99a5-d4398c461a60"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:35.404400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f64b9070-a32a-41ef-8811-aa05fd66baf3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1473 microversion: 2.1 time: 0.442995 Oct 02 01:04:35.405462 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 516/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:34 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:35.411558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ffd92382-b0f4-4467-8a4e-6d236379cc78 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8813b6dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:35.415998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:35.416768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:35.417673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:35.424891 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:35.435133 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] Creating event network-changed:34aae495-9601-4a7f-99a5-d4398c461a60 for instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 on n-h1-master-1 Oct 02 01:04:35.442624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:04:35.454356 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e31fde54-90df-4306-bb01-6c478092e662 req-d8737b4a-1d67-4952-8fae-e22bb84a2b70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066230 Oct 02 01:04:35.455234 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 506/1022] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:35.461004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "name": "network-vif-plugged", "status": "completed", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}, {"server_uuid": "8dd5fc9e-d301-46f7-b01c-80b93bbb172b", "name": "network-vif-plugged", "status": "completed", "tag": "b58f567d-6585-487c-aff1-48b1fa50116d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:35.463043 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ffd92382-b0f4-4467-8a4e-6d236379cc78 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.055935 Oct 02 01:04:35.463564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 517/1023] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:35 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:35.468844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:35.469697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:35.477095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:35.477596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:35.478074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:35.478222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:35.478658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:35.478873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:35.479097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:35.479555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:35.479988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:35.495316 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] Creating event network-vif-plugged:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:04:35.495823 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] Creating event network-vif-plugged:b58f567d-6585-487c-aff1-48b1fa50116d for instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b on n-h2-master-1 Oct 02 01:04:35.528434 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a23f6d93-eee5-4b20-80d1-20e4136e86c0 req-cb6670d0-f4a3-43c2-b341-6df86dedb7e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071588 Oct 02 01:04:35.529046 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 507/1024] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:35.664907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:35.673154 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99d8a9f2-a88a-4b03-a72b-f359e725cb5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.208432 Oct 02 01:04:35.674263 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 518/1025] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:35 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:36.412379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:36.413090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:36.420630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.421186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.421696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.422519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.424934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.425457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.431344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:36.432903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:36.441314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.442324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.443676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.445404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.447203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.447993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.746570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:36.753056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:36.762144 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:36.763636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:36.764802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5fac6ec9-9b33-4420-a5e4-9e18d70c5733 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.357197 Oct 02 01:04:36.765356 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 508/1026] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:36 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:36.785736 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5161b7d-c8d6-46fe-b509-327e1fc2e671 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881496ca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:36.787087 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99bcc3f7-0848-4f4a-a1b9-5a43efe08705 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1473 microversion: 2.1 time: 0.360476 Oct 02 01:04:36.797768 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 519/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:36 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1473 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:36.807206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:36.808439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:36.820225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.820722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.821162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.822460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:36.823038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:36.823369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:36.866559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5161b7d-c8d6-46fe-b509-327e1fc2e671 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.089749 Oct 02 01:04:36.868002 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 509/1028] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:36 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:37.075890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:37.089011 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18370452-f88b-47c1-b3b3-eb903343faae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1318 microversion: 2.1 time: 0.284320 Oct 02 01:04:37.089829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 520/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:36 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:37.472391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d0527-6134-4260-829e-1a3c714713a3", "name": "network-vif-unplugged", "status": "completed", "tag": "328c8fa1-2bb1-40ea-89ce-8c35f58d851e"}, {"name": "network-changed", "server_uuid": "5d8d0527-6134-4260-829e-1a3c714713a3", "tag": "328c8fa1-2bb1-40ea-89ce-8c35f58d851e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:37.483857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.484334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.484769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.495750 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] Creating event network-vif-unplugged:328c8fa1-2bb1-40ea-89ce-8c35f58d851e for instance 5d8d0527-6134-4260-829e-1a3c714713a3 on n-h1-master-1 Oct 02 01:04:37.496203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] Creating event network-changed:328c8fa1-2bb1-40ea-89ce-8c35f58d851e for instance 5d8d0527-6134-4260-829e-1a3c714713a3 on n-h1-master-1 Oct 02 01:04:37.501184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-122e9f1d-1d0c-4166-bd1f-df2d1d71a182 req-b9e3a22f-eb2a-4d89-9b36-1f2cf00c29ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.033132 Oct 02 01:04:37.503883 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 510/1030] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:37.791761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:37.792495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:37.800246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.800843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.804476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.804476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.804476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.804476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.938543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Action: 'update', calling method: .version_select at 0x7fb881451790>, body: {"quota_set": {"ram": "5120"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:37.950348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:37.959586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:37.961033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:37.962209 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4af42c6b-b000-4428-a83f-475ecc0ece64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.174515 Oct 02 01:04:37.962993 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 521/1031] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:37 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:37.967839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:37.968443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:37.976092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.976901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.977477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:37.978312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:37.979013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:37.979580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.004774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.005338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.005836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.006665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.007187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.007675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.064717 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e6fe3d7-3e63-458e-b134-ae83f461d46e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409" status: 200 len: 240 microversion: 2.36 time: 0.258698 Oct 02 01:04:38.071328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 511/1032] 10.222.0.23 () {62 vars in 1303 bytes} [Sun Oct 2 01:04:37 2022] PUT /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409 => generated 240 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:04:38.071328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd31ab5a-3efb-45b2-9140-0ae2b24237b8 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881525c10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.115940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd31ab5a-3efb-45b2-9140-0ae2b24237b8 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.049336 Oct 02 01:04:38.116714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 512/1033] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:38.123113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Calling method '.version_select at 0x7fb881451ca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.173806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.182456 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e4c0c05-a258-4470-911b-8b9a506018bb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1473 microversion: 2.1 time: 0.217982 Oct 02 01:04:38.183205 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 522/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:37 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:38.189202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.189809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.190412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.191159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.191268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.191611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.191918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:38.192032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.202097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.202591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.203077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.203780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.204247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.205368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.211591 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aabd963f-7302-4e9b-903c-4f415d0fbb67 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409/detail" status: 200 len: 672 microversion: 2.36 time: 0.091956 Oct 02 01:04:38.212195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 513/1035] 10.222.0.23 () {60 vars in 1304 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409/detail => generated 672 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:04:38.346062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.356939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Action: 'update', calling method: .version_select at 0x7fb88146db80>, body: {"quota_set": {"ram": "2048"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:38.357374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bac396f4-9b79-4cff-a5d4-21a5d00a5780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1468 microversion: 2.1 time: 0.173089 Oct 02 01:04:38.357951 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 523/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1468 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:38.379952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.380564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:38.386351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.386864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.387306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.388001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.388456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.388880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.421967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.422449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.423009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.424288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.425037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.425519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.461405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.461878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.462313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.463066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.463520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.463943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.500557 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SAVEPOINT=3,nova_api:INSERT=3,nova_api:RELEASE=3,nova_api:SELECT=91 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:38.522507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.529070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf723d2b-2af1-4805-807c-ce9fca35d6f0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409?user_id=363fc8ffd3164fd0b9a4df84a1cec92b" status: 200 len: 240 microversion: 2.36 time: 0.175771 Oct 02 01:04:38.529722 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 514/1037] 10.222.0.23 () {62 vars in 1384 bytes} [Sun Oct 2 01:04:38 2022] PUT /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409?user_id=363fc8ffd3164fd0b9a4df84a1cec92b => generated 240 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:04:38.536446 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-baa4794b-e34c-4812-9fcb-c7b58135b6dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7" status: 200 len: 1467 microversion: 2.1 time: 0.160757 Oct 02 01:04:38.537038 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 524/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:38.541970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5eb41d2a-6f8e-40f2-9b4e-b29cc451cc70 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Calling method '.version_select at 0x7fb881451700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.558350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.563819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.565478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Searching by: {'reservation_id': 'r-0w7g9fr6', 'deleted': False, 'project_id': '70c6b40e739146e8b98b38971b879e85'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:04:38.573486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.573921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.574552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.575488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.575948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.576383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.628797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5eb41d2a-6f8e-40f2-9b4e-b29cc451cc70 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409?user_id=363fc8ffd3164fd0b9a4df84a1cec92b" status: 200 len: 282 microversion: 2.36 time: 0.090758 Oct 02 01:04:38.629387 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 515/1039] 10.222.0.23 () {60 vars in 1364 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/os-quota-sets/7705fae231a044baa1e171de04cca409?user_id=363fc8ffd3164fd0b9a4df84a1cec92b => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:04:38.738106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:04:38.843554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:38.858104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:38.858724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:38.859243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:38.988766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:38.989506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:39.004445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.005223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.005828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.006805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.007410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.007984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.197720 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d933d4fc-3486-467c-b899-7aff1e9d2ebb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-0w7g9fr6" status: 200 len: 2928 microversion: 2.1 time: 0.641437 Oct 02 01:04:39.199140 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 525/1040] 10.222.0.23 () {58 vars in 1197 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0w7g9fr6 => generated 2928 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:39.215284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8cbe250d-faed-4b13-8176-9611a128ebdc tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88150e670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:39.272958 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8cbe250d-faed-4b13-8176-9611a128ebdc tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.072114 Oct 02 01:04:39.273704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 526/1041] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:39 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:39.291767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:39.292938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:39.301192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.301791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.302362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.304534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.305531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.306485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.422840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:39.432961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:39.434974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:39.436593 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63d20ac3-3ee5-4cf8-bc42-0d1085b485de tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.452556 Oct 02 01:04:39.451717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 516/1042] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:38 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:04:39.464267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e9d665c-af5a-4e77-8352-e6c435e97780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:39.546101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.compute.server_groups [None req-0e9d665c-af5a-4e77-8352-e6c435e97780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Querying cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) for 2 instances {{(pid=122354) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 02 01:04:39.557793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e9d665c-af5a-4e77-8352-e6c435e97780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.558380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e9d665c-af5a-4e77-8352-e6c435e97780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.558858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e9d665c-af5a-4e77-8352-e6c435e97780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.644702 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e9d665c-af5a-4e77-8352-e6c435e97780 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/23f2eb95-85c2-4c3b-9c8a-3b01b3751d28" status: 200 len: 266 microversion: 2.1 time: 0.205967 Oct 02 01:04:39.646796 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 517/1043] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:04:39 2022] GET /compute/v2.1/os-server-groups/23f2eb95-85c2-4c3b-9c8a-3b01b3751d28 => generated 266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:39.666154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:39.667636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:39.684613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.693562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.694202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.695169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.695936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.696616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.773526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:39.784175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f0e687e-53a9-462b-875f-4a3ff35cd217 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1470 microversion: 2.1 time: 0.506905 Oct 02 01:04:39.785899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 527/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:39 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:39.808403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:39.809147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:39.816942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.817414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.821411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.822436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.823142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.823639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.996553 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-51e942de-0c9a-4c80-8e53-70740fbf0daf tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3/action" status: 204 len: 0 microversion: 2.1 time: 0.192254 Oct 02 01:04:40.004067 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 528/1045] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:04:39 2022] POST /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:04:40.021617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:40.022337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:40.051976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.052832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.053278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.053998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.054471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.054928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.079114 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:40.204627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a44453a-9f8a-494a-8735-8190c91ab290 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1619 microversion: 2.1 time: 0.549092 Oct 02 01:04:40.210044 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 518/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:39 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1619 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:40.240266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:40.241379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:40.255788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.261776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.265020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.265961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.269776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.272936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.476572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:40.489125 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d2814a66-264a-4425-b0a1-342c5401dbe3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1470 microversion: 2.1 time: 0.475464 Oct 02 01:04:40.490163 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 529/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:40 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1470 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:40.503706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-102d6ecd-8102-4620-9bbb-b4c5518c121a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812e7ca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:40.590632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-102d6ecd-8102-4620-9bbb-b4c5518c121a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.098954 Oct 02 01:04:40.591916 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 530/1048] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:40 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:40.602147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:40.603097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:40.628179 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eba77a2c-2974-4fb3-86d5-9fa635514f5a tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7" status: 200 len: 1618 microversion: 2.1 time: 0.392318 Oct 02 01:04:40.629113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 519/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:40 2022] GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 => generated 1618 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:40.662171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba923869-ba79-4dbd-81c6-3c6f9e8c23d6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: .version_select at 0x7fb8814b2550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1758350043", "policies": ["anti-affinity"]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:40.670977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.670977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.670977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.687884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.691231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.691610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.718208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ba923869-ba79-4dbd-81c6-3c6f9e8c23d6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:40.733868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ba923869-ba79-4dbd-81c6-3c6f9e8c23d6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:40.847539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ba923869-ba79-4dbd-81c6-3c6f9e8c23d6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:40.859250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ba923869-ba79-4dbd-81c6-3c6f9e8c23d6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:40.894515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba923869-ba79-4dbd-81c6-3c6f9e8c23d6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.238461 Oct 02 01:04:40.896705 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 520/1050] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:04:40 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:41.071787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:41.086158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:41.095057 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:41.097339 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8985e12a-54da-48f9-885a-3bd76ee82042 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.504559 Oct 02 01:04:41.098572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1409452046", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "66e4e734-fbf6-4302-802b-d7bc44a8b6ac"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:41.103449 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 531/1051] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:40 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:41.193397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:41.518658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:41.519334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:41.531176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:41.531705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:41.532185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:41.533441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:41.533928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:41.536018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.113882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:42.133449 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ee67687-d880-475f-9ae4-68cf58d8f62d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1470 microversion: 2.1 time: 0.619345 Oct 02 01:04:42.134638 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 532/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:41 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1470 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:42.144474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0a14a373-31db-45ac-8821-abc7002d4024 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812e7dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:42.244844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0a14a373-31db-45ac-8821-abc7002d4024 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.108690 Oct 02 01:04:42.245454 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 533/1053] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:42 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:42.259797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3", "name": "network-vif-plugged", "status": "completed", "tag": "34aae495-9601-4a7f-99a5-d4398c461a60"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:42.339037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.344724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.345450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.390574 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] Creating event network-vif-plugged:34aae495-9601-4a7f-99a5-d4398c461a60 for instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 on n-h1-master-1 Oct 02 01:04:42.400711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:04:42.448155 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c408f64e-8d99-473e-91a4-28222d176080 req-4509be11-774f-4968-9ee1-24fb41e74936 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200678 Oct 02 01:04:42.456662 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 534/1054] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:42.462276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:42.479173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:42.510635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.511383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.511987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.515665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.516329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.517243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.611493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:42.612455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:42.612931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:42.613479 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:42.613897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:42.645691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.646212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.646675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.647396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:42.647853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:42.648279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:42.696248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:42.713677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:42.749970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Going to run 2 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:42.752858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:42.868451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122354) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 02 01:04:42.914373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:42.934128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:43.031326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:43.038720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:43.061152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=4daebd58-0e5e-4267-b2f7-dbd74eb96e14,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:43.131085 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:43.145403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:43.152676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:43.154081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:43.166185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:43.172244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:43.176152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-854c79b3-4900-479e-85f6-4f26a85e2cb6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.718086 Oct 02 01:04:43.176965 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 535/1055] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:42 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:43.213528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:43.214422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:43.217200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:43.225146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.225643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.226079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.226929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.227385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.227706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:43.227830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.274259 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4fa34d67-c26d-466c-bf91-044da6b7b418 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.180711 Oct 02 01:04:43.277601 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 521/1056] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 2183 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 02 01:04:43.280003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3238a2f3-eaa1-4007-96b7-1489d05ebf58 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881451790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:43.340867 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3238a2f3-eaa1-4007-96b7-1489d05ebf58 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.064737 Oct 02 01:04:43.341881 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 522/1057] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:43 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:43.356354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:43.363334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:43.364423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Searching by: {'deleted': False, 'project_id': '70c6b40e739146e8b98b38971b879e85'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:04:43.409683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.411299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.412671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.414112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.418459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.419212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.594219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:04:43.607335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:43.619114 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a08acf87-a627-4f49-a5b7-e8bad88052e5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1470 microversion: 2.1 time: 0.422909 Oct 02 01:04:43.622259 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 536/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:43 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:43.639147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2de53d5-9f32-4d2c-8e18-bd34841ca158"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:43.644925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:43.660260 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:43.664640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.666501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.667005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.667727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:43.669819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:43.671033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:43.788709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49278812-7f2e-44d5-8451-d89438a77e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.432899 Oct 02 01:04:43.799250 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 523/1059] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:04:43 2022] GET /compute/v2.1/servers => generated 1663 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:43.821109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-981aca9b-42b3-4238-bc85-6df6408c64bf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:43.821847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-981aca9b-42b3-4238-bc85-6df6408c64bf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:43.953689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-981aca9b-42b3-4238-bc85-6df6408c64bf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:43.969166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-981aca9b-42b3-4238-bc85-6df6408c64bf tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1219 microversion: 2.1 time: 0.166935 Oct 02 01:04:43.974847 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 524/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:43 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:44.210145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:44.211012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:44.219475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.219974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.223736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.227552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.231506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.233393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.432436 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b11608f-9909-4481-b6c8-efce2533d4d1 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "POST /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807445 Oct 02 01:04:44.433084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 537/1061] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:43 2022] POST /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:44.448453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bffc842b-7b38-4041-b947-d43de4c3f26d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881210c10>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:44.569394 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bffc842b-7b38-4041-b947-d43de4c3f26d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.135092 Oct 02 01:04:44.569985 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 538/1062] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:44 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:44.594191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:44.604674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:44.617940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:44.619211 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-553e9849-0528-4d9f-8589-00daa43ccf3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.415819 Oct 02 01:04:44.625281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 525/1063] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:44 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:04:44.650130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:44.651419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:44.676373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.676865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.677303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.678123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.678569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.680140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.952740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:44.987728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.988513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.989127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:44.992643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:44.993286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:44.993917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.030559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec36da9c-f12c-48a3-9dca-72c987dab8da tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.374599 Oct 02 01:04:45.031490 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 526/1064] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:04:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:45.038386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-00cc60e7-c89c-4637-8d56-f36677d91128 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.039476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-00cc60e7-c89c-4637-8d56-f36677d91128 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:45.184855 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-00cc60e7-c89c-4637-8d56-f36677d91128 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:45.198060 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-00cc60e7-c89c-4637-8d56-f36677d91128 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1219 microversion: 2.1 time: 0.165277 Oct 02 01:04:45.203948 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 527/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:45.225070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.229807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.230540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.231415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.232375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.233184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.234003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.271285 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-caee9fa4-792c-4539-9446-d769624c106c tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.054804 Oct 02 01:04:45.272133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 528/1066] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:45.307879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.326210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.326875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.327409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.328228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.328954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.329646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.394172 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-78e14b8a-82b7-4d50-aea0-7fa92e9379bc tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091656 Oct 02 01:04:45.395211 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 529/1067] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:45.408222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.417376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.421048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.421904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.422939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.424173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.424955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.452723 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-481bc4b7-8575-4b9e-af0a-b1c0b8d0e659 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.048916 Oct 02 01:04:45.453969 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 530/1068] 10.222.0.23 () {58 vars in 1194 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:04:45.468412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.472819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.481329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.482134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.483398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.484067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.484733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.522154 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a06e896-e3e7-4b51-9b31-2bb3a14cb072 tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.057592 Oct 02 01:04:45.523714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 531/1069] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:45.539635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:45.542259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.550460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.551193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.551930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.552944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.553624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.554339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.559834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0804a4d3-9091-4dee-ac1c-85938991fff1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1462 microversion: 2.1 time: 0.912551 Oct 02 01:04:45.561356 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 539/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:44 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1462 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:45.585900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.586870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:45.612990 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7bafff7-0e5d-4c97-aa7f-b3a1d4b0dd1a tempest-ServicesAdminNegativeTestJSON-851381192 tempest-ServicesAdminNegativeTestJSON-851381192-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.080522 Oct 02 01:04:45.622166 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 532/1071] 10.222.0.23 () {58 vars in 1198 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:04:45.623167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d31b1815-6cc0-448e-8d0b-22393e413e08 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881451ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.630945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.633914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.648467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.649245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:45.649733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:45.650207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:45.712506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d31b1815-6cc0-448e-8d0b-22393e413e08 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.097832 Oct 02 01:04:45.713432 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 533/1072] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:45.952752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-270e830e-81d9-4724-960a-05907c73f7a0 tempest-ServicesAdminNegativeTestJSON-792173903 tempest-ServicesAdminNegativeTestJSON-792173903-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:45.957401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-270e830e-81d9-4724-960a-05907c73f7a0 tempest-ServicesAdminNegativeTestJSON-792173903 tempest-ServicesAdminNegativeTestJSON-792173903-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '747cf596ed8b41f4b6b81c0833a870d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ce2e8af02c45ad944c5c987f48415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-270e830e-81d9-4724-960a-05907c73f7a0 tempest-ServicesAdminNegativeTestJSON-792173903 tempest-ServicesAdminNegativeTestJSON-792173903-project] Request method failure captured: Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOrmTr8HSF1ocxASh-ZJrrA6FnXGobBInqXq2dgMrtIjYz2Cj1B0mJGpyldBFGzMwepNXDMfQy0fucW6xRRya2YJOTAyOuVdlqjWnhtArOUhnx7TE67gSXYh8O0SYGKJ5M8wQ5JYqoW2YH_ww55FP2xwoJfxFJmU6y48SpSDppH1V4 Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b0ce2e8af02c45ad944c5c987f48415a Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-792173903 Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:04:45.972396 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0ce2e8af02c45ad944c5c987f48415a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0ce2e8af02c45ad944c5c987f48415a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0ce2e8af02c45ad944c5c987f48415a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0ce2e8af02c45ad944c5c987f48415a"}]}] Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-792173903 Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b0ce2e8af02c45ad944c5c987f48415a Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-792173903 Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServicesAdminNegativeTestJSON-792173903-project Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 747cf596ed8b41f4b6b81c0833a870d1 Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-792173903-project Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 02 01:04:45.973798 n-d-master-1 devstack@n-api.service[122354]: action_args: {} Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:04:45.974564 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 02 01:04:45.975750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:04:45.979925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-270e830e-81d9-4724-960a-05907c73f7a0 tempest-ServicesAdminNegativeTestJSON-792173903 tempest-ServicesAdminNegativeTestJSON-792173903-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:45.980912 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-270e830e-81d9-4724-960a-05907c73f7a0 tempest-ServicesAdminNegativeTestJSON-792173903 tempest-ServicesAdminNegativeTestJSON-792173903-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.266706 Oct 02 01:04:45.989406 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 534/1073] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:46.000653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:46.001283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:46.034281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.040098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.040854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.044631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.047841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.048516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.270376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:46.280633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e81eae1-ba78-4671-9030-fed720771fc0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1462 microversion: 2.1 time: 0.699136 Oct 02 01:04:46.295246 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 540/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1462 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:46.310695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:46.311842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:46.319326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.320167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.320770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.321664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:46.322296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:46.322934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:46.491714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:46.503301 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f167ed4c-a393-4342-99b6-95f4e2040d17 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1271 microversion: 2.1 time: 0.204473 Oct 02 01:04:46.506746 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 541/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:46 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:46.531372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09df34fe-132e-4848-80c6-b9fcf9aa36ca tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'create', calling method: .version_select at 0x7fb8811b8430>, body: {"keypair": {"name": "tempest-keypair-706782710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNukVMfAJbyxlpvE7b3Thm8sILVNv8Mn4yfP4evSzzI8NXORG5M8+i4ymqT1OvdQbDgnnXz+eHxPaurNHFH4DmtZHjxMgtZqn5buvVwpQcO5Wyhp7GQ+vtGcQpMn4Q0VPg=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:46.561205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:46.573370 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:46.574839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:46.576010 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65b580c5-0613-4810-94bd-8b88c4db61b8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1566 microversion: 2.25 time: 0.587516 Oct 02 01:04:46.587494 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 535/1076] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:45 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1566 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:46.599912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-09df34fe-132e-4848-80c6-b9fcf9aa36ca tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for project c0e072a3f56045949210c8d4452298ce. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:46.610294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-09df34fe-132e-4848-80c6-b9fcf9aa36ca tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for user 739083b66f9b433889944e555b0aef23 and project c0e072a3f56045949210c8d4452298ce. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:46.730760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58ee4f21-e39c-4635-9d92-c07c665fefc6 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881451ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:46.813317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09df34fe-132e-4848-80c6-b9fcf9aa36ca tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.304374 Oct 02 01:04:46.816905 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 542/1077] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:04:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:46.870040 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58ee4f21-e39c-4635-9d92-c07c665fefc6 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.144571 Oct 02 01:04:46.872092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 536/1078] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:46 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:47.536919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:47.538714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:47.569967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:47.570811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:47.571369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:47.575120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:47.576395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:47.581694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:47.615378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:47.616297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:47.654911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:47.655634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:47.661037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:47.678761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:47.679470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:47.693822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:47.918944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:47.938534 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c5b6871-fa9d-4071-9f0e-296b19261b5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1277 microversion: 2.1 time: 0.411979 Oct 02 01:04:47.940772 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 543/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:47 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1277 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:47.953396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae97f640-2134-4413-963a-72b100aac58f tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811b83a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:48.030071 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae97f640-2134-4413-963a-72b100aac58f tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.087457 Oct 02 01:04:48.039945 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 544/1080] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:47 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:48.267274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:48.285770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:48.293295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:48.294497 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-323ecd9e-4233-492d-96e9-31daafede1ff tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1541 microversion: 2.25 time: 0.693060 Oct 02 01:04:48.297706 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 537/1081] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:47 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1541 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:48.327662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2724aab-4094-4f96-af89-3832b532f64a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '.version_select at 0x7fb8811b8dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:48.331214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2724aab-4094-4f96-af89-3832b532f64a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:48.331709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2724aab-4094-4f96-af89-3832b532f64a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:48.332164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2724aab-4094-4f96-af89-3832b532f64a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:48.358053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2724aab-4094-4f96-af89-3832b532f64a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.034132 Oct 02 01:04:48.359051 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 545/1082] 10.222.0.23 () {60 vars in 1184 bytes} [Sun Oct 2 01:04:48 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:48.375762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:48.377571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:48.386414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:48.391035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:48.391670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:48.392691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:48.393409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:48.393999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:48.965430 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:48.972326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:48.974748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:49.010673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.011333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.014456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.015318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.015811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.016259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.583770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:49.615513 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22d89221-501c-4898-b8f7-c25c5ed8063c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1277 microversion: 2.1 time: 0.649985 Oct 02 01:04:49.631294 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 546/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:48 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1277 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:49.649925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7314b3b-0809-4f50-a12d-de1975868705 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811b8940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:49.756603 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7314b3b-0809-4f50-a12d-de1975868705 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.137279 Oct 02 01:04:49.758663 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 547/1084] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:49 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:49.765228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:49.768539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:49.786667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 5d8d0527-6134-4260-829e-1a3c714713a3 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:49.798024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.799587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.802043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.803537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.804607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.806513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.874402 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3367160-8536-4719-bf6c-ec14e5f9267f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 2033 microversion: 2.25 time: 1.500964 Oct 02 01:04:49.879849 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 538/1085] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:48 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 2033 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:49.914415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae732d63-bb7b-48bf-bf3b-c098881a8c2d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Action: 'create', calling method: .version_select at 0x7fb8813b69d0>, body: {"keypair": {"name": "tempest-keypair-1891448116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqRfJ6S+1z/YsezBf/byhdNRjFnmKoZW5xLbjoR9kJc7z93CCluqqR3yzTZ6AQDonCdLfQxwQ9AJV/MX7QtNTPBAuQz/9lGIM0QSW+1/D50Ld5ljRPuatt3Q2Y5s4j6dQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:49.968420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ae732d63-bb7b-48bf-bf3b-c098881a8c2d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:49.993357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ae732d63-bb7b-48bf-bf3b-c098881a8c2d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for user d44f8d053e07440699d217cd63c94d0d and project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:50.065939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae732d63-bb7b-48bf-bf3b-c098881a8c2d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.157346 Oct 02 01:04:50.068082 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 539/1086] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:04:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:04:50.493108 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7004bdf8-602d-4b62-ba8c-cf58737b9e10 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1812 microversion: 2.1 time: 0.732997 Oct 02 01:04:50.500558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 548/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:49 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1812 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:50.536724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.551370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.553119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.558256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.562075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.566191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.570788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.644683 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06d8d3a3-d1bd-4662-a3d4-8f132634ab33 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '.version_select at 0x7fb8811c6d30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.649518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06d8d3a3-d1bd-4662-a3d4-8f132634ab33 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.651398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06d8d3a3-d1bd-4662-a3d4-8f132634ab33 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.651715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06d8d3a3-d1bd-4662-a3d4-8f132634ab33 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.670282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06d8d3a3-d1bd-4662-a3d4-8f132634ab33 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.032281 Oct 02 01:04:50.671761 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 549/1088] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:50.678190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.679194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:50.686267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.687211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.688144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.689783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.690634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.691576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.729891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42b0a418-d920-424f-bb28-442bd386f174 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.204906 Oct 02 01:04:50.735446 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 540/1089] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:50.771414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ae90c09-1772-4247-ab14-173c14f1926c tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.789802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ae90c09-1772-4247-ab14-173c14f1926c tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052393 Oct 02 01:04:50.791095 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 541/1090] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:50.797312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e79f9290-6f23-40ee-b000-787a9c36596a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812bfe50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.900304 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e79f9290-6f23-40ee-b000-787a9c36596a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.104825 Oct 02 01:04:50.951644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 542/1091] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:50.991121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1025f858-0e31-4b64-9407-ff484347187e tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-59282506", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:51.035193 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1025f858-0e31-4b64-9407-ff484347187e tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.081909 Oct 02 01:04:51.037562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 543/1092] 10.222.0.23 () {60 vars in 1146 bytes} [Sun Oct 2 01:04:50 2022] POST /compute/v2.1/flavors => generated 497 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:51.051629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7dc0a21b-d823-4ef8-bd97-763d86af6513 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:51.062087 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7dc0a21b-d823-4ef8-bd97-763d86af6513 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016250 Oct 02 01:04:51.063239 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 544/1093] 10.222.0.23 () {58 vars in 1182 bytes} [Sun Oct 2 01:04:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:04:51.259546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-674113408", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "bbacc0d8-b993-43c1-a245-13ed6552ed58"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:51.365199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:52.318011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:52.331336 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4e0ecaa-05f4-401c-8d03-740b3a32ecdb tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 1.653742 Oct 02 01:04:52.347053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 550/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:52.364513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87cb672a-6cdf-4fec-b875-8564c0d198db tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812044c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:52.418487 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87cb672a-6cdf-4fec-b875-8564c0d198db tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.069551 Oct 02 01:04:52.419601 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 551/1095] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:52 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:52.731881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:52.732489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:52.732793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:52.733268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:52.733734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:52.771030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:52.771787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:52.772669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:52.773774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:52.776982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:52.777781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:52.860010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:52.886131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for user 739083b66f9b433889944e555b0aef23 and project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:52.938263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:52.948297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:52.977133 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:53.100754 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b974e256-f93c-4e08-9f1f-48a50fecb9e8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846390 Oct 02 01:04:53.108295 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 545/1096] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:04:53.117710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43f25320-ebde-4a92-9b5a-a25afa69cc6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:53.125613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43f25320-ebde-4a92-9b5a-a25afa69cc6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:53.313524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43f25320-ebde-4a92-9b5a-a25afa69cc6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:53.322580 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43f25320-ebde-4a92-9b5a-a25afa69cc6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1278 microversion: 2.1 time: 0.213791 Oct 02 01:04:53.325030 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 552/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:53 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:53.361050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:53.361922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:53.373891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:53.375356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:53.377683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:53.378617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:53.381673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:53.382281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:53.416517 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:53.435574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50e22ca2-df5d-4527-998c-c266b344b6e0 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812040d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:53.509950 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50e22ca2-df5d-4527-998c-c266b344b6e0 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.078296 Oct 02 01:04:53.518356 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 553/1098] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:53 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:53.885784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1318559815", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:53.971391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:53.992789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:54.001829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-51b2ff7e-c138-4997-854d-44dc03762289 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.645547 Oct 02 01:04:54.002413 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 546/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:53 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:54.349236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:54.350026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:54.351980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:54.352972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:54.353835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:54.355109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:54.355912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:54.368573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.369542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.370868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.375600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.376913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.384127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.388697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.389145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.403031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.403031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.403031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.403031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.468233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Getting quotas for project 56d7664bcbb0489c83d28d36c57dc80f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:54.486757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Getting quotas for user 8151aecbbb284b71ba3fb42de244b870 and project 56d7664bcbb0489c83d28d36c57dc80f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:54.513605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:54.525725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:54.587546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:54.604065 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8343d7eb-d09a-491a-a40e-c1df5d210f83 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1274 microversion: 2.1 time: 0.258090 Oct 02 01:04:54.607259 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 547/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:54 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:54.630345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37f3a7a8-9e45-445f-9507-eeb0073a8bb4", "device": "/dev/xvdb"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:54.630587 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca5e72f4-1b65-437d-9778-4513899fd29d tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988533 Oct 02 01:04:54.639542 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 554/1101] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:04:54.644412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:54.653928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2bd3747-925a-4dcb-a9ec-a2f2cbd1d884 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881233670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:54.671024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.671522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.671961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.683683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.684055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.684512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.820856 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c2bd3747-925a-4dcb-a9ec-a2f2cbd1d884 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.179966 Oct 02 01:04:54.823579 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 555/1102] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:54 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:54.849081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7c803c82-c8d3-45d2-bbb6-e2d782eb6f57 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:54.852491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7c803c82-c8d3-45d2-bbb6-e2d782eb6f57 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:55.076105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7c803c82-c8d3-45d2-bbb6-e2d782eb6f57 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:55.085750 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7c803c82-c8d3-45d2-bbb6-e2d782eb6f57 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1214 microversion: 2.1 time: 0.261029 Oct 02 01:04:55.087236 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 556/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:54 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:55.092127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-617e245d-cc31-47cc-a44a-7743935b346e req-3a87f3d1-6797-4aea-ae5a-ecc66536df37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4daebd58-0e5e-4267-b2f7-dbd74eb96e14", "tag": "76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:55.109800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-617e245d-cc31-47cc-a44a-7743935b346e req-3a87f3d1-6797-4aea-ae5a-ecc66536df37 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.110474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-617e245d-cc31-47cc-a44a-7743935b346e req-3a87f3d1-6797-4aea-ae5a-ecc66536df37 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.112110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-617e245d-cc31-47cc-a44a-7743935b346e req-3a87f3d1-6797-4aea-ae5a-ecc66536df37 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.141264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-617e245d-cc31-47cc-a44a-7743935b346e req-3a87f3d1-6797-4aea-ae5a-ecc66536df37 service nova] Creating event network-changed:76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1 for instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 on n-h1-master-1 Oct 02 01:04:55.152054 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-617e245d-cc31-47cc-a44a-7743935b346e req-3a87f3d1-6797-4aea-ae5a-ecc66536df37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063399 Oct 02 01:04:55.158852 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 557/1104] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:55.165794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:55.169035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:55.183666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.187347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.188021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.189632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.190299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.194617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.507462 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0418671a-ebcd-4a56-8988-8c1bd9666b42 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "POST /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894456 Oct 02 01:04:55.508939 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 548/1105] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:54 2022] POST /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:55.524809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1426044643", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "9a195c53-3350-481b-9278-75a22d79ccc3"}], "security_groups": [{"name": "tempest-securitygroup--1977175838"}], "key_name": "tempest-keypair-1891448116", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:55.679346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:55.687255 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:55.690903 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3def0225-0d8e-4ac2-8b41-3ac6ec705635 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.530428 Oct 02 01:04:55.696777 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 558/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:55 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:55.705394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:55.712605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:55.733178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.733844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.734551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.736251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.737447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.738693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.949298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:55.968982 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de41d01a-cf7a-4eb8-b17e-78e96584673a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1348 microversion: 2.1 time: 0.270343 Oct 02 01:04:55.970947 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 559/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:55 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1348 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:55.980427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-020b6701-b87e-4760-bf3d-c6536c753442 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fec10>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:56.041941 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] validate_networks() for [('9a195c53-3350-481b-9278-75a22d79ccc3', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:56.048933 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-020b6701-b87e-4760-bf3d-c6536c753442 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.075660 Oct 02 01:04:56.050294 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 560/1108] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:55 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:56.119035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:56.120205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:56.137356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:56.138173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:56.139187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:56.140109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:56.142063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:56.144065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:56.327147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:56.347831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa01256e-2abb-4f77-944e-b6e042113ea2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1266 microversion: 2.1 time: 0.232344 Oct 02 01:04:56.365188 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 561/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:56 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:56.722194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:56.723889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:56.731837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:56.732644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:56.733332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:56.734270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:56.735134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:56.735867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.554049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:57.567063 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-041f753a-4e18-4443-99ee-eaad71d68951 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.849535 Oct 02 01:04:57.567665 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 562/1110] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:56 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:04:57.580629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:57.581179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:57.600731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.601449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.601989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.602749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.603215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.603648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.709723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:57.710844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:57.711766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:57.712349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:57.713008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:57.728868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.734054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.734898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.737543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.738681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.740527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.771633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:57.777310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:57.784787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for user d44f8d053e07440699d217cd63c94d0d and project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:57.785111 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac55b548-4aed-4191-b3f4-2b345390a342 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1336 microversion: 2.1 time: 0.213686 Oct 02 01:04:57.801757 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 563/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:57 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:57.823304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e0a469f2-053d-4943-9101-3afee1380508 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811ad280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:57.831809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:57.843039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:57.915017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e0a469f2-053d-4943-9101-3afee1380508 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.110650 Oct 02 01:04:57.924470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 564/1112] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:57 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:57.928955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:57.930784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:57.940677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.941184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.941966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.942903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.943421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.943848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:58.007009 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b240b8ae-47b2-410f-b9b8-0d83bb2b6b77 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.494224 Oct 02 01:04:58.015545 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 549/1113] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:04:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:04:58.030842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-412c7994-9d3e-4af6-889c-c283e84b7fff req-9f4964cc-882d-4741-b5de-12bd3f13fabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12ca6565-38b1-44a5-a691-6a98d464f163", "tag": "5753d52b-535b-4703-bf55-11b10217f5c3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:58.056179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-412c7994-9d3e-4af6-889c-c283e84b7fff req-9f4964cc-882d-4741-b5de-12bd3f13fabd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.059211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-412c7994-9d3e-4af6-889c-c283e84b7fff req-9f4964cc-882d-4741-b5de-12bd3f13fabd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.060005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-412c7994-9d3e-4af6-889c-c283e84b7fff req-9f4964cc-882d-4741-b5de-12bd3f13fabd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:58.078300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-412c7994-9d3e-4af6-889c-c283e84b7fff req-9f4964cc-882d-4741-b5de-12bd3f13fabd service nova] Creating event network-changed:5753d52b-535b-4703-bf55-11b10217f5c3 for instance 12ca6565-38b1-44a5-a691-6a98d464f163 on n-h2-master-1 Oct 02 01:04:58.084491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:58.095059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-412c7994-9d3e-4af6-889c-c283e84b7fff req-9f4964cc-882d-4741-b5de-12bd3f13fabd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075292 Oct 02 01:04:58.096524 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 550/1114] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:58.099355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b42e8f30-402e-4560-9cf7-582249b7e1a1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1274 microversion: 2.1 time: 0.179951 Oct 02 01:04:58.110805 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 565/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:57 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:58.111345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4dc37c98-4cee-42fe-8c42-979b19a51b8b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:58.111345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4dc37c98-4cee-42fe-8c42-979b19a51b8b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:58.169869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4dc37c98-4cee-42fe-8c42-979b19a51b8b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:58.190090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4dc37c98-4cee-42fe-8c42-979b19a51b8b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:58.191629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4dc37c98-4cee-42fe-8c42-979b19a51b8b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:58.192922 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4dc37c98-4cee-42fe-8c42-979b19a51b8b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1286 microversion: 2.25 time: 0.095167 Oct 02 01:04:58.217421 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 551/1116] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:58 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:04:58.592547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:58.593552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:58.609275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.611824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.613223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:58.615155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.617059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.618074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:58.811961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:58.812833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:58.839454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.847094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.847952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:58.851206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.854210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.857196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:59.277645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.286453 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-daa53591-73ff-4e43-ac71-590e31544f18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.699221 Oct 02 01:04:59.303312 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 566/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:58 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:59.308926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b38a7935-21fa-441d-a654-56a818d75edf tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fe4c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:59.387099 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b38a7935-21fa-441d-a654-56a818d75edf tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.082102 Oct 02 01:04:59.387704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 567/1118] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:59 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:59.401228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:59.407242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:59.420084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:59.420594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:59.421006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:59.429081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:59.434075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:59.434972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:59.470357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.480382 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd450a82-e7a0-4a2c-9979-07e9bb0ceac0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.675970 Oct 02 01:04:59.483257 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 552/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:58 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:59.492089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:59.495322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:59.506342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:59.507689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:59.508145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:59.509285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:59.509756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:59.510192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:59.568097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.580477 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac3a8164-e045-45f7-bb56-084d4b6ab730 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1274 microversion: 2.1 time: 0.191710 Oct 02 01:04:59.581441 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 568/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:59 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:59.612648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.636316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.637921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.639197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-31fc2c0e-612a-40d2-95e3-752f4bed47d7 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1290 microversion: 2.25 time: 0.154795 Oct 02 01:04:59.639780 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 553/1121] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:04:59 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1290 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:00.311580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:00.312924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:00.333670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.336441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.339028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.343186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.346026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.348289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.403475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96018099-756e-49b9-95fe-65554bffd141 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812a0f70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:00.477251 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96018099-756e-49b9-95fe-65554bffd141 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.078463 Oct 02 01:05:00.478151 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 554/1122] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:00 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:00.509758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:00.510469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:00.522704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.523375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.523920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.524897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.525500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.525947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.832610 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:00.855837 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50126d70-a897-4f6a-b6e7-fb43a3a54266 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.547861 Oct 02 01:05:00.856081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:00.856847 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 569/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:00 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:00.867381 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d076ee3e-9297-4b2a-9510-2be1c360ee09 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.358748 Oct 02 01:05:00.879201 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:00.880995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:00.883984 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 555/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:00 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:00.898094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.899164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:00.900164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.901320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.901970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:00.903312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.903931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.904513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.913213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.915452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.915452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.918710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.919203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.919728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.147802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:01.175730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:01.177585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:01.184904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13e3f254-b2e3-48b5-b384-01394da759b2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1282 microversion: 2.25 time: 0.297742 Oct 02 01:05:01.208029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 556/1125] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:00 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1282 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:01.232628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:01.250506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59ce9f2e-a200-4376-95b8-b4205012b0e1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1284 microversion: 2.1 time: 0.389969 Oct 02 01:05:01.262750 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 570/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:00 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1284 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:01.492705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca52c117-9b1f-4886-97d2-ec79f3a55b88 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812a0af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:01.554958 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca52c117-9b1f-4886-97d2-ec79f3a55b88 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1422 microversion: 2.1 time: 0.066155 Oct 02 01:05:01.555734 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 557/1127] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:01 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1422 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:01.694104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f8e17861-6ae9-45a7-bf9d-22411f182a73 req-cc642134-2255-465e-9dc8-e3c4506a5ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:01.706042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f8e17861-6ae9-45a7-bf9d-22411f182a73 req-cc642134-2255-465e-9dc8-e3c4506a5ea1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.706813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f8e17861-6ae9-45a7-bf9d-22411f182a73 req-cc642134-2255-465e-9dc8-e3c4506a5ea1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.707409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f8e17861-6ae9-45a7-bf9d-22411f182a73 req-cc642134-2255-465e-9dc8-e3c4506a5ea1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.719585 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f8e17861-6ae9-45a7-bf9d-22411f182a73 req-cc642134-2255-465e-9dc8-e3c4506a5ea1 service nova] Creating event network-changed:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h1-master-1 Oct 02 01:05:01.730229 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f8e17861-6ae9-45a7-bf9d-22411f182a73 req-cc642134-2255-465e-9dc8-e3c4506a5ea1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039526 Oct 02 01:05:01.731403 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 571/1128] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:01.883297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:01.884201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:01.896670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:01.897645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:01.904072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.907865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.908666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.909396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.910300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.910929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.911513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.916130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.916670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.917838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.920922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.921387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.199160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.221048 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9ef19ec-5555-405b-b20b-e9f79e0b5100 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.339898 Oct 02 01:05:02.221675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 558/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:01 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:02.236223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.238290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b48ffc84-5f28-4713-b3b4-c1c5672cfe51 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.345785 Oct 02 01:05:02.241154 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 572/1130] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:01 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:02.247288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:02.247997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:02.264669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.265552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.267547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.268530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.269096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.270252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.304559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:02.310448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:02.353863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.356365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.361390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.366417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.371584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.374689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.687713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.699469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.706236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.708896 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c00c3a33-21b5-44e1-a941-1ea6f3b9c373 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1282 microversion: 2.25 time: 0.482405 Oct 02 01:05:02.728504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.728504 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4cdc85c-c6d1-4c2c-9b38-a494d7aa01c1 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1284 microversion: 2.1 time: 0.455371 Oct 02 01:05:02.729712 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 559/1131] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:02 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1282 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:02.734391 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 573/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:02 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1284 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:02.738340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-575eac8e-4e17-42ea-b35f-fdc7f1e60e9d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881267550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:02.806335 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-575eac8e-4e17-42ea-b35f-fdc7f1e60e9d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1431 microversion: 2.1 time: 0.074576 Oct 02 01:05:02.811648 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 560/1133] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:02 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1431 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:02.825623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a14e9fa-f5ce-4b1e-b7ae-a13f12398795 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811c6e50>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:02.890161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a14e9fa-f5ce-4b1e-b7ae-a13f12398795 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 200 len: 1431 microversion: 2.1 time: 0.068494 Oct 02 01:05:02.891206 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 574/1134] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:02 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 1431 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:02.907616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:02.909110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:02.916395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.917325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.917923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.919157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.919794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.920920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.248191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.248806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.257214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.257715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.258156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.271009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.271709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.272379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.293301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.310627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5374d58-89d2-4e88-9f5c-127e91701a42 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1479 microversion: 2.1 time: 0.408306 Oct 02 01:05:03.311723 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 561/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:02 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1479 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:03.318475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.319492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.325539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.326581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.327270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.328213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.329902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.330574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.570166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.580537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.588444 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e2a8c65-28d7-4371-b37d-261718b00e46 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.275399 Oct 02 01:05:03.593484 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e37ee91e-ea93-47cd-8f53-52388db54239 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.349552 Oct 02 01:05:03.594409 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 562/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:03 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:03.611131 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 575/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:03 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:03.621249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-12769f96-ece3-4ee3-9f62-05b3d99f946e req-b503bb00-2a2e-4c88-aff4-9f56da772f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ca6565-38b1-44a5-a691-6a98d464f163", "name": "network-vif-plugged", "status": "completed", "tag": "5753d52b-535b-4703-bf55-11b10217f5c3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:03.623561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.631260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.641239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.644072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-12769f96-ece3-4ee3-9f62-05b3d99f946e req-b503bb00-2a2e-4c88-aff4-9f56da772f14 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.644947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.645637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.646580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.647376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-12769f96-ece3-4ee3-9f62-05b3d99f946e req-b503bb00-2a2e-4c88-aff4-9f56da772f14 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.648022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-12769f96-ece3-4ee3-9f62-05b3d99f946e req-b503bb00-2a2e-4c88-aff4-9f56da772f14 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.648754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.651962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.678333 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-12769f96-ece3-4ee3-9f62-05b3d99f946e req-b503bb00-2a2e-4c88-aff4-9f56da772f14 service nova] Creating event network-vif-plugged:5753d52b-535b-4703-bf55-11b10217f5c3 for instance 12ca6565-38b1-44a5-a691-6a98d464f163 on n-h2-master-1 Oct 02 01:05:03.686360 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-12769f96-ece3-4ee3-9f62-05b3d99f946e req-b503bb00-2a2e-4c88-aff4-9f56da772f14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068912 Oct 02 01:05:03.690806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 563/1138] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:03.707142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a73322e-9fe6-4886-9d6f-3cf2a3655b18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094592 Oct 02 01:05:03.708516 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 576/1139] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:03 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:03.720709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.722081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.729548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.730452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.731105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.731818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.732439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.733051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.743214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.743987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.751208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.751924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.752454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.753420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.754046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.754749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.840610 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.851278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.853106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.855183 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-293e61ae-5a46-4cea-8118-f956d8e54317 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1338 microversion: 2.25 time: 0.122895 Oct 02 01:05:03.871106 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 577/1140] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:03 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1338 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:03.871106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.871106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.874013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.874864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.875808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.877855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.879928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.880873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.943590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lazy-loading 'services' on Instance uuid 84b9b23c-04cc-48a2-a899-6bad90818950 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:04.293099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ea11e40-3998-47d3-8e30-03920a4108f7 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments/a2de53d5-9f32-4d2c-8e18-bd34841ca158" status: 202 len: 0 microversion: 2.1 time: 0.577545 Oct 02 01:05:04.294820 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 564/1141] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:05:03 2022] DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments/a2de53d5-9f32-4d2c-8e18-bd34841ca158 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:04.320339 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:04.338740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.339897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.350634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.353270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.353828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.357475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.358484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.359141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.368695 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0abe289b-9bb2-4df0-bd7a-b4d7a7364049 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.507226 Oct 02 01:05:04.374066 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 578/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:03 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:04.585531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:04.593491 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-91a9a840-043e-4406-a6da-cb96b7fa7478 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1466 microversion: 2.1 time: 0.261226 Oct 02 01:05:04.594049 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 565/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1466 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:04.615804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cab6178b-aa5b-4ab7-881f-a6f354b75bd9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812108b0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.622104 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:04.624059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.626362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.632432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.632944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.633339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.634028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.634662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.635265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.663987 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cab6178b-aa5b-4ab7-881f-a6f354b75bd9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/d452563b-d97f-4ef2-b927-770421bd0406" status: 200 len: 784 microversion: 2.1 time: 0.052039 Oct 02 01:05:04.664698 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 579/1144] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/images/d452563b-d97f-4ef2-b927-770421bd0406 => generated 784 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:04.675830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.676441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.683003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.683501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.683940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.684649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.685107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.685534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.917948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:04.930431 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17d6fa3b-3e0a-4c28-98c5-ae6311b2b2f7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.310152 Oct 02 01:05:04.946623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:04.948912 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 566/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:04.951913 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a121af14-6892-4a0a-969a-da94b2aa58dc tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1319 microversion: 2.1 time: 0.281404 Oct 02 01:05:04.954365 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 580/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:04.965542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.966313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.971590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae3613b8-f1ea-4a31-a1fa-8d878b35a5f0 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.974401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.974800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.975245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.976612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.977257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.977945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.980978 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae3613b8-f1ea-4a31-a1fa-8d878b35a5f0 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030711 Oct 02 01:05:04.983474 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:04.989762 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 567/1147] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:04.994665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f107c4e-7a58-4100-99af-53898f442e01 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812844c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:05.080765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:05.084781 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:05.092920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:05.095287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:05.097796 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-39d7c480-a7dd-49d9-93ef-bb7dfad6cb4a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1344 microversion: 2.25 time: 0.142053 Oct 02 01:05:05.098971 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 581/1148] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:05.341045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-051378bf-457e-4817-8b97-4d78b0d8a076 req-84174ba9-b50f-4eeb-ac69-c6e80cb31f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aef15f0-1588-49a4-91e5-784d833442ee", "tag": "cae22939-6051-4c0e-b5b7-1ec9c1d30e6c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:05.359639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-051378bf-457e-4817-8b97-4d78b0d8a076 req-84174ba9-b50f-4eeb-ac69-c6e80cb31f2c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.360536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-051378bf-457e-4817-8b97-4d78b0d8a076 req-84174ba9-b50f-4eeb-ac69-c6e80cb31f2c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.361308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-051378bf-457e-4817-8b97-4d78b0d8a076 req-84174ba9-b50f-4eeb-ac69-c6e80cb31f2c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.375640 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-051378bf-457e-4817-8b97-4d78b0d8a076 req-84174ba9-b50f-4eeb-ac69-c6e80cb31f2c service nova] Creating event network-changed:cae22939-6051-4c0e-b5b7-1ec9c1d30e6c for instance 0aef15f0-1588-49a4-91e5-784d833442ee on n-h1-master-1 Oct 02 01:05:05.382044 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-051378bf-457e-4817-8b97-4d78b0d8a076 req-84174ba9-b50f-4eeb-ac69-c6e80cb31f2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044894 Oct 02 01:05:05.383202 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 582/1149] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:05.399752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:05.400489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:05.407899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.408644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.409320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.410496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.411466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.412052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.590477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:05.608119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62a179a3-64d9-458e-8639-1b1de4730c1a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.217571 Oct 02 01:05:05.609231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 583/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:05 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:05.715534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5d039764-9a9d-48b1-b301-74f41c2d9d57 req-25e9f67d-2fb4-49e1-aa24-e99e4da7f078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daebd58-0e5e-4267-b2f7-dbd74eb96e14", "name": "network-vif-plugged", "status": "completed", "tag": "76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:05.726285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5d039764-9a9d-48b1-b301-74f41c2d9d57 req-25e9f67d-2fb4-49e1-aa24-e99e4da7f078 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.727052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5d039764-9a9d-48b1-b301-74f41c2d9d57 req-25e9f67d-2fb4-49e1-aa24-e99e4da7f078 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.727481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5d039764-9a9d-48b1-b301-74f41c2d9d57 req-25e9f67d-2fb4-49e1-aa24-e99e4da7f078 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.741990 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f107c4e-7a58-4100-99af-53898f442e01 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "DELETE /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 204 len: 0 microversion: 2.1 time: 0.750998 Oct 02 01:05:05.742568 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 568/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:04 2022] DELETE /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 0 bytes in 752 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:05.744131 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5d039764-9a9d-48b1-b301-74f41c2d9d57 req-25e9f67d-2fb4-49e1-aa24-e99e4da7f078 service nova] Creating event network-vif-plugged:76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1 for instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 on n-h1-master-1 Oct 02 01:05:05.749117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5d039764-9a9d-48b1-b301-74f41c2d9d57 req-25e9f67d-2fb4-49e1-aa24-e99e4da7f078 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Oct 02 01:05:05.749724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 584/1152] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:05.755237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff4e9a44-b1c5-49f9-b147-df8fe44be234 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fd3a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:05.777886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ff4e9a44-b1c5-49f9-b147-df8fe44be234 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] HTTP exception thrown: Image not found. Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff4e9a44-b1c5-49f9-b147-df8fe44be234 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Request method failure captured: Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c HTTP/1.1 Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOF52GgmSrn049sMimsdW88YKOE5ABa3leEGjHpCDFcnLsVaFJk9k24IDxXcw_qlnRtOaXfjgTqdkdyU2tRy2qRjaAfTfw2jhlcFYWMEpfjD3GA5HYViHDSFE0GqtduFmGKfDu7_BuYvdy8Us485zvgiQDzczm2jRqmQnn4HOD7CHI Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 73b489bd5bcd454da7e49c89f35f711f Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:05:05.780076 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_73b489bd5bcd454da7e49c89f35f711f"}]}] Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 73b489bd5bcd454da7e49c89f35f711f Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerTestJSON-613029511-project Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30185488a8864d5abae55abd94a7322e Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerTestJSON-613029511-project Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a6a4e434-44f7-409f-9b9a-a7f0a3abb74c'} Oct 02 01:05:05.781651 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:05:05.783270 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a6a4e434-44f7-409f-9b9a-a7f0a3abb74c Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:05:05.784778 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6a4e434-44f7-409f-9b9a-a7f0a3abb74c could not be found. Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:05:05.786228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff4e9a44-b1c5-49f9-b147-df8fe44be234 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:05.787804 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff4e9a44-b1c5-49f9-b147-df8fe44be234 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 404 len: 62 microversion: 2.1 time: 0.034566 Oct 02 01:05:05.788932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 569/1153] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:05 2022] GET /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:05:05.796752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-362469533"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:05.800019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:05.806540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.807425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.807793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.808526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.808927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.809387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.961387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:05.962010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:05.968384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.968876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.969318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.970611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:05.971076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:05.971501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.975815 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:06.015708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8a07f83-3274-4163-8add-daa76b75ccc3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "POST /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55/action" status: 202 len: 0 microversion: 2.1 time: 0.223006 Oct 02 01:05:06.016660 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 585/1154] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:05:05 2022] POST /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:05:06.021767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.022557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:06.025604 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:06.029756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.030323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.030711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.031411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.031863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.032876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.446863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.456293 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14548ee8-f3e9-423f-b0e4-e486e789fb80 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.499525 Oct 02 01:05:06.466936 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 570/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:05 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:06.471168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-699044e7-6e65-4943-b935-f4fd3b683146 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fd4c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.496718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.505553 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5fd1e6d1-629d-4e48-9484-741968da5322 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1469 microversion: 2.1 time: 0.487798 Oct 02 01:05:06.506124 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 586/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:06.515614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.516229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:06.522853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.523760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.524205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.524934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.525393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.525818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.530287 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-699044e7-6e65-4943-b935-f4fd3b683146 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.072567 Oct 02 01:05:06.530889 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 571/1157] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:06.536540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.537149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:06.543683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.544162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.544594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.545283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.545731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.546272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.727311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.730298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.736952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.739060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.739258 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6e7e98b-6655-4e04-8739-351b0ce0c902 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1319 microversion: 2.1 time: 0.207138 Oct 02 01:05:06.739840 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 572/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:06.740321 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b048f99-e3e9-4a5d-9d4d-536cb4b84945 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.229647 Oct 02 01:05:06.740869 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 587/1159] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:06.744400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.745203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:06.751171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.751860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.752357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.753108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.753623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.754111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.880936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.888580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c79d206-2199-45c6-95f0-c6610d845cd4 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.147803 Oct 02 01:05:06.889153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 573/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:07.479813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.480427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:07.486998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.487479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.487909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.488598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.489048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.489471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.548370 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e72fb4b-32c6-475e-959d-6b4a266f4e9b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812a0dc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.598811 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e72fb4b-32c6-475e-959d-6b4a266f4e9b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.056158 Oct 02 01:05:07.599379 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 574/1161] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:07.620228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:07.627908 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9bfb265f-4c6f-4859-8d6a-93eec972e205 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.151997 Oct 02 01:05:07.628479 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 588/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:07.761148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.761864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:07.764926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.765500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:07.768033 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=39 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:07.770061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.770556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.771024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.771728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.772183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.772608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.780184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.780672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.781133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.781839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.783149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.783675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.963840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:07.968030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:07.976213 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1990bb41-c039-4de7-a75c-843ef764ae04 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1319 microversion: 2.1 time: 0.218782 Oct 02 01:05:07.976952 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 575/1163] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:07.977344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:07.978856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:07.979952 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9668ca5d-ab0d-4c51-b512-a85a6dbb625b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.218972 Oct 02 01:05:07.984703 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 589/1164] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:07.984849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.984849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:07.988848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.989401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.989901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.990690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.991215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.991710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:08.124618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:08.132875 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-62c90851-22b3-40b6-a111-3bc9581addcf tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.154578 Oct 02 01:05:08.133380 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 576/1165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:08.613900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44b46202-27f0-4297-b18c-1386c9a08f18 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811ad5e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:08.655588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:08.656650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:08.670188 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44b46202-27f0-4297-b18c-1386c9a08f18 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.060724 Oct 02 01:05:08.671463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 590/1166] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:08 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:08.675985 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=78 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:08.680814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:08.681311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:08.681995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:08.682955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:08.683419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:08.683932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:08.865475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:08.876541 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26eb0554-87c7-4988-a2bc-6c2f9b886e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.228263 Oct 02 01:05:08.880226 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 577/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:08 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:08.999768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.001554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.005152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.005766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.009172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.009926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.010614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.011549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.012247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.012890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.024613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.025030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.025474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.026193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.026670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.027102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.233600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.245883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-086390f2-8a68-40db-82fb-6574d837f17a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1319 microversion: 2.1 time: 0.250576 Oct 02 01:05:09.263330 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 591/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:08 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:09.263713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.267239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-210664e8-11c3-4cb5-92b1-aad98236e772 req-35b08c34-53ad-4085-9695-61aaaff419cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458d4fea-512b-4a99-8b13-647e57ef0c93", "tag": "1f80054f-e9ef-427a-a9f7-7d7d79b7a14e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:09.270938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.272486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.274855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6154c483-b9fa-4143-8059-c302cd63e5d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.274174 Oct 02 01:05:09.277087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-210664e8-11c3-4cb5-92b1-aad98236e772 req-35b08c34-53ad-4085-9695-61aaaff419cb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.277573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-210664e8-11c3-4cb5-92b1-aad98236e772 req-35b08c34-53ad-4085-9695-61aaaff419cb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.278001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-210664e8-11c3-4cb5-92b1-aad98236e772 req-35b08c34-53ad-4085-9695-61aaaff419cb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.287937 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 578/1169] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:08 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:09.302453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.303118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.303508 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-210664e8-11c3-4cb5-92b1-aad98236e772 req-35b08c34-53ad-4085-9695-61aaaff419cb service nova] Creating event network-changed:1f80054f-e9ef-427a-a9f7-7d7d79b7a14e for instance 458d4fea-512b-4a99-8b13-647e57ef0c93 on n-h1-master-1 Oct 02 01:05:09.309442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.309597 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-210664e8-11c3-4cb5-92b1-aad98236e772 req-35b08c34-53ad-4085-9695-61aaaff419cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056863 Oct 02 01:05:09.309940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.310238 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 592/1170] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:09.310454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.311166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.312642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.312642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.320732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fad0cec5-88df-4db8-a8a2-52f55c7d1058 req-87cae38f-0ca5-43f9-96fa-67d36a038ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "name": "network-vif-unplugged", "status": "completed", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:09.331869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fad0cec5-88df-4db8-a8a2-52f55c7d1058 req-87cae38f-0ca5-43f9-96fa-67d36a038ee9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.332352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fad0cec5-88df-4db8-a8a2-52f55c7d1058 req-87cae38f-0ca5-43f9-96fa-67d36a038ee9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.332994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fad0cec5-88df-4db8-a8a2-52f55c7d1058 req-87cae38f-0ca5-43f9-96fa-67d36a038ee9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.360454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fad0cec5-88df-4db8-a8a2-52f55c7d1058 req-87cae38f-0ca5-43f9-96fa-67d36a038ee9 service nova] Creating event network-vif-unplugged:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:05:09.373382 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fad0cec5-88df-4db8-a8a2-52f55c7d1058 req-87cae38f-0ca5-43f9-96fa-67d36a038ee9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059831 Oct 02 01:05:09.374593 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 593/1171] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:09.475998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.483689 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d733eba8-dc01-4010-9dd5-8de3c7ef7d18 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.194719 Oct 02 01:05:09.484257 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 579/1172] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:09 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:09.687908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50d20cfe-e103-4fc4-a876-a57cdf622933 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811a2430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.736395 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50d20cfe-e103-4fc4-a876-a57cdf622933 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.051639 Oct 02 01:05:09.737517 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 594/1173] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:09 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:09.902167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.902908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.911063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.911821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.912427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.913293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.913897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.914486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.041156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:10.042252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:10.049970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.050881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.052158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.053188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.053866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.054494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.089189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.109055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7ca9401-82f9-4127-8f75-26986936a38a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.210598 Oct 02 01:05:10.109954 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 580/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:09 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:10.222083 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44ca7722-7421-4f47-8444-f90afb9129d6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1858 microversion: 2.1 time: 0.185381 Oct 02 01:05:10.234994 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 595/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:10 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1858 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:10.245601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:10.248764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:10.256246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.257199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.257840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.258984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.259634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.260303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.275780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:10.277538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:10.285718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.286304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.286846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.287923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.288464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.289108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.305652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lazy-loading 'flavor' on Instance uuid 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:10.319721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Going to try to live migrate instance to n-h1-master-1 {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:05:10.434666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.444021 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52abed9c-c902-4bfa-a86d-6d0f50fe70df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1319 microversion: 2.1 time: 0.172308 Oct 02 01:05:10.445372 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 596/1176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:10 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:10.450592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:10.451760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:10.473779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.474213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.475638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.476189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.476565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.476990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.668460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.677910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.684910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.686075 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca25a083-9847-4ed9-a989-6de069b0cfb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.239538 Oct 02 01:05:10.704694 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 597/1177] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:10 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:10.704694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:10.704694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:10.714254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.715003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.716234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.717989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.718525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.719000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.933165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:10.944118 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5d3bb01-3776-4eeb-8ea7-d640e4177cb2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.252262 Oct 02 01:05:10.956726 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 598/1178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:10 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:10.962353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58084de8-3e06-4706-9457-b90bce3af55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881129ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:11.019178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58084de8-3e06-4706-9457-b90bce3af55c tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.061224 Oct 02 01:05:11.027268 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 599/1179] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:10 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:11.135750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:11.136563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:11.147558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.148179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.148746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.149599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.150282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.150866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.298446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:11.306370 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0227978b-8515-4782-a6b3-3b8bb0c788b2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.175214 Oct 02 01:05:11.307235 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 600/1180] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:11 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:11.467836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:11.468449 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:11.474575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.475094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.475556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.476243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.476696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.477120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.615430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:11.623185 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0690a0f1-7a73-498e-a042-7a40c749abc8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1469 microversion: 2.1 time: 0.159288 Oct 02 01:05:11.623764 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 601/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:11 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:11.646017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:11.651100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:11.652057 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Searching by: {'reservation_id': 'r-o0beh26e', 'deleted': False, 'project_id': '70c6b40e739146e8b98b38971b879e85'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:05:11.657652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.658258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.658788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.659605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.660141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.660637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.707843 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:11.756933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:05:11.828446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:11.836440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.836931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.837369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.971497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d903587e-c6e9-4626-83ae-14c29a08aa8d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-o0beh26e" status: 200 len: 2931 microversion: 2.1 time: 0.328988 Oct 02 01:05:11.972314 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 602/1182] 10.222.0.23 () {58 vars in 1197 bytes} [Sun Oct 2 01:05:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-o0beh26e => generated 2931 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:11.977151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:11.977749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:11.989601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.990094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.990528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:11.991312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:11.992279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:11.992623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.138122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:12.151717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:12.153599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:12.154987 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9fb176b-2b6a-4926-a079-6e75a219a527 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.181302 Oct 02 01:05:12.155883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 603/1183] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:11 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:12.161055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.161788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:12.168493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.169095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.169643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.170827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.171002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.171522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.303030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:12.311995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2a1aa48-4796-4317-9a59-54f0c2e326a3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.155176 Oct 02 01:05:12.313051 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 604/1184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:12.317861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c214a76-114c-4a4e-ba70-dbbecca629e4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.333343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_groups [None req-5c214a76-114c-4a4e-ba70-dbbecca629e4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Querying cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) for 2 instances {{(pid=122355) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 02 01:05:12.334049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c214a76-114c-4a4e-ba70-dbbecca629e4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.334524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c214a76-114c-4a4e-ba70-dbbecca629e4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.334999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c214a76-114c-4a4e-ba70-dbbecca629e4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.364742 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c214a76-114c-4a4e-ba70-dbbecca629e4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/66e4e734-fbf6-4302-802b-d7bc44a8b6ac" status: 200 len: 271 microversion: 2.1 time: 0.050852 Oct 02 01:05:12.365227 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 605/1185] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/os-server-groups/66e4e734-fbf6-4302-802b-d7bc44a8b6ac => generated 271 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:12.369973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ec32ad2-18a7-45dc-9029-b585dd7959e1 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811a2a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.413376 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ec32ad2-18a7-45dc-9029-b585dd7959e1 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.047132 Oct 02 01:05:12.413948 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 606/1186] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:12.418294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-068112ea-3008-46ba-8b70-945d3121f446 req-414d2801-0d30-4a82-a535-e6b59ab40ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:12.427809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-068112ea-3008-46ba-8b70-945d3121f446 req-414d2801-0d30-4a82-a535-e6b59ab40ba9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.428290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-068112ea-3008-46ba-8b70-945d3121f446 req-414d2801-0d30-4a82-a535-e6b59ab40ba9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.428721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-068112ea-3008-46ba-8b70-945d3121f446 req-414d2801-0d30-4a82-a535-e6b59ab40ba9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.440017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-068112ea-3008-46ba-8b70-945d3121f446 req-414d2801-0d30-4a82-a535-e6b59ab40ba9 service nova] Creating event network-vif-plugged:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h1-master-1 Oct 02 01:05:12.444952 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-068112ea-3008-46ba-8b70-945d3121f446 req-414d2801-0d30-4a82-a535-e6b59ab40ba9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029869 Oct 02 01:05:12.445705 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 607/1187] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:12.451341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.452163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:12.459299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.459864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.460376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.461161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.461692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.462795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.597343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:12.605023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-514b643c-82cf-44d9-a3db-c8faa669a9a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.158124 Oct 02 01:05:12.605595 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 608/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:12.610094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.610824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:12.617187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.617724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.618169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.619000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.619585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.620083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.763466 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3681fc3-ac67-4ae4-8972-b3532745b2b1 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 200 len: 1620 microversion: 2.1 time: 0.156813 Oct 02 01:05:12.773870 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 609/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 1620 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:12.787144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.787770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:12.793786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.794265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.794767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.795465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.796005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.796429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.926338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7f5ce63-fbfc-4b7d-84f3-8efd71d3af3d tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1620 microversion: 2.1 time: 0.143886 Oct 02 01:05:12.926943 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 610/1190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1620 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:12.972048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:12.974258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:12.980277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.980760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.981188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:12.981881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:12.982329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:12.982782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.013531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e625f764-7f49-4dc3-8b69-c28c17accb86 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048265 Oct 02 01:05:13.014093 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 611/1191] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:12 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:13.049808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1025826439", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7d3d7159-ba16-41d9-8d7b-c87ac671ad0a"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:13.100333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:05:13.313135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:05:13.313738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:05:13.314215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:05:13.314650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:05:13.315066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:05:13.324125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.324602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.325034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.325755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.326204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.326647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.343592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:05:13.348685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:05:13.361782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:05:13.364116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:05:13.409510 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d403e014-10f4-4666-a1b6-7607d95cb4ee tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.364235 Oct 02 01:05:13.410088 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 612/1192] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:05:13.414673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:13.415294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:13.421959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.423094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.423553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.424395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.424770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.425206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.561060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:13.569703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:13.571468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:13.572627 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26a4334a-ef07-4725-af1d-6aa3e9e10c06 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.161539 Oct 02 01:05:13.573205 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 613/1193] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:13 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:13.577700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:13.578314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:13.584756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.585238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.585761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.586452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.587009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.587569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.718918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:13.727356 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6cdc4fd4-7819-4730-9f57-af5c3858ca74 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.153190 Oct 02 01:05:13.728017 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 614/1194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:13 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:13.733053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54dd683c-2d22-40a6-a871-2ffecb9ceb0b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:13.733769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-54dd683c-2d22-40a6-a871-2ffecb9ceb0b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:13.789617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-54dd683c-2d22-40a6-a871-2ffecb9ceb0b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:13.797335 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-54dd683c-2d22-40a6-a871-2ffecb9ceb0b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1217 microversion: 2.1 time: 0.068115 Oct 02 01:05:13.798115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 615/1195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:13 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:13.802873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6cfbaa2-645b-4a72-9ce5-289f75f223c5 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811b8670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:13.848535 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6cfbaa2-645b-4a72-9ce5-289f75f223c5 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.049035 Oct 02 01:05:13.849090 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 616/1196] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:13 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:13.853408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:13.854009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:13.860233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.860720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.861153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:13.861843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:13.862291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:13.862761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.004722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.012483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2e4c599-5499-4429-8401-b008d0e9ee38 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.162452 Oct 02 01:05:14.013146 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 617/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:13 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:14.026325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:14.028706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:14.034848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.035337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.035785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.036469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.036919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.037346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.067947 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8482e3c5-de92-4c01-aac1-4eb6c233ced3 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 Oct 02 01:05:14.068526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 618/1198] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:14 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:14.597729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:14.598249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:14.605509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.605996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.606431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.607155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.607609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.608033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.738404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.746574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.748033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.749230 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0c20757a-06e2-43ec-b7a8-299641e77fd4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.155628 Oct 02 01:05:14.749798 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 619/1199] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:14 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:14.754138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:14.754762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:14.760259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.760735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.761166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.761843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.762293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.762738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.896902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.905148 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-05ea9576-7523-4da6-92b3-f8079abb5142 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.154297 Oct 02 01:05:14.905753 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 620/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:14 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:14.911270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:14.911880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:14.918853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.919341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.919780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.920497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:14.920950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:14.921378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:14.984082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:14.992595 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c16bb1c1-4aa6-4cda-ae54-07f22f83d459 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1221 microversion: 2.1 time: 0.085887 Oct 02 01:05:14.993164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 621/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:14 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:14.997474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d420f4c6-035c-42c2-b040-b059c55cafe0 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811b89d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.041268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d420f4c6-035c-42c2-b040-b059c55cafe0 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.047098 Oct 02 01:05:15.041838 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 622/1202] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:14 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:15.046205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.046842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:15.053982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.054470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.054948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.055664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.056108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.056537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.186468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.188923 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:15.195666 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b61db549-1cb1-40fe-afc8-82e287a1e4dc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.152891 Oct 02 01:05:15.196240 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 623/1203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:15.200968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.203233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:15.209431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.209911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.210344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.211053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.211536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.211956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.240607 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc5f98f1-d463-457c-b1fe-0e1ef9342c07 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Oct 02 01:05:15.241158 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 624/1204] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:15.313551 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.318147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.318814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Searching by: {'deleted': False, 'project_id': '4ad7cba3465048b195bfe5d870860bdf'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:05:15.323911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.324385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.324805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.325507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.325951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.326367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.351948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:05:15.381163 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20e3f8b9-6826-4a57-90db-476ccfbc3ff7 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.071193 Oct 02 01:05:15.381756 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 625/1205] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers => generated 333 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:15.395304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.400307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.401055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Searching by: {'deleted': False, 'project_id': '4ad7cba3465048b195bfe5d870860bdf'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:05:15.406211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.407319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.407893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.408650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.409106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.409565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.434657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:05:15.504292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.510762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.511253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.511693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.623680 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-67d707d7-983a-4dc0-9b75-1490f3156a30 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.232810 Oct 02 01:05:15.624293 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 626/1206] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:15.649650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bad06c29-bcb7-4c7d-8669-5195744f847e tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.657538 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bad06c29-bcb7-4c7d-8669-5195744f847e tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011416 Oct 02 01:05:15.658116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 627/1207] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:15.773409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.773937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:15.780837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.781322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.781838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.782530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.783018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.783446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.910252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.918165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.919629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:15.920729 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a69a8ec5-8ee3-4009-960f-1785412d5dca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.151322 Oct 02 01:05:15.921287 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 628/1208] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:15.930828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:15.931545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:15.941336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.941909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.942427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:15.943240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:15.943780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:15.944217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.092923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:16.100901 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d0064878-475a-4115-8091-a8cdbb960ca8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.174866 Oct 02 01:05:16.101486 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 629/1209] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:15 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:16.112728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.113884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.120271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.120831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.121272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.121967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.122423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.122985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.185341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:16.193897 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12c9d285-553d-49e6-9f6a-87cd95f3b333 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1221 microversion: 2.1 time: 0.086134 Oct 02 01:05:16.194474 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 630/1210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:16.198840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ff74709-ed4e-4ada-a1cb-df10b3bdaf62 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88103f310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.248752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ff74709-ed4e-4ada-a1cb-df10b3bdaf62 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.053208 Oct 02 01:05:16.249334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 631/1211] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:16.254873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.255488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.258659 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:16.263697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.264187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.264626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.265329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.265919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.266460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.403568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:16.411752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3eadb9e-e11b-4812-ab80-18e119f0c418 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.161483 Oct 02 01:05:16.412322 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 632/1212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:16.416673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.417165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.423329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.423809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.424248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.424931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.425415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.425844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.450752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:16.524844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95b48732-fee5-4bc6-8981-978498d001fb tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 204 len: 0 microversion: 2.1 time: 0.110983 Oct 02 01:05:16.525433 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 633/1213] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:16 2022] DELETE /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:16.530542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.533416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.539219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.539700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.540138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.540825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.541280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.541703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.572745 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5bcec415-17eb-4332-951f-ce40599e9585 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Oct 02 01:05:16.573231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 634/1214] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:16.577948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6042811e-c069-4d87-b6e2-5090dd60bbb6 req-6e30096b-52da-4e67-b6df-14fb7cbba23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "name": "network-vif-plugged", "status": "completed", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:16.587849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6042811e-c069-4d87-b6e2-5090dd60bbb6 req-6e30096b-52da-4e67-b6df-14fb7cbba23b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.588325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6042811e-c069-4d87-b6e2-5090dd60bbb6 req-6e30096b-52da-4e67-b6df-14fb7cbba23b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.588751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6042811e-c069-4d87-b6e2-5090dd60bbb6 req-6e30096b-52da-4e67-b6df-14fb7cbba23b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.600020 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6042811e-c069-4d87-b6e2-5090dd60bbb6 req-6e30096b-52da-4e67-b6df-14fb7cbba23b service nova] Creating event network-vif-plugged:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:05:16.605099 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6042811e-c069-4d87-b6e2-5090dd60bbb6 req-6e30096b-52da-4e67-b6df-14fb7cbba23b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030770 Oct 02 01:05:16.605683 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 635/1215] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:16.610620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.611315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.617332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.617812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.618244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.618954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.619411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.619831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.752652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:16.760304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a92a0fc6-ece1-4a3c-b0d3-846046eceeb5 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1699 microversion: 2.1 time: 0.153545 Oct 02 01:05:16.760867 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 636/1216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:16.950969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:16.951600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:16.959689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.960176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.960612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:16.961311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:16.961767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:16.962194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.092656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:17.101511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:17.102968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:17.104074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-974fad24-0a91-4040-891a-034ffdaad284 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.157000 Oct 02 01:05:17.104633 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 637/1217] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:16 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:17.124032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.124642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:17.130784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.131271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.131726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.132390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.132846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.133268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.261274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:17.269480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cf5ec9a1-b77f-4647-90a8-d2d91d8731a0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.149091 Oct 02 01:05:17.270053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 638/1218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:17.274518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.275169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:17.280692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.281176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.282130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.282978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.283444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.283871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.347675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:17.355552 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ffafaebf-806c-4ac4-a9f2-8f63de64d2e7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1221 microversion: 2.1 time: 0.084555 Oct 02 01:05:17.356136 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 639/1219] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:17.360677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-487b040d-a3c6-4a85-9621-092452db522b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88103fb80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.403814 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-487b040d-a3c6-4a85-9621-092452db522b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.046674 Oct 02 01:05:17.404381 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 640/1220] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:17.434167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.434798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:17.440724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.441203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.441634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.442321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.442799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.443222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.458983 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:17.577821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:17.586588 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65b3a742-f115-4bb7-be05-47e821462f6b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.156194 Oct 02 01:05:17.587196 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 641/1221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:17.592010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.594980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:17.600927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.601633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.601865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.603094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.603715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.604293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.636909 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d63704d4-454e-4ac0-bf91-760ea8c32baf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048488 Oct 02 01:05:17.637481 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 642/1222] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:05:17.742330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.745162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:17.754301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.755105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.755914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.756919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.757622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.758298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.795504 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0a2bc7c9-7114-42a8-ae04-c8a880cc0d18 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057964 Oct 02 01:05:17.798690 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 643/1223] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:05:17.802513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:17.803172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:17.809574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.810091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.810558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:17.811337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:17.811822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:17.812274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.020698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.028478 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-102d523d-82b5-4d60-9e39-45c5c0b31b22 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1699 microversion: 2.1 time: 0.231023 Oct 02 01:05:18.029057 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 644/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:17 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1699 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:18.034900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.035395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.041195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.041678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.042108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.042818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.043270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.043691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.069158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:18.146448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0175f7a-0467-48c5-b574-c94d367d9b11 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 204 len: 0 microversion: 2.1 time: 0.115914 Oct 02 01:05:18.147077 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 645/1225] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:18 2022] DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:18.152324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.153022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.159590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.160112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.160549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.161418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.161951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.162456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.185837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ba5f5b0-f4f9-4b2c-83c6-1df1d9979c6e tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/action" status: 202 len: 0 microversion: 2.1 time: 7.944750 Oct 02 01:05:18.189597 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 581/1226] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:05:10 2022] POST /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/action => generated 0 bytes in 7946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:18.192033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.192658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.199115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.199593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.200020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.200704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.201157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.201576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.381632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.384541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.391564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.394121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.394121 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4098f41-115e-410b-b319-467344bb3116 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.246007 Oct 02 01:05:18.394537 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f7b47fe-42f5-4cd2-916f-7aff6ae63755 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1682 microversion: 2.1 time: 0.206445 Oct 02 01:05:18.406725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 646/1227] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:18.407506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 582/1228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:18.412774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.412774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.417168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.418017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.418867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.419366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.421110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.421674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.422147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.424004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.424752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.425249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.425971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.426712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.427399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.428661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.622199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.633896 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b818c8b3-632f-4c54-b868-5de03ce4a2f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.237685 Oct 02 01:05:18.634458 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 647/1229] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:18.634991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.639434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.639611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.644692 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-582b8445-561e-4bb8-a168-8dc9e7190741 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.235847 Oct 02 01:05:18.645702 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 583/1230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:18.647828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.648314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.648762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.649482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.649949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.650379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.654146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a4b6d05-a38b-4d0e-a3a5-69ccb6a0f182 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881151160>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.705305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a4b6d05-a38b-4d0e-a3a5-69ccb6a0f182 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.058215 Oct 02 01:05:18.705875 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 584/1231] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:18.710711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:18.712575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:18.719875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.720501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.722144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.723012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.723692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.723947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.724443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.731824 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0c5fe4e2-4d98-40c0-91c3-bf3e453d350f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1213 microversion: 2.1 time: 0.096305 Oct 02 01:05:18.732396 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 648/1232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:18.745762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c7676de0-e732-41de-87a6-e42306027f97 req-e9553a79-c4f8-46fe-baa8-246670b14d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458d4fea-512b-4a99-8b13-647e57ef0c93", "name": "network-vif-plugged", "status": "completed", "tag": "1f80054f-e9ef-427a-a9f7-7d7d79b7a14e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:18.755818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c7676de0-e732-41de-87a6-e42306027f97 req-e9553a79-c4f8-46fe-baa8-246670b14d0c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:18.756338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c7676de0-e732-41de-87a6-e42306027f97 req-e9553a79-c4f8-46fe-baa8-246670b14d0c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:18.756707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c7676de0-e732-41de-87a6-e42306027f97 req-e9553a79-c4f8-46fe-baa8-246670b14d0c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:18.768515 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c7676de0-e732-41de-87a6-e42306027f97 req-e9553a79-c4f8-46fe-baa8-246670b14d0c service nova] Creating event network-vif-plugged:1f80054f-e9ef-427a-a9f7-7d7d79b7a14e for instance 458d4fea-512b-4a99-8b13-647e57ef0c93 on n-h1-master-1 Oct 02 01:05:18.773564 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c7676de0-e732-41de-87a6-e42306027f97 req-e9553a79-c4f8-46fe-baa8-246670b14d0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040024 Oct 02 01:05:18.774248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 649/1233] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:18.864380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:18.872236 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39d6e54a-c860-4e86-b89c-8cf7ac40f9a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.165197 Oct 02 01:05:18.873469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 585/1234] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:18 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:19.053069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.053732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.060128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.060609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.061043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.061730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.062183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.062636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.192739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.200413 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7bf928a-2e22-407f-afa0-19010af4d099 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1699 microversion: 2.1 time: 0.151760 Oct 02 01:05:19.200990 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 650/1235] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:19.419896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.420501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.420605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.421189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.427286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.427705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.427821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.428179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.428320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.428611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.429004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.429291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.429739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.430093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.430198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.430535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.630174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.634460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.637939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0492d3e9-7f93-41b8-95ca-456b16ae2cfd tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1682 microversion: 2.1 time: 0.222166 Oct 02 01:05:19.638513 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 586/1236] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:19.642453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.643910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.645010 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec860c79-9113-454c-b1ab-2179fc4e5009 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.228361 Oct 02 01:05:19.645558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 651/1237] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:19.677886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.678526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.678789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.679400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.684863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.685350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.685483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.685788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.685919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.686300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.686486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.687025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.687144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.687461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.687558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.687945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.879416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.882948 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:19.887163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.888648 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0ade489e-39a5-4d68-b595-0adc32eba737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.214562 Oct 02 01:05:19.889230 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 587/1238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:19.895275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8aca1d95-b915-41f6-8be6-5089048d506d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fd310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.905416 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ee5f2c82-9f63-427d-b67d-9dbc8256e2e8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.230125 Oct 02 01:05:19.906287 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 652/1239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:19.911669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.912280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.919055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.919552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.919987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.920711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.921167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.921596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.950810 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8aca1d95-b915-41f6-8be6-5089048d506d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.060268 Oct 02 01:05:19.960101 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 588/1240] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:19.962127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:19.962970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:19.970322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.971791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.972418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.973298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:19.973915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:19.974494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:19.989315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:19.996977 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aaafbc04-94ba-4547-b7d8-631d3e9e10a9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1213 microversion: 2.1 time: 0.089172 Oct 02 01:05:19.997556 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 653/1241] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:20.108510 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:20.116172 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5aac1f68-2694-4b33-b70b-618e072a703b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.163455 Oct 02 01:05:20.116751 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 589/1242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:19 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:20.223347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:20.223957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:20.229974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:20.230453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:20.230916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:20.231602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:20.232050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:20.232470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:20.408590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:20.419522 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5438e494-0559-4b3a-be9c-112666824b32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1699 microversion: 2.1 time: 0.200063 Oct 02 01:05:20.420837 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 654/1243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:20 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1699 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:20.662812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:20.663559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:20.670515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:20.670515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:20.671108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:20.672317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:20.677758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:20.678851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:20.679075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:20.679304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:20.679720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:20.680208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:20.680328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:20.680649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:20.680771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:20.681214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.138768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.144234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.147691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-736d4547-e08b-411b-86c7-6fcd5f57eab9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1682 microversion: 2.1 time: 0.488918 Oct 02 01:05:21.148279 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 590/1244] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:20 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1682 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:21.157408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.157408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.157408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5b561f5f-d891-4c6c-a0a4-cae297931e3e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.490083 Oct 02 01:05:21.157720 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 655/1245] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:20 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:21.160990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:21.161594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:21.167424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.168086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.168686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.169539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.169773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8de8e99-45bb-4001-a5da-0d746de0a396 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811514c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:21.169997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.170415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.214582 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8de8e99-45bb-4001-a5da-0d746de0a396 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.055619 Oct 02 01:05:21.215576 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 591/1246] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:21 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:21.221622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:21.222238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:21.230660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.231160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.231598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.232299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.232759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.233185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.351758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.361155 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-109b3147-bc61-4be5-9ffe-67b8bcef8437 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.204307 Oct 02 01:05:21.361736 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 656/1247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:21 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:21.366127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:21.366759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:21.373414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.373899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.374333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.375103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.375557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.375978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.380738 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:21.397393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.405377 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9ebf39e-619f-44b2-9d9c-c60bbf917a82 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.188849 Oct 02 01:05:21.405934 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 592/1248] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:21 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:21.411314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:21.411922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:21.417834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.418308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.419038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.419727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.420175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.420594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.443497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.451053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbbc04f9-37e5-48bb-8bcd-80bec5b98238 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1269 microversion: 2.1 time: 0.088337 Oct 02 01:05:21.451627 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 657/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:21 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:21.459925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:21.460769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:21.467544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.468025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.468454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.470143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:21.470616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:21.471065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:21.610558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.619170 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-78963e01-5b1a-4406-8b8c-e96d85d38d42 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1378 microversion: 2.1 time: 0.212219 Oct 02 01:05:21.627457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 593/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:21 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1378 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:21.638945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:21.648596 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac305a4f-49e6-4a06-80c9-442a9d771c35 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1699 microversion: 2.1 time: 0.192324 Oct 02 01:05:21.658891 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 658/1251] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:21 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1699 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:22.173397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:22.174016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:22.176758 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:22.182414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.183059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.183569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.183691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:22.184210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:22.184360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.184989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.185494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.192116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.192601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.193399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.194103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.194749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.195178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.504211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:22.513050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:22.514625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:22.516569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7902657e-c6e7-4e9a-9f08-47567a720ed6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.336960 Oct 02 01:05:22.517735 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 659/1252] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:22 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:22.529373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-568e3e5b-ba37-41a2-adc9-9370143292df tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881005040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:22.529718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:22.536554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-79570c3d-0d7e-4ff6-867f-f97558fb25bf tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1682 microversion: 2.1 time: 0.367068 Oct 02 01:05:22.538921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 594/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:22 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:22.544469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:22.545310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:22.557703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.558233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.558642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.559460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.559812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.560269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.573187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-568e3e5b-ba37-41a2-adc9-9370143292df tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.054365 Oct 02 01:05:22.574074 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 660/1254] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:22 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:22.579245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:22.579993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:22.588925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.589431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.589884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:22.590639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:22.591096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:22.591531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.155860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.169992 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1767817-e7cb-45db-a85f-2a1397dfdd3a tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.594499 Oct 02 01:05:23.171944 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 661/1255] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:22 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.173879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.184856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.185791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.189827 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-80c06514-cc44-478f-a863-2d392ebcc1a9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.648871 Oct 02 01:05:23.196010 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 595/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:22 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.202165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.208199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.208815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.209473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.210201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.210379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.215253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.219570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.228027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.228875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.229549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.230487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.231214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.231878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.304580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.316164 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7eb26d65-108a-4ef1-a057-9d84ac33c533 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1269 microversion: 2.1 time: 0.142858 Oct 02 01:05:23.317281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 662/1257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.323214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.324014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.332074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.332707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.333254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.334059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.334638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.335177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.456374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.464918 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d6905764-b7ff-447f-bb84-11519282eb79 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1631 microversion: 2.1 time: 0.146478 Oct 02 01:05:23.465624 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 663/1258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1631 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.468804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.475735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e311c488-9324-4d52-91b2-25cf36e2c99b req-2f988f15-ce38-44f5-8969-78ea99d7b930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfd9835-627c-451d-b86e-1115b727db28", "name": "network-vif-deleted", "tag": "72f94aae-1dc8-4f1a-84c8-2e35e6b5d419"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:23.477271 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3ea16c8-f4a6-4960-947f-dacabd42bb9d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1528 microversion: 2.1 time: 0.279003 Oct 02 01:05:23.487068 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 596/1259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.489314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e311c488-9324-4d52-91b2-25cf36e2c99b req-2f988f15-ce38-44f5-8969-78ea99d7b930 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.490017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e311c488-9324-4d52-91b2-25cf36e2c99b req-2f988f15-ce38-44f5-8969-78ea99d7b930 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.490682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e311c488-9324-4d52-91b2-25cf36e2c99b req-2f988f15-ce38-44f5-8969-78ea99d7b930 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.503277 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e311c488-9324-4d52-91b2-25cf36e2c99b req-2f988f15-ce38-44f5-8969-78ea99d7b930 service nova] Creating event network-vif-deleted:72f94aae-1dc8-4f1a-84c8-2e35e6b5d419 for instance 0dfd9835-627c-451d-b86e-1115b727db28 on n-h1-master-1 Oct 02 01:05:23.503849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.504456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.508761 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e311c488-9324-4d52-91b2-25cf36e2c99b req-2f988f15-ce38-44f5-8969-78ea99d7b930 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041300 Oct 02 01:05:23.509387 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 664/1260] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:23.513296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.513830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.514587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.515135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.515660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.516264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.543092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.543896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.554236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.554766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.555204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.555910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.556392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.556817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.714106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.723365 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-403628e1-1fe8-41f4-91a2-ae3252e1ce24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1528 microversion: 2.1 time: 0.225745 Oct 02 01:05:23.724279 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 597/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1528 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:23.729182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.729970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.736838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.737562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.738192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.739452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.740859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.741545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.753463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.762217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.763940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.765118 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0adf844f-1dcf-43c3-9277-90f3b5cbc6e2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1412 microversion: 2.25 time: 0.226710 Oct 02 01:05:23.766748 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 665/1262] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1412 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:05:23.770758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-588bbcbe-5154-4448-a3aa-cc346a49e701 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881005dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.833143 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-588bbcbe-5154-4448-a3aa-cc346a49e701 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.065853 Oct 02 01:05:23.834137 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 666/1263] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.838156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-def200d9-1a6e-46ee-a215-aabd2ea74415 req-abd94b61-4b4d-49f5-8d1e-0ae44888fa8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aef15f0-1588-49a4-91e5-784d833442ee", "name": "network-vif-plugged", "status": "completed", "tag": "cae22939-6051-4c0e-b5b7-1ec9c1d30e6c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:23.849099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-def200d9-1a6e-46ee-a215-aabd2ea74415 req-abd94b61-4b4d-49f5-8d1e-0ae44888fa8a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.849587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-def200d9-1a6e-46ee-a215-aabd2ea74415 req-abd94b61-4b4d-49f5-8d1e-0ae44888fa8a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.850020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-def200d9-1a6e-46ee-a215-aabd2ea74415 req-abd94b61-4b4d-49f5-8d1e-0ae44888fa8a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.863410 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-def200d9-1a6e-46ee-a215-aabd2ea74415 req-abd94b61-4b4d-49f5-8d1e-0ae44888fa8a service nova] Creating event network-vif-plugged:cae22939-6051-4c0e-b5b7-1ec9c1d30e6c for instance 0aef15f0-1588-49a4-91e5-784d833442ee on n-h1-master-1 Oct 02 01:05:23.869196 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-def200d9-1a6e-46ee-a215-aabd2ea74415 req-abd94b61-4b4d-49f5-8d1e-0ae44888fa8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Oct 02 01:05:23.870185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 667/1264] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:23.885699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3518f3a1-d5d0-4b3b-95f6-567af7e07a59 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.903657 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3518f3a1-d5d0-4b3b-95f6-567af7e07a59 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/bbacc0d8-b993-43c1-a245-13ed6552ed58" status: 202 len: 0 microversion: 2.1 time: 0.032162 Oct 02 01:05:23.908752 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 668/1265] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:23 2022] DELETE /compute/v2.1/flavors/bbacc0d8-b993-43c1-a245-13ed6552ed58 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:23.914720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f17e1d0-26a2-4e70-bdcd-74567710fedc tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:23.928961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:23.937511 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f17e1d0-26a2-4e70-bdcd-74567710fedc tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026827 Oct 02 01:05:23.939198 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 669/1266] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.947437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bdb6043e-ee16-4754-bd12-d5afc5842c03 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1682 microversion: 2.1 time: 0.221801 Oct 02 01:05:23.948034 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 598/1267] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:23 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:23.956864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:23.963864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:23.975586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.976222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.976926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:23.977729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:23.978180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:23.979192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.070855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:24.077949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Old instance type tempest-test_resize_flavor_-59282506, new instance type m1.heat {{(pid=122355) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:05:24.085622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:05:24.086040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:05:24.086505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:05:24.086984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:05:24.087399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:05:24.196083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:24.196696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:24.206570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.207093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.207532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.208681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.208681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.209094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.413208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:24.427068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3017cae-11c0-4ab4-89ec-a6185c9bdf96 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.234623 Oct 02 01:05:24.427660 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 599/1268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:24 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:24.452081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:24.453012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:24.468378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.470941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.472493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.473560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.474358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.475094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.561165 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bec12c96-5353-4b70-b56c-cb705df39680 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.607969 Oct 02 01:05:24.564691 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 670/1269] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:05:23 2022] POST /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:24.586305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:24.587257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:24.624406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.624619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.626098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.627333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.627333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.627769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.791877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:24.809229 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a3ed1a1-26ad-46a0-9d16-9cb7c1bd5435 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1269 microversion: 2.1 time: 0.243473 Oct 02 01:05:24.823434 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 671/1270] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:24 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1269 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:24.844464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:24.845742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:24.857897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.858576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.860195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.861300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.861920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.862543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.896682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:24.924027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e72c9b4a-36cc-444c-847a-6fe813ff02da tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.487894 Oct 02 01:05:24.924931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 600/1271] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:24 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:24.937141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.938416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.938988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.939584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lazy-loading 'fault' on Instance uuid 0dfd9835-627c-451d-b86e-1115b727db28 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:24.942871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:24.944519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:24.964381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.964875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.965531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:24.968425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:24.970034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:24.971641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.054429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.073347 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2225b84e-d9a5-433e-af89-58fd97036e1b tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1358 microversion: 2.1 time: 0.248771 Oct 02 01:05:25.075200 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 672/1272] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:24 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:25.085662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:25.086450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:25.100851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.102296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.103019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.105352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.106072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.107055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.253815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.262988 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-daf35c5a-4ab4-449b-989a-8d66c937e74a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1537 microversion: 2.1 time: 0.336565 Oct 02 01:05:25.263809 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 601/1273] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:24 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1537 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:25.270059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c477411a-c6da-40c1-a648-31928da92e50 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88128e280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:25.307587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.319226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.320298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c477411a-c6da-40c1-a648-31928da92e50 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.055308 Oct 02 01:05:25.320876 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 602/1274] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:25 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:25.321211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.322722 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-63e49c25-541f-4820-b702-08dd6253e3d2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1608 microversion: 2.25 time: 0.246471 Oct 02 01:05:25.325601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:25.326354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:25.334173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.334684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.335121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.336014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.336397 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 673/1275] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:05:25 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1608 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:05:25.336573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.337329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.363609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:25.364870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:25.370753 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:25.379394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.380078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.382681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.383714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.384732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.385381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.414446 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:25.427938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.438117 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ced0dd8b-ca74-48a7-9b19-2811fccea19a tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1614 microversion: 2.1 time: 0.115361 Oct 02 01:05:25.438979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 603/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:25 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:25.458753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:25.459405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:25.471900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.472398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.473711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.474507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.476356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.476907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.497511 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-790bd929-0f33-4cf6-812f-1edf2ac393c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.151204 Oct 02 01:05:25.498153 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 674/1277] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:05:25 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:05:25.630237 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:25.634483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-63ea733c-3dbb-4aa0-8045-871c76938843 req-8f1b24a6-545d-4d3e-bc56-31f067be668b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b9b23c-04cc-48a2-a899-6bad90818950", "name": "network-vif-deleted", "tag": "34b11d27-94e5-4bbe-a6f1-08508f199f5f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:25.647626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-63ea733c-3dbb-4aa0-8045-871c76938843 req-8f1b24a6-545d-4d3e-bc56-31f067be668b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.648108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-63ea733c-3dbb-4aa0-8045-871c76938843 req-8f1b24a6-545d-4d3e-bc56-31f067be668b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.648543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-63ea733c-3dbb-4aa0-8045-871c76938843 req-8f1b24a6-545d-4d3e-bc56-31f067be668b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.661721 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-63ea733c-3dbb-4aa0-8045-871c76938843 req-8f1b24a6-545d-4d3e-bc56-31f067be668b service nova] Creating event network-vif-deleted:34b11d27-94e5-4bbe-a6f1-08508f199f5f for instance 84b9b23c-04cc-48a2-a899-6bad90818950 on n-h1-master-1 Oct 02 01:05:25.668013 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-63ea733c-3dbb-4aa0-8045-871c76938843 req-8f1b24a6-545d-4d3e-bc56-31f067be668b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Oct 02 01:05:25.668721 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 675/1278] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:25.839852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:25.839852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:25.857710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.858426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.859007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.860643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:25.862536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:25.865780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:25.980392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:25.991732 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a362d2b8-239f-457f-b84e-997c2c14ca53 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1314 microversion: 2.1 time: 0.539761 Oct 02 01:05:25.992325 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 604/1279] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:25 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:26.012396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:26.013222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:26.021941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.022710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.023320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.024039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.024508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.024936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.040964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:26.054481 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-245f2922-622c-46e6-b6af-1b5805d31d86 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1269 microversion: 2.1 time: 0.219736 Oct 02 01:05:26.066822 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 676/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:25 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:26.104367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:26.105894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:26.120683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.120683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.123487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.124290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.124826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.125330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.163732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.163943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.164411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.164925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lazy-loading 'fault' on Instance uuid 0dfd9835-627c-451d-b86e-1115b727db28 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:26.277040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:26.288475 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5376dfea-6db4-47af-988c-1f681a57882a tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1358 microversion: 2.1 time: 0.193449 Oct 02 01:05:26.289444 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 677/1281] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:26 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:26.298990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:26.300776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:26.315712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.316221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.316665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.317388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.317851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.318284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.321652 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:26.334414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:26.351506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f8ca749-f55d-47cf-a0b1-1fbfd005b859 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.338516 Oct 02 01:05:26.352192 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 605/1282] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:26 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:26.359592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10f60cfb-62ed-42d0-b70b-86d089c570f9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88113d940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:26.424625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10f60cfb-62ed-42d0-b70b-86d089c570f9 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.071125 Oct 02 01:05:26.425797 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 606/1283] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:26 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:26.464046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:26.464797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:26.472304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.472803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.473245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.473954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:26.474795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:26.475520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:26.633803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:26.645517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cafa4142-8ca4-4ddb-9055-1c51539b1f51 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1326 microversion: 2.1 time: 0.185328 Oct 02 01:05:26.646861 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 607/1284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:26 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1326 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:27.017498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.019054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:27.032318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:27.035944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.036538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.037052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.039720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.041043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.041711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.053212 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea7244cd-98aa-432f-9714-e8079de96f2d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1537 microversion: 2.1 time: 0.761791 Oct 02 01:05:27.054118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 678/1285] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:26 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1537 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:27.071719 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:27.081147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.082011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:27.103735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.104696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.106041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.107050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.107746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.108446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.211875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:27.221264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da92d305-eb4e-482f-8d27-bb13a3fc2007 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1275 microversion: 2.1 time: 0.144260 Oct 02 01:05:27.222273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 679/1286] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:27.315174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.315796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:27.331101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.331607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.332059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.332879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.333359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.333857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.380299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.380776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.381216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.381668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lazy-loading 'fault' on Instance uuid 0dfd9835-627c-451d-b86e-1115b727db28 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:27.464722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db18eb48be64e72a9419d4e7452ca5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad7cba3465048b195bfe5d870860bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:27.478986 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b45a48f-7f88-4977-a34f-ab2e3ff1cb32 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 200 len: 1358 microversion: 2.1 time: 0.169149 Oct 02 01:05:27.495679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:27.501472 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 680/1287] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:27.510019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.512478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:27.512911 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f179c68-e7ea-4a52-b468-c068c46a5aa3 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1464 microversion: 2.1 time: 0.502040 Oct 02 01:05:27.513492 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 608/1288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1464 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:27.530794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.532491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.533327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.536189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8fa656c-d84a-4245-9128-c1449cc434cf tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88112bee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.550750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.551682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.552695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.616321 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8fa656c-d84a-4245-9128-c1449cc434cf tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.095358 Oct 02 01:05:27.617222 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 609/1289] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:27.782291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Calling method '.version_select at 0x7fb8812a0ca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.805974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.806475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.807229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.848770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.857565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.859937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.911008 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fef31e66-42f3-486a-9ec6-ae63ba339eb8 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/56d7664bcbb0489c83d28d36c57dc80f?start=2022-10-01T01%3A05%3A27.530691&end=2022-10-03T01%3A05%3A27.530691" status: 200 len: 695 microversion: 2.1 time: 0.284946 Oct 02 01:05:27.914617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 610/1290] 10.222.0.23 () {58 vars in 1412 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/os-simple-tenant-usage/56d7664bcbb0489c83d28d36c57dc80f?start=2022-10-01T01%3A05%3A27.530691&end=2022-10-03T01%3A05%3A27.530691 => generated 695 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:27.934013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:27.934661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:27.942444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.942969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.943411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.944126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.944585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.945011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.985723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:27.986208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:27.986993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:27.987456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lazy-loading 'fault' on Instance uuid 84b9b23c-04cc-48a2-a899-6bad90818950 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:28.181364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:28.191856 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-32816001-4684-4c45-8e9d-3b190a4d5015 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1331 microversion: 2.1 time: 0.261987 Oct 02 01:05:28.206193 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 611/1291] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:28.206193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '.version_select at 0x7fb8812673a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:28.209725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.210326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.213094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.225552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.225552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.225861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.252062 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6194ca5a-ccbf-42d3-90b4-8bc0fa88a5b7 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/56d7664bcbb0489c83d28d36c57dc80f?start=2022-10-01T01%3A05%3A27.530691&end=2022-10-03T01%3A05%3A27.530691" status: 200 len: 695 microversion: 2.1 time: 0.057989 Oct 02 01:05:28.273981 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 612/1292] 10.222.0.23 () {58 vars in 1412 bytes} [Sun Oct 2 01:05:28 2022] GET /compute/v2.1/os-simple-tenant-usage/56d7664bcbb0489c83d28d36c57dc80f?start=2022-10-01T01%3A05%3A27.530691&end=2022-10-03T01%3A05%3A27.530691 => generated 695 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:28.281346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:28.282215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:28.290803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.290803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.291599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.292411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.293051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.293795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.377994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:28.400651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1343df19-1685-4776-b6c1-31f6b6b70bd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.896075 Oct 02 01:05:28.403571 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 681/1293] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:27 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:28.424004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:28.430317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:28.457750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.460154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.460672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.461439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.461916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.466841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.625172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:28.635923 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-962c62c6-9056-45c7-a776-f88ea4d3edd1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1275 microversion: 2.1 time: 0.229439 Oct 02 01:05:28.636702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 682/1294] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:28 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:28.648378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Calling method '.version_select at 0x7fb881215040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:28.678289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.682724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.683296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.732237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.732733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.733173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.903618 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c28bbb43-8ee4-461d-ac1f-7cfaa6defbf2 tempest-TenantUsagesTestJSON-1714566965 tempest-TenantUsagesTestJSON-1714566965-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-01T01%3A05%3A27.530691&end=2022-10-03T01%3A05%3A27.530691&detailed=1" status: 200 len: 15383 microversion: 2.1 time: 0.259708 Oct 02 01:05:28.908888 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 683/1295] 10.222.0.23 () {58 vars in 1335 bytes} [Sun Oct 2 01:05:28 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-01T01%3A05%3A27.530691&end=2022-10-03T01%3A05%3A27.530691&detailed=1 => generated 15383 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:05:28.923416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-42536b55-0c90-4966-bff0-4f0f237ffb56 req-e26825d2-a735-4531-8be8-a6a19ab8db40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458d4fea-512b-4a99-8b13-647e57ef0c93", "tag": "1f80054f-e9ef-427a-a9f7-7d7d79b7a14e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:28.948451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-42536b55-0c90-4966-bff0-4f0f237ffb56 req-e26825d2-a735-4531-8be8-a6a19ab8db40 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:28.948938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-42536b55-0c90-4966-bff0-4f0f237ffb56 req-e26825d2-a735-4531-8be8-a6a19ab8db40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:28.949376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-42536b55-0c90-4966-bff0-4f0f237ffb56 req-e26825d2-a735-4531-8be8-a6a19ab8db40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:28.975617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-42536b55-0c90-4966-bff0-4f0f237ffb56 req-e26825d2-a735-4531-8be8-a6a19ab8db40 service nova] Creating event network-changed:1f80054f-e9ef-427a-a9f7-7d7d79b7a14e for instance 458d4fea-512b-4a99-8b13-647e57ef0c93 on n-h1-master-1 Oct 02 01:05:28.990971 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-42536b55-0c90-4966-bff0-4f0f237ffb56 req-e26825d2-a735-4531-8be8-a6a19ab8db40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080637 Oct 02 01:05:28.992006 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 684/1296] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:29.001869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.002584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] [instance: 0dfd9835-627c-451d-b86e-1115b727db28] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.024054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.024593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.025050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.026078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.026527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.026989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.067788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] HTTP exception thrown: Instance 0dfd9835-627c-451d-b86e-1115b727db28 could not be found. Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Request method failure captured: Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 HTTP/1.1 Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOONMcMJiJ16dSi5w0opg2cNOPpfKoPgRiDAV3BgdmfUbp6jsiXkxe9ubJ0ULlSZGZHbqeupYs8_otc1Vb_1Ex4y04W5FiKwkLhPvzroFd1OpwhAIAACFfA5ly9DQ4twyMjAdWBo-3TjvzBdZHXUYF_b-KkOzCxkkJitZj_tRAcTzbHg Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ad7cba3465048b195bfe5d870860bdf Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-77815970 Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:05:29.071062 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ad7cba3465048b195bfe5d870860bdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ad7cba3465048b195bfe5d870860bdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ad7cba3465048b195bfe5d870860bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ad7cba3465048b195bfe5d870860bdf"}]}] Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-77815970 Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ad7cba3465048b195bfe5d870860bdf Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-77815970 Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-77815970-project Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 0db18eb48be64e72a9419d4e7452ca5b Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-77815970-project Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0dfd9835-627c-451d-b86e-1115b727db28 could not be found. Oct 02 01:05:29.072444 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0dfd9835-627c-451d-b86e-1115b727db28'} Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dfd9835-627c-451d-b86e-1115b727db28 could not be found. Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:29.073226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dfd9835-627c-451d-b86e-1115b727db28 could not be found. Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dfd9835-627c-451d-b86e-1115b727db28 could not be found. Oct 02 01:05:29.074654 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:29.075807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Returning 404 to user: Instance 0dfd9835-627c-451d-b86e-1115b727db28 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:29.075807 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10059a0c-4db9-463c-acef-fe2d313f9334 tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28" status: 404 len: 111 microversion: 2.1 time: 0.079356 Oct 02 01:05:29.079933 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 685/1297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:28 2022] GET /compute/v2.1/servers/0dfd9835-627c-451d-b86e-1115b727db28 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:29.084952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-74a8bd21-ff4e-4ec6-9e38-4949b020bc47 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8810e2310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.186200 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-74a8bd21-ff4e-4ec6-9e38-4949b020bc47 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.105107 Oct 02 01:05:29.187465 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 686/1298] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:29 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:29.201377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.205888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.221309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.223408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.224082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.226400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.227110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.230246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.293549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:29.428857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:29.446755 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ded992c-6d79-44e8-ad90-29cb9ab4ecc6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1537 microversion: 2.1 time: 1.169541 Oct 02 01:05:29.456651 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 613/1299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:28 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1537 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:29.473374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6989b42-c717-45f1-9874-101cc120823f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] Calling method '.version_select at 0x7fb8812a0dc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.480821 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d10fd456-bccc-4728-a3f8-adde1e743e50 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 204 len: 0 microversion: 2.1 time: 0.290515 Oct 02 01:05:29.482138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 687/1300] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:29 2022] DELETE /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:29.488408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.497644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.515184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.516149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.516960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.517929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.521266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.521804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.536695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6989b42-c717-45f1-9874-101cc120823f tempest-ServersTestJSON-77815970 tempest-ServersTestJSON-77815970-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366302206" status: 202 len: 0 microversion: 2.1 time: 0.078894 Oct 02 01:05:29.539637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 614/1301] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366302206 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:29.550448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.551412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.574406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.575267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.578993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.580105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.580775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.584219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.605591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.605836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.606762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.607309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lazy-loading 'fault' on Instance uuid 84b9b23c-04cc-48a2-a899-6bad90818950 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:29.842401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9632b1b483dd442f88e8898ef29eb257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7bf422e16441498c97377ae1b7a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:29.855237 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c359699-04b9-42cb-8f24-cb5c42a2f4f2 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 200 len: 1331 microversion: 2.1 time: 0.371469 Oct 02 01:05:29.855849 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 688/1302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:29 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 1331 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:29.876313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:29.886793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:29.899072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.899568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.900009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:29.904472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:29.904994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:29.909757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:30.363905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:30.378290 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0db26d72-0ffb-42c6-8e61-488c088a6174 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.836534 Oct 02 01:05:30.391286 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 615/1303] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:29 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:30.399666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:30.400340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:30.411480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:30.420344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:30.421172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:30.421780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:30.423508 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06618c05-df70-41c1-bf09-ddc1642a5f83 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1470 microversion: 2.1 time: 0.562368 Oct 02 01:05:30.429929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:30.431282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:30.431480 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 689/1304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:29 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1470 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:30.433432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:30.444670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71e1527e-4734-4175-83ee-ac9e3a41018d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811adb80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:30.533458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71e1527e-4734-4175-83ee-ac9e3a41018d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.100407 Oct 02 01:05:30.535519 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 690/1305] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:30 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:30.540604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:30.541975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:30.549526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:30.550371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:30.551089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:30.552045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:30.552744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:30.553413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.443911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:31.464234 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b14ac6e4-8dbd-407b-a24f-8d8efe2a54fa tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.927428 Oct 02 01:05:31.464829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 691/1306] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:30 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:31.492029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:31.492956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:31.508745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.513884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.514582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.517511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.519123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.519745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.523481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:31.533244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65a89846-5de2-4d94-9c7c-a46d280482d4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 1.140585 Oct 02 01:05:31.539202 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 616/1307] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:30 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:31.548097 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] HTTP exception thrown: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Request method failure captured: Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 HTTP/1.1 Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOMDDi6F-I7Iz6Cf6U1cmnXPx9l5h3qWMhyZZ3H5SUVyzJei7R1tvoVO2nnhnEUBwRtwJs45NwmQk7Fpd-2YxnVIX9T3rFK9WEgztLKeKaSbp5FOX1wT0CY8T8XUEAUb1Alm1VxOhAdIXnVJtos-8v9tKFtBxEiclGX03B6Roccimsw Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8fa7bf422e16441498c97377ae1b7a85 Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:05:31.552649 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fa7bf422e16441498c97377ae1b7a85"}]}] Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8fa7bf422e16441498c97377ae1b7a85 Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachSCSIVolumeTestJSON-1169323559-project Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 9632b1b483dd442f88e8898ef29eb257 Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1169323559-project Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:31.554387 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '84b9b23c-04cc-48a2-a899-6bad90818950'} Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:31.555395 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:31.556711 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:31.558141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Returning 404 to user: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:31.559573 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a4df772-b213-4dc3-a20e-32b759b30b2c tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 404 len: 111 microversion: 2.1 time: 0.072172 Oct 02 01:05:31.560157 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 692/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:31 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:31.562053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:31.563336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:31.571697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:31.577615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.579892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.580353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.581090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.581582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.584587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:31.586336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.610060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.618181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.621392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:31.622953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:31.629928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:31.634966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.059815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:32.078501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f524275-4c17-4044-8cbb-ae7cf30b760b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.537852 Oct 02 01:05:32.079486 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 617/1309] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:31 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:32.095604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1da444e8-8d97-49cc-8a1e-6e810d063924 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881284940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:32.171093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1da444e8-8d97-49cc-8a1e-6e810d063924 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.090693 Oct 02 01:05:32.181887 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 618/1310] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:32 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:32.187438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1f4acd4-8c4b-40cc-86be-f1e7875f53a9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '.version_select at 0x7fb8812bf9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:32.227340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:32.227929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1f4acd4-8c4b-40cc-86be-f1e7875f53a9 tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455707336" status: 202 len: 0 microversion: 2.1 time: 0.044580 Oct 02 01:05:32.228739 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 619/1311] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:05:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455707336 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:05:32.246870 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-912dce18-ae13-41ab-ab73-c3ec3d0ea0d8 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1470 microversion: 2.1 time: 0.679686 Oct 02 01:05:32.248493 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 693/1312] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:31 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1470 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:32.438306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-491d33c9-a967-419a-8930-26685ea59f64 req-d949d509-5eb5-4bde-b416-701dce99c9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f085246-1145-42f4-85f1-75ca14086904", "tag": "4278224d-ce4b-47ad-b590-3842c0f39429"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:32.472795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-491d33c9-a967-419a-8930-26685ea59f64 req-d949d509-5eb5-4bde-b416-701dce99c9da service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.473403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-491d33c9-a967-419a-8930-26685ea59f64 req-d949d509-5eb5-4bde-b416-701dce99c9da service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.473917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-491d33c9-a967-419a-8930-26685ea59f64 req-d949d509-5eb5-4bde-b416-701dce99c9da service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.491967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:32.492590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:32.504571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.504870 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-491d33c9-a967-419a-8930-26685ea59f64 req-d949d509-5eb5-4bde-b416-701dce99c9da service nova] Creating event network-changed:4278224d-ce4b-47ad-b590-3842c0f39429 for instance 8f085246-1145-42f4-85f1-75ca14086904 on n-h1-master-1 Oct 02 01:05:32.505977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.506878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.507780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.511104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.511815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.515090 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-491d33c9-a967-419a-8930-26685ea59f64 req-d949d509-5eb5-4bde-b416-701dce99c9da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097147 Oct 02 01:05:32.518970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 620/1313] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:32.560005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:32.560786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:32.579304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.582999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.583696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:32.584569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:32.587472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:32.588009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:33.233541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:33.246690 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3f1c31e-306e-4836-946e-7adc45d9166f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.758672 Oct 02 01:05:33.266990 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 694/1314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:32 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:33.273598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:33.275080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:33.280180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:33.285997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:33.288129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:33.289674 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6416be65-3f64-4a40-9911-bb3d790f1ae9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.734813 Oct 02 01:05:33.303366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 621/1315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:32 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:33.303366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26d24deb-a841-4289-994f-adafa0dacbc4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812cbb80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:33.304320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:33.305445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:33.315159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:33.316022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:33.395898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26d24deb-a841-4289-994f-adafa0dacbc4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.098986 Oct 02 01:05:33.400643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 622/1316] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:33 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:33.413318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:33.413955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:33.422910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:33.423409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:33.423853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:33.424568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:33.425028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:33.425466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:33.729624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:33.743450 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-166ec3b9-3281-410a-97a9-87523fb7258e tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1470 microversion: 2.1 time: 0.341601 Oct 02 01:05:33.743967 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 623/1317] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:33 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:33.861134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:33.873344 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a25af1c3-60bb-4790-a134-ac21a4338e37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.604766 Oct 02 01:05:33.895498 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 695/1318] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:33 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:34.274222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:34.275425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:34.294321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.298593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.299253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.300143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.302672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.303359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.325407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:34.326284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:34.347755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.348253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.348700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.349444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.349912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.367896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.663135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:34.677751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:34.682683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d8388618-56f6-45ed-a2e0-a490f2c2dd56 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.364831 Oct 02 01:05:34.694670 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 696/1319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:34 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:34.705169 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ddd106b-e78a-42ee-bb58-067a71289f1b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.429170 Oct 02 01:05:34.718646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8884f08d-5802-45a1-879a-0f702f1c8136 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881297040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:34.724231 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 624/1320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:34 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:34.771945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:34.772821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:34.789517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.791242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.791760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.793513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.795736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:34.796262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:34.951816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:34.960927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7145f38b-16d3-437e-8aca-8dc8a31838b2 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1428 microversion: 2.1 time: 0.193537 Oct 02 01:05:34.968086 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 625/1321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:34 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1428 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:34.973374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-acb4156b-943f-48c7-be68-89593b19fc2a req-ca9d592b-63f9-49e4-8ebe-03c695b088ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aef15f0-1588-49a4-91e5-784d833442ee", "name": "network-vif-deleted", "tag": "cae22939-6051-4c0e-b5b7-1ec9c1d30e6c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:34.996775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-acb4156b-943f-48c7-be68-89593b19fc2a req-ca9d592b-63f9-49e4-8ebe-03c695b088ac service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:34.999322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-acb4156b-943f-48c7-be68-89593b19fc2a req-ca9d592b-63f9-49e4-8ebe-03c695b088ac service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.005294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-acb4156b-943f-48c7-be68-89593b19fc2a req-ca9d592b-63f9-49e4-8ebe-03c695b088ac service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.022829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-acb4156b-943f-48c7-be68-89593b19fc2a req-ca9d592b-63f9-49e4-8ebe-03c695b088ac service nova] Creating event network-vif-deleted:cae22939-6051-4c0e-b5b7-1ec9c1d30e6c for instance 0aef15f0-1588-49a4-91e5-784d833442ee on n-h1-master-1 Oct 02 01:05:35.045268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-acb4156b-943f-48c7-be68-89593b19fc2a req-ca9d592b-63f9-49e4-8ebe-03c695b088ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075228 Oct 02 01:05:35.045705 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 626/1322] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:35.053680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.054408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.072470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.072961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.073399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.081916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.082678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.083320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.380889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:35.404567 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aabea1ac-fc98-4b48-8972-dbc4ccc54862 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.357357 Oct 02 01:05:35.423738 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 627/1323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:35 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:35.709923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.710998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.726691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.727205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.727653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.728970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.729447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.729867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.757424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8884f08d-5802-45a1-879a-0f702f1c8136 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 1.067316 Oct 02 01:05:35.760613 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 697/1324] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:34 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:35.772544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.773447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.793702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.794371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.796499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.798023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.800414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.803712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.811765 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:36.126760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:36.135494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d65a8f06-f812-47ec-b5cf-d74f76beb01c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.373657 Oct 02 01:05:36.154972 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 698/1325] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:35 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:36.163945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:36.183023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:36.195645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.211345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.211985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.212917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.213546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.214155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.233842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:36.249922 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4233a1ff-8652-4b0e-9ae5-dbd98dd7e74f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.543852 Oct 02 01:05:36.251397 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 628/1326] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:35 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:36.381220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:36.393264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a47c439f-7b7c-42e7-91cb-15db37d86b1f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1428 microversion: 2.1 time: 0.233117 Oct 02 01:05:36.394277 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 699/1327] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:36 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1428 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:36.433057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:36.434149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:36.442999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.443815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.444469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.445408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.446076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.446753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.613497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:36.636139 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99b509fd-d1c3-44c1-a5b1-e0b9c48d1396 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.205999 Oct 02 01:05:36.641285 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 629/1328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:36 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:36.773460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61857eb1-bfab-4294-9470-fbbf8982abcf tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fc820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:36.852684 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61857eb1-bfab-4294-9470-fbbf8982abcf tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.083210 Oct 02 01:05:36.853272 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 700/1329] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:36 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:37.168029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.168999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.182860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.183468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.183983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.184967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.185647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.186294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.277100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.278442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.292703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.293482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.301723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.302963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.303627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.304260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.605101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:37.615436 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-316cb70e-03f1-4e8b-aaff-bf2b0bfc3ccd tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.342276 Oct 02 01:05:37.619654 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 701/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:37.629621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.632067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.645054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.645710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.646278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.647147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.648016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.648730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.666917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:37.686494 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-61a6306b-0384-47e6-8997-858d2a3d1d2e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.519882 Oct 02 01:05:37.691400 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 630/1331] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:37.711161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.712735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.731401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.735081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.737334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.740414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.742962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.749550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.826906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:37.840482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f673f52e-d084-43d5-970f-bdde0e0a8b0f tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1428 microversion: 2.1 time: 0.219284 Oct 02 01:05:37.842088 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 702/1332] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:37.869881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0067cd4-b555-4c61-9420-abf92b43d7c7 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881297040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.956272 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0067cd4-b555-4c61-9420-abf92b43d7c7 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.090862 Oct 02 01:05:37.957420 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 703/1333] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:38.089151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:38.100732 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96fd6447-72d5-4392-a744-5e9a5c76d6d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.407817 Oct 02 01:05:38.101604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 631/1334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:38.642071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:38.643202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:38.659331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:38.660082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:38.660740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:38.663833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:38.664373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:38.664931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:38.717896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:38.720806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:38.732257 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:38.733280 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:38.757470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:38.761973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:38.763866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:38.765669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:38.767800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:38.768418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:38.809702 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:38.978642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:38.994808 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-594188ee-35e0-4f21-b1d2-a439a0ecec5a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.357116 Oct 02 01:05:39.003473 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 704/1335] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:38 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:39.012172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:39.013145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:39.037603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.039879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.041695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.042724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.047986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.048786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.127630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:39.137550 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-da1bcf6c-adae-4652-a93f-675724f4f48d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.423679 Oct 02 01:05:39.140221 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 632/1336] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:38 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:39.146859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b1f351e-f116-46bf-bcde-2bd9d5865e89 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811514c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:39.195719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.209484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.210502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.213803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lazy-loading 'fault' on Instance uuid 0aef15f0-1588-49a4-91e5-784d833442ee {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:39.244627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b1f351e-f116-46bf-bcde-2bd9d5865e89 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.101427 Oct 02 01:05:39.246831 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 633/1337] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:39 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:39.262329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:39.264945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:39.284859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.287914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.291097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.292592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.293809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.297231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.334852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8151aecbbb284b71ba3fb42de244b870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d7664bcbb0489c83d28d36c57dc80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:39.353850 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-131c63ac-3272-4ef4-8e51-d22241e9ecb0 tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 200 len: 1304 microversion: 2.1 time: 0.348160 Oct 02 01:05:39.357496 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 705/1338] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:39 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 1304 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:40.028208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:40.028829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:40.039141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.039631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.040066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.040782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.041237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.041669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.101564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:40.112429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68e842d7-7451-4dd9-8b80-bb1cfa1a4214 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.862374 Oct 02 01:05:40.113300 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 634/1339] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:39 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:40.167553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:40.168175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:40.178375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.181755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.182493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.185824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.186343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.186822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.404667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:40.413960 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5020e480-a043-4834-8152-c33836b37983 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.250307 Oct 02 01:05:40.438085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:40.442771 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 635/1340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:40 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:40.451313 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f26995e6-49e7-4706-8ef3-716b9c79168c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.426844 Oct 02 01:05:40.463273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 706/1341] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:40 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:40.477182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:40.477963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1ff9d17-462c-441e-a019-ef120fa3e8c3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8813a98b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:40.485664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] [instance: 0aef15f0-1588-49a4-91e5-784d833442ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:40.494359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.495290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.495896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.496806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.497431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.498111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.519444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] HTTP exception thrown: Instance 0aef15f0-1588-49a4-91e5-784d833442ee could not be found. Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Request method failure captured: Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee HTTP/1.1 Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOOzycdwryl5oalIRD1XoTMgkRDrWoHrM5huDd1-QXc-ED6rlSfCgxSByUrn9DKFSwfqbij79JLfMqcx1D3yUlaLig1-pkbSCobD21r1Fvpx4xgYGMtSJoxMeRWh__Ox5W4QZ0FCGcNP1tOSVsloM7ATd9FWtQXJQSqR7RkXofbjEBA Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 56d7664bcbb0489c83d28d36c57dc80f Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TenantUsagesTestJSON-591278412 Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:05:40.521364 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56d7664bcbb0489c83d28d36c57dc80f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56d7664bcbb0489c83d28d36c57dc80f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56d7664bcbb0489c83d28d36c57dc80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56d7664bcbb0489c83d28d36c57dc80f"}]}] Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TenantUsagesTestJSON-591278412 Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 56d7664bcbb0489c83d28d36c57dc80f Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TenantUsagesTestJSON-591278412 Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TenantUsagesTestJSON-591278412-project Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8151aecbbb284b71ba3fb42de244b870 Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TenantUsagesTestJSON-591278412-project Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0aef15f0-1588-49a4-91e5-784d833442ee could not be found. Oct 02 01:05:40.522765 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0aef15f0-1588-49a4-91e5-784d833442ee'} Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aef15f0-1588-49a4-91e5-784d833442ee could not be found. Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:40.523524 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aef15f0-1588-49a4-91e5-784d833442ee could not be found. Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aef15f0-1588-49a4-91e5-784d833442ee could not be found. Oct 02 01:05:40.524831 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.527677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] Returning 404 to user: Instance 0aef15f0-1588-49a4-91e5-784d833442ee could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:40.528759 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2827a0a8-c87c-4a20-b63c-059c3af7500b tempest-TenantUsagesTestJSON-591278412 tempest-TenantUsagesTestJSON-591278412-project] 10.222.0.23 "GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee" status: 404 len: 111 microversion: 2.1 time: 0.064457 Oct 02 01:05:40.538643 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 707/1342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:40 2022] GET /compute/v2.1/servers/0aef15f0-1588-49a4-91e5-784d833442ee => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:40.561345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1ff9d17-462c-441e-a019-ef120fa3e8c3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.113600 Oct 02 01:05:40.572993 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 636/1343] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:40 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:41.139977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:41.140641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:41.151046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.153215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.155248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.158980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.160336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.161041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.448443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:41.449602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:41.462373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.465662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.466390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.467351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.473171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.482949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.717225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:41.741721 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-363c8d5c-dd7f-48d2-93ee-7d773fc65d37 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.605346 Oct 02 01:05:41.743191 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 708/1344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:41 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:41.762120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:41.766277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:41.792929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.793686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.795093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.799468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.800226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.802117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.120835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:42.135203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-532f5117-5946-44f4-bebd-0d6ed44f0493 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.691835 Oct 02 01:05:42.157684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 637/1345] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:41 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:42.163643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:42.164436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:42.172098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.172964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.173662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.174626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.175304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.175947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.204483 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] HTTP exception thrown: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Request method failure captured: Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 HTTP/1.1 Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOMDDi6F-I7Iz6Cf6U1cmnXPx9l5h3qWMhyZZ3H5SUVyzJei7R1tvoVO2nnhnEUBwRtwJs45NwmQk7Fpd-2YxnVIX9T3rFK9WEgztLKeKaSbp5FOX1wT0CY8T8XUEAUb1Alm1VxOhAdIXnVJtos-8v9tKFtBxEiclGX03B6Roccimsw Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8fa7bf422e16441498c97377ae1b7a85 Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:05:42.207428 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fa7bf422e16441498c97377ae1b7a85"}]}] Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8fa7bf422e16441498c97377ae1b7a85 Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachSCSIVolumeTestJSON-1169323559-project Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 9632b1b483dd442f88e8898ef29eb257 Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1169323559-project Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.208837 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '84b9b23c-04cc-48a2-a899-6bad90818950'} Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:42.209590 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.210825 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.216375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Returning 404 to user: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:42.218283 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f40955e-0fb7-4003-b2f9-60389a8a2b6f tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 404 len: 111 microversion: 2.1 time: 0.059147 Oct 02 01:05:42.220948 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 638/1346] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:42 2022] DELETE /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:42.223391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:42.228259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f68a8607-dadc-4b70-838e-89b4f5418300 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88142ff70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:42.243452 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-323d2610-93ef-4831-9d17-39ea12d2036e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.496885 Oct 02 01:05:42.249538 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 709/1347] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:41 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:42.263600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:42.265755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] [instance: 84b9b23c-04cc-48a2-a899-6bad90818950] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:42.282828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.289851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.292530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.296278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.300427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.303304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.332937 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f68a8607-dadc-4b70-838e-89b4f5418300 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.110142 Oct 02 01:05:42.336423 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 639/1348] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:42 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:42.367418 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] HTTP exception thrown: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Request method failure captured: Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 HTTP/1.1 Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOMDDi6F-I7Iz6Cf6U1cmnXPx9l5h3qWMhyZZ3H5SUVyzJei7R1tvoVO2nnhnEUBwRtwJs45NwmQk7Fpd-2YxnVIX9T3rFK9WEgztLKeKaSbp5FOX1wT0CY8T8XUEAUb1Alm1VxOhAdIXnVJtos-8v9tKFtBxEiclGX03B6Roccimsw Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8fa7bf422e16441498c97377ae1b7a85 Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:05:42.373102 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa7bf422e16441498c97377ae1b7a85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fa7bf422e16441498c97377ae1b7a85"}]}] Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8fa7bf422e16441498c97377ae1b7a85 Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1169323559 Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachSCSIVolumeTestJSON-1169323559-project Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 9632b1b483dd442f88e8898ef29eb257 Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1169323559-project Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.376525 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '84b9b23c-04cc-48a2-a899-6bad90818950'} Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:42.378057 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. Oct 02 01:05:42.380601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:05:42.385276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] Returning 404 to user: Instance 84b9b23c-04cc-48a2-a899-6bad90818950 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:42.385276 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e59716d1-253c-4f3a-9249-5d0063421fda tempest-AttachSCSIVolumeTestJSON-1169323559 tempest-AttachSCSIVolumeTestJSON-1169323559-project] 10.222.0.23 "GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950" status: 404 len: 111 microversion: 2.1 time: 0.125657 Oct 02 01:05:42.385276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 710/1349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:42 2022] GET /compute/v2.1/servers/84b9b23c-04cc-48a2-a899-6bad90818950 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:42.787623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:42.788847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:42.808882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.809392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.809841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.810578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.811067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.811499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.080139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d5ef784c-482d-4d50-90ce-2e04932e79d8 req-a9c89660-081f-4d77-a9b6-5717780df93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f085246-1145-42f4-85f1-75ca14086904", "name": "network-vif-plugged", "status": "completed", "tag": "4278224d-ce4b-47ad-b590-3842c0f39429"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:43.138205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5ef784c-482d-4d50-90ce-2e04932e79d8 req-a9c89660-081f-4d77-a9b6-5717780df93b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.140384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5ef784c-482d-4d50-90ce-2e04932e79d8 req-a9c89660-081f-4d77-a9b6-5717780df93b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.141278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5ef784c-482d-4d50-90ce-2e04932e79d8 req-a9c89660-081f-4d77-a9b6-5717780df93b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.165681 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d5ef784c-482d-4d50-90ce-2e04932e79d8 req-a9c89660-081f-4d77-a9b6-5717780df93b service nova] Creating event network-vif-plugged:4278224d-ce4b-47ad-b590-3842c0f39429 for instance 8f085246-1145-42f4-85f1-75ca14086904 on n-h1-master-1 Oct 02 01:05:43.196305 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d5ef784c-482d-4d50-90ce-2e04932e79d8 req-a9c89660-081f-4d77-a9b6-5717780df93b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122091 Oct 02 01:05:43.201341 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 711/1350] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:43.232971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:43.240054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:43.263929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.264993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.267191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.268695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.269901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.272017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.434862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:43.446963 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef9a5c57-31c9-4c62-938a-74821eb8fb5f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.664357 Oct 02 01:05:43.447723 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 640/1351] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:42 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:43.464909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:43.465841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:43.484914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.485909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.486626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.487512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.488123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.488706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.935461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:43.952879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04440d48-df89-458b-b1cd-67c2d92e9188 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.492862 Oct 02 01:05:43.956228 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 641/1352] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:43 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:43.956949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:43.967853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3582acd4-2399-4f85-8842-2d704add653d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881316280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:43.975531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-392b67c8-e843-4101-94b9-05b8796a63cc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.768449 Oct 02 01:05:43.976373 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 712/1353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:43 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:44.091288 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3582acd4-2399-4f85-8842-2d704add653d tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.132594 Oct 02 01:05:44.092260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 642/1354] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:43 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:44.477913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:44.479751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:44.488508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:44.489371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:44.489985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:44.491727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:44.492417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:44.493005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:44.863512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:44.874521 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d330c77-5cf0-4bae-8471-9ac88cc8b91f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.403861 Oct 02 01:05:44.882876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 713/1355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:44 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:44.995405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:44.998768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:45.003726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:45.005356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:45.014777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:45.023555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:45.026308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:45.027343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:45.029089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:45.029939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:45.037461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:45.041244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:45.041980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:45.045940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:45.049141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:45.049682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:45.834936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:45.845045 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3deb6756-804f-485b-be41-55307b7126da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1317 microversion: 2.1 time: 0.863641 Oct 02 01:05:45.849767 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 643/1356] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:44 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:45.873266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6584b3e-6a43-4245-b8f1-b5954659ae8a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88134b040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:45.915185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:45.938675 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c1d1d5a-4281-4d48-ab07-b74e4c23618d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.938869 Oct 02 01:05:45.943120 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 714/1357] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:44 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:45.953360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:45.961865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:46.007155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.012654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.017294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.018444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.020619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.022626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.411731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:46.419047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6584b3e-6a43-4245-b8f1-b5954659ae8a tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.567398 Oct 02 01:05:46.419962 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 644/1358] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:45 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:46.449461 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88bbb294-11d1-49e1-ac4d-3f2ecce719e9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.498310 Oct 02 01:05:46.451857 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 715/1359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:45 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:46.879559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:46.880314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:46.891971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.892474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.892910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.893625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.894082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.894505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.970132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:46.970788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:46.987637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.988143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.994748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.995631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.996123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.996566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:47.479945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:47.489506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e3726a3-c0ad-4826-b843-96b69c7a7396 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.523903 Oct 02 01:05:47.515390 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 716/1360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:46 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:47.533966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d84f65c7-6adb-4736-b41e-3950a23fa11c req-29df17a1-115e-49d5-bd95-b2dc0f279a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb1a15c-d52b-476c-a4e3-50bbdbaef041", "name": "network-vif-unplugged", "status": "completed", "tag": "08aace31-2f62-4fd1-ab2a-13fc3014b4c9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:47.580065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d84f65c7-6adb-4736-b41e-3950a23fa11c req-29df17a1-115e-49d5-bd95-b2dc0f279a16 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:47.580546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d84f65c7-6adb-4736-b41e-3950a23fa11c req-29df17a1-115e-49d5-bd95-b2dc0f279a16 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:47.580990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d84f65c7-6adb-4736-b41e-3950a23fa11c req-29df17a1-115e-49d5-bd95-b2dc0f279a16 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:47.597332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:47.610225 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8d7aa5b-addd-48a4-b182-f83068450d18 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1467 microversion: 2.1 time: 0.734669 Oct 02 01:05:47.613657 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 645/1361] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:46 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1467 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:47.630424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b1787ca-8199-42be-b438-5bf9f0a84444 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881151790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:47.634383 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d84f65c7-6adb-4736-b41e-3950a23fa11c req-29df17a1-115e-49d5-bd95-b2dc0f279a16 service nova] Creating event network-vif-unplugged:08aace31-2f62-4fd1-ab2a-13fc3014b4c9 for instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 on n-h2-master-1 Oct 02 01:05:47.640053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d84f65c7-6adb-4736-b41e-3950a23fa11c req-29df17a1-115e-49d5-bd95-b2dc0f279a16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123376 Oct 02 01:05:47.644510 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 717/1362] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:47.650459 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:47.651421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:47.659124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:47.659607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:47.660050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:47.660755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:47.661397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:47.661979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.319511 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b1787ca-8199-42be-b438-5bf9f0a84444 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.702563 Oct 02 01:05:48.320098 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 646/1363] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:47 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:48.347193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:48.353224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:48.377917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.377917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.385597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.386394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.386906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.387357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.746680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:48.763367 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-edcae445-24e9-4a0a-a773-197a0c97146e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 1.117399 Oct 02 01:05:48.782253 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 718/1364] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:47 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:48.800042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0dd36864-8fe7-491b-a676-0706731bcdea tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8811b8310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:48.829345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c86e9d1-ea87-4fb2-a521-3f4f5e7163c0 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1618 microversion: 2.1 time: 0.497182 Oct 02 01:05:48.830014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 647/1365] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:48 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1618 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:48.846155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:48.846826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:48.858391 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0dd36864-8fe7-491b-a676-0706731bcdea tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/650e2e80-a0c5-487b-86c6-1f2288285a4f" status: 200 len: 661 microversion: 2.1 time: 0.074596 Oct 02 01:05:48.860200 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 719/1366] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:48 2022] GET /compute/v2.1/images/650e2e80-a0c5-487b-86c6-1f2288285a4f => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:48.883681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.884176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.884627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.885355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.885817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.886248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.895799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3fcbd01-bb97-4ea3-b3d5-c1e5b64d891f tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881382550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:48.994744 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3fcbd01-bb97-4ea3-b3d5-c1e5b64d891f tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/650e2e80-a0c5-487b-86c6-1f2288285a4f" status: 200 len: 661 microversion: 2.1 time: 0.122022 Oct 02 01:05:48.995953 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 720/1367] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:48 2022] GET /compute/v2.1/images/650e2e80-a0c5-487b-86c6-1f2288285a4f => generated 661 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:49.130689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2060329551", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7d3d7159-ba16-41d9-8d7b-c87ac671ad0a"]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:49.304121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:05:49.605542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:49.615426 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf1de9f3-de8a-4fdc-89bf-7b444bb2a461 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.779712 Oct 02 01:05:49.616014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 648/1368] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:48 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:49.644041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-336a32b2-14c4-425b-87e4-5ab1336a54fd tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8814b2e50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:49.765188 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-336a32b2-14c4-425b-87e4-5ab1336a54fd tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.133001 Oct 02 01:05:49.781450 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 649/1369] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:49 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:49.787061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-77110ff4-b38c-41f4-8edb-809ac5967431 req-c3a2879f-5a4e-453f-a937-7d8e84c0cf3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb1a15c-d52b-476c-a4e3-50bbdbaef041", "tag": "08aace31-2f62-4fd1-ab2a-13fc3014b4c9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:49.816712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-77110ff4-b38c-41f4-8edb-809ac5967431 req-c3a2879f-5a4e-453f-a937-7d8e84c0cf3d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.817199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-77110ff4-b38c-41f4-8edb-809ac5967431 req-c3a2879f-5a4e-453f-a937-7d8e84c0cf3d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.817632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-77110ff4-b38c-41f4-8edb-809ac5967431 req-c3a2879f-5a4e-453f-a937-7d8e84c0cf3d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.833871 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-77110ff4-b38c-41f4-8edb-809ac5967431 req-c3a2879f-5a4e-453f-a937-7d8e84c0cf3d service nova] Creating event network-changed:08aace31-2f62-4fd1-ab2a-13fc3014b4c9 for instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 on n-h2-master-1 Oct 02 01:05:49.864562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-77110ff4-b38c-41f4-8edb-809ac5967431 req-c3a2879f-5a4e-453f-a937-7d8e84c0cf3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081571 Oct 02 01:05:49.865336 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 650/1370] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:49.873381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:49.874292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:49.891181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.896383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.897645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.901936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.902588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.903603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:50.046244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:05:50.047409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:05:50.050029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:05:50.051093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:05:50.051531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:05:50.116451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:50.117349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:50.119311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:50.121539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:50.122207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:50.125124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:50.150847 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:50.165082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:05:50.172077 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:50.175263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:05:50.194565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:05:50.197549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:05:50.335151 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83e3fab3-75d9-495d-9bfd-dcc43135896b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210829 Oct 02 01:05:50.346895 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 721/1371] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:05:50.359807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3804ad0-cf08-4e5b-a76f-684551795a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:50.366053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3804ad0-cf08-4e5b-a76f-684551795a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:50.691931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3804ad0-cf08-4e5b-a76f-684551795a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:50.706084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3804ad0-cf08-4e5b-a76f-684551795a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1217 microversion: 2.1 time: 0.357743 Oct 02 01:05:50.706808 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 722/1372] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:50 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1217 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:50.720805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:50.739442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:50.740070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:50.743281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-914f0b1f-9eca-42be-b3c0-40dc18d219f0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.870409 Oct 02 01:05:50.743928 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 651/1373] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:49 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:50.768561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:50.769089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:50.776013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:50.776013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:50.781237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4857e7f7-477e-4613-a741-6136b9005ff1 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8814b2160>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:50.791236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:50.791833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.086681 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4857e7f7-477e-4613-a741-6136b9005ff1 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.309302 Oct 02 01:05:51.087361 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 652/1374] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:50 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:51.100438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-966fd181-997c-4703-9b48-10661bada1fc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88119b550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.197889 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-966fd181-997c-4703-9b48-10661bada1fc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/706578ae-7b0e-4e9e-be33-ed266072b50d" status: 200 len: 662 microversion: 2.1 time: 0.108256 Oct 02 01:05:51.199258 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 653/1375] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:51 2022] GET /compute/v2.1/images/706578ae-7b0e-4e9e-be33-ed266072b50d => generated 662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:51.223056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47d75a8e-d178-47b3-86a6-1134574af9ea tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881b43700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.318710 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47d75a8e-d178-47b3-86a6-1134574af9ea tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/706578ae-7b0e-4e9e-be33-ed266072b50d" status: 200 len: 662 microversion: 2.1 time: 0.088493 Oct 02 01:05:51.321114 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 654/1376] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:51 2022] GET /compute/v2.1/images/706578ae-7b0e-4e9e-be33-ed266072b50d => generated 662 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:51.444606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:51.470330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-202702cb-2091-4eef-8cd7-7552116dd9b7 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.762486 Oct 02 01:05:51.490745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 723/1377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:50 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:51.733150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-768bbb79-e77b-408d-a93a-12cd6d91a88f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.733990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-768bbb79-e77b-408d-a93a-12cd6d91a88f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:51.764086 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:51.805226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.806211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:51.822714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.823476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.826685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.828773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.833475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.834303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.025534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-768bbb79-e77b-408d-a93a-12cd6d91a88f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:52.045940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-768bbb79-e77b-408d-a93a-12cd6d91a88f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1217 microversion: 2.1 time: 0.317760 Oct 02 01:05:52.049358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 655/1378] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:51 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1217 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:52.104786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-309ebcb2-e9f4-4192-b4b0-24fd1319b089 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb88123d3a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:52.213924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-309ebcb2-e9f4-4192-b4b0-24fd1319b089 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.114346 Oct 02 01:05:52.214389 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 656/1379] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:52 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:52.498962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:52.499937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:52.513222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:52.514657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:52.516958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.521421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:52.522120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:52.522783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.971225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:52.992115 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fdb544b8-fee6-49a2-981d-9a295f72a8f4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.497169 Oct 02 01:05:52.995979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 657/1380] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:52 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:53.030064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:53.053262 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-387ea448-64a1-4c2b-a7a4-f762495820cd tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 1.275823 Oct 02 01:05:53.054265 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 724/1381] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:51 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:53.075403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.076334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:53.096070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.098678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.100256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.101027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.101496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.101924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.230112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-120a0f3b-beaf-4961-b616-0b6c9e1f3804 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812100d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.349597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:53.369071 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2069af50-7b60-4e28-a25f-8e9961ceb35c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1269 microversion: 2.1 time: 0.297449 Oct 02 01:05:53.373150 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 658/1382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:53 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1269 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:53.643220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09663cd7-b349-4088-9be6-936f31dc5f58 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88154b040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.741532 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-120a0f3b-beaf-4961-b616-0b6c9e1f3804 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1426 microversion: 2.1 time: 0.515745 Oct 02 01:05:53.752023 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09663cd7-b349-4088-9be6-936f31dc5f58 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/9ebc58fc-e2cb-4018-9da2-5a8aac50f01d" status: 200 len: 661 microversion: 2.1 time: 0.113718 Oct 02 01:05:53.752574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 659/1383] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:53 2022] GET /compute/v2.1/images/9ebc58fc-e2cb-4018-9da2-5a8aac50f01d => generated 661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:53.753099 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 725/1384] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:53 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1426 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:53.772741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-abf055a2-940e-48d0-aba4-667dc2eee74c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88103fdc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.883720 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-abf055a2-940e-48d0-aba4-667dc2eee74c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/9ebc58fc-e2cb-4018-9da2-5a8aac50f01d" status: 200 len: 661 microversion: 2.1 time: 0.120377 Oct 02 01:05:53.887286 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 726/1385] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:53 2022] GET /compute/v2.1/images/9ebc58fc-e2cb-4018-9da2-5a8aac50f01d => generated 661 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:54.025675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.026891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:54.035997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.038886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.039891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.054864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.058101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.058828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.082635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.083867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:54.100322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.101000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.101638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.102522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.103166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.103846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.472897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:54.504836 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-853607b6-6e9f-4867-9013-e6a025654f69 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.483296 Oct 02 01:05:54.506234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:54.523181 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 660/1386] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:54.530527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-630590671", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:54.535460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db2664ca-5ff2-4cc2-9f88-5f4f6a45bef7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.456001 Oct 02 01:05:54.536442 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 727/1387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:54.551411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.553317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:54.584615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.585320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.585856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.586777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.587338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.587921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.684573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:05:54.776784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:54.805138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0225d69-5279-483f-8e68-e618cc2d08da tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1275 microversion: 2.1 time: 0.264156 Oct 02 01:05:54.806685 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 728/1388] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:54.814242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40b43254-77a9-4bc2-9769-bfe0a9b29f59 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8812e7160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.866968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40b43254-77a9-4bc2-9769-bfe0a9b29f59 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1435 microversion: 2.1 time: 0.057969 Oct 02 01:05:54.879241 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 729/1389] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1435 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:54.884189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f73c044e-a9be-4fc4-a341-3cdaeb2e0149 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8813530d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.938506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f73c044e-a9be-4fc4-a341-3cdaeb2e0149 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 200 len: 1435 microversion: 2.1 time: 0.058123 Oct 02 01:05:54.947633 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 730/1390] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 1435 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:54.961235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.962101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:54.976578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.977323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.978087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.979012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.979638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.980232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.325457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:05:55.326480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:05:55.327473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:05:55.330120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:05:55.330812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:05:55.362805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.363813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.364496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.366285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.367105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.367892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.419816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:55.433799 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95b5a85c-3b7c-4b36-b8eb-11c3babb7b0b tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1479 microversion: 2.1 time: 0.476390 Oct 02 01:05:55.444721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Getting quotas for project 7c58ca9b345e41538c7adb8abde0773f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:05:55.454131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Getting quotas for user d141ea927c214f978ffdc50892a0dc3c and project 7c58ca9b345e41538c7adb8abde0773f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:05:55.455221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 731/1391] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1479 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:55.492162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:05:55.498431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:05:55.539548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:55.541393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:55.596351 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-633bbc22-f450-4fa4-864a-bc29076963c9 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067190 Oct 02 01:05:55.597100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 661/1392] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:05:55.601480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.601870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:55.602685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:55.603375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.608415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.609983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.611028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.611370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.621914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.629099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.629724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.635080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.635862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.636491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.114574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:56.130683 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-843e8f67-561c-4812-ad90-07cbf9c59743 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.531443 Oct 02 01:05:56.131871 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 662/1393] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:55 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:56.138711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:56.149546 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1dd29748-86c3-413c-8261-7880e5230c0a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.623192 Oct 02 01:05:56.154415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 732/1394] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:55 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:56.165293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:56.166208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:56.169848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1392480136", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:56.178672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.179904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.180572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.181545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.182224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.184490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.297071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:05:56.854635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:56.864309 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-233124e3-31bf-4de4-aa0c-8ac5a2f3a7b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 0.707343 Oct 02 01:05:56.879474 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 733/1395] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:56 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:56.886891 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:56.887787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:56.895444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.897246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.897882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.898847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.899741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.900525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.982287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:05:56.983385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:05:56.985484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:05:56.986129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:05:56.986974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:05:57.009006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.013106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.014513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.020939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.022008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.023256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.076961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Getting quotas for project 7c58ca9b345e41538c7adb8abde0773f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:05:57.096060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Getting quotas for user d141ea927c214f978ffdc50892a0dc3c and project 7c58ca9b345e41538c7adb8abde0773f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:05:57.122419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:05:57.129985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:05:57.279764 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-89135b7e-cc73-4d77-a9b9-a61dba889d12 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144672 Oct 02 01:05:57.286403 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 663/1396] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:05:57.300700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:57.301348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:57.343365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.344327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.344794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.348200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.348683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.349117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.020017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:58.029226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3a1bfa14-a6a3-4655-8552-5024171e7d4e tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1466 microversion: 2.1 time: 1.148581 Oct 02 01:05:58.029888 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 734/1397] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:56 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1466 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:58.047077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:58.049484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:58.064164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.074098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.074801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.075904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.076652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.077334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.446584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:58.457247 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:58.466211 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de778e79-bc4e-4ec2-8425-6986f7abfae3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 1.178287 Oct 02 01:05:58.473438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 664/1398] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:57 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:58.486974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:58.492113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:58.492750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:58.498651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-265c2d27-52f2-42ef-aa68-a533e1cac752 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.463746 Oct 02 01:05:58.502850 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 735/1399] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:58 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:58.515012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:58.518518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:58.524476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.524979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.525747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.526137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.526622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.527059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.536546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.536988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.537428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.538151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.538770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.539095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.769000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:58.782768 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df678380-c080-43ee-8860-15251d980336 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1214 microversion: 2.1 time: 0.307959 Oct 02 01:05:58.783617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 665/1400] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:58 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:58.799986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b30bf309-d454-428d-9dda-d15e7d1ff3b8 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb8811fd040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:59.568848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:59.579043 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b30bf309-d454-428d-9dda-d15e7d1ff3b8 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "DELETE /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab" status: 204 len: 0 microversion: 2.1 time: 0.794046 Oct 02 01:05:59.579634 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 666/1401] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:58 2022] DELETE /compute/v2.1/images/cfa3bb9d-bebf-469c-8cff-effddaa122ab => generated 0 bytes in 795 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:59.585420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-60dddd0f-722a-427d-abcf-2d6fa86dbd84 req-52311a01-0562-434b-a4ef-24fe0f8815c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa3b34-7019-4848-8e88-c274c9132153", "tag": "1f43dffe-e628-4d09-9157-5d36a45f4eaa"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:59.593830 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be5496a6-cc44-4305-a779-d7f53d999008 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 1.088800 Oct 02 01:05:59.594435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 736/1402] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:58 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:59.615188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60dddd0f-722a-427d-abcf-2d6fa86dbd84 req-52311a01-0562-434b-a4ef-24fe0f8815c9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.615676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60dddd0f-722a-427d-abcf-2d6fa86dbd84 req-52311a01-0562-434b-a4ef-24fe0f8815c9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.616115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60dddd0f-722a-427d-abcf-2d6fa86dbd84 req-52311a01-0562-434b-a4ef-24fe0f8815c9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.628680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-60dddd0f-722a-427d-abcf-2d6fa86dbd84 req-52311a01-0562-434b-a4ef-24fe0f8815c9 service nova] Creating event network-changed:1f43dffe-e628-4d09-9157-5d36a45f4eaa for instance 77aa3b34-7019-4848-8e88-c274c9132153 on n-h1-master-1 Oct 02 01:05:59.634004 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-60dddd0f-722a-427d-abcf-2d6fa86dbd84 req-52311a01-0562-434b-a4ef-24fe0f8815c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053145 Oct 02 01:05:59.634827 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 667/1403] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:59.641365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:59.642378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:59.649572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.650302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.650939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.651802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.652449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.653082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.835615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-607df9a9-1da8-4d86-beec-db1b86a88c70 req-34e697d9-f6e5-413e-a8e7-4ed64c5e634a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "name": "network-vif-unplugged", "status": "completed", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:59.852464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-607df9a9-1da8-4d86-beec-db1b86a88c70 req-34e697d9-f6e5-413e-a8e7-4ed64c5e634a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.852994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-607df9a9-1da8-4d86-beec-db1b86a88c70 req-34e697d9-f6e5-413e-a8e7-4ed64c5e634a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.854141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-607df9a9-1da8-4d86-beec-db1b86a88c70 req-34e697d9-f6e5-413e-a8e7-4ed64c5e634a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.874799 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-607df9a9-1da8-4d86-beec-db1b86a88c70 req-34e697d9-f6e5-413e-a8e7-4ed64c5e634a service nova] Creating event network-vif-unplugged:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:05:59.884798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-607df9a9-1da8-4d86-beec-db1b86a88c70 req-34e697d9-f6e5-413e-a8e7-4ed64c5e634a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.289096 Oct 02 01:05:59.887405 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 737/1404] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:59.897720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:59.898833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:59.906185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.907020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.908133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.909017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.909636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.910224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.984408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:59.993838 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c7c890d-ce51-42be-ae3e-c47ae9e7f0d2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.357237 Oct 02 01:05:59.994425 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 668/1405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:59 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:00.006249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db674679-26eb-4053-a81e-a5fd9ff94087 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '.version_select at 0x7fb881b43d30>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:00.056187 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-db674679-26eb-4053-a81e-a5fd9ff94087 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] HTTP exception thrown: Image not found. Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db674679-26eb-4053-a81e-a5fd9ff94087 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Request method failure captured: Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c HTTP/1.1 Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOF52GgmSrn049sMimsdW88YKOE5ABa3leEGjHpCDFcnLsVaFJk9k24IDxXcw_qlnRtOaXfjgTqdkdyU2tRy2qRjaAfTfw2jhlcFYWMEpfjD3GA5HYViHDSFE0GqtduFmGKfDu7_BuYvdy8Us485zvgiQDzczm2jRqmQnn4HOD7CHI Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 73b489bd5bcd454da7e49c89f35f711f Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:00.058352 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_73b489bd5bcd454da7e49c89f35f711f"}]}] Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 73b489bd5bcd454da7e49c89f35f711f Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerTestJSON-613029511-project Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30185488a8864d5abae55abd94a7322e Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerTestJSON-613029511-project Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a6a4e434-44f7-409f-9b9a-a7f0a3abb74c'} Oct 02 01:06:00.060060 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a6a4e434-44f7-409f-9b9a-a7f0a3abb74c to delete Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:00.060941 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6a4e434-44f7-409f-9b9a-a7f0a3abb74c could not be found. Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:00.062295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db674679-26eb-4053-a81e-a5fd9ff94087 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:00.063791 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-db674679-26eb-4053-a81e-a5fd9ff94087 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "DELETE /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c" status: 404 len: 62 microversion: 2.1 time: 0.057849 Oct 02 01:06:00.065136 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 669/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:00 2022] DELETE /compute/v2.1/images/a6a4e434-44f7-409f-9b9a-a7f0a3abb74c => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:06:00.068720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:00.069339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:00.094978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.095492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.095943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.096680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.097147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.097591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.151419 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:00.278899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:00.289929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f835088-868a-49cd-be21-b40ae28581ae tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1278 microversion: 2.1 time: 0.224820 Oct 02 01:06:00.306384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 670/1407] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:00 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:00.312141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:00.313178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:00.319792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.320613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.321315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.322292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.323071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.323712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.351701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:06:00.442468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:00.456356 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0203bfd-8c2a-4c75-9341-cdf859214914 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.561483 Oct 02 01:06:00.456982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 738/1408] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:59 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:00.477966 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3e709d7-c8e7-47a9-81dc-f720d76aa161 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 204 len: 0 microversion: 2.1 time: 0.169602 Oct 02 01:06:00.479948 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 671/1409] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:00 2022] DELETE /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:06:00.488808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:00.489430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:00.498340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.503095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.503894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.504907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.505742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.506574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.624848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:00.625956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:00.632372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.632860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.633490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.634222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.634718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.635143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.696287 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:01.456939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:01.476042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-287c7d87-c5f1-46d4-856b-00df662992f4 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1472 microversion: 2.1 time: 0.991474 Oct 02 01:06:01.476901 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 739/1410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:00 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1472 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:01.497719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:01.499181 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:01.505335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:01.513081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:01.513588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:01.518062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:01.520693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:01.523260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:01.523727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:01.528742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c216f714-0416-4dcf-9d13-f0b9f4a17122 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 0.908079 Oct 02 01:06:01.543323 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 672/1411] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:00 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:01.576496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:01.577234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:01.601660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:01.611367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:01.611935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:01.612773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:01.613313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:01.613813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:01.988582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:01.997034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-da065f29-fb9d-4975-b837-d4dd3d216b96 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1276 microversion: 2.1 time: 0.452219 Oct 02 01:06:02.003684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 673/1412] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:01 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:02.019109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:02.020377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:02.034828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.035669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.036571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.040856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.041826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.042392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.188776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:02.206751 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a95e00a8-87b7-4feb-a0ed-8a3998c704c9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.722136 Oct 02 01:06:02.211860 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 740/1413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:01 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:02.482095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:02.491859 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f018bf76-3a41-4ab0-b19b-aa526372bf5a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.486916 Oct 02 01:06:02.497848 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 674/1414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:02 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:02.518768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:02.520461 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:02.540650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.541153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.544558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.548546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.549293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.557835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:02.558816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:02.561043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.579273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.591047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.591530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.592580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.593165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.593598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:03.671892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:03.687116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:03.698684 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbd2dbb6-40b4-4e3c-b7ae-4dfc1546bdca tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1472 microversion: 2.1 time: 1.189237 Oct 02 01:06:03.711685 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-904eade8-043b-49c2-b088-aa72671c3e52 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 1.146652 Oct 02 01:06:03.714370 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 675/1416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:02 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:03.717083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 741/1416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:02 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1472 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:03.723106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:03.723723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:03.740166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:03.740801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:03.741899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:03.747192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:03.747969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:03.748758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:03.749190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:03.750200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:03.773405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:03.774319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:03.779358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:03.783512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:03.793127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:03.793677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.555513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:04.569749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5ce61d3-d690-47d2-9e92-dde7d077bfdc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 0.842038 Oct 02 01:06:04.573037 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 676/1417] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:03 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:04.581346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:04.582255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:04.591168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.596095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.597218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.598108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.598832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.599376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.885027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:04.894626 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70700e34-525b-4146-bc02-628ea43cdd31 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 1.176320 Oct 02 01:06:04.901679 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 742/1418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:03 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:04.909618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:04.910488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:04.917989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.918921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.919605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.920488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.921626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.922220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.291692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:05.304709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90517b10-022c-4ebb-9a7c-eef44ac3d1ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 0.730291 Oct 02 01:06:05.307413 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 677/1419] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:04 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:05.313437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.314939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.322122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.323453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.323996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.324959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.325519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.326077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.607297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:05.622579 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dce14c3f-bf13-40da-be66-80cfa2a34174 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1472 microversion: 2.1 time: 0.719517 Oct 02 01:06:05.623793 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 743/1420] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:04 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1472 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:05.629283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.630053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.638283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.639136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.639772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.640722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.641190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.641549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.644714 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.949993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:05.958242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e514786-3527-4b05-8a9c-14c78cec3b4a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 0.649223 Oct 02 01:06:05.958862 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 678/1421] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:05 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:05.963937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.964835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.971980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.972806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.973494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.974634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.975300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.976085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.263447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:06.276565 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3565aab7-8379-4556-b155-93da9dc01276 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 0.650975 Oct 02 01:06:06.280120 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 744/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:05 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:06.330406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:06.331081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:06.338884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.339380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.339835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.340502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.340958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.341380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.608112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:06.622838 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e45877c8-741c-4852-844f-1e6e7fa4b02e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 0.662369 Oct 02 01:06:06.626674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 679/1423] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:05 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:06.870270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-84286777-8680-474e-b531-8b12eb690b33 req-857784e3-6346-4cba-a7ab-277c6b28c44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:06.884653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-84286777-8680-474e-b531-8b12eb690b33 req-857784e3-6346-4cba-a7ab-277c6b28c44b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.885148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-84286777-8680-474e-b531-8b12eb690b33 req-857784e3-6346-4cba-a7ab-277c6b28c44b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.885586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-84286777-8680-474e-b531-8b12eb690b33 req-857784e3-6346-4cba-a7ab-277c6b28c44b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.909264 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-84286777-8680-474e-b531-8b12eb690b33 req-857784e3-6346-4cba-a7ab-277c6b28c44b service nova] Creating event network-changed:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:06:06.929027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-84286777-8680-474e-b531-8b12eb690b33 req-857784e3-6346-4cba-a7ab-277c6b28c44b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294141 Oct 02 01:06:06.929659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 680/1424] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:06.944143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:06.945012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:06.962971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.965654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.969357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.970441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.970957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.971395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:07.053106 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:07.106307 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=14 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:07.551364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:07.560703 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4aa04337-1cfa-4af4-942a-f0f5764710fc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1542 microversion: 2.1 time: 1.234620 Oct 02 01:06:07.566688 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 745/1425] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:06 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1542 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:07.588490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:07.595655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:07.625169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:07.629552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:07.630026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:07.634001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:07.634508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:07.634975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:08.007721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:08.049879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76028b85-f573-4203-916d-92d90dbeda24 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1472 microversion: 2.1 time: 1.114049 Oct 02 01:06:08.057058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 681/1426] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:06 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1472 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:08.064657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:08.065687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:08.099566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:08.100969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:08.101802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:08.102753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:08.103413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:08.104171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:08.403592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:08.419041 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1ee25dc-07de-489d-a4bd-753853d7554e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 0.850425 Oct 02 01:06:08.420232 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 746/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:07 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:08.444909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:08.448150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:08.466196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:08.470427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:08.471117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:08.473868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:08.475841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:08.478131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.206314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:09.219453 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d765260e-d5b0-4fef-bfb3-4a0e905bf9ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 1.160199 Oct 02 01:06:09.220366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 682/1428] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:08 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:09.231379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8caaba18-e0f2-494b-87a2-c52b41a71131 req-ba6adf79-3e27-40f7-82e6-718e4df5abea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3b34-7019-4848-8e88-c274c9132153", "name": "network-vif-plugged", "status": "completed", "tag": "1f43dffe-e628-4d09-9157-5d36a45f4eaa"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:09.244439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8caaba18-e0f2-494b-87a2-c52b41a71131 req-ba6adf79-3e27-40f7-82e6-718e4df5abea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.247359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8caaba18-e0f2-494b-87a2-c52b41a71131 req-ba6adf79-3e27-40f7-82e6-718e4df5abea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.255649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8caaba18-e0f2-494b-87a2-c52b41a71131 req-ba6adf79-3e27-40f7-82e6-718e4df5abea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.260327 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:09.275292 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8caaba18-e0f2-494b-87a2-c52b41a71131 req-ba6adf79-3e27-40f7-82e6-718e4df5abea service nova] Creating event network-vif-plugged:1f43dffe-e628-4d09-9157-5d36a45f4eaa for instance 77aa3b34-7019-4848-8e88-c274c9132153 on n-h1-master-1 Oct 02 01:06:09.282205 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8caaba18-e0f2-494b-87a2-c52b41a71131 req-ba6adf79-3e27-40f7-82e6-718e4df5abea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060016 Oct 02 01:06:09.283795 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 683/1429] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:09.294141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:09.295385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:09.304633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.305343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.305888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.307346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.308172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.308857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.441998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:09.456220 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-38cb9f48-3ec1-46fe-a79f-1232299b4c87 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 1.032547 Oct 02 01:06:09.460153 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 747/1430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:08 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:09.473609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-50051324-2954-4e3b-8210-912c735c5933 req-d8899f2a-6bb6-4276-a1a5-0f556008aa25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2380d2b-4b4e-4183-819c-c8af9a479d55", "name": "network-vif-deleted", "tag": "fafa2894-f0ec-41b8-b618-51d36f579869"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:09.514871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-50051324-2954-4e3b-8210-912c735c5933 req-d8899f2a-6bb6-4276-a1a5-0f556008aa25 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.518792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-50051324-2954-4e3b-8210-912c735c5933 req-d8899f2a-6bb6-4276-a1a5-0f556008aa25 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.519434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-50051324-2954-4e3b-8210-912c735c5933 req-d8899f2a-6bb6-4276-a1a5-0f556008aa25 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.539976 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-50051324-2954-4e3b-8210-912c735c5933 req-d8899f2a-6bb6-4276-a1a5-0f556008aa25 service nova] Creating event network-vif-deleted:fafa2894-f0ec-41b8-b618-51d36f579869 for instance a2380d2b-4b4e-4183-819c-c8af9a479d55 on n-h1-master-1 Oct 02 01:06:09.557835 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-50051324-2954-4e3b-8210-912c735c5933 req-d8899f2a-6bb6-4276-a1a5-0f556008aa25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096099 Oct 02 01:06:09.558643 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 748/1431] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:09.572812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:09.577965 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:09.591642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.593211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.595730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.597332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.600689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.602195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.685729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.686304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.687339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.688125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lazy-loading 'fault' on Instance uuid a2380d2b-4b4e-4183-819c-c8af9a479d55 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:06:09.818933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30185488a8864d5abae55abd94a7322e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b489bd5bcd454da7e49c89f35f711f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:09.832829 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bfd78a31-f64d-467b-960e-c35a94113eb3 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 200 len: 1307 microversion: 2.1 time: 0.268783 Oct 02 01:06:09.833935 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 749/1432] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:09 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:09.839822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-3603399a-19db-4f0c-a2f3-8165ac77c48a req-68c371dc-2511-4aa4-b926-0bf9955f04d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c9a9004-7066-456c-8c1b-99e03b63b2e7", "tag": "299976b2-a154-4fee-9940-050f8ca7645b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:09.852686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3603399a-19db-4f0c-a2f3-8165ac77c48a req-68c371dc-2511-4aa4-b926-0bf9955f04d9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.853170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3603399a-19db-4f0c-a2f3-8165ac77c48a req-68c371dc-2511-4aa4-b926-0bf9955f04d9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.853601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3603399a-19db-4f0c-a2f3-8165ac77c48a req-68c371dc-2511-4aa4-b926-0bf9955f04d9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.873271 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-3603399a-19db-4f0c-a2f3-8165ac77c48a req-68c371dc-2511-4aa4-b926-0bf9955f04d9 service nova] Creating event network-changed:299976b2-a154-4fee-9940-050f8ca7645b for instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 on n-h2-master-1 Oct 02 01:06:09.879390 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-3603399a-19db-4f0c-a2f3-8165ac77c48a req-68c371dc-2511-4aa4-b926-0bf9955f04d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043798 Oct 02 01:06:09.880922 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 750/1433] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:09.887559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:09.888848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:09.897301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.898135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.898861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:09.899828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:09.901732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:09.902390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:10.027348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:10.039212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2742ef0f-361d-42bd-8881-095583e51ca0 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1541 microversion: 2.1 time: 0.753976 Oct 02 01:06:10.042237 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 684/1434] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:09 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1541 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:10.230036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:10.247750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:10.249053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:10.255786 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ab2270fc-3bf3-4e08-ac3e-98b2ec310523 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1317 microversion: 2.1 time: 0.372788 Oct 02 01:06:10.263282 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 751/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:09 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:10.279131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:10.279630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:10.280075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:10.283903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:10.284399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:10.284848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:10.486048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:10.487133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:10.507594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:10.510310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:10.510978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:10.511884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:10.513202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:10.515439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:11.648961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:11.660611 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65ac7779-fb4d-4b31-897b-e53fa8df3ea6 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 1.418745 Oct 02 01:06:11.683423 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 685/1436] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:10 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:11.693718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:11.694341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] [instance: a2380d2b-4b4e-4183-819c-c8af9a479d55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:11.704383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:11.705980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:11.709544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:11.713286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:11.713966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:11.714588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:11.750680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] HTTP exception thrown: Instance a2380d2b-4b4e-4183-819c-c8af9a479d55 could not be found. Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Request method failure captured: Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 HTTP/1.1 Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOOF52GgmSrn049sMimsdW88YKOE5ABa3leEGjHpCDFcnLsVaFJk9k24IDxXcw_qlnRtOaXfjgTqdkdyU2tRy2qRjaAfTfw2jhlcFYWMEpfjD3GA5HYViHDSFE0GqtduFmGKfDu7_BuYvdy8Us485zvgiQDzczm2jRqmQnn4HOD7CHI Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 73b489bd5bcd454da7e49c89f35f711f Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:11.752769 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/73b489bd5bcd454da7e49c89f35f711f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_73b489bd5bcd454da7e49c89f35f711f"}]}] Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 73b489bd5bcd454da7e49c89f35f711f Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-613029511 Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerTestJSON-613029511-project Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30185488a8864d5abae55abd94a7322e Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerTestJSON-613029511-project Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a2380d2b-4b4e-4183-819c-c8af9a479d55 could not be found. Oct 02 01:06:11.754457 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a2380d2b-4b4e-4183-819c-c8af9a479d55'} Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2380d2b-4b4e-4183-819c-c8af9a479d55 could not be found. Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:11.755521 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2380d2b-4b4e-4183-819c-c8af9a479d55 could not be found. Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2380d2b-4b4e-4183-819c-c8af9a479d55 could not be found. Oct 02 01:06:11.757066 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:11.760202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] Returning 404 to user: Instance a2380d2b-4b4e-4183-819c-c8af9a479d55 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:11.761711 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27b48718-789a-47a9-a41a-8b84093cc140 tempest-ImagesOneServerTestJSON-613029511 tempest-ImagesOneServerTestJSON-613029511-project] 10.222.0.23 "GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55" status: 404 len: 111 microversion: 2.1 time: 0.077232 Oct 02 01:06:11.762469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 686/1437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:11 2022] GET /compute/v2.1/servers/a2380d2b-4b4e-4183-819c-c8af9a479d55 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:11.789701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:11.790648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:11.806248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:11.807459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:11.808793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:11.810158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:11.810825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:11.811428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:11.908513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:11.924350 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e490878-32c8-4a52-95f8-bd079b376207 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1717 microversion: 2.1 time: 1.440776 Oct 02 01:06:11.925933 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 752/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:10 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1717 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:11.938445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:11.939194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:11.957420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:11.970719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:11.971558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:11.976519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:11.978033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:11.983202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:12.473618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:12.510266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54089bc1-0371-40d3-9970-57c76ba14270 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1541 microversion: 2.1 time: 0.745989 Oct 02 01:06:12.512565 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 687/1439] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:11 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1541 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:12.524872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "name": "network-vif-unplugged", "status": "completed", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:12.556809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:12.559067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:12.560509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:12.585162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:12.597117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1f312dad-a78b-4768-a731-8782d8ccb1ed tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1467 microversion: 2.1 time: 0.665308 Oct 02 01:06:12.615167 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 753/1440] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:11 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1467 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:12.630643 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] Creating event network-vif-unplugged:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h2-master-1 Oct 02 01:06:12.652725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:12.654384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:12.655063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] Instance e4081c15-ec76-44d4-81f3-4bb471661d4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:06:12.679329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:12.683252 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d9c37390-628f-4493-ad9c-d05e7711f405 req-ecbea029-482e-43b6-ba0a-d47bd68670ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167481 Oct 02 01:06:12.684818 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 688/1441] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:12.688078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:12.690943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:12.692927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:12.695243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:12.696381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:12.697162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:12.697500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:12.710448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:12.712870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:12.714041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:12.715675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:12.716501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:12.718022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:13.163094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:13.177463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9aa1ea7-5dc8-47aa-9463-fff2f559e296 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 0.488914 Oct 02 01:06:13.183817 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 689/1442] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:12 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:13.191902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:13.193177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:13.200069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:13.200938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:13.201501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:13.203204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:13.204693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:13.205305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:13.377964 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f5fa8a3-0b05-4b73-a78f-233e98d9f892 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1618 microversion: 2.1 time: 0.733657 Oct 02 01:06:13.382955 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 754/1443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:12 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1618 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:13.541331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:13.542101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:13.555163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:13.556135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:13.556584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:13.557316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:13.558020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:13.558451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:13.819412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:13.838248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45da02ce-9514-4943-a189-d679e36e5496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1707 microversion: 2.1 time: 0.650131 Oct 02 01:06:13.840216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 690/1444] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:13 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1707 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:13.853563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1692154875", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7d3d7159-ba16-41d9-8d7b-c87ac671ad0a"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:14.004118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:06:15.118054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:15.145038 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8579ee98-5f3f-4436-bcfc-4b63a0e84e62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1541 microversion: 2.1 time: 1.606132 Oct 02 01:06:15.154538 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 755/1445] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:13 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1541 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:15.170622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64aab1d2-8441-4b24-ae53-91333f208fbc tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '.version_select at 0x7fb8813e65e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:15.189178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64aab1d2-8441-4b24-ae53-91333f208fbc tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:15.191611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64aab1d2-8441-4b24-ae53-91333f208fbc tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:15.192310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64aab1d2-8441-4b24-ae53-91333f208fbc tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:15.246352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64aab1d2-8441-4b24-ae53-91333f208fbc tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3118 microversion: 2.1 time: 0.088726 Oct 02 01:06:15.250633 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 756/1446] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:06:15 2022] GET /compute/v2.1/os-migrations => generated 3118 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:15.267742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:15.273570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:15.284894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:15.295415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:15.296685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:15.297608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:15.298228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:15.298877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:16.178103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:06:16.180343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:06:16.180954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:06:16.181469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:06:16.181995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:06:16.195183 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:16.216425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:16.219999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:16.222019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:16.225500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:16.230902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:16.232107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:16.290152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:16.299396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Getting quotas for user c076d9dc75a7400f87b480d2b18dcc14 and project 70c6b40e739146e8b98b38971b879e85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:16.319362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:06:16.322436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:06:16.419584 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b4547828-0d29-4401-9a45-095c5552b36b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572366 Oct 02 01:06:16.420859 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 691/1447] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:06:16.449958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:16.492759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:16.494780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:16.495607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:16.496151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:16.510731 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d5c7ca6-4d0a-42e8-b4f2-bd6412a5e5e1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 1.257874 Oct 02 01:06:16.520508 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 757/1448] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:15 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:16.531793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] Creating event network-changed:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h2-master-1 Oct 02 01:06:16.544988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] Instance e4081c15-ec76-44d4-81f3-4bb471661d4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:06:16.586550 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-efbc0ce9-79f8-41ad-acca-a3d125d564de req-77787ba4-f504-4a4d-ac19-3b564965248d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160929 Oct 02 01:06:16.589065 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 692/1449] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:16.607376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:16.608396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:16.619808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:16.620667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:16.621274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:16.622365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:16.623056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:16.623644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:16.929240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ac44579-acf8-429b-9aba-65f04b04d782 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb88167bdc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYHBO3kXQ7U8TEUr1MXBvEVsLrv2YtfmK5z0oNQfa0GAsT1/kE951F+plvIw6Za8Pn2EWQFd1GvcYc4CLvQDHRWjmODRJMjkMqCazo02Ca9Nk40ly2XXoFPJF7atZ3+hg=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ac44579-acf8-429b-9aba-65f04b04d782 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 257 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:06:16.934363 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:06:16.936087 n-d-master-1 devstack@n-api.service[122355]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYHBO3kXQ7U8TEUr1MXBvEVsLrv2YtfmK5z0oNQfa0GAsT1/kE951F+plvIw6Za8Pn2EWQFd1GvcYc4CLvQDHRWjmODRJMjkMqCazo02Ca9Nk40ly2XXoFPJF7atZ3+hg=="}} Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYHBO3kXQ7U8TEUr1MXBvEVsLrv2YtfmK5z0oNQfa0GAsT1/kE951F+plvIw6Za8Pn2EWQFd1GvcYc4CLvQDHRWjmODRJMjkMqCazo02Ca9Nk40ly2XXoFPJF7atZ3+hg=='}}} Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:16.937360 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:16.938935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:06:16.940899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:06:16.943509 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 02 01:06:16.943509 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:16.945517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ac44579-acf8-429b-9aba-65f04b04d782 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:17.001381 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ac44579-acf8-429b-9aba-65f04b04d782 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.466082 Oct 02 01:06:17.006359 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 758/1450] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:06:16 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 485 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:06:17.032145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:17.036510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:17.073999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:17.080488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:17.087900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:17.090228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:17.098893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:17.099800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:17.832091 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8fb9bc15-c896-45cb-83df-8a1b128d6373 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1858 microversion: 2.1 time: 1.241475 Oct 02 01:06:17.844530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:17.850884 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 693/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:16 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1858 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:17.856122 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dfb37da1-44eb-4da2-a4ce-f0810f6ad568 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1475 microversion: 2.1 time: 0.847474 Oct 02 01:06:17.856422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:17.859284 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 759/1452] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:17 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1475 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:17.859671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:17.868422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb8820201f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1472703079", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:17.872632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:17.875050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:17.875724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:17.876594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:17.877232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:17.877800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:17.906637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:17.919574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for user cdcd84fe261f41a89278587ca4432474 and project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:17.946003 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 2167 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1472703079", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:06:17.963321 n-d-master-1 devstack@n-api.service[122355]: exception: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1472703079', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:17.966025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:17.969901 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:17.972189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:17.973295 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d9d4027-bcae-499e-90d3-da46b9d0595f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112492 Oct 02 01:06:17.974048 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 760/1453] 10.222.0.23 () {60 vars in 1160 bytes} [Sun Oct 2 01:06:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:17.978939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c3bf9b57-03dc-4078-9871-6bdafba1b279 req-86bb7e7d-e21d-457f-bfc9-b1fec08d0902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "name": "network-vif-plugged", "status": "completed", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:18.000748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c3bf9b57-03dc-4078-9871-6bdafba1b279 req-86bb7e7d-e21d-457f-bfc9-b1fec08d0902 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:18.002079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c3bf9b57-03dc-4078-9871-6bdafba1b279 req-86bb7e7d-e21d-457f-bfc9-b1fec08d0902 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:18.002793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c3bf9b57-03dc-4078-9871-6bdafba1b279 req-86bb7e7d-e21d-457f-bfc9-b1fec08d0902 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:18.020306 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c3bf9b57-03dc-4078-9871-6bdafba1b279 req-86bb7e7d-e21d-457f-bfc9-b1fec08d0902 service nova] Creating event network-vif-plugged:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:06:18.028728 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c3bf9b57-03dc-4078-9871-6bdafba1b279 req-86bb7e7d-e21d-457f-bfc9-b1fec08d0902 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053238 Oct 02 01:06:18.029894 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 761/1454] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:18.036630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:18.037998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:18.044032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:18.045031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:18.047535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:18.048231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:18.049390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:18.050005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:18.050665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:18.059509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8bc9b11-2edd-4e06-b547-f6b582c50c20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1221 microversion: 2.1 time: 0.207115 Oct 02 01:06:18.060112 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 694/1455] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:17 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1221 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:18.151488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de58d4e2-6a44-4589-bb44-a95d79b0e60a tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Action: 'create', calling method: .version_select at 0x7fb8817ceee0>, body: {"pool": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:18.401893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:18.423080 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b407fe25-1061-441b-93e6-2c1f403a7791 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 0.390889 Oct 02 01:06:18.423861 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 762/1456] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:18 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:18.429379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:18.430119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:18.438208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:18.439241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:18.439753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:18.440537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:18.441066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:18.441571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:18.785527 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4e0d225-ee7b-493a-b2c1-3b71cc0dd105 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1858 microversion: 2.1 time: 0.360293 Oct 02 01:06:18.786131 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 763/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:18 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1858 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:18.801919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12cc78b7-8898-4e6e-92a7-624bd425226f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb8813e65e0>, body: {"keypair": {"name": "tempest-keypair-823722360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7cTLNHICLNVkXuuUirg+8WaOkMx7xrEp+7jp1FsQLQJV7hH0boKSpUaFCBoA9YXiyvwd6H6JwnWrPPWH6D2R+lJxc30hAyMA/OwhiVxgJYLnfySxUXsIfifGTNcpyYtA=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:18.811358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-12cc78b7-8898-4e6e-92a7-624bd425226f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:18.817921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-12cc78b7-8898-4e6e-92a7-624bd425226f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for user cdcd84fe261f41a89278587ca4432474 and project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:18.821795 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:18.853782 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12cc78b7-8898-4e6e-92a7-624bd425226f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066349 Oct 02 01:06:18.855800 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 764/1458] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:06:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:18.877301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb8813823a0>, body: {"keypair": {"name": "tempest-keypair-823722360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3dy7PzZaOwCq9CM4LeAfQIZxq7YhHr7RDiDl047IfSfGITxR4l/zAj4IdDpuCSUj6nVbvzsvkm8hBD8oxlzjDNboRWyrM5di1tYVucmkIM8K1QISEqTWipYVB2klgsg=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:18.915312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:18.964709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for user cdcd84fe261f41a89278587ca4432474 and project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:19.016648 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] HTTP exception thrown: Key pair 'tempest-keypair-823722360' already exists. Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 272 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: {"keypair": {"name": "tempest-keypair-823722360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3dy7PzZaOwCq9CM4LeAfQIZxq7YhHr7RDiDl047IfSfGITxR4l/zAj4IdDpuCSUj6nVbvzsvkm8hBD8oxlzjDNboRWyrM5di1tYVucmkIM8K1QISEqTWipYVB2klgsg=="}} Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: exception: Key pair 'tempest-keypair-823722360' already exists. Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-823722360', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3dy7PzZaOwCq9CM4LeAfQIZxq7YhHr7RDiDl047IfSfGITxR4l/zAj4IdDpuCSUj6nVbvzsvkm8hBD8oxlzjDNboRWyrM5di1tYVucmkIM8K1QISEqTWipYVB2klgsg=='}}} Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result.read() Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cdcd84fe261f41a89278587ca4432474-tempest-keypair-823722360' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 02 01:06:19.027504 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi session.flush() Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result.read() Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 02 01:06:19.036227 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cdcd84fe261f41a89278587ca4432474-tempest-keypair-823722360' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 2, 1, 6, 19, 5053), 'updated_at': None, 'name': 'tempest-keypair-823722360', 'user_id': 'cdcd84fe261f41a89278587ca4432474', 'fingerprint': '42:f8:fe:ce:6b:3c:9a:c1:fc:59:64:10:39:4f:53:4b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3dy7PzZaOwCq9CM4LeAfQIZxq7YhHr7RDiDl047IfSfGITxR4l/zAj4IdDpuCSUj6nVbvzsvkm8hBD8oxlzjDNboRWyrM5di1tYVucmkIM8K1QISEqTWipYVB2klgsg==', 'type': 'ssh'}] Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi keypair.create() Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._create() Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-823722360' already exists. Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 02 01:06:19.040517 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-823722360' already exists. Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-823722360' already exists. Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 409 to user: Key pair 'tempest-keypair-823722360' already exists. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8d9052e0-801c-4565-b6b3-d5c0c77533f5 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.163696 Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 765/1459] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:06:18 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:19.052121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:19.054152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:19.054152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:19.054477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:19.055185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:19.055747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:19.056502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:19.302816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:19.317996 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43db63cb-5e75-4a81-9556-3cdee5317b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1473 microversion: 2.1 time: 0.284194 Oct 02 01:06:19.319217 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 766/1460] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:19 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1473 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:19.328198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:19.328877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:19.337227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:19.337750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:19.338710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:19.339450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:19.339915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:19.341309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:19.392641 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:19.585556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lazy-loading 'services' on Instance uuid 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:06:19.790699 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62772fb4-85a6-490f-84ed-b8cc3f509d7b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments/37f3a7a8-9e45-445f-9507-eeb0073a8bb4" status: 202 len: 0 microversion: 2.1 time: 0.466138 Oct 02 01:06:19.807228 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 767/1461] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:06:19 2022] DELETE /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments/37f3a7a8-9e45-445f-9507-eeb0073a8bb4 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:06:19.815424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5afa2c93-234b-485a-833c-edf2f8fad07e tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Calling method '.version_select at 0x7fb8820925e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:19.866683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5afa2c93-234b-485a-833c-edf2f8fad07e tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823722360" status: 202 len: 0 microversion: 2.1 time: 0.056902 Oct 02 01:06:19.867688 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 768/1462] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:06:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823722360 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:06:19.877432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:19.878307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:19.899501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:19.900511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:19.901468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:19.913725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:19.914264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:19.916993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:20.078453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:20.090931 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0cdf85d6-4c63-41cd-96ab-b9dc71f416df tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1213 microversion: 2.1 time: 0.221922 Oct 02 01:06:20.093189 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 769/1463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:19 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:20.099635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:20.100455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:20.107875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:20.109665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:20.110311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:20.111092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:20.111553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:20.112242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:20.453041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:20.462393 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3008e248-ae44-456a-8e63-190bbbfe1361 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 0.366990 Oct 02 01:06:20.475326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 770/1464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:20 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:20.487748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:20.489619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:20.496455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:20.497122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:20.497649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:20.499023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:20.499886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:20.500686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:20.579293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c87a8f13-3fb5-4bda-a15e-ce123310ef59 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102373 Oct 02 01:06:20.580067 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 771/1465] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:06:20 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:20.589973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a48f5b79-5842-4ee5-a057-ad29e099eeef tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb881607ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkN9qfoZj3323Ez8GANv9DlJZGXfVNN7kXfG9d1X3dngO0IBFDY5pqUMRbi8oJrtbd22lonpTPKdEibC1iuBhyQ+U9lwzsq+qZ+MY+39mn1pXo9QfnCOgWdvzWU82ANmQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a48f5b79-5842-4ee5-a057-ad29e099eeef tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 247 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkN9qfoZj3323Ez8GANv9DlJZGXfVNN7kXfG9d1X3dngO0IBFDY5pqUMRbi8oJrtbd22lonpTPKdEibC1iuBhyQ+U9lwzsq+qZ+MY+39mn1pXo9QfnCOgWdvzWU82ANmQ=="}} Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkN9qfoZj3323Ez8GANv9DlJZGXfVNN7kXfG9d1X3dngO0IBFDY5pqUMRbi8oJrtbd22lonpTPKdEibC1iuBhyQ+U9lwzsq+qZ+MY+39mn1pXo9QfnCOgWdvzWU82ANmQ=='}}} Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi '' Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:06:20.594165 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a48f5b79-5842-4ee5-a057-ad29e099eeef tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a48f5b79-5842-4ee5-a057-ad29e099eeef tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010106 Oct 02 01:06:20.598253 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 772/1466] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:06:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:06:20.604037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:20.604661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:20.612866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:20.613399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:20.613848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:20.614564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:20.615053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:20.615483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.245506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de58d4e2-6a44-4589-bb44-a95d79b0e60a tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.184322 Oct 02 01:06:21.246629 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 695/1467] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:06:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:21.251858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb88146df70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-982475522", "public_key": " "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:21.291719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:21.306770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:21.308284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ffa276f-09a7-4779-a188-810d8790e028 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1470 microversion: 2.1 time: 0.710537 Oct 02 01:06:21.309125 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 773/1468] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:20 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1470 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:21.319817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1ac15e5e-7bf6-4905-afe7-b27f92e01d98 req-819761e3-a463-40ee-b7b8-0ccd07d61538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9a9004-7066-456c-8c1b-99e03b63b2e7", "name": "network-vif-plugged", "status": "completed", "tag": "299976b2-a154-4fee-9940-050f8ca7645b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:21.330144 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for user cdcd84fe261f41a89278587ca4432474 and project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:21.334506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1ac15e5e-7bf6-4905-afe7-b27f92e01d98 req-819761e3-a463-40ee-b7b8-0ccd07d61538 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.335251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1ac15e5e-7bf6-4905-afe7-b27f92e01d98 req-819761e3-a463-40ee-b7b8-0ccd07d61538 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.335985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1ac15e5e-7bf6-4905-afe7-b27f92e01d98 req-819761e3-a463-40ee-b7b8-0ccd07d61538 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.354107 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1ac15e5e-7bf6-4905-afe7-b27f92e01d98 req-819761e3-a463-40ee-b7b8-0ccd07d61538 service nova] Creating event network-vif-plugged:299976b2-a154-4fee-9940-050f8ca7645b for instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 on n-h2-master-1 Oct 02 01:06:21.359792 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1ac15e5e-7bf6-4905-afe7-b27f92e01d98 req-819761e3-a463-40ee-b7b8-0ccd07d61538 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049382 Oct 02 01:06:21.360876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 774/1469] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:21.366185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:21.367137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:21.375189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.375934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.376539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.377697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.378307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.379180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.397454 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 94 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-982475522", "public_key": " "}} Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: exception: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-982475522', 'public_key': ' '}}} Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:21.404391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8d70022-3fb2-4bac-9d49-cd615b530634 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.160863 Oct 02 01:06:21.411658 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 696/1470] 10.222.0.23 () {60 vars in 1158 bytes} [Sun Oct 2 01:06:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:21.426421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23a9dcaf-9357-4ecb-8585-19acc1a2d8a5 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Calling method '.version_select at 0x7fb88190a4c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:21.506681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:21.523588 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d909b5ee-8ce1-44c9-a315-996444232ec8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1213 microversion: 2.1 time: 0.161300 Oct 02 01:06:21.524388 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 775/1471] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:21 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:21.537923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:21.538475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:21.555288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.556486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.557657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.568005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.569489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.570754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.699522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.700023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.703416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.708734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.709242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.710760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.720679 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23a9dcaf-9357-4ecb-8585-19acc1a2d8a5 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/2c3980e0-8a4d-498e-b843-dffca1ab5aac" status: 200 len: 142 microversion: 2.1 time: 0.309103 Oct 02 01:06:21.721692 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 697/1472] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:06:21 2022] GET /compute/v2.1/os-floating-ips/2c3980e0-8a4d-498e-b843-dffca1ab5aac => generated 142 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:21.727852 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0679b9a-2aef-4c47-97a9-de3441c22f6f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb88190adc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPLGgFEtkOT8ETc+kcl5X6kFLJf+0+6vwY2AuW9C5xWQRm5MBBsFtHZbhbcr2wkWW4Gv4Q7DyxUy2s4e/dio+tiqesLZuEk5Zc+tSN91bNJ23gOGuaYXUY/JMXKvAefRw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0679b9a-2aef-4c47-97a9-de3441c22f6f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 507 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPLGgFEtkOT8ETc+kcl5X6kFLJf+0+6vwY2AuW9C5xWQRm5MBBsFtHZbhbcr2wkWW4Gv4Q7DyxUy2s4e/dio+tiqesLZuEk5Zc+tSN91bNJ23gOGuaYXUY/JMXKvAefRw=="}} Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPLGgFEtkOT8ETc+kcl5X6kFLJf+0+6vwY2AuW9C5xWQRm5MBBsFtHZbhbcr2wkWW4Gv4Q7DyxUy2s4e/dio+tiqesLZuEk5Zc+tSN91bNJ23gOGuaYXUY/JMXKvAefRw=='}}} Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 02 01:06:21.734963 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 02 01:06:21.738849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:21.743892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0679b9a-2aef-4c47-97a9-de3441c22f6f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:21.745031 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0679b9a-2aef-4c47-97a9-de3441c22f6f tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021775 Oct 02 01:06:21.746398 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 698/1473] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:06:21 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:06:21.755922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:21.756856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:21.767004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.767854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.768473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.769362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:21.770415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:21.771856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:21.815765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:21.825566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for user 739083b66f9b433889944e555b0aef23 and project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:22.098930 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3d21f4d-acb8-4ff4-8c0e-74ba5e642932 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.569769 Oct 02 01:06:22.100290 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 776/1474] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:06:21 2022] POST /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:06:22.111436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:22.116124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:22.159746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:22.161002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:22.162815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:22.164461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:22.166430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:22.167073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:22.250206 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41c16d52-b4fa-44f6-a447-26b580d7377f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148526 Oct 02 01:06:22.251529 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 777/1475] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:06:22 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:22.262143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5316b46-8fc8-41ea-8663-5fb88138768e tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Calling method '.version_select at 0x7fb88157c4c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:22.526188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:22.536232 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08bd34ce-d911-42e4-a82e-2541991e2b49 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 0.788035 Oct 02 01:06:22.537149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 699/1476] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:21 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:22.543700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Action: 'create', calling method: .version_select at 0x7fb881bc40d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-158700048", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:22.566719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:22.583429 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Getting quotas for user cdcd84fe261f41a89278587ca4432474 and project 7607431e4506494bb3a9060bd3d168e9. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:22.602304 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 117 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-158700048", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: exception: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-158700048', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 02 01:06:22.604574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 02 01:06:22.610717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:22.615576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:22.616918 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-73a88fbb-98a3-4ee6-8c13-5d1ff2a19862 tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.078324 Oct 02 01:06:22.618012 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 700/1477] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:06:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:22.622916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:22.623783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:22.631791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:22.632584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:22.633222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:22.634144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:22.634878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:22.635609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:22.760022 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5316b46-8fc8-41ea-8663-5fb88138768e tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.507137 Oct 02 01:06:22.761108 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 778/1478] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:06:22 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:22.772541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:22.773165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:22.786944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:22.787439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:22.787880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:22.788602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:22.789089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:22.789485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:23.039000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:23.053882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-036c2fd5-1e31-44a9-8b60-3a31ccad5b0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1269 microversion: 2.1 time: 0.291593 Oct 02 01:06:23.054801 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 779/1479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:22 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1269 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:23.062327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2d70749-e369-4cf0-8bf5-050d6da5e74b tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Calling method '.version_select at 0x7fb88167b040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:23.095992 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b2d70749-e369-4cf0-8bf5-050d6da5e74b tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-326782058 not found for user cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2d70749-e369-4cf0-8bf5-050d6da5e74b tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Request method failure captured: Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-326782058 HTTP/1.1 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOQHtxeNvP4OKkgCFDG6LE-TAdG7vAbA-X2XbRipccamfhWFB6dzKRFCOv2HIMmunSKyYF1PGBwkUXT4luT7IQ15Qk-JyQ7Kjs8EZjDo-FZeGsjZSswEKY6PqocNOAtAO0e14BuP2cE9YD3t5Ty5Eah6-p3VixpfOEXBBRKO6mOBEf0 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7607431e4506494bb3a9060bd3d168e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7607431e4506494bb3a9060bd3d168e9"}]}] Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7607431e4506494bb3a9060bd3d168e9 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-241859974 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-KeyPairsNegativeTestJSON-241859974-project Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: exception: Keypair tempest-keypair-non-existent-326782058 not found for user cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'tempest-keypair-non-existent-326782058'} Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-326782058 not found for user cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:23.105651 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-326782058 not found for user cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-326782058 not found for user cdcd84fe261f41a89278587ca4432474 Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2d70749-e369-4cf0-8bf5-050d6da5e74b tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] Returning 404 to user: Keypair tempest-keypair-non-existent-326782058 not found for user cdcd84fe261f41a89278587ca4432474 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2d70749-e369-4cf0-8bf5-050d6da5e74b tempest-KeyPairsNegativeTestJSON-241859974 tempest-KeyPairsNegativeTestJSON-241859974-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-326782058" status: 404 len: 144 microversion: 2.1 time: 0.050884 Oct 02 01:06:23.112429 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 780/1480] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:06:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-326782058 => generated 144 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:23.120139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-511d25d3-f707-47ac-b75a-c9b15b7dc16d tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Calling method '.version_select at 0x7fb881040550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:23.260998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:23.287363 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c6e1e8e6-d560-4c89-9bce-b2d3af7b9314 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1469 microversion: 2.1 time: 0.668029 Oct 02 01:06:23.291370 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 701/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:22 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:23.307744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:23.320760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:23.337403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:23.337905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:23.338351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:23.339147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:23.339611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:23.340479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:23.446688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-acec406e-88c6-4a0e-848c-197c0e62b8a7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152460 Oct 02 01:06:23.450707 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 702/1482] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:06:23 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:23.561263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:23.564993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:23.572986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:23.584595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:23.586532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:23.587411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:23.593873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:23.594682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:24.777324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:24.799671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11eebe45-c910-43d1-8069-ec4f1066a4be tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1318 microversion: 2.1 time: 1.242059 Oct 02 01:06:24.801362 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 703/1483] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:23 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1318 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:24.809104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:24.809722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:24.828481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:24.830218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:24.831003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:24.831819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:24.832355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:24.832854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:24.999485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:25.020574 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9a738b2-3d61-463c-a24f-9fb7ad41cb0c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1275 microversion: 2.1 time: 0.212166 Oct 02 01:06:25.021425 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 704/1484] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:24 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:25.038450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:25.039424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:25.071139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.072730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.074149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:25.076552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.077654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.084643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:25.710413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:25.729455 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3200a496-f851-41a7-99c2-3aa03be75e30 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1469 microversion: 2.1 time: 0.705826 Oct 02 01:06:25.730889 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 705/1485] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:25 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1469 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:25.738811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:25.741566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:25.767226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.768449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.769071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:25.769998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.770849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.771641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:25.811193 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd31be2e-fe69-4d53-8722-4353d6f1fd9e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078930 Oct 02 01:06:25.813056 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 706/1486] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:06:25 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:25.820926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:25.835825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.836595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.837328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:25.876506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] Creating event network-vif-plugged:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h2-master-1 Oct 02 01:06:25.886141 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:25.895553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] Instance e4081c15-ec76-44d4-81f3-4bb471661d4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:06:25.909556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d1215b28-6951-4975-8e3a-4dbe9b6e8093 req-e1f60b7e-fc27-4cf6-9606-a06a84b66b85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095036 Oct 02 01:06:25.911121 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 707/1487] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:25.918044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:25.919167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:25.929111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.930586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.931202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:25.931937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:25.932394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:25.932820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:26.270150 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:26.568394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:26.587164 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fa576b4c-4624-42e0-a0e9-2a64ddd3395d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1468 microversion: 2.1 time: 0.673663 Oct 02 01:06:26.589344 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 708/1488] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:25 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1468 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:26.820596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Calling method '.version_select at 0x7fb8814dd550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:26.838277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:26.838825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:26.839270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:26.840959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:26.841452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:26.842018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:26.882891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-147ea548-2bdc-436e-a162-7745c4e75bbc tempest-AbsoluteLimitsTestJSON-1078099167 tempest-AbsoluteLimitsTestJSON-1078099167-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.292141 Oct 02 01:06:26.883849 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 709/1489] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:26.907448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:26.909190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:26.916108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:26.916740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:26.918642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:26.920124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:26.921674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:26.922543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:26.934001 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-511d25d3-f707-47ac-b75a-c9b15b7dc16d tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/2c3980e0-8a4d-498e-b843-dffca1ab5aac" status: 202 len: 0 microversion: 2.1 time: 3.823683 Oct 02 01:06:26.941852 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 781/1490] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:06:23 2022] DELETE /compute/v2.1/os-floating-ips/2c3980e0-8a4d-498e-b843-dffca1ab5aac => generated 0 bytes in 3833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:06:26.946810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:26.947436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:26.975957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:26.976481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:26.976938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:26.978075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:26.978741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:26.979201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:27.158568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:27.171963 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-db95d78e-34bb-4c66-a18c-f683c8391693 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1275 microversion: 2.1 time: 0.286269 Oct 02 01:06:27.184572 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 710/1491] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:26 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:27.210286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:27.210965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:27.224710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:27.225207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:27.225642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:27.226351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:27.227598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:27.228030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:27.312614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:27.320908 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47ae9f50-25cf-4a93-a441-3212ccb12cfb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 1467 microversion: 2.1 time: 0.377906 Oct 02 01:06:27.322081 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 782/1492] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:26 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 1467 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:27.327717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:27.330224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:27.336531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:27.337215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:27.337826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:27.338722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:27.339331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:27.339901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:27.380327 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8890b513-4736-4b10-9681-e41bd4210cb5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056921 Oct 02 01:06:27.381455 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 783/1493] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:06:27 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:06:27.386134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eac25158-5e21-4ed7-b469-de13ed065975 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Action: 'create', calling method: .version_select at 0x7fb88103fc10>, body: {"pool": null} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:27.573560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:27.584994 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f0c527a-c259-41ae-88a1-614ca4ccf903 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1469 microversion: 2.1 time: 0.390217 Oct 02 01:06:27.598640 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 711/1494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:27 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:27.603742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1756311586"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:27.607107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:27.621778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:27.622285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:27.622823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:27.623581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:27.629204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:27.630412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:28.148054 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae61c95b-2eb4-4e19-918d-a4cd22a21bc0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "POST /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b/action" status: 202 len: 0 microversion: 2.1 time: 0.555879 Oct 02 01:06:28.154851 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 712/1495] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:06:27 2022] POST /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:06:28.162039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7123d053-9e75-4251-9342-63d077ca5f6c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8812a0a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:28.247070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7123d053-9e75-4251-9342-63d077ca5f6c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 0.089495 Oct 02 01:06:28.259572 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 713/1496] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:28 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:28.272879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:28.278315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:28.300589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:28.301354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:28.303115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:28.306047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:28.308963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:28.309806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:28.868913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:28.880176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-863c7f7a-6050-4a5b-ab83-dcdb92636794 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.617524 Oct 02 01:06:28.884790 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 714/1497] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:28 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:28.906332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:28.907104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:28.928159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:28.929918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:28.931384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:28.932766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:28.935102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:28.936989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:28.989871 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:29.512685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:29.533980 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fb16a072-3ea4-436c-bd96-5f66649b83ef tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1469 microversion: 2.1 time: 0.647402 Oct 02 01:06:29.534688 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 715/1498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:28 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1469 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:29.539768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e4ef811-b332-4a1b-8fe5-a2fafea150ad tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88180c820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:29.637344 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e4ef811-b332-4a1b-8fe5-a2fafea150ad tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 0.101201 Oct 02 01:06:29.638083 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 716/1499] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:29 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:29.912667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:29.913291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:29.923069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:29.923858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:29.924485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:29.925600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:29.926353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:29.927000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:30.395820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:30.404318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-32f630d2-9a7c-4085-a1d3-f03790a8d368 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.495630 Oct 02 01:06:30.406948 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 717/1500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:29 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:30.557447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:30.558394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:30.570144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:30.582364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:30.583064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:30.584159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:30.584883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:30.585502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:31.159962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eac25158-5e21-4ed7-b469-de13ed065975 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.777264 Oct 02 01:06:31.161883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 784/1501] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:06:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:31.172460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ba8cd65-6a52-41d1-bf45-9160a6d06e89 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881051dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:31.235924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:31.250886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-084fb5d6-d5d3-46c0-897b-eb85145d81cb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1535 microversion: 2.1 time: 0.691114 Oct 02 01:06:31.252113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 718/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:30 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1535 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:31.268462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5b38af7-c3ff-431b-b65a-5cc031649f5f tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Calling method '.version_select at 0x7fb8812a0dc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:31.292673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ba8cd65-6a52-41d1-bf45-9160a6d06e89 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 0.129200 Oct 02 01:06:31.293260 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 785/1503] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:31 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:31.304932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-484402f7-be9a-471c-84bc-22c1e3f23673 req-03dbcabb-1b41-4916-8343-c94f11a6c4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bc5257-bfd0-4f2b-9f56-b2302a63c99a", "tag": "2aac06d1-846f-4def-b569-7231bb57f969"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:31.332668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-484402f7-be9a-471c-84bc-22c1e3f23673 req-03dbcabb-1b41-4916-8343-c94f11a6c4e0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:31.333157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-484402f7-be9a-471c-84bc-22c1e3f23673 req-03dbcabb-1b41-4916-8343-c94f11a6c4e0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:31.334273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-484402f7-be9a-471c-84bc-22c1e3f23673 req-03dbcabb-1b41-4916-8343-c94f11a6c4e0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:31.349619 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-484402f7-be9a-471c-84bc-22c1e3f23673 req-03dbcabb-1b41-4916-8343-c94f11a6c4e0 service nova] Creating event network-changed:2aac06d1-846f-4def-b569-7231bb57f969 for instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a on n-h2-master-1 Oct 02 01:06:31.355654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-484402f7-be9a-471c-84bc-22c1e3f23673 req-03dbcabb-1b41-4916-8343-c94f11a6c4e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054632 Oct 02 01:06:31.357724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 786/1504] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:31.435120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:31.440532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:31.459571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:31.461057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:31.463652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:31.465276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:31.466709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:31.468814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:31.776509 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:32.344948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:32.353287 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80e103b1-8334-406f-ba45-0492786b7b4c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.926046 Oct 02 01:06:32.367668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 787/1505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:31 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:06:32.373037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:32.373661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:32.388999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:32.389528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:32.394164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:32.395267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:32.395935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:32.396556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:32.423707 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:33.433930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:33.455066 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1716c08b-5d4c-4d2f-9d08-5533f8a960ee tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1535 microversion: 2.1 time: 1.088074 Oct 02 01:06:33.456348 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 788/1506] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:32 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1535 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:33.465694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0c9aa56-a137-459e-bd59-80d68a764465 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881412a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:34.960514 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5b38af7-c3ff-431b-b65a-5cc031649f5f tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109" status: 202 len: 0 microversion: 2.1 time: 3.704583 Oct 02 01:06:34.962134 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 719/1507] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:06:31 2022] DELETE /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109 => generated 0 bytes in 3707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:06:34.970459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:34.972297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:34.993018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:34.995101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:34.997258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:35.001284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:35.002826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:35.005215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:35.711255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:35.733895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88db8669-321a-4da3-9069-04b0b1a2a1b4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.762571 Oct 02 01:06:35.734624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 720/1508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:34 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:35.740742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "name": "network-vif-unplugged", "status": "completed", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:35.788034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:35.788524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:35.788956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:35.856618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] Creating event network-vif-unplugged:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h1-master-1 Oct 02 01:06:35.881310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] Instance e4081c15-ec76-44d4-81f3-4bb471661d4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:06:35.907324 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-839764ea-8858-4184-aecf-22b4385ec75c req-cee10b76-930e-47ff-9077-522cab088886 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171200 Oct 02 01:06:35.911620 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 721/1509] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:36.414003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:36.418153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:36.445176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:36.446882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:36.447819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:36.451723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:36.452352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:36.452815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:36.837935 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:36.855736 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:37.365609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:37.376300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43628301-7f40-4fef-acea-5954705a359e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1535 microversion: 2.1 time: 1.463351 Oct 02 01:06:37.388376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 722/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:35 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1535 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:37.416698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c25b9a74-83bf-4759-a6b3-ed4978815d32 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Calling method '.version_select at 0x7fb88190c550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:37.574310 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-c25b9a74-83bf-4759-a6b3-ed4978815d32 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9e53351d-a64c-4f5d-acb1-98df5881c109 could not be found", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:06:37.575465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c25b9a74-83bf-4759-a6b3-ed4978815d32 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] HTTP exception thrown: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c25b9a74-83bf-4759-a6b3-ed4978815d32 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Request method failure captured: Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109 HTTP/1.1 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOQJA0r6GLRTuaHMJ8Xyf4yANMK9rUeaKDfmrRLr90U_DPIIXQeS-qGivYGfjq0-cvbnY2VnoatonHI6pKfNgswX3hdjnFLaGmE1cpSrBbkQihCEZrp6MNdCkZAhqdl3cgX0NgNrdF3x3x4faGbG22v7_zsMJJdP8dPBLdVtDlWL4mM Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 171d6e6675244130be822a3a69c6fe2e Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsTestJSON-920750931 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/171d6e6675244130be822a3a69c6fe2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/171d6e6675244130be822a3a69c6fe2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/171d6e6675244130be822a3a69c6fe2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_171d6e6675244130be822a3a69c6fe2e"}]}] Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsTestJSON-920750931 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 171d6e6675244130be822a3a69c6fe2e Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsTestJSON-920750931 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsTestJSON-920750931-project Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a0d9202ae84a4b5d90d136dcc0046695 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsTestJSON-920750931-project Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: exception: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '9e53351d-a64c-4f5d-acb1-98df5881c109'} Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9e53351d-a64c-4f5d-acb1-98df5881c109 could not be found Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-727fb5ed-f0fd-4119-afb7-846d43a773c8'] Oct 02 01:06:37.607486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109. Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:37.613309 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:37.617771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c25b9a74-83bf-4759-a6b3-ed4978815d32 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Returning 404 to user: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:37.619149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c25b9a74-83bf-4759-a6b3-ed4978815d32 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109" status: 404 len: 111 microversion: 2.1 time: 0.223784 Oct 02 01:06:37.620228 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 723/1511] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:06:37 2022] GET /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109 => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:37.633224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:37.634166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:37.663328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:37.665387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:37.665986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:37.667961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:37.670187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:37.672068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:38.052094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:38.067274 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d12bda67-d564-4cc5-ac63-ea3353e9f893 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.443505 Oct 02 01:06:38.082626 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 724/1512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:37 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:38.093481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0f3c859b-f6fd-474f-b2dc-bbab49d0dda8 req-85fa3b63-8831-47dd-b409-e58dab7d36bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "name": "network-vif-plugged", "status": "completed", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:38.114939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0f3c859b-f6fd-474f-b2dc-bbab49d0dda8 req-85fa3b63-8831-47dd-b409-e58dab7d36bd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:38.117370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0f3c859b-f6fd-474f-b2dc-bbab49d0dda8 req-85fa3b63-8831-47dd-b409-e58dab7d36bd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:38.118726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0f3c859b-f6fd-474f-b2dc-bbab49d0dda8 req-85fa3b63-8831-47dd-b409-e58dab7d36bd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:38.151807 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0f3c859b-f6fd-474f-b2dc-bbab49d0dda8 req-85fa3b63-8831-47dd-b409-e58dab7d36bd service nova] Creating event network-vif-plugged:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:06:38.163438 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0f3c859b-f6fd-474f-b2dc-bbab49d0dda8 req-85fa3b63-8831-47dd-b409-e58dab7d36bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087026 Oct 02 01:06:38.164062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 725/1513] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:38.170750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f64c9931-69a4-4ae3-90fa-7b8da5a0fa07 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Calling method '.version_select at 0x7fb8816d5ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:38.332316 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-f64c9931-69a4-4ae3-90fa-7b8da5a0fa07 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9e53351d-a64c-4f5d-acb1-98df5881c109 could not be found", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:06:38.333013 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f64c9931-69a4-4ae3-90fa-7b8da5a0fa07 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] HTTP exception thrown: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f64c9931-69a4-4ae3-90fa-7b8da5a0fa07 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Request method failure captured: Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109 HTTP/1.1 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOQJA0r6GLRTuaHMJ8Xyf4yANMK9rUeaKDfmrRLr90U_DPIIXQeS-qGivYGfjq0-cvbnY2VnoatonHI6pKfNgswX3hdjnFLaGmE1cpSrBbkQihCEZrp6MNdCkZAhqdl3cgX0NgNrdF3x3x4faGbG22v7_zsMJJdP8dPBLdVtDlWL4mM Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 171d6e6675244130be822a3a69c6fe2e Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsTestJSON-920750931 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/171d6e6675244130be822a3a69c6fe2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/171d6e6675244130be822a3a69c6fe2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/171d6e6675244130be822a3a69c6fe2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_171d6e6675244130be822a3a69c6fe2e"}]}] Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsTestJSON-920750931 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 171d6e6675244130be822a3a69c6fe2e Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsTestJSON-920750931 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsTestJSON-920750931-project Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a0d9202ae84a4b5d90d136dcc0046695 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsTestJSON-920750931-project Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: exception: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '9e53351d-a64c-4f5d-acb1-98df5881c109'} Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9e53351d-a64c-4f5d-acb1-98df5881c109 could not be found Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-234ac96e-3992-440c-a2e2-5866fa8731fd'] Oct 02 01:06:38.335151 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109. Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f64c9931-69a4-4ae3-90fa-7b8da5a0fa07 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] Returning 404 to user: Floating IP not found for ID 9e53351d-a64c-4f5d-acb1-98df5881c109 {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f64c9931-69a4-4ae3-90fa-7b8da5a0fa07 tempest-FloatingIPsTestJSON-920750931 tempest-FloatingIPsTestJSON-920750931-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109" status: 404 len: 111 microversion: 2.1 time: 0.170180 Oct 02 01:06:38.339506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 726/1514] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:06:38 2022] DELETE /compute/v2.1/os-floating-ips/9e53351d-a64c-4f5d-acb1-98df5881c109 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:38.350644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:38.398071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:38.403236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:38.404715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:38.427129 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] Creating event network-changed:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h1-master-1 Oct 02 01:06:38.462225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] Instance e4081c15-ec76-44d4-81f3-4bb471661d4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:06:38.485393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9e76c310-c114-4b6b-be9e-d09b3d0d4c20 req-b3ecee2c-c029-4284-83ea-cd958abbef34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140493 Oct 02 01:06:38.492346 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 727/1515] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:38.502307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:38.503372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:38.517073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:38.520628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:38.521437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:38.522352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:38.523023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:38.523921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:39.819030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:39.839160 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8aa5a7ad-d4b0-4812-9f70-5ac52b74e7fb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1535 microversion: 2.1 time: 1.339236 Oct 02 01:06:39.841520 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 728/1516] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:38 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1535 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:39.851721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:39.852777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:39.871491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:39.872223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:39.872868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:39.873910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:39.875015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:39.876881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:40.588146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:40.602620 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53c63a44-1515-4590-9610-48be9d1b856d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.757470 Oct 02 01:06:40.605731 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 729/1517] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:39 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:40.734010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5e29ab7-58ef-4031-bf40-c9caae13b88d tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb88113d310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-649524487", "description": "tempest-description-1322116784"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:41.656196 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5e29ab7-58ef-4031-bf40-c9caae13b88d tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.045983 Oct 02 01:06:41.658368 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 730/1518] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:06:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:41.664913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:41.666066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:41.684978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:41.691479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:41.693740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:41.704446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:41.705603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:41.706503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:41.777468 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:42.302885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:42.314619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76a667bc-71be-44bf-85b8-1b3c78c9e656 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1528 microversion: 2.1 time: 0.654888 Oct 02 01:06:42.321224 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 731/1519] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:41 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1528 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:42.326459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:42.327704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:42.346910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:42.348419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:42.349794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:42.351557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:42.352316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:42.353018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:42.419827 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:42.884474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:42.895727 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17491529-04f5-4ea5-a78f-aae2f1a267be tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.573238 Oct 02 01:06:42.897467 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 732/1520] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:42 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:42.922135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7401547-4646-48e3-be3f-e91b1e1e818d tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb88128e790>, body: {"security_group_rule": {"parent_group_id": "d82d3f2e-2de8-4297-a521-20b6b160db96", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:43.442727 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:43.447588 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7401547-4646-48e3-be3f-e91b1e1e818d tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.548579 Oct 02 01:06:43.448682 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 733/1521] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:06:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:43.455303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e75027c2-b1c1-4f3c-9af6-6ae80476724c req-dfbdd07c-7651-4d1f-9237-a210f4e20fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bc5257-bfd0-4f2b-9f56-b2302a63c99a", "name": "network-vif-plugged", "status": "completed", "tag": "2aac06d1-846f-4def-b569-7231bb57f969"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:43.472104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e75027c2-b1c1-4f3c-9af6-6ae80476724c req-dfbdd07c-7651-4d1f-9237-a210f4e20fe6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:43.472887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e75027c2-b1c1-4f3c-9af6-6ae80476724c req-dfbdd07c-7651-4d1f-9237-a210f4e20fe6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:43.473517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e75027c2-b1c1-4f3c-9af6-6ae80476724c req-dfbdd07c-7651-4d1f-9237-a210f4e20fe6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:43.487536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e75027c2-b1c1-4f3c-9af6-6ae80476724c req-dfbdd07c-7651-4d1f-9237-a210f4e20fe6 service nova] Creating event network-vif-plugged:2aac06d1-846f-4def-b569-7231bb57f969 for instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a on n-h2-master-1 Oct 02 01:06:43.497146 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e75027c2-b1c1-4f3c-9af6-6ae80476724c req-dfbdd07c-7651-4d1f-9237-a210f4e20fe6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046106 Oct 02 01:06:43.498294 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 734/1522] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:43.506284 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:43.507983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:43.518718 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:43.522516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:43.523462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:43.524411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:43.525562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:43.526617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:43.527777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:44.921396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:44.941834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d55c1e6d-3cc2-4acf-a847-a64f21343c3e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1528 microversion: 2.1 time: 1.440909 Oct 02 01:06:44.943814 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 735/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:43 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1528 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:44.977502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aad7609b-eee4-4f5f-aaa7-ef508c63bb1d tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb8816d5280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1399021787", "description": "tempest-description-386937580"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:45.759544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aad7609b-eee4-4f5f-aaa7-ef508c63bb1d tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.813603 Oct 02 01:06:45.761177 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 736/1524] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:06:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:45.768528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:45.770534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:45.784018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:45.784768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:45.785346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:45.786255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:45.786901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:45.787483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:46.252959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:46.263444 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd51d675-a00b-4c38-8b9f-95560b4e4bbe tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1317 microversion: 2.1 time: 0.500950 Oct 02 01:06:46.273322 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 737/1525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:45 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:46.294213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bac2d549-ccc0-4ac2-8a5f-d1ef3091e453 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:46.302390 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-bac2d549-ccc0-4ac2-8a5f-d1ef3091e453 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] HTTP exception thrown: Flavor bbacc0d8-b993-43c1-a245-13ed6552ed58 could not be found. Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bac2d549-ccc0-4ac2-8a5f-d1ef3091e453 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Request method failure captured: Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/flavors/bbacc0d8-b993-43c1-a245-13ed6552ed58 HTTP/1.1 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLtHXffnd_qTTirgEpgQuHJ6vtEQcmgbRnR9WuzDQ4-ls1SayF5rbvjJuUOFgeqTNXgnfbeLS02zA7WqxgP5v1HbIGRUrxR56kFuklgKB-B6ILWVPt5IzjaTuqJYZHAYQCJXe_SoC9odblzQ6gj92iR3cN9xpYpi4wKcbsNISfZM-g Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0109446141724cb18793396cffef0f5d Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-MigrationsAdminTest-755750085 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0109446141724cb18793396cffef0f5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0109446141724cb18793396cffef0f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0109446141724cb18793396cffef0f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0109446141724cb18793396cffef0f5d"}]}] Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-MigrationsAdminTest-755750085 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0109446141724cb18793396cffef0f5d Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-MigrationsAdminTest-755750085 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-MigrationsAdminTest-755750085-project-admin Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfabe41ff3a6492b95dfcff64ffc38d1 Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-MigrationsAdminTest-755750085-project-admin Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor bbacc0d8-b993-43c1-a245-13ed6552ed58 could not be found. Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bbacc0d8-b993-43c1-a245-13ed6552ed58'} Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bbacc0d8-b993-43c1-a245-13ed6552ed58 could not be found. Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor bbacc0d8-b993-43c1-a245-13ed6552ed58 could not be found. Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:46.316965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bbacc0d8-b993-43c1-a245-13ed6552ed58 could not be found. Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:06:46.323571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bac2d549-ccc0-4ac2-8a5f-d1ef3091e453 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Returning 404 to user: Flavor bbacc0d8-b993-43c1-a245-13ed6552ed58 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:46.324880 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bac2d549-ccc0-4ac2-8a5f-d1ef3091e453 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/bbacc0d8-b993-43c1-a245-13ed6552ed58" status: 404 len: 109 microversion: 2.1 time: 0.044034 Oct 02 01:06:46.331683 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 738/1526] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:46 2022] DELETE /compute/v2.1/flavors/bbacc0d8-b993-43c1-a245-13ed6552ed58 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:46.351697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbf0b05a-3468-419b-86c2-8256d984daae tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb88128e8b0>, body: {"security_group_rule": {"parent_group_id": "9041b844-2729-4820-9005-dc5ecf326f2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:46.793125 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cbf0b05a-3468-419b-86c2-8256d984daae tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.460056 Oct 02 01:06:46.794008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 739/1527] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:06:46 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:46.798986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1711174530", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:51.842924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0c9aa56-a137-459e-bd59-80d68a764465 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 18.384559 Oct 02 01:06:51.848671 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 789/1528] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:33 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 18391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:51.854583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea5870c9-8458-41ab-83c5-0d0f8b072aeb tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb8813824c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-229201685", "description": "tempest-description-1875365225"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:51.866576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:06:52.465300 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea5870c9-8458-41ab-83c5-0d0f8b072aeb tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.614697 Oct 02 01:06:52.466244 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 790/1529] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:06:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:52.471539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-35ef8085-5cca-4aa1-a3bd-f7a94c23b310 req-d651ff26-649e-4caa-becb-50177f33898b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:52.493702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-35ef8085-5cca-4aa1-a3bd-f7a94c23b310 req-d651ff26-649e-4caa-becb-50177f33898b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:52.494283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-35ef8085-5cca-4aa1-a3bd-f7a94c23b310 req-d651ff26-649e-4caa-becb-50177f33898b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:52.494950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-35ef8085-5cca-4aa1-a3bd-f7a94c23b310 req-d651ff26-649e-4caa-becb-50177f33898b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:52.499460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:06:52.500110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:06:52.501480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:06:52.502073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:06:52.502708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:06:52.508208 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-35ef8085-5cca-4aa1-a3bd-f7a94c23b310 req-d651ff26-649e-4caa-becb-50177f33898b service nova] Creating event network-vif-plugged:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h1-master-1 Oct 02 01:06:52.515703 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-35ef8085-5cca-4aa1-a3bd-f7a94c23b310 req-d651ff26-649e-4caa-becb-50177f33898b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046772 Oct 02 01:06:52.516502 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 791/1530] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:52.522106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:52.522528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:52.522684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:52.523534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:52.526628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:52.527491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:52.530785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:52.531823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:52.532534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:52.533193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:52.537639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:52.539694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:52.540362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:52.542569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:52.559959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:52.567799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Getting quotas for user 739083b66f9b433889944e555b0aef23 and project c0e072a3f56045949210c8d4452298ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:52.586279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:06:52.588707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:06:52.692154 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5f5e528-8828-4bcf-814d-20eed611f90e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.893395 Oct 02 01:06:52.693108 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 740/1531] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 5898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:06:52.700386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b73c8d52-dafe-4c04-9ac4-bd9d59af4049 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Action: 'create', calling method: .version_select at 0x7fb8813b69d0>, body: {"keypair": {"name": "tempest-keypair-85429138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNonjGej7uV5p1Vnydjopu3+AU3sDvkmatlo9Zr00Gba6Y0eIGTTGdzdSq6bAH33WdCcXA9zDWTrpHvLn8GtNBvlU4fdqwpcBd4pnQmDtzbzN4QFKaBZlmnCvfjfoP3ZPg=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:52.749584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b73c8d52-dafe-4c04-9ac4-bd9d59af4049 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Getting quotas for project 2b6dd9c628eb4be5b48c28a1192e16c1. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:06:52.770567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:52.772657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b73c8d52-dafe-4c04-9ac4-bd9d59af4049 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Getting quotas for user c4c8a46a0556407f9956cbd1ffd75c7e and project 2b6dd9c628eb4be5b48c28a1192e16c1. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:06:52.785299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2fdeec9e-0312-4482-ad9e-ae8926f6f4d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1467 microversion: 2.1 time: 0.266713 Oct 02 01:06:52.804801 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 792/1532] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:52 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1467 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:52.821799 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b73c8d52-dafe-4c04-9ac4-bd9d59af4049 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.127114 Oct 02 01:06:52.823523 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 741/1533] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:06:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:06:52.846973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5b17a26-4cde-40a2-8f9b-888138680cd4 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb88393ee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1094552962", "description": "tempest-description-472238377"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:53.064592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-073f81f5-fe21-4355-80e0-bf0ef14f1d73 tempest-ListImagesTestJSON-1670718872 tempest-ListImagesTestJSON-1670718872-project] Calling method '.version_select at 0x7fb881060550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:53.148068 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-073f81f5-fe21-4355-80e0-bf0ef14f1d73 tempest-ListImagesTestJSON-1670718872 tempest-ListImagesTestJSON-1670718872-project] 10.222.0.23 "GET /compute/v2.1/images/d452563b-d97f-4ef2-b927-770421bd0406" status: 200 len: 784 microversion: 2.1 time: 0.341048 Oct 02 01:06:53.150911 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 793/1534] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:52 2022] GET /compute/v2.1/images/d452563b-d97f-4ef2-b927-770421bd0406 => generated 784 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:53.167300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0627f07-dbbf-48c2-ba21-3abcece39f1f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:53.168395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0627f07-dbbf-48c2-ba21-3abcece39f1f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:53.464691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c0627f07-dbbf-48c2-ba21-3abcece39f1f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:53.476920 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0627f07-dbbf-48c2-ba21-3abcece39f1f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1213 microversion: 2.1 time: 0.322581 Oct 02 01:06:53.480783 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 794/1535] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:53 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1213 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:53.495006 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:53.495889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:53.517539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:53.519426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:53.520049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:53.522588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:53.524729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:53.527518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:53.877331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5b17a26-4cde-40a2-8f9b-888138680cd4 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.051790 Oct 02 01:06:53.879183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 742/1536] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:06:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:53.898181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9160dbd-b56f-4ec1-b8e3-61a572b70dac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8817b8670>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:53.925950 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5413cdeb-10c8-45dc-aefc-e7985565df66 tempest-ServersOnMultiNodesTest-991315295 tempest-ServersOnMultiNodesTest-991315295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1618 microversion: 2.1 time: 0.443377 Oct 02 01:06:53.926558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 795/1537] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:53 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1618 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:53.961325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c79fc7c-d118-4cc2-b069-4da936050039 tempest-ListImagesTestJSON-1670718872 tempest-ListImagesTestJSON-1670718872-project] Calling method '.version_select at 0x7fb881555af0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:54.347582 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9160dbd-b56f-4ec1-b8e3-61a572b70dac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 0.453269 Oct 02 01:06:54.349067 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 743/1538] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:53 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:54.362373 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c79fc7c-d118-4cc2-b069-4da936050039 tempest-ListImagesTestJSON-1670718872 tempest-ListImagesTestJSON-1670718872-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.409101 Oct 02 01:06:54.363560 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 796/1539] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:53 2022] GET /compute/v2.1/images => generated 445 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:54.372009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10f80365-0bf8-407f-8e33-347ef4915512 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb88128eca0>, body: {"security_group_rule": {"parent_group_id": "ddcd8aba-1e69-437b-98f2-ff1cdde9429b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7727bd0a-5527-4f6c-ba06-7f984ecd515a"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:54.379134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:54.380076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:54.387953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:54.388572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:54.389128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:54.390009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:54.390646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:54.391293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:54.440476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:06:54.587550 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3851bc6d-3aa9-4316-9e43-f02d64bf9a29 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 204 len: 0 microversion: 2.1 time: 0.213845 Oct 02 01:06:54.589170 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 797/1540] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:54 2022] DELETE /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:06:54.597380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eb3e7632-3c6f-409d-a71b-d981bd5df78a tempest-ListImagesTestJSON-1670718872 tempest-ListImagesTestJSON-1670718872-project] Calling method '.version_select at 0x7fb881060550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:54.667870 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eb3e7632-3c6f-409d-a71b-d981bd5df78a tempest-ListImagesTestJSON-1670718872 tempest-ListImagesTestJSON-1670718872-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.077008 Oct 02 01:06:54.681311 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 798/1541] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:06:54 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:54.688404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:54.689503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:54.698115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:54.698902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:54.699584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:54.700535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:54.702105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:54.702833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:54.813105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:54.821329 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-844af598-2be6-452c-82a4-9a5effc2eddc tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1265 microversion: 2.1 time: 0.137207 Oct 02 01:06:54.836469 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 799/1542] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:54 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:54.848877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:54.849503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:54.856784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:54.859977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:54.859977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:54.859977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:54.860257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:54.860620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:55.153494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:55.165800 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de591c47-05b5-41f5-9870-f80f8b365263 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1473 microversion: 2.1 time: 0.324768 Oct 02 01:06:55.166688 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 800/1543] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:54 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:55.257808 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10f80365-0bf8-407f-8e33-347ef4915512 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.907360 Oct 02 01:06:55.258561 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 744/1544] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:06:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:55.272880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad572e13-fdcf-4b58-8178-70e299625a44 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb88102eaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-582418910", "description": "tempest-description-1109625621"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:55.378868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3dfbf0f7-976f-46be-9900-a09673328108 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881420a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:55.488124 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3dfbf0f7-976f-46be-9900-a09673328108 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 0.124342 Oct 02 01:06:55.488721 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 745/1545] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:55 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:55.848910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:55.849784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:55.867383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:55.868174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:55.868790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:55.869697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:55.870840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:55.871470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:56.240290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:56.248910 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bda02c6-aa79-4fb5-98b4-22d3e30065f6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1271 microversion: 2.1 time: 0.403930 Oct 02 01:06:56.255612 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 746/1546] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:55 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1271 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:56.264281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:56.266029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:56.273926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:56.274429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:56.274908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:56.275807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:56.276320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:56.276720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:56.283368 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad572e13-fdcf-4b58-8178-70e299625a44 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.013928 Oct 02 01:06:56.291901 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 801/1547] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:06:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:56.297702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2689e456-9ea6-420f-be4f-0cec5697202e tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb881051310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-69096124", "description": "tempest-description-215093652"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:57.039725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:57.050810 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ac49cb7-ffad-4aa2-a865-728888742924 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1473 microversion: 2.1 time: 0.792183 Oct 02 01:06:57.063640 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 747/1548] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:56 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1473 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:57.068734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd14105f-51df-4234-bb33-600bb2e83d02 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8816d5280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:57.122330 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd14105f-51df-4234-bb33-600bb2e83d02 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1453 microversion: 2.1 time: 0.057267 Oct 02 01:06:57.122933 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 748/1549] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:57 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1453 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:57.128569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1278774555", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4f191c16-fd5a-451a-b556-ef4319dc6303"}, {"port": "9d7260a1-4157-406c-8464-41223d149d9b", "tag": "port-1"}, {"port": "179e51bf-6cf7-46dd-b434-82948432387b", "tag": "port-2"}, {"uuid": "83e47b64-2570-4e29-aefa-2ffecdc92879", "tag": "net-1"}, {"uuid": "83e47b64-2570-4e29-aefa-2ffecdc92879"}, {"uuid": "385a963f-dd9b-4cbe-80bd-eaa1fde0caf6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "385a963f-dd9b-4cbe-80bd-eaa1fde0caf6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "eb8be7f4-8095-4121-b152-d03ce3357a9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5d7a16de-ef69-4c75-8e8b-1d741250031a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d15e0b16-1cdd-4bc1-9099-dd71a23b124d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--684019247"}], "key_name": "tempest-keypair-85429138", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:57.768798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2689e456-9ea6-420f-be4f-0cec5697202e tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.475472 Oct 02 01:06:57.777786 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 802/1550] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:06:56 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:57.784069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:57.785680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:57.808005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:57.809311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:57.810082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:57.810992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:57.812112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:57.812793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:57.985770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] validate_networks() for [('4f191c16-fd5a-451a-b556-ef4319dc6303', None, None, None, None, None), (None, None, '9d7260a1-4157-406c-8464-41223d149d9b', None, None, None), (None, None, '179e51bf-6cf7-46dd-b434-82948432387b', None, None, None), ('83e47b64-2570-4e29-aefa-2ffecdc92879', None, None, None, None, None), ('83e47b64-2570-4e29-aefa-2ffecdc92879', None, None, None, None, None), ('385a963f-dd9b-4cbe-80bd-eaa1fde0caf6', '10.2.2.100', None, None, None, None), ('385a963f-dd9b-4cbe-80bd-eaa1fde0caf6', '10.2.2.200', None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:06:58.039809 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:58.063497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40c7abae-9da4-4645-9dee-1f8b2a82e9d4 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1271 microversion: 2.1 time: 0.283861 Oct 02 01:06:58.064538 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 803/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:57 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:58.416507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Calling method '.version_select at 0x7fb881051940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:58.452686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:58.456703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:58.459529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:58.464336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:58.465397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:58.467007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:58.553733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-37bd5563-b87e-4626-97c7-b407bd13b751 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.487822 Oct 02 01:06:58.554450 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 804/1552] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:58.559579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f35e2467-c948-4d25-b7d5-dd7c88a1784b tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb8816ce670>, body: {"security_group_rule": {"parent_group_id": "bb0481e3-fa86-48ba-a7dd-16dbdeb17793", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b1f37627-6710-4e0b-8717-5a86164606cc"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:59.840393 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f35e2467-c948-4d25-b7d5-dd7c88a1784b tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 1.283837 Oct 02 01:06:59.844023 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 805/1553] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:06:58 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:59.851813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:59.852792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:59.873363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:59.877905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:59.879502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:59.882496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:59.883264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:59.886295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:59.957608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:59.958204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:59.959597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:59.960161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lazy-loading 'fault' on Instance uuid 98bc5257-bfd0-4f2b-9f56-b2302a63c99a {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:00.072741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:00.082961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fddeb536-3ba7-4323-aa71-3334bbfe93d5 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 200 len: 1307 microversion: 2.1 time: 0.236826 Oct 02 01:07:00.084202 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 806/1554] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:59 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:00.091428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6f88ba21-dc8f-439c-9524-bbb9d551d961 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8816ee310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:00.188321 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6f88ba21-dc8f-439c-9524-bbb9d551d961 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1462 microversion: 2.1 time: 0.102556 Oct 02 01:07:00.193531 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 807/1555] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:00 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:00.206477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1519417963", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:00.300269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:07:00.826956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Getting quotas for project 815dc360b4004abfb574f4fb4a8bc3a7. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:00.833047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Getting quotas for user 992fb97f8ca443a9ae617e5209246994 and project 815dc360b4004abfb574f4fb4a8bc3a7. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:00.855583 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Request method failure captured: Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 1752 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOQxBbBMp-p06nhCzib_7e77zv1Jhw1C8gT_tQDs3Oc7OTMBe9wpZJ4NrnTfs9EXm2Heufr_hDlEbcLTQc05agegFYNawPIaygnkmDlwRjt88hTR-amqbfUwNZwkcdAqygLtn3WfYp6l43W8P1zSaFuNtOz5S8vni9Q9nZn-hinL_q4 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 815dc360b4004abfb574f4fb4a8bc3a7 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2038183828 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/815dc360b4004abfb574f4fb4a8bc3a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/815dc360b4004abfb574f4fb4a8bc3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/815dc360b4004abfb574f4fb4a8bc3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_815dc360b4004abfb574f4fb4a8bc3a7"}]}] Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2038183828 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 815dc360b4004abfb574f4fb4a8bc3a7 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2038183828 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 992fb97f8ca443a9ae617e5209246994 Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1519417963", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:00.893540 n-d-master-1 devstack@n-api.service[122355]: exception: Maximum number of metadata items exceeds 128 Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1519417963', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:07:00.896371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 02 01:07:00.900105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:00.902727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:00.904243 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-57e5f6fd-6bbb-4817-9ec9-614d9e7a26b5 tempest-AbsoluteLimitsNegativeTestJSON-2038183828 tempest-AbsoluteLimitsNegativeTestJSON-2038183828-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.707527 Oct 02 01:07:00.904887 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 808/1556] 10.222.0.23 () {60 vars in 1148 bytes} [Sun Oct 2 01:07:00 2022] POST /compute/v2.1/servers => generated 87 bytes in 709 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:07:00.925525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:00.928209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:00.939979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:00.942446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:00.943395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:00.945908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:00.946680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:00.947312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:01.291361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:01.306429 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a135640-9f9d-4901-bc91-983109d06e2c tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.400157 Oct 02 01:07:01.307837 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 809/1557] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:00 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:01.317052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-34a60730-ba61-4519-a234-9b12f5ecc903 req-8d0c17a3-9d1e-4c30-94d7-4fc76c82994a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bc5257-bfd0-4f2b-9f56-b2302a63c99a", "name": "network-vif-deleted", "tag": "2aac06d1-846f-4def-b569-7231bb57f969"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:01.329741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-34a60730-ba61-4519-a234-9b12f5ecc903 req-8d0c17a3-9d1e-4c30-94d7-4fc76c82994a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:01.330463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-34a60730-ba61-4519-a234-9b12f5ecc903 req-8d0c17a3-9d1e-4c30-94d7-4fc76c82994a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:01.331848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-34a60730-ba61-4519-a234-9b12f5ecc903 req-8d0c17a3-9d1e-4c30-94d7-4fc76c82994a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:01.387253 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-34a60730-ba61-4519-a234-9b12f5ecc903 req-8d0c17a3-9d1e-4c30-94d7-4fc76c82994a service nova] Creating event network-vif-deleted:2aac06d1-846f-4def-b569-7231bb57f969 for instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a on n-h2-master-1 Oct 02 01:07:01.403244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-34a60730-ba61-4519-a234-9b12f5ecc903 req-8d0c17a3-9d1e-4c30-94d7-4fc76c82994a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093726 Oct 02 01:07:01.404010 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 810/1558] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:01.409752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f6f906a-e8df-4714-85c2-842190680ac6 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88102e700>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:02.381055 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f6f906a-e8df-4714-85c2-842190680ac6 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b1f37627-6710-4e0b-8717-5a86164606cc" status: 202 len: 0 microversion: 2.1 time: 0.975180 Oct 02 01:07:02.384456 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 811/1559] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:01 2022] DELETE /compute/v2.1/os-security-groups/b1f37627-6710-4e0b-8717-5a86164606cc => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:02.391076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1afdfcbe-51ad-4154-b7b4-124788e86876 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885681a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:02.458685 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1afdfcbe-51ad-4154-b7b4-124788e86876 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 200 len: 1462 microversion: 2.1 time: 0.072639 Oct 02 01:07:02.468141 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 812/1560] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:02 2022] GET /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 1462 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:02.468141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:02.468141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 98bc5257-bfd0-4f2b-9f56-b2302a63c99a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:02.475265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:02.476032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:02.476808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:02.477572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:02.478048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:02.478490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:02.504179 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a could not be found. Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a HTTP/1.1 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a could not be found. Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '98bc5257-bfd0-4f2b-9f56-b2302a63c99a'} Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a could not be found. Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a could not be found. Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:02.506035 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a could not be found. Oct 02 01:07:02.512098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:02.513962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 98bc5257-bfd0-4f2b-9f56-b2302a63c99a could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:02.513962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa0c9724-60b9-46d5-9dce-4d40fad5d0b6 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a" status: 404 len: 111 microversion: 2.1 time: 0.053175 Oct 02 01:07:02.515008 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 813/1561] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:02 2022] GET /compute/v2.1/servers/98bc5257-bfd0-4f2b-9f56-b2302a63c99a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:02.521987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-303317136", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50e67603-d71e-41c6-898e-f46b864cbf22"}], "block_device_mapping_v2": [{"uuid": "0b0864f4-db7f-4f38-ade9-0f8353e36309", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:02.550762 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:02.592193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] validate_networks() for [('50e67603-d71e-41c6-898e-f46b864cbf22', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:07:02.790299 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:03.367625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:07:03.368060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:07:03.368595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:07:03.369014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:07:03.369429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:07:03.378545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:03.379075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:03.379507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:03.380305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:03.380765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:03.381384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:03.400334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:03.407726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Getting quotas for user 6da1976f703f402788953f3332a281de and project ffe656702bb24b6a9b459ff1b19a0d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:03.493112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:07:03.495679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b0864f4-db7f-4f38-ade9-0f8353e36309',volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:07:03.500305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:07:03.500755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:07:03.501412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:07:03.502446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:07:03.503362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:07:03.512591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:03.513127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:03.513584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:03.515005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:03.515541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:03.515970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:03.534227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Getting quotas for project 2b6dd9c628eb4be5b48c28a1192e16c1. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:03.539809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Getting quotas for user c4c8a46a0556407f9956cbd1ffd75c7e and project 2b6dd9c628eb4be5b48c28a1192e16c1. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:03.717820 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a8d6745-c0eb-474b-bcab-b546eb9d1e4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201372 Oct 02 01:07:03.719188 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 814/1562] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:07:03.728479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:03.733355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:03.745714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:03.746213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:03.746750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:03.747467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:03.748125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:03.749129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:03.766831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:07:03.771181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='eb8be7f4-8095-4121-b152-d03ce3357a9c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5d7a16de-ef69-4c75-8e8b-1d741250031a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d15e0b16-1cdd-4bc1-9099-dd71a23b124d',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:07:04.141394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:04.154371 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b09fe848-57be-41aa-990f-63e92821f8ae tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.433794 Oct 02 01:07:04.158144 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 815/1563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:03 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:04.168366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47fa5114-f552-49ae-ab0d-a88001759b9f tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88157caf0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:04.261852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2fa1e2a5-6d56-4737-bcaa-56c0b585dc1d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.136171 Oct 02 01:07:04.262857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 749/1564] 10.222.0.23 () {62 vars in 1189 bytes} [Sun Oct 2 01:06:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 7139 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:07:04.275239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:04.276333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:04.284007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.285411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.286018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.287934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.289593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.290230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.362251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47fa5114-f552-49ae-ab0d-a88001759b9f tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/bb0481e3-fa86-48ba-a7dd-16dbdeb17793" status: 200 len: 247 microversion: 2.1 time: 0.202558 Oct 02 01:07:04.365348 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 816/1565] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:07:04 2022] GET /compute/v2.1/os-security-groups/bb0481e3-fa86-48ba-a7dd-16dbdeb17793 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:04.370787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:04.371555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:04.390011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.390718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.393163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.396231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.400721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.401275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.439187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:04.555053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:04.567250 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ffb48466-b3be-4507-b6cc-58fbe53f837d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 204 len: 0 microversion: 2.1 time: 0.199413 Oct 02 01:07:04.568763 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 817/1566] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:04 2022] DELETE /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:04.571563 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88e63845-9927-49ff-a60b-70f27d67fee7 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 1467 microversion: 2.1 time: 0.307194 Oct 02 01:07:04.582808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 750/1567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:04 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 1467 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:04.582808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:04.584111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:04.587068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d3b0af4e-89f1-4c54-b057-4635cf9da76b req-092e43a1-1373-4d2e-9299-ffedb3a0938d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:04.598085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d3b0af4e-89f1-4c54-b057-4635cf9da76b req-092e43a1-1373-4d2e-9299-ffedb3a0938d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.598887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d3b0af4e-89f1-4c54-b057-4635cf9da76b req-092e43a1-1373-4d2e-9299-ffedb3a0938d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.599480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d3b0af4e-89f1-4c54-b057-4635cf9da76b req-092e43a1-1373-4d2e-9299-ffedb3a0938d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.601435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.602288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.603175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.605572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.606265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.606965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.613349 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d3b0af4e-89f1-4c54-b057-4635cf9da76b req-092e43a1-1373-4d2e-9299-ffedb3a0938d service nova] Creating event network-changed:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h1-master-1 Oct 02 01:07:04.620780 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d3b0af4e-89f1-4c54-b057-4635cf9da76b req-092e43a1-1373-4d2e-9299-ffedb3a0938d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050390 Oct 02 01:07:04.621406 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 818/1568] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:04.629157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67e43c7b-43a6-4cfa-b6a5-44f8dec3fb09 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:04.634918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-67e43c7b-43a6-4cfa-b6a5-44f8dec3fb09 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:04.682503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:04.692852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2956436-77f9-4765-841d-377df1c804ea tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1102 microversion: 2.1 time: 0.116583 Oct 02 01:07:04.693440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 751/1569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:04 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1102 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:04.698869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60d2bbff-57a2-4c86-adb8-0ae611d04b71 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb8817ecca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1383500319", "description": "tempest-description-1005381968"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:04.726280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-67e43c7b-43a6-4cfa-b6a5-44f8dec3fb09 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:04.757259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-67e43c7b-43a6-4cfa-b6a5-44f8dec3fb09 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:04.761051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-67e43c7b-43a6-4cfa-b6a5-44f8dec3fb09 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:04.762483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-67e43c7b-43a6-4cfa-b6a5-44f8dec3fb09 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1284 microversion: 2.42 time: 0.137641 Oct 02 01:07:04.763295 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 819/1570] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:04 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:04.769454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:04.770302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:04.777961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.778706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.779332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:04.780778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:04.781245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:04.781659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.165243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:05.169169 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:05.184491 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-308b92f6-e837-4e89-a013-f2aa9ec220ef tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1473 microversion: 2.1 time: 0.419202 Oct 02 01:07:05.185628 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 820/1571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:04 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1473 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:05.191619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-136728062"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:05.194750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:05.201624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.202916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.203695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.204426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.204889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.205398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.245701 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60d2bbff-57a2-4c86-adb8-0ae611d04b71 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.551051 Oct 02 01:07:05.254545 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 752/1572] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:07:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:05.254545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:05.254545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:05.259298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.259992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.260622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.261509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.262136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.262972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.492290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78253413-a417-49b7-9918-9c5d075bbe08 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "POST /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7/action" status: 202 len: 0 microversion: 2.1 time: 0.304914 Oct 02 01:07:05.493008 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 821/1573] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:07:05 2022] POST /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:07:05.499882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f59964d-4255-472b-8e51-bc33f595c1cb tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb885681af0>, body: {"security_group_rule": {"parent_group_id": "a81f9c22-320c-4ff5-b224-5e0555c1e356", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:05.585190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:05.595320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50122502-c409-4d39-a089-eb94232c9d3d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.347578 Oct 02 01:07:05.595910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 753/1574] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:05 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:05.601089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e504bc1-1373-46e8-b6e2-745895550064 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88128eaf0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:05.663343 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e504bc1-1373-46e8-b6e2-745895550064 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.065875 Oct 02 01:07:05.673332 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 754/1575] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:05 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:05.725643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:05.726845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:05.735879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.736506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.737130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.737935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.739525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.740143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.891922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:05.906181 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-33159b11-bd3d-4d73-91eb-e59d40fc4c4d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1102 microversion: 2.1 time: 0.190061 Oct 02 01:07:05.907431 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 755/1576] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:05 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1102 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:05.912553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:05.913176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:05.923100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.923678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.924847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:05.925591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:05.926060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:05.927447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.000876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f59964d-4255-472b-8e51-bc33f595c1cb tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.506097 Oct 02 01:07:06.001485 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 822/1577] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:07:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:06.013375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8afce99a-2041-48aa-8042-9f1d633bb1f9 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Action: 'create', calling method: .version_select at 0x7fb8810604c0>, body: {"security_group_rule": {"parent_group_id": "a81f9c22-320c-4ff5-b224-5e0555c1e356", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:06.111468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:06.131143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:06.133904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:06.136532 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38e7ca33-162a-4bdc-aa43-6722df1bda66 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1526 microversion: 2.42 time: 0.227820 Oct 02 01:07:06.142805 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 756/1578] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:05 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1526 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:06.211150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:06.211771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:06.219347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:06.219838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:06.220279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.220988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:06.221448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:06.221877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.749518 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8afce99a-2041-48aa-8042-9f1d633bb1f9 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.739868 Oct 02 01:07:06.756514 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 823/1579] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:07:06 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:07:06.756514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fb47798b-8a82-43f2-baea-64ee84b01e98 req-72be6b5a-5dc4-4bd7-a9f9-8f8205c9064c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "name": "network-vif-unplugged", "status": "completed", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:06.770119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fb47798b-8a82-43f2-baea-64ee84b01e98 req-72be6b5a-5dc4-4bd7-a9f9-8f8205c9064c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:06.770898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fb47798b-8a82-43f2-baea-64ee84b01e98 req-72be6b5a-5dc4-4bd7-a9f9-8f8205c9064c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:06.771495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fb47798b-8a82-43f2-baea-64ee84b01e98 req-72be6b5a-5dc4-4bd7-a9f9-8f8205c9064c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.783054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:06.784074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fb47798b-8a82-43f2-baea-64ee84b01e98 req-72be6b5a-5dc4-4bd7-a9f9-8f8205c9064c service nova] Creating event network-vif-unplugged:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:07:06.789407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fb47798b-8a82-43f2-baea-64ee84b01e98 req-72be6b5a-5dc4-4bd7-a9f9-8f8205c9064c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037512 Oct 02 01:07:06.791324 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 824/1580] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:06.792469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0c718f9-ea08-4ed2-a440-df9aa1ac12b1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1473 microversion: 2.1 time: 0.584934 Oct 02 01:07:06.793044 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 757/1581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:06 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1473 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:07:06.801661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:06.803700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:06.805364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16048065-3f9e-49c5-83b4-862a877ff29e tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88161c3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:06.812157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:06.812927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:06.813457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.814294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:06.814913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:06.815438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.864920 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-16048065-3f9e-49c5-83b4-862a877ff29e tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.070203 Oct 02 01:07:06.865744 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 825/1582] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:06 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:06.871032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52d71344-2b25-4a23-9d0d-cd6e7772f158 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88163adc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:06.968397 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52d71344-2b25-4a23-9d0d-cd6e7772f158 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/a81f9c22-320c-4ff5-b224-5e0555c1e356" status: 200 len: 665 microversion: 2.1 time: 0.101046 Oct 02 01:07:06.980446 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 826/1583] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:07:06 2022] GET /compute/v2.1/os-security-groups/a81f9c22-320c-4ff5-b224-5e0555c1e356 => generated 665 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:06.988249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:06.989033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:06.997326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:06.998065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:06.999169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:06.999981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:07.000907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:07.001542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:07.003124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:07.011773 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d36ad90-3ad5-44e4-9c00-296b1f7aa83e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.217541 Oct 02 01:07:07.012552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 758/1584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:06 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:07.018795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef08765d-31c2-4a07-9005-dd996728fd74 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb8817b8670>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:07.206455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:07.216680 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-432259ab-fb5b-4fe3-8844-dee446986152 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1102 microversion: 2.1 time: 0.234042 Oct 02 01:07:07.231983 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 827/1585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:06 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1102 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:07.242190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:07.242863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:07.249656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:07.250195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:07.250670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:07.251388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:07.252398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:07.252830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:07.403458 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:07.424104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:07.425564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:07.430240 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9476e0e3-a31b-484b-95e4-eabc53b52b9f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1574 microversion: 2.42 time: 0.197023 Oct 02 01:07:07.431834 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 828/1586] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:07 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:07.505514 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef08765d-31c2-4a07-9005-dd996728fd74 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/d69dc766-3d05-4d29-b465-afc68d555ca6" status: 202 len: 0 microversion: 2.1 time: 0.491167 Oct 02 01:07:07.507709 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 759/1587] 10.222.0.23 () {58 vars in 1287 bytes} [Sun Oct 2 01:07:07 2022] DELETE /compute/v2.1/os-security-group-rules/d69dc766-3d05-4d29-b465-afc68d555ca6 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:07.518001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b5d2131-5a35-49bc-be64-2aec5e98d3a2 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb885681dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:07.818940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:07.819564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:07.827389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:07.835271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:07.836034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:07.837020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:07.837720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:07.847607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.052916 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b5d2131-5a35-49bc-be64-2aec5e98d3a2 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a81f9c22-320c-4ff5-b224-5e0555c1e356" status: 202 len: 0 microversion: 2.1 time: 0.539576 Oct 02 01:07:08.059702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 829/1588] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:07 2022] DELETE /compute/v2.1/os-security-groups/a81f9c22-320c-4ff5-b224-5e0555c1e356 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:08.068261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbe6194e-8ae2-4d37-9071-3a6b6d40a3c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881210af0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.137006 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbe6194e-8ae2-4d37-9071-3a6b6d40a3c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.069633 Oct 02 01:07:08.137006 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 830/1589] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:08 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:08.151944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.152741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:08.166448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.167386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.168071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.171083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.172666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.173855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.340320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:08.355719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36c0bb22-fe1d-4c36-81f3-673f8562a210 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1473 microversion: 2.1 time: 0.540163 Oct 02 01:07:08.356665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 760/1590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:07 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1473 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:08.370758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb8817b8b80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.428620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:08.442758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3eab682e-77ee-4a08-b4d5-81f6acdaca1d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.307626 Oct 02 01:07:08.443366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 831/1591] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:08 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:08.457353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.460783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:08.461312 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:07:08.461937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Neutron security group b1f37627-6710-4e0b-8717-5a86164606cc not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:07:08.462469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] HTTP exception thrown: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.462469 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] Oct 02 01:07:08.475992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Request method failure captured: Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/b1f37627-6710-4e0b-8717-5a86164606cc HTTP/1.1 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOQeuo3F60OY4CYHuMaZLm1bGzzcbJrr4BMVkph0BZLDSxTJwaVqQAa14acDt7pUOxdDnl_nIM5pnWkqfCG0q8mSh3UDJ-9cJ8lzxLHwhgqz-1-sWByMUdjLsTAJByc468WAqJMKjHv3B-wE5f18W7sumdKyaJ2hmF1hWz5Kqx0wxHA Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2de604b2fe4141ddab1c3bd993ee32a7 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2014293152 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2de604b2fe4141ddab1c3bd993ee32a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2de604b2fe4141ddab1c3bd993ee32a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2de604b2fe4141ddab1c3bd993ee32a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2de604b2fe4141ddab1c3bd993ee32a7"}]}] Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2014293152 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2de604b2fe4141ddab1c3bd993ee32a7 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2014293152 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupRulesTestJSON-2014293152-project Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 56797e6a3e434d4b816fde3bd2ff0d59 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2014293152-project Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: exception: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b1f37627-6710-4e0b-8717-5a86164606cc'} Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:07:08.476218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Returning 404 to user: Security group b1f37627-6710-4e0b-8717-5a86164606cc does not exist Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-fd694eba-9f42-441d-b5c6-372b423ba5ad'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c317931-dc8a-4690-ae76-6ee1275006fd tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b1f37627-6710-4e0b-8717-5a86164606cc" status: 404 len: 194 microversion: 2.1 time: 0.119947 Oct 02 01:07:08.481404 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 761/1592] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:08 2022] DELETE /compute/v2.1/os-security-groups/b1f37627-6710-4e0b-8717-5a86164606cc => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:08.487740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.488612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.489699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.489966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.490702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:08.491079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.491694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.509035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.509717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.510179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.510965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.511436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.511870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.679311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:08.699032 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96becca0-c0ea-49f8-84b7-1ab941387da7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1094 microversion: 2.1 time: 0.251468 Oct 02 01:07:08.703737 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 832/1593] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:08 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1094 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:08.717105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.717818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:08.735259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.737679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.738826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.739971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.741166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.742772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.795245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:08.812434 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99b96ccc-9b7d-416b-9309-21d0e0150fb0 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 2345 microversion: 2.25 time: 0.331464 Oct 02 01:07:08.819479 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 762/1594] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:08 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 2345 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:08.828023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5004473-9447-47ba-ac22-bf693e99fb62 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88128eee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.933864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:08.948615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:08.950349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:08.952570 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96355eeb-70f9-4f7d-b648-eef0fe7fde98 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1582 microversion: 2.42 time: 0.244679 Oct 02 01:07:08.953343 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 833/1595] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:08 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1582 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:08.981606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:08.986354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.986354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.986840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:08.987901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:08.988358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:08.988776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:09.006418 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:09.019653 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-737e0631-7157-4e7e-8b72-dcb2011668bd tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.065098 Oct 02 01:07:09.020276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 834/1596] 10.222.0.23 () {60 vars in 1217 bytes} [Sun Oct 2 01:07:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:07:09.155624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d8dde705-d3e4-43fc-83f1-a6de487cf4de tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855d39d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:09.232649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d8dde705-d3e4-43fc-83f1-a6de487cf4de tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.083797 Oct 02 01:07:09.239938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 835/1597] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:09 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:09.294947 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5004473-9447-47ba-ac22-bf693e99fb62 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/bb0481e3-fa86-48ba-a7dd-16dbdeb17793" status: 202 len: 0 microversion: 2.1 time: 0.473537 Oct 02 01:07:09.298097 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 763/1598] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:08 2022] DELETE /compute/v2.1/os-security-groups/bb0481e3-fa86-48ba-a7dd-16dbdeb17793 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:09.314092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ffecdc82-eef7-40a5-84db-f0c277c4bfbf tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88103fee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:09.475493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f485f867-bd89-40a4-a4af-735ef3d4bde8 req-d24e1757-d839-4c88-b085-df2ddb7316c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3b34-7019-4848-8e88-c274c9132153", "name": "network-vif-deleted", "tag": "1f43dffe-e628-4d09-9157-5d36a45f4eaa"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:09.520330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f485f867-bd89-40a4-a4af-735ef3d4bde8 req-d24e1757-d839-4c88-b085-df2ddb7316c8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:09.520997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f485f867-bd89-40a4-a4af-735ef3d4bde8 req-d24e1757-d839-4c88-b085-df2ddb7316c8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:09.521898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f485f867-bd89-40a4-a4af-735ef3d4bde8 req-d24e1757-d839-4c88-b085-df2ddb7316c8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:09.561910 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f485f867-bd89-40a4-a4af-735ef3d4bde8 req-d24e1757-d839-4c88-b085-df2ddb7316c8 service nova] Creating event network-vif-deleted:1f43dffe-e628-4d09-9157-5d36a45f4eaa for instance 77aa3b34-7019-4848-8e88-c274c9132153 on n-h1-master-1 Oct 02 01:07:09.581671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f485f867-bd89-40a4-a4af-735ef3d4bde8 req-d24e1757-d839-4c88-b085-df2ddb7316c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248348 Oct 02 01:07:09.588189 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 764/1599] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:09.599370 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:09.624905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:09.643082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:09.644552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:09.646797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:09.647795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:09.653914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:09.658059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:09.719879 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:10.198635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:10.215137 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ffecdc82-eef7-40a5-84db-f0c277c4bfbf tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7727bd0a-5527-4f6c-ba06-7f984ecd515a" status: 202 len: 0 microversion: 2.1 time: 0.912829 Oct 02 01:07:10.219301 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 836/1600] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:09 2022] DELETE /compute/v2.1/os-security-groups/7727bd0a-5527-4f6c-ba06-7f984ecd515a => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:10.219478 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c5d04c8-25b6-40fa-81eb-730f94cf3fd3 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1302 microversion: 2.1 time: 0.629636 Oct 02 01:07:10.220103 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 765/1601] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:09 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1302 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:10.234298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:10.234298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:10.235048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:10.235048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:10.250445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:10.252888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:10.253357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:10.254104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:10.260325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:10.260797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:10.284141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:10.284652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:10.285094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:10.285817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:10.286276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:10.298251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:10.545493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:10.554658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b51ae68-72e3-48bb-bc74-8bfc10e57f10 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1168 microversion: 2.1 time: 0.326650 Oct 02 01:07:10.559577 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 766/1602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:10 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1168 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:10.599159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:10.601069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:10.637372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:10.643286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:10.646236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:10.649492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:10.652008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:10.654621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:10.845262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:10.856658 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12e0cba5-e569-4a32-9212-84812e1063b5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.639379 Oct 02 01:07:10.860751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:10.869291 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 837/1603] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:10 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:10.894683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:10.897875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fad5334-a229-4afe-bd5d-cb5b40599ec4 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88560ea60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:10.900691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:10.903602 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a498a6c3-8730-4e91-b3f8-62ebdcc39ae2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1592 microversion: 2.42 time: 0.339011 Oct 02 01:07:10.914826 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 767/1604] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:10 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1592 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:10.930203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e5b8f4b-8858-4504-bd33-a4449c5305b5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88142f3a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:11.044391 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e5b8f4b-8858-4504-bd33-a4449c5305b5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.125630 Oct 02 01:07:11.063287 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 768/1605] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:10 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:11.242274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:11.243797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:11.256792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.261970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.271024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.272192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.279077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.281107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.437144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.449326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.450722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.451648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lazy-loading 'fault' on Instance uuid 77aa3b34-7019-4848-8e88-c274c9132153 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:11.478322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fad5334-a229-4afe-bd5d-cb5b40599ec4 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ddcd8aba-1e69-437b-98f2-ff1cdde9429b" status: 202 len: 0 microversion: 2.1 time: 0.606977 Oct 02 01:07:11.483479 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 838/1606] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:10 2022] DELETE /compute/v2.1/os-security-groups/ddcd8aba-1e69-437b-98f2-ff1cdde9429b => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:11.491576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5a20a76e-b9c1-4f5e-a0a4-aadab13e998a req-aeb34c1b-2cab-49d4-9991-8c75cea305dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "name": "network-vif-plugged", "status": "completed", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:11.548763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5a20a76e-b9c1-4f5e-a0a4-aadab13e998a req-aeb34c1b-2cab-49d4-9991-8c75cea305dc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.549275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5a20a76e-b9c1-4f5e-a0a4-aadab13e998a req-aeb34c1b-2cab-49d4-9991-8c75cea305dc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.549715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5a20a76e-b9c1-4f5e-a0a4-aadab13e998a req-aeb34c1b-2cab-49d4-9991-8c75cea305dc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.587701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5a20a76e-b9c1-4f5e-a0a4-aadab13e998a req-aeb34c1b-2cab-49d4-9991-8c75cea305dc service nova] Creating event network-vif-plugged:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h1-master-1 Oct 02 01:07:11.600152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5a20a76e-b9c1-4f5e-a0a4-aadab13e998a req-aeb34c1b-2cab-49d4-9991-8c75cea305dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117545 Oct 02 01:07:11.601741 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 839/1607] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:11.612262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0e10c32-6aa1-4711-8cf2-1c5de511aa69 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb8855d34c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:11.642919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:11.653948 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-909f15f3-b0f9-4e04-9a2a-d7a419f6a13d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 200 len: 1307 microversion: 2.1 time: 0.416339 Oct 02 01:07:11.673892 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 769/1608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:11 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:07:11.706298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:11.709192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:11.730365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.731167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.731866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.733556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.734432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.735157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.914741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:11.932134 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdb40c0e-d2ca-4528-9c8d-6067e68e0e2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1168 microversion: 2.1 time: 0.238335 Oct 02 01:07:11.933278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 770/1609] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:11 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1168 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:11.959265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:11.960426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:11.972138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.973036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.973733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.976519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.977228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.977892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:12.651828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:12.664640 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-675d87ff-217c-433e-9c59-b249afe45ef6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.729944 Oct 02 01:07:12.671112 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 771/1610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:11 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:12.680485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:12.689578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:12.700084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0e10c32-6aa1-4711-8cf2-1c5de511aa69 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9041b844-2729-4820-9005-dc5ecf326f2c" status: 202 len: 0 microversion: 2.1 time: 1.096613 Oct 02 01:07:12.701029 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 840/1611] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:11 2022] DELETE /compute/v2.1/os-security-groups/9041b844-2729-4820-9005-dc5ecf326f2c => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:12.707360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac630d19-775d-4fda-a7ea-e8103ea04163 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88161c3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:12.723471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:12.734495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:12.737431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:12.738358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:12.742197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:12.745510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:12.802993 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac630d19-775d-4fda-a7ea-e8103ea04163 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.100076 Oct 02 01:07:12.803898 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 841/1612] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:12 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:12.817547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:12.819539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 77aa3b34-7019-4848-8e88-c274c9132153] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:12.834909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:12.837990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:12.838647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:12.839731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:12.841219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:12.843066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:12.877902 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 77aa3b34-7019-4848-8e88-c274c9132153 could not be found. Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 HTTP/1.1 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 77aa3b34-7019-4848-8e88-c274c9132153 could not be found. Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '77aa3b34-7019-4848-8e88-c274c9132153'} Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77aa3b34-7019-4848-8e88-c274c9132153 could not be found. Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77aa3b34-7019-4848-8e88-c274c9132153 could not be found. Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:12.884210 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77aa3b34-7019-4848-8e88-c274c9132153 could not be found. Oct 02 01:07:12.890565 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:12.894025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 77aa3b34-7019-4848-8e88-c274c9132153 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:12.896227 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2edd134a-172a-4f8f-8e91-a9c9760da828 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153" status: 404 len: 111 microversion: 2.1 time: 0.089460 Oct 02 01:07:12.898841 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 842/1613] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:12 2022] GET /compute/v2.1/servers/77aa3b34-7019-4848-8e88-c274c9132153 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:12.910800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a778c39-7e03-49f0-99eb-c390c3a304b1 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] Calling method '.version_select at 0x7fb88137e820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:12.975424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:12.988653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:12.996333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:13.003152 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1896a2b-faa1-4d69-9163-0f4e613afb9b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1592 microversion: 2.42 time: 0.330723 Oct 02 01:07:13.009618 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 772/1614] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:12 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1592 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:13.026281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:13.026980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:13.048194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.056125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.058156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.059925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.065911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.067637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.121594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:13.264613 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a778c39-7e03-49f0-99eb-c390c3a304b1 tempest-SecurityGroupRulesTestJSON-2014293152 tempest-SecurityGroupRulesTestJSON-2014293152-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d82d3f2e-2de8-4297-a521-20b6b160db96" status: 202 len: 0 microversion: 2.1 time: 0.364342 Oct 02 01:07:13.265631 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 843/1615] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:07:12 2022] DELETE /compute/v2.1/os-security-groups/d82d3f2e-2de8-4297-a521-20b6b160db96 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:13.272037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:13.272667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:13.292193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.292908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.298295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.301082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.302100 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c26c797-fc1f-479d-9680-2b60329bd882 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 204 len: 0 microversion: 2.1 time: 0.290735 Oct 02 01:07:13.302737 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 773/1616] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:13 2022] DELETE /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:13.303312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.305722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.316619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:13.317434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:13.339236 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:13.341146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.346199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.347028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.347957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.348581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.349166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.496540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:13.508407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5083c162-364e-4100-8c4c-d69bdd567dd6 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1168 microversion: 2.1 time: 0.241658 Oct 02 01:07:13.516581 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 844/1617] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:13 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1168 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:13.524726 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:13.548024 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:13.647330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a7a5ba6f-3ea7-4b4f-bd77-f7902ce42eab req-013da7f9-cfef-4312-a835-d8d466ceeb4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9a9004-7066-456c-8c1b-99e03b63b2e7", "name": "network-vif-plugged", "status": "completed", "tag": "299976b2-a154-4fee-9940-050f8ca7645b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:13.675873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a7a5ba6f-3ea7-4b4f-bd77-f7902ce42eab req-013da7f9-cfef-4312-a835-d8d466ceeb4b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.680001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a7a5ba6f-3ea7-4b4f-bd77-f7902ce42eab req-013da7f9-cfef-4312-a835-d8d466ceeb4b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.684595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a7a5ba6f-3ea7-4b4f-bd77-f7902ce42eab req-013da7f9-cfef-4312-a835-d8d466ceeb4b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.707408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a7a5ba6f-3ea7-4b4f-bd77-f7902ce42eab req-013da7f9-cfef-4312-a835-d8d466ceeb4b service nova] Creating event network-vif-plugged:299976b2-a154-4fee-9940-050f8ca7645b for instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 on n-h2-master-1 Oct 02 01:07:13.723515 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a7a5ba6f-3ea7-4b4f-bd77-f7902ce42eab req-013da7f9-cfef-4312-a835-d8d466ceeb4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079775 Oct 02 01:07:13.727800 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 845/1618] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:07:13.737759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:13.741654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:13.747929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:13.757411 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97387a9c-624a-4871-835b-d6a019c186e9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1473 microversion: 2.1 time: 0.450329 Oct 02 01:07:13.761027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.764631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.765324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.766170 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 774/1619] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:13 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1473 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:13.768910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:13.769727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:13.770718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.820753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e056f51f-0323-4eca-b063-398b4e74738d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8856c2820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:13.924850 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e056f51f-0323-4eca-b063-398b4e74738d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.107674 Oct 02 01:07:13.930778 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 775/1620] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:13 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:07:14.048346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:14.049340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:14.057257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.058027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.058747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.060214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.061106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.061701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.245837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:14.257381 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f43deed-be0a-422f-8638-a3cd6c0d5f62 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1313 microversion: 2.1 time: 0.528018 Oct 02 01:07:14.257982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 846/1621] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:13 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:14.307931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:14.325002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:14.332665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:14.335295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47727627-85fc-4fbe-a78e-e5ae9ec4753c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1659 microversion: 2.42 time: 0.297887 Oct 02 01:07:14.336812 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 776/1622] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:14 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1659 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:07:14.540262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:14.541145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:14.549161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.556366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.558324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.565890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.567233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.567929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.707139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:14.724993 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30f72bbb-e844-460e-b4b7-fae2bdffd825 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1168 microversion: 2.1 time: 0.185855 Oct 02 01:07:14.725773 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 847/1623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:14 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1168 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:14.788203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:14.789558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:14.815244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.819931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.823381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.824500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.825213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.831756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.929941 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:15.038876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-214bdcfe-553b-408a-b64d-d758b0a4a9b5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Action: 'create', calling method: .version_select at 0x7fb8816075e0>, body: {"keypair": {"name": "tempest-keypair-2106632051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxZfIgF6b9kO4WytPZibn8cUFScy0kNADKh0tiZgel8G4RIyvna7Bcm9bKDKR8dYDO57Tbf4L7zkjgiPCEQhn+fttwTvbywHBFXH8Tutf6kY6hzaran+jMwC+PeMlBs7A=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:15.075431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-214bdcfe-553b-408a-b64d-d758b0a4a9b5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Getting quotas for project 8639be724fdc4c128da53dd69fbbc356. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:15.086878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-214bdcfe-553b-408a-b64d-d758b0a4a9b5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Getting quotas for user ddc06a9186b9434d86d5815276c9b51d and project 8639be724fdc4c128da53dd69fbbc356. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:15.128117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-214bdcfe-553b-408a-b64d-d758b0a4a9b5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205690 Oct 02 01:07:15.129113 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 848/1624] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:07:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:07:15.141604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d2df761-e39e-4f0c-a1dd-35751b55da47 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855d3af0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:15.220404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d2df761-e39e-4f0c-a1dd-35751b55da47 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.088575 Oct 02 01:07:15.221552 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 849/1625] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:15 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:15.280514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:15.288104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:15.288985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:15.300730 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f90ade0-1c85-4a67-8233-e58e37311c9b tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1473 microversion: 2.1 time: 0.517187 Oct 02 01:07:15.301347 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 777/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:14 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:15.303006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:15.307321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:15.310094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:15.313569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:15.314281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:15.319308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:15.367737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:15.368363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:15.376108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:15.378566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:15.379080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:15.382660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:15.383190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:15.386678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:16.145605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:16.162271 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f828d180-319e-4601-88e6-91c81da83298 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1462 microversion: 2.1 time: 0.879340 Oct 02 01:07:16.182666 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 850/1627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:15 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1462 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:16.183398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:16.187502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:16.192060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:16.224458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:16.226020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:16.227258 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccd2bbf5-3c90-4091-9608-68228eaaaafb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1659 microversion: 2.42 time: 0.863588 Oct 02 01:07:16.231810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:16.232624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:16.234208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:16.234669 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 778/1628] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:15 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1659 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:16.236865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:16.243228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:16.244385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:16.569922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:16.571455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:16.587967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:16.588813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:16.589540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:16.590418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:16.591059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:16.591743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.295612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:17.316522 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18b75e16-99df-4f03-bf65-29136da0d034 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 1.148003 Oct 02 01:07:17.321521 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 851/1629] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:16 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:17.326905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-28b878af-03df-473d-82ba-9b9c8bfd6586 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881412310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:17.388592 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54b1acff-571e-41c4-8390-92da851a51b1 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1613 microversion: 2.1 time: 1.152513 Oct 02 01:07:17.392916 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 779/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:16 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1613 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:17.425189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:17.428357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:17.469951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.470453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.470931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.491140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.492466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.495287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.500953 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-28b878af-03df-473d-82ba-9b9c8bfd6586 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.178003 Oct 02 01:07:17.505701 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 852/1631] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:17 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:17.540103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0de1d669-30ca-4696-94c7-aefccadcf40c req-81064f8e-9f3e-4aa1-9809-fc193603f708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f085246-1145-42f4-85f1-75ca14086904", "name": "network-vif-deleted", "tag": "4278224d-ce4b-47ad-b590-3842c0f39429"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:17.603470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0de1d669-30ca-4696-94c7-aefccadcf40c req-81064f8e-9f3e-4aa1-9809-fc193603f708 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.603980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0de1d669-30ca-4696-94c7-aefccadcf40c req-81064f8e-9f3e-4aa1-9809-fc193603f708 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.604390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0de1d669-30ca-4696-94c7-aefccadcf40c req-81064f8e-9f3e-4aa1-9809-fc193603f708 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.665911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.672810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.673214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.673682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lazy-loading 'fault' on Instance uuid 8f085246-1145-42f4-85f1-75ca14086904 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:17.685011 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0de1d669-30ca-4696-94c7-aefccadcf40c req-81064f8e-9f3e-4aa1-9809-fc193603f708 service nova] Creating event network-vif-deleted:4278224d-ce4b-47ad-b590-3842c0f39429 for instance 8f085246-1145-42f4-85f1-75ca14086904 on n-h1-master-1 Oct 02 01:07:17.706190 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0de1d669-30ca-4696-94c7-aefccadcf40c req-81064f8e-9f3e-4aa1-9809-fc193603f708 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195421 Oct 02 01:07:17.716702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 853/1632] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:17.731703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:17.732415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:17.783932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.784434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.784875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.785594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.786050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.802391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.308555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:18.390031 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-243a0cea-0cda-484d-9da6-11a3fbd41fb1 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 200 len: 1307 microversion: 2.1 time: 0.994591 Oct 02 01:07:18.395366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 780/1633] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:17 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 1307 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:18.407366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:18.408432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:18.432170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:18.432685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:18.433124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.440221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:18.440932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:18.441889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.491197 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:18.525891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bfabe41ff3a6492b95dfcff64ffc38d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109446141724cb18793396cffef0f5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:18.526528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] flavor_id is None. Assuming migration. {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 02 01:07:18.530723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:07:18.610357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:18.631009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:18.637073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:18.650751 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4d333281-ee25-4296-90ab-d7b936ffec17 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1659 microversion: 2.42 time: 0.932380 Oct 02 01:07:18.670759 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 854/1634] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:17 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1659 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:18.670759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:18.671891 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:18.696111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:18.696607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:18.697039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.717737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:18.721421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:18.724602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.743390 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:18.999690 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:19.160266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3f7c97b-b76a-47ef-b390-a783a33a9801 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7/action" status: 202 len: 0 microversion: 2.1 time: 0.762567 Oct 02 01:07:19.160835 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 781/1635] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:07:18 2022] POST /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7/action => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:07:19.166118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc8603ec-2263-4548-b6f9-b4f14ee86591 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8817feee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:19.281427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc8603ec-2263-4548-b6f9-b4f14ee86591 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.119238 Oct 02 01:07:19.292754 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 782/1636] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:19 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:19.298320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:19.298977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:19.317587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.323349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.324040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:19.324955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.325582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.326200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:19.736569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:19.831092 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20640c08-37f5-4e3f-b858-80e99bbb8329 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 1.176639 Oct 02 01:07:19.832302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 855/1637] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:18 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:19.838918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:19.839680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8f085246-1145-42f4-85f1-75ca14086904] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:19.869902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.870407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.870888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:19.871598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.872064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.872489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:19.900283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 8f085246-1145-42f4-85f1-75ca14086904 could not be found. Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 HTTP/1.1 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 8f085246-1145-42f4-85f1-75ca14086904 could not be found. Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '8f085246-1145-42f4-85f1-75ca14086904'} Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f085246-1145-42f4-85f1-75ca14086904 could not be found. Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f085246-1145-42f4-85f1-75ca14086904 could not be found. Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:19.903938 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f085246-1145-42f4-85f1-75ca14086904 could not be found. Oct 02 01:07:19.908862 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:19.911261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 8f085246-1145-42f4-85f1-75ca14086904 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:19.912516 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c8bfd33-4b0a-4070-87b9-7632a44f7e92 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904" status: 404 len: 111 microversion: 2.1 time: 0.078554 Oct 02 01:07:19.913309 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 856/1638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:19 2022] GET /compute/v2.1/servers/8f085246-1145-42f4-85f1-75ca14086904 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:19.919038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:19.920644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:19.935002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.939769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.940737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:19.941732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.943105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.943796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.184210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:20.195759 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-86eaab43-04de-48dc-b2f0-81f44b049eba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1471 microversion: 2.1 time: 0.901832 Oct 02 01:07:20.206223 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 783/1639] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:19 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1471 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:20.250027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:20.250559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:20.269396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.269904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.270343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.271098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.271557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.271985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.337090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:20.473964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:20.502435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:20.505684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:20.511705 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-243261c3-d1f1-425c-b67c-61744ba4749c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1705 microversion: 2.42 time: 0.597079 Oct 02 01:07:20.528982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 857/1640] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:19 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1705 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:20.544098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9952ea99-b2ce-49cc-99c6-8f155bc608fb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855943a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:20.548031 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b553037d-d915-4a60-97c9-2c6e2d2f0f0f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 204 len: 0 microversion: 2.1 time: 0.333664 Oct 02 01:07:20.564320 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 784/1641] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:20 2022] DELETE /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:20.572690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:20.573282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:20.610064 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9952ea99-b2ce-49cc-99c6-8f155bc608fb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.075198 Oct 02 01:07:20.611471 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 858/1642] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:20 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:20.629347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.629851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.630283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.639646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.647832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.652063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.695853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:20.852582 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45ed48df-1bd0-4141-bc9d-3c0ee061cfc2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 204 len: 0 microversion: 2.1 time: 0.283693 Oct 02 01:07:20.858526 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 785/1643] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:20 2022] DELETE /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:20.894129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:20.894958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:20.907777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.909136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.909774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.910718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.911410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:20.913823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.914537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.914746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:20.926201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.927456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.928121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.929323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:20.930725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:20.930725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:21.639684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:21.645760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:21.668214 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a941e2f6-1342-48dc-80a3-32c0a3b4fec9 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1475 microversion: 2.1 time: 0.769210 Oct 02 01:07:21.671694 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 786/1644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:20 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1475 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:21.672995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbe211e9-e943-4eb3-abb2-f75205301e2a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 0.806658 Oct 02 01:07:21.674228 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 859/1645] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:20 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:21.687076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:21.698372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:21.699625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:21.700884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:21.712805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:21.715265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:21.715715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:21.716510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:21.717288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:21.718519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:21.719011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:21.719929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:21.721410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:21.722055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:21.722757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:21.727100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.202453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:22.213203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d511a4d-5cfa-4af7-a237-f3c30b439081 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1471 microversion: 2.1 time: 0.537395 Oct 02 01:07:22.216444 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 787/1646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:21 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1471 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:22.228902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba2be5fc-1661-49fe-9d69-bd40ca94bafa tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8856c20d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:22.259406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:22.276336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:22.280921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:22.283329 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f58701c4-4f99-40a9-bf70-cd067a7419ed tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1705 microversion: 2.42 time: 0.605596 Oct 02 01:07:22.284641 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 860/1647] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:21 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1705 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:22.290238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-32781056-16db-4bb8-bfac-5df414b2e619 req-ab96a5f0-2d56-41ad-8e77-6e570fe39257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39831e69-dcd1-4272-9b0a-0b8717bdad39", "tag": "04589599-8f46-424b-93a0-f62bdc1ad661"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:22.306775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-32781056-16db-4bb8-bfac-5df414b2e619 req-ab96a5f0-2d56-41ad-8e77-6e570fe39257 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.307653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-32781056-16db-4bb8-bfac-5df414b2e619 req-ab96a5f0-2d56-41ad-8e77-6e570fe39257 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.308328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-32781056-16db-4bb8-bfac-5df414b2e619 req-ab96a5f0-2d56-41ad-8e77-6e570fe39257 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.314019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba2be5fc-1661-49fe-9d69-bd40ca94bafa tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.096569 Oct 02 01:07:22.314637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 788/1648] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:22 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:22.353806 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-32781056-16db-4bb8-bfac-5df414b2e619 req-ab96a5f0-2d56-41ad-8e77-6e570fe39257 service nova] Creating event network-changed:04589599-8f46-424b-93a0-f62bdc1ad661 for instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 on n-h1-master-1 Oct 02 01:07:22.361784 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-32781056-16db-4bb8-bfac-5df414b2e619 req-ab96a5f0-2d56-41ad-8e77-6e570fe39257 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074941 Oct 02 01:07:22.363540 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 861/1649] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:22.692591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:22.693379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:22.701144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:22.703050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:22.719443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.721151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.723773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.727330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.728082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.728774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.729800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.730810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.731545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.734216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.735628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.739894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:23.606766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:23.617324 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1eec2da-efc6-4e6d-b04f-ab91cd831eb7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 0.920803 Oct 02 01:07:23.621054 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 862/1650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:22 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:07:23.635171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:23.636047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:23.652622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:23.655521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:23.656259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:23.657324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:23.658021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:23.658736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:24.902818 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:24.911945 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b7a9216-2fe4-488f-8c1a-75ae2eb3028a tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1475 microversion: 2.1 time: 2.223112 Oct 02 01:07:24.917186 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 789/1651] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:22 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1475 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:24.919191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:24.925617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:24.926975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:24.932907 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b75a63e4-b723-473b-90a6-3a2677e0b28f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1471 microversion: 2.1 time: 1.310746 Oct 02 01:07:24.933530 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 863/1652] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:23 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1471 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:24.940414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:24.947220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:24.947882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:24.948808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:24.949435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:24.950048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:24.966292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-698e9919-4157-47b2-a93e-3c1cce5749c0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8815559d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:25.045785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-698e9919-4157-47b2-a93e-3c1cce5749c0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.097158 Oct 02 01:07:25.050965 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 864/1653] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:24 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:25.056082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:25.056976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:25.087583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.088771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:25.089917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:25.091113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.091974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:25.093505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:25.105237 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:25.761700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:25.788473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:25.795193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:25.796429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1545d821-9fe8-479b-aa71-5e60eb3f4ec2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1705 microversion: 2.42 time: 0.878100 Oct 02 01:07:25.814633 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 790/1654] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:24 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1705 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:25.814633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-92162a38-848e-419c-9dd8-610518097df9 req-19d2621f-2c43-4c7c-932e-3e96b0fcd1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ca6565-38b1-44a5-a691-6a98d464f163", "name": "network-vif-deleted", "tag": "5753d52b-535b-4703-bf55-11b10217f5c3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:25.876497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92162a38-848e-419c-9dd8-610518097df9 req-19d2621f-2c43-4c7c-932e-3e96b0fcd1bb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.876986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92162a38-848e-419c-9dd8-610518097df9 req-19d2621f-2c43-4c7c-932e-3e96b0fcd1bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:25.877420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92162a38-848e-419c-9dd8-610518097df9 req-19d2621f-2c43-4c7c-932e-3e96b0fcd1bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:25.883931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:25.898279 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1bc6355f-73bc-42de-b768-4c3798e6c6eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 0.845776 Oct 02 01:07:25.898907 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 865/1655] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:25 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:25.924055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-92162a38-848e-419c-9dd8-610518097df9 req-19d2621f-2c43-4c7c-932e-3e96b0fcd1bb service nova] Creating event network-vif-deleted:5753d52b-535b-4703-bf55-11b10217f5c3 for instance 12ca6565-38b1-44a5-a691-6a98d464f163 on n-h2-master-1 Oct 02 01:07:25.944133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:25.944953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:25.947007 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-92162a38-848e-419c-9dd8-610518097df9 req-19d2621f-2c43-4c7c-932e-3e96b0fcd1bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140031 Oct 02 01:07:25.947719 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 791/1656] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:25.963842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:25.964563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:25.966416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.976914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:25.978026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:25.980447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.997525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:26.001820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:26.056587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:26.058118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:26.058577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:26.066154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:26.070519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:26.072157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:26.317650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:26.329850 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59b54bf9-8d38-422e-ad88-e4d2c212d4e8 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1433 microversion: 2.1 time: 0.392887 Oct 02 01:07:26.332119 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 866/1657] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:25 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1433 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:26.343611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-172dad3b-ee2a-486e-b47d-f8d10fa1422b req-e72c2e19-981e-4363-a5dc-d5d9a60ad612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daebd58-0e5e-4267-b2f7-dbd74eb96e14", "name": "network-vif-unplugged", "status": "completed", "tag": "76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:26.374320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-172dad3b-ee2a-486e-b47d-f8d10fa1422b req-e72c2e19-981e-4363-a5dc-d5d9a60ad612 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:26.375403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-172dad3b-ee2a-486e-b47d-f8d10fa1422b req-e72c2e19-981e-4363-a5dc-d5d9a60ad612 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:26.380642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-172dad3b-ee2a-486e-b47d-f8d10fa1422b req-e72c2e19-981e-4363-a5dc-d5d9a60ad612 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:26.410729 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-172dad3b-ee2a-486e-b47d-f8d10fa1422b req-e72c2e19-981e-4363-a5dc-d5d9a60ad612 service nova] Creating event network-vif-unplugged:76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1 for instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 on n-h1-master-1 Oct 02 01:07:26.416714 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-172dad3b-ee2a-486e-b47d-f8d10fa1422b req-e72c2e19-981e-4363-a5dc-d5d9a60ad612 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081272 Oct 02 01:07:26.417673 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 867/1658] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:26.425885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10dcbcd4-0d3e-4475-a973-de3573c38970 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885546b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:26.495941 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10dcbcd4-0d3e-4475-a973-de3573c38970 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.076162 Oct 02 01:07:26.503932 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 868/1659] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:26 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:26.843842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:26.847239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:26.861956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:26.866005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:26.866756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:26.867994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:26.870930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:26.871622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:27.676868 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:27.704174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:27.714547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:27.722028 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23eed6bd-8a54-432c-b868-ccb8c8c5c50a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1751 microversion: 2.42 time: 0.890473 Oct 02 01:07:27.741118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 869/1660] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:26 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1751 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:07:27.756630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:27.757347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:27.783592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:27.788991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:27.791594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:27.792955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:27.799685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:27.801060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:27.819004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:27.860422 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-30c24b21-bed4-4cc0-bd8c-210ec3cb2740 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1471 microversion: 2.1 time: 1.901766 Oct 02 01:07:27.866487 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 792/1661] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:25 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1471 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:27.885378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd9679a-d575-445c-99bc-1eceff014c4d", "device": "/dev/xvdb"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:27.891646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:27.902779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:27.905445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:27.906089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:27.907279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:27.907966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:27.908577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.266538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:28.275158 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f57ee25-a44f-40a3-98e4-74691dc224fa tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 0.543423 Oct 02 01:07:28.294216 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 870/1662] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:27 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:28.308178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:28.314089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:28.360551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.362472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.367871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.369457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.372071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.372793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.495374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.496360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.500378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.501791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lazy-loading 'fault' on Instance uuid 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:28.605605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:28.621026 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db1cedcc-fd7d-401e-b08b-b9d139513be0 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 200 len: 1309 microversion: 2.1 time: 0.323022 Oct 02 01:07:28.636858 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 871/1663] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:28 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:28.653728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61136342-07ca-4416-ade9-a3123889080d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8814120d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:28.791192 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61136342-07ca-4416-ade9-a3123889080d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1452 microversion: 2.1 time: 0.146621 Oct 02 01:07:28.794145 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 872/1664] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:28 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:28.813952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-da100fe2-e160-406e-aab3-b771e57cfc96 req-33797f7a-1ff0-449f-aab0-ea63c2dbadc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daebd58-0e5e-4267-b2f7-dbd74eb96e14", "name": "network-vif-deleted", "tag": "76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:28.854079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-da100fe2-e160-406e-aab3-b771e57cfc96 req-33797f7a-1ff0-449f-aab0-ea63c2dbadc4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.856152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-da100fe2-e160-406e-aab3-b771e57cfc96 req-33797f7a-1ff0-449f-aab0-ea63c2dbadc4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.857433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-da100fe2-e160-406e-aab3-b771e57cfc96 req-33797f7a-1ff0-449f-aab0-ea63c2dbadc4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.925833 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-da100fe2-e160-406e-aab3-b771e57cfc96 req-33797f7a-1ff0-449f-aab0-ea63c2dbadc4 service nova] Creating event network-vif-deleted:76b86f5c-ddcc-44b6-a8ed-6925ed4bf2e1 for instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 on n-h1-master-1 Oct 02 01:07:28.946222 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-da100fe2-e160-406e-aab3-b771e57cfc96 req-33797f7a-1ff0-449f-aab0-ea63c2dbadc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147509 Oct 02 01:07:28.950467 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 873/1665] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:28.958566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:28.960269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:28.991590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:29.010003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:29.012398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:29.018506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:29.021215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:29.021683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:29.692343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:29.717824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:29.725508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:29.736175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3d492c4-9043-40c9-82dc-aba33f985b20 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1751 microversion: 2.42 time: 0.783837 Oct 02 01:07:29.736781 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 874/1666] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:28 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1751 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:29.746684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:29.747305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:29.775012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:29.775695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:29.776195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:29.777184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:29.777674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:29.778216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.163698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:30.177700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-beedc46e-f2c3-4bb9-b8ab-7d3254a7d4ad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 0.439412 Oct 02 01:07:30.180819 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 875/1667] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:29 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:30.190511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:30.191478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:30.212074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.216718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.218183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.225894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.228487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.230992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.614618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:30.626129 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae4702bd-51f8-4f42-9f30-8365fa6aae72 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1210 microversion: 2.1 time: 0.442977 Oct 02 01:07:30.630832 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 876/1668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:30 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1210 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:30.647691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:30.649022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 4daebd58-0e5e-4267-b2f7-dbd74eb96e14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:30.659796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.660292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.661113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.661545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.662270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.663249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.685385 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 could not be found. Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 HTTP/1.1 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 could not be found. Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '4daebd58-0e5e-4267-b2f7-dbd74eb96e14'} Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 could not be found. Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 could not be found. Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:30.688222 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 could not be found. Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 4daebd58-0e5e-4267-b2f7-dbd74eb96e14 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-67fb1206-35e3-4e6c-b921-e557c36e116c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14" status: 404 len: 111 microversion: 2.1 time: 0.057853 Oct 02 01:07:30.692633 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 877/1669] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:30 2022] GET /compute/v2.1/servers/4daebd58-0e5e-4267-b2f7-dbd74eb96e14 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:30.697963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89ff317d-a4b5-42ac-bb12-c3b67740a162 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885598820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:31.523930 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-629c0968-d6b7-4e54-9f20-6a0f496252f9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "POST /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 3.655499 Oct 02 01:07:31.529316 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 793/1670] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Oct 2 01:07:27 2022] POST /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 194 bytes in 3661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:07:31.554361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:31.555399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 12ca6565-38b1-44a5-a691-6a98d464f163] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:31.581317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:31.581814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:31.582266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.586994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:31.591401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:31.592152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.630520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 12ca6565-38b1-44a5-a691-6a98d464f163 could not be found. Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 HTTP/1.1 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 12ca6565-38b1-44a5-a691-6a98d464f163 could not be found. Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '12ca6565-38b1-44a5-a691-6a98d464f163'} Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12ca6565-38b1-44a5-a691-6a98d464f163 could not be found. Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12ca6565-38b1-44a5-a691-6a98d464f163 could not be found. Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:31.637340 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12ca6565-38b1-44a5-a691-6a98d464f163 could not be found. Oct 02 01:07:31.643002 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:31.644376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 12ca6565-38b1-44a5-a691-6a98d464f163 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:31.647235 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dcabfd45-74d9-45b1-8e3a-857b40080bb4 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163" status: 404 len: 111 microversion: 2.1 time: 0.115197 Oct 02 01:07:31.651858 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 794/1671] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:31 2022] GET /compute/v2.1/servers/12ca6565-38b1-44a5-a691-6a98d464f163 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:31.664207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:31.666571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:31.678898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:31.679607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:31.680445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.681491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:31.682114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:31.682905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.714508 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:32.096442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:32.114313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:32.117866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:32.133734 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-501cd8aa-af27-4bc5-9eef-74e6e1a23385 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1843 microversion: 2.42 time: 0.476353 Oct 02 01:07:32.152669 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 795/1672] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:31 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1843 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:32.171675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:32.182380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:32.191358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:32.192903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:32.199627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:32.200789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:32.201761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:32.202582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:32.619441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:32.631041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a1fa1d8-7c1c-4b20-8160-82775d955337 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 0.477151 Oct 02 01:07:32.631988 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 796/1673] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:32 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:32.645288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:32.645903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:32.652789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:32.653369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:32.660603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:32.661476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:32.667643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:32.668375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:32.970558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:32.993005 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df65b4aa-2021-45d1-b067-4e0ac2ba128a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 0.359385 Oct 02 01:07:32.997130 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 797/1674] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:32 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:33.016567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb726bf9-208b-4372-a047-fe88bbf58149 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:33.080765 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb726bf9-208b-4372-a047-fe88bbf58149 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/66e4e734-fbf6-4302-802b-d7bc44a8b6ac" status: 204 len: 0 microversion: 2.1 time: 0.080710 Oct 02 01:07:33.087476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 798/1675] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:07:32 2022] DELETE /compute/v2.1/os-server-groups/66e4e734-fbf6-4302-802b-d7bc44a8b6ac => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:33.094351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:33.095711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:33.109103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:33.110011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:33.110785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.111870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:33.112558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:33.113361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.162126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:33.338919 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b4236f9-1b3f-4907-8339-ba8c8e9ddd20 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7" status: 204 len: 0 microversion: 2.1 time: 0.249945 Oct 02 01:07:33.339979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 799/1676] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:33 2022] DELETE /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:33.346076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:33.348863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:33.363712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:33.366800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:33.367512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.369037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:33.370893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:33.375017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.728711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:33.745064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:33.755384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:33.756926 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc3a288e-6614-421a-876e-df266cf12d28 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1843 microversion: 2.42 time: 0.415437 Oct 02 01:07:33.757693 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 800/1677] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:33 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1843 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:33.762412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:33.767371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:33.791715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:33.792399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:33.793031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.794290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:33.803442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:33.804164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.856422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:34.032331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6216a2f-8c89-4116-b629-7b5b5a647b1e tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 204 len: 0 microversion: 2.1 time: 0.273078 Oct 02 01:07:34.035997 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 801/1678] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:33 2022] DELETE /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:34.041506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:34.042224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:34.058935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:34.059435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:34.060133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:34.060999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:34.061469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:34.061950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:34.964448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:34.975333 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3493831-49ec-448e-9cee-a8cab6a94f6e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 0.937959 Oct 02 01:07:34.976173 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 802/1679] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:34 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:34.983304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:34.984125 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:35.003265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:35.006574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:35.012543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:35.016527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:35.018324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:35.021424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:35.500231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:35.508475 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a2c6b58-43bd-44fd-aae9-6869e2e200b0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 0.530870 Oct 02 01:07:35.509085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 803/1680] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:34 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:35.513930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:35.528017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:35.549809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:35.554324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:35.555053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:35.556609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:35.562070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:35.562811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:36.113885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:36.133424 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0dce83c3-a8ec-4338-b6c3-78f8d30f0e57 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7" status: 200 len: 1473 microversion: 2.1 time: 0.623216 Oct 02 01:07:36.134040 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 804/1681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:35 2022] GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:36.165074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:36.165617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:36.185724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:36.188364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:36.189003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:36.189901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:36.194004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:36.195189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:37.963044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:37.995784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:38.000612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:38.015732 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad890935-48f1-4193-b414-f77c23817c6f tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1864 microversion: 2.42 time: 1.867392 Oct 02 01:07:38.016367 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 805/1682] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:36 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1864 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:38.041785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9275858e-5234-4211-9305-e96d0716b576 req-07d04a91-a2ba-4998-93a2-19f6c7f2cab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "d0d278c0-2d7f-4560-8593-274b58492b90"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:38.065016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9275858e-5234-4211-9305-e96d0716b576 req-07d04a91-a2ba-4998-93a2-19f6c7f2cab6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:38.068984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9275858e-5234-4211-9305-e96d0716b576 req-07d04a91-a2ba-4998-93a2-19f6c7f2cab6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:38.070273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9275858e-5234-4211-9305-e96d0716b576 req-07d04a91-a2ba-4998-93a2-19f6c7f2cab6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:38.103767 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9275858e-5234-4211-9305-e96d0716b576 req-07d04a91-a2ba-4998-93a2-19f6c7f2cab6 service nova] Creating event network-changed:d0d278c0-2d7f-4560-8593-274b58492b90 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:38.109679 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9275858e-5234-4211-9305-e96d0716b576 req-07d04a91-a2ba-4998-93a2-19f6c7f2cab6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077187 Oct 02 01:07:38.110861 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 806/1683] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:38.116076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:38.131881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:38.144665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:38.145862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:38.146499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:38.147815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:38.148172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:38.148601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:38.730688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:38.742061 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-751a163f-d9b2-45f4-b8e5-eb6ccd98103e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 0.629825 Oct 02 01:07:38.742675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 807/1684] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:38 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:38.753189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:38.753811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:38.770261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:38.780706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:38.781239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:38.782107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:38.782575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:38.789355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:39.611994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:39.631064 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7659bdde-058c-404e-b0f0-e0225c3efa3c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 0.887051 Oct 02 01:07:39.668722 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 808/1685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:38 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:39.704751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:39.707738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:39.727759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:39.741040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:39.741503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:39.749894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:39.754772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:39.755733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:40.011753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:40.023575 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a44c41b6-4b36-417a-b1be-4f473a0f932f tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7" status: 200 len: 1303 microversion: 2.1 time: 0.353229 Oct 02 01:07:40.025560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 809/1686] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:39 2022] GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 => generated 1303 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:40.051407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:40.055502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:40.072164 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:40.073893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:40.074663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:40.076038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:40.077237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:40.079934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:40.080597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:40.095921 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:40.655134 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:40.685850 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:40.820655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:40.837257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:40.844250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:40.846993 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-150d7643-48b0-4512-9288-def0af0e4357 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 0.803041 Oct 02 01:07:40.849570 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 810/1687] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:40 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:40.867757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-36cda207-5226-4899-8d08-3a05428c976c req-b016c1b1-3d2a-4f44-ae79-9e6ce696c6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd5fc9e-d301-46f7-b01c-80b93bbb172b", "name": "network-vif-deleted", "tag": "b58f567d-6585-487c-aff1-48b1fa50116d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:40.910115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-36cda207-5226-4899-8d08-3a05428c976c req-b016c1b1-3d2a-4f44-ae79-9e6ce696c6e2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:40.912371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-36cda207-5226-4899-8d08-3a05428c976c req-b016c1b1-3d2a-4f44-ae79-9e6ce696c6e2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:40.914496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-36cda207-5226-4899-8d08-3a05428c976c req-b016c1b1-3d2a-4f44-ae79-9e6ce696c6e2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:40.944094 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-36cda207-5226-4899-8d08-3a05428c976c req-b016c1b1-3d2a-4f44-ae79-9e6ce696c6e2 service nova] Creating event network-vif-deleted:b58f567d-6585-487c-aff1-48b1fa50116d for instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b on n-h2-master-1 Oct 02 01:07:40.953884 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-36cda207-5226-4899-8d08-3a05428c976c req-b016c1b1-3d2a-4f44-ae79-9e6ce696c6e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100574 Oct 02 01:07:40.957196 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 811/1688] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:40.977770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:40.986116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:40.997687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:40.999412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.000155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.010480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.012304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.015013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.054507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89ff317d-a4b5-42ac-bb12-c3b67740a162 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1461 microversion: 2.1 time: 10.362268 Oct 02 01:07:41.055551 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 878/1689] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:30 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1461 bytes in 10364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:41.070227 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "9d7260a1-4157-406c-8464-41223d149d9b"}, {"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "179e51bf-6cf7-46dd-b434-82948432387b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:41.113632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.120785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.123593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.149078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] Creating event network-changed:9d7260a1-4157-406c-8464-41223d149d9b for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:41.149910 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] Creating event network-changed:179e51bf-6cf7-46dd-b434-82948432387b for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:41.158882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-30893726-8194-44a6-899c-5423ff44a6d8 req-da6b1ad1-01d4-4bce-b0dc-18e928a79fdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.101674 Oct 02 01:07:41.160947 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 879/1690] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:41.168444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:41.169385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:41.179216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.180561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.183740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.186850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.188129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.188717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.494923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:41.510982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8188e950-4a22-45bf-9307-9803066a200e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 0.548842 Oct 02 01:07:41.513016 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 812/1691] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:40 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:41.524901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:41.529161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: e2f6a611-31a5-4996-9a30-67917ff14bf7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:41.543460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.545542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.546303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.547064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.551322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.551769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.584374 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance e2f6a611-31a5-4996-9a30-67917ff14bf7 could not be found. Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 HTTP/1.1 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: exception: Instance e2f6a611-31a5-4996-9a30-67917ff14bf7 could not be found. Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'e2f6a611-31a5-4996-9a30-67917ff14bf7'} Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f6a611-31a5-4996-9a30-67917ff14bf7 could not be found. Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f6a611-31a5-4996-9a30-67917ff14bf7 could not be found. Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:41.590845 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f6a611-31a5-4996-9a30-67917ff14bf7 could not be found. Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance e2f6a611-31a5-4996-9a30-67917ff14bf7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba5da5a7-ef27-468e-80be-a016ebb764ae tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7" status: 404 len: 111 microversion: 2.1 time: 0.076897 Oct 02 01:07:41.595813 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 813/1692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:41 2022] GET /compute/v2.1/servers/e2f6a611-31a5-4996-9a30-67917ff14bf7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:41.606865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-797a05f1-1a7c-4536-9f1a-df31daa091de tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88111b700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:41.690070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-797a05f1-1a7c-4536-9f1a-df31daa091de tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 200 len: 1461 microversion: 2.1 time: 0.095840 Oct 02 01:07:41.695067 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 814/1693] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:41 2022] GET /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:41.701095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:41.705734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:41.718562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.719083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.725823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.726591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.727092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.727806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.772667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:41.790086 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8756f8b4-e15e-4395-8e01-d23847cff97d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 0.627680 Oct 02 01:07:41.807485 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 880/1694] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:41 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:41.807744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.807744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.807744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.807744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lazy-loading 'fault' on Instance uuid 8dd5fc9e-d301-46f7-b01c-80b93bbb172b {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:41.816187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:41.821122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:41.856301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.857199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.860766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.861646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:41.863215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:41.867018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:41.969185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:41.988941 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-98a531b1-5e34-403f-843f-1895bfe0628c tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 200 len: 1308 microversion: 2.1 time: 0.292496 Oct 02 01:07:42.003368 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 815/1695] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:41 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:42.003368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:42.003368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:42.033387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:42.033892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:42.034338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:42.035093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:42.035547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:42.053293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:42.741622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:42.761375 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-75bfdcfa-8f10-4bd7-8c3d-4bd950de2f46 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1468 microversion: 2.1 time: 0.955043 Oct 02 01:07:42.764553 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 881/1696] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:41 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1468 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:42.794172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:42.799303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:42.810423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:42.812787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:42.813507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:42.818729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:42.821144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:42.825529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:42.890534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:42.909008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:42.919294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:42.925650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13286d9f-b205-4b9e-b936-e90411170609 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 0.930188 Oct 02 01:07:42.928409 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 816/1697] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:41 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:42.954371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2007900751"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:42.966184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:42.983406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:42.984290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:42.984433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:42.985138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:42.985476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:42.995075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.365315 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e8abe82-f097-4c0f-a7de-9ea6190c07c4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "POST /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b/action" status: 202 len: 0 microversion: 2.1 time: 0.432152 Oct 02 01:07:43.369981 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 817/1698] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:07:42 2022] POST /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:07:43.384476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:43.385901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:43.403379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:43.405723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:43.406461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.407584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:43.409115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:43.423593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.613170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:43.625750 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23e702c4-144e-4195-b3c4-2c3f12b5e41b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 0.859882 Oct 02 01:07:43.627625 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 882/1699] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:42 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:43.637057 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:43.642856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 8dd5fc9e-d301-46f7-b01c-80b93bbb172b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:43.650003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:43.658584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:43.659965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.667280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:43.667972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:43.668589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.701875 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b could not be found. Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b HTTP/1.1 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b could not be found. Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '8dd5fc9e-d301-46f7-b01c-80b93bbb172b'} Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b could not be found. Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b could not be found. Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:43.703922 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b could not be found. Oct 02 01:07:43.709097 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:43.710388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 8dd5fc9e-d301-46f7-b01c-80b93bbb172b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:43.712117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1b0fa3d-fbf5-408b-b90a-8a4652b16a34 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b" status: 404 len: 111 microversion: 2.1 time: 0.083049 Oct 02 01:07:43.714899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 883/1700] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:43 2022] GET /compute/v2.1/servers/8dd5fc9e-d301-46f7-b01c-80b93bbb172b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:43.723053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-228ababf-354d-43dd-9a89-7f6d9e23049e req-e9d56273-0e34-47c7-bf49-928c140d4b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f6a611-31a5-4996-9a30-67917ff14bf7", "name": "network-vif-deleted", "tag": "b4d4d444-09c5-486d-a0c2-b659585eb9af"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:43.750955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-228ababf-354d-43dd-9a89-7f6d9e23049e req-e9d56273-0e34-47c7-bf49-928c140d4b01 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:43.751471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-228ababf-354d-43dd-9a89-7f6d9e23049e req-e9d56273-0e34-47c7-bf49-928c140d4b01 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:43.751874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-228ababf-354d-43dd-9a89-7f6d9e23049e req-e9d56273-0e34-47c7-bf49-928c140d4b01 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.784812 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-228ababf-354d-43dd-9a89-7f6d9e23049e req-e9d56273-0e34-47c7-bf49-928c140d4b01 service nova] Creating event network-vif-deleted:b4d4d444-09c5-486d-a0c2-b659585eb9af for instance e2f6a611-31a5-4996-9a30-67917ff14bf7 on n-h2-master-1 Oct 02 01:07:43.792256 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-228ababf-354d-43dd-9a89-7f6d9e23049e req-e9d56273-0e34-47c7-bf49-928c140d4b01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075494 Oct 02 01:07:43.792895 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 884/1701] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:43.806237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-cdf8a5f7-4059-42a7-b60e-336897390c94 req-5cc337e9-0536-4400-814e-da389cd117b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:43.836929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cdf8a5f7-4059-42a7-b60e-336897390c94 req-5cc337e9-0536-4400-814e-da389cd117b0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:43.838299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cdf8a5f7-4059-42a7-b60e-336897390c94 req-5cc337e9-0536-4400-814e-da389cd117b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:43.838792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cdf8a5f7-4059-42a7-b60e-336897390c94 req-5cc337e9-0536-4400-814e-da389cd117b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:43.884646 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-cdf8a5f7-4059-42a7-b60e-336897390c94 req-5cc337e9-0536-4400-814e-da389cd117b0 service nova] Creating event network-changed:b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:43.898632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-cdf8a5f7-4059-42a7-b60e-336897390c94 req-5cc337e9-0536-4400-814e-da389cd117b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101358 Oct 02 01:07:43.902971 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 885/1702] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:43.919035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b36c439e-52de-4d8f-9c41-9432a9b2aa17 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855d3820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:43.975364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:43.991488 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2bce2b37-f1a7-491d-8f93-cab47239da2c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 0.612362 Oct 02 01:07:44.006102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 818/1703] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:43 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:44.006102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1524925-be28-4aff-b761-ea4b17bb6059 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:44.019030 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b36c439e-52de-4d8f-9c41-9432a9b2aa17 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.113883 Oct 02 01:07:44.019640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 886/1704] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:43 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:44.032075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:44.032992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:44.048955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.049462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.049915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.056360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.056964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.057420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.068829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1524925-be28-4aff-b761-ea4b17bb6059 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/23f2eb95-85c2-4c3b-9c8a-3b01b3751d28" status: 204 len: 0 microversion: 2.1 time: 0.071790 Oct 02 01:07:44.074519 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 819/1705] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:07:43 2022] DELETE /compute/v2.1/os-server-groups/23f2eb95-85c2-4c3b-9c8a-3b01b3751d28 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:44.080604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:44.085767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:44.095932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.096969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.097675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.098896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.099582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.100260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.148642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:07:44.327877 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-567062f7-6e6a-4b42-8fa3-94cefe5f7eb2 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 204 len: 0 microversion: 2.1 time: 0.250377 Oct 02 01:07:44.332499 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 820/1706] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:07:44 2022] DELETE /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:07:44.338623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:44.339628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:44.358463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.362190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.362984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.364687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.365360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.366492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.596330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:44.607748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:44.609517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:44.611250 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba42cca6-e6de-4ac5-8293-60d8ff13df50 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 0.590395 Oct 02 01:07:44.612045 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 887/1707] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:44 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:44.651059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:44.651818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:44.660750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.661510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.661686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.662403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:44.664343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:44.664762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:44.734212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:44.751883 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7bff7e4e-1e2c-4c46-a059-7699121d0b58 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1471 microversion: 2.1 time: 0.417542 Oct 02 01:07:44.767481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 821/1708] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:44 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:45.021300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:45.022839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:45.037527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:45.040395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:45.044901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:45.048508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:45.049774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:45.052519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:46.445199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:46.458368 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed9cc8ad-61e0-478b-bc19-2d042a018b33 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1476 microversion: 2.1 time: 1.812741 Oct 02 01:07:46.462216 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 888/1709] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:44 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1476 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:46.467611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac2befbb-6239-4ed6-b89f-4ba7411696f0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88560e1f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:46.558183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:46.577943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa5d17a2-6d7f-4fa9-878d-e53c50cd3ddf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 1.560233 Oct 02 01:07:46.578561 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 822/1710] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:45 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:07:46.588214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:46.588839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:46.592954 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac2befbb-6239-4ed6-b89f-4ba7411696f0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.129317 Oct 02 01:07:46.594450 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 889/1711] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:46 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:46.604703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:46.605203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:46.605637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:46.606363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:46.606501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:46.606890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:46.607313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:46.611766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:46.627956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:46.628997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:46.630134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:46.632242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:46.634509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:46.637212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:47.386760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:47.415608 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-07c9d8e6-72b1-4a82-9e5d-183c5176fbb7 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1471 microversion: 2.1 time: 0.816123 Oct 02 01:07:47.416497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 890/1712] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:46 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1471 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:47.431646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-792100bd-984e-4bb0-880c-d721387ca717 req-a829cb3a-28e2-47e4-8699-beeeff6ed8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:47.478017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-792100bd-984e-4bb0-880c-d721387ca717 req-a829cb3a-28e2-47e4-8699-beeeff6ed8e5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:47.478678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-792100bd-984e-4bb0-880c-d721387ca717 req-a829cb3a-28e2-47e4-8699-beeeff6ed8e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:47.480751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-792100bd-984e-4bb0-880c-d721387ca717 req-a829cb3a-28e2-47e4-8699-beeeff6ed8e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:47.518979 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-792100bd-984e-4bb0-880c-d721387ca717 req-a829cb3a-28e2-47e4-8699-beeeff6ed8e5 service nova] Creating event network-changed:25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:47.537121 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-792100bd-984e-4bb0-880c-d721387ca717 req-a829cb3a-28e2-47e4-8699-beeeff6ed8e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115279 Oct 02 01:07:47.538207 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 891/1713] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:47.548700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b6553cbe-c06b-4bb7-9e62-70fe4e85dc42 req-1364aa0e-b79f-40d8-ab08-8298a1f9005d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39831e69-dcd1-4272-9b0a-0b8717bdad39", "name": "network-vif-plugged", "status": "completed", "tag": "04589599-8f46-424b-93a0-f62bdc1ad661"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:47.582083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b6553cbe-c06b-4bb7-9e62-70fe4e85dc42 req-1364aa0e-b79f-40d8-ab08-8298a1f9005d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:47.582583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b6553cbe-c06b-4bb7-9e62-70fe4e85dc42 req-1364aa0e-b79f-40d8-ab08-8298a1f9005d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:47.583048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b6553cbe-c06b-4bb7-9e62-70fe4e85dc42 req-1364aa0e-b79f-40d8-ab08-8298a1f9005d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:47.631464 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b6553cbe-c06b-4bb7-9e62-70fe4e85dc42 req-1364aa0e-b79f-40d8-ab08-8298a1f9005d service nova] Creating event network-vif-plugged:04589599-8f46-424b-93a0-f62bdc1ad661 for instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 on n-h1-master-1 Oct 02 01:07:47.640931 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b6553cbe-c06b-4bb7-9e62-70fe4e85dc42 req-1364aa0e-b79f-40d8-ab08-8298a1f9005d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098233 Oct 02 01:07:47.641625 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 892/1714] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:47.658864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:47.665089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:47.700552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:47.701177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:47.701624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:47.702446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:47.702939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:47.703366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:48.140581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:48.161457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:48.164043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:48.171648 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f5beb8d-ab11-40fe-9d84-dea75fe9f363 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 1.591988 Oct 02 01:07:48.183896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 823/1715] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:46 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:48.198046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:48.201911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:48.238234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:48.240413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:48.242944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:48.248540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:48.249346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:48.251794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:48.754590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:48.768505 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd4443bc-7e24-410b-9f2b-5663e661de24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1475 microversion: 2.1 time: 1.124226 Oct 02 01:07:48.772307 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 893/1716] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:47 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1475 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:48.781732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68d34a77-63ec-4163-b024-6187d99fa34b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855b00d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:49.359720 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68d34a77-63ec-4163-b024-6187d99fa34b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.586085 Oct 02 01:07:49.361973 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 894/1717] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:48 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:49.366790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "name": "network-vif-unplugged", "status": "completed", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:49.379411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.380148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.382552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.404593 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] Creating event network-vif-unplugged:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h2-master-1 Oct 02 01:07:49.417535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:07:49.448883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-823ad857-8250-4e48-8c3a-cad56546a491 req-bd4abf87-0c48-4018-be01-50305878096c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083317 Oct 02 01:07:49.450667 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 895/1718] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:49.490871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:49.491838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:49.512338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:49.515409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.515925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.516367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.517082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.517539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.517965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.521210 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75f23ba5-01d8-4c84-a8f6-bdeb54891a12 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1198 microversion: 2.1 time: 1.335879 Oct 02 01:07:49.534627 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 824/1719] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:48 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1198 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:49.549366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:49.552498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:49.577684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.578467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.579169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.580237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.580699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.581296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.864873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:49.872199 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b5d3fa1-ba04-46fc-9aad-63487e339454 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1429 microversion: 2.1 time: 0.417477 Oct 02 01:07:49.888149 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 896/1720] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:49 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1429 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:49.898223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "f5e3966a-d368-487e-b5a2-ec22b74ff1da"}, {"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "59e8f14e-0229-48db-bae6-a559e24b69a8"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:49.913829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.914457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.915265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.928379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] Creating event network-changed:f5e3966a-d368-487e-b5a2-ec22b74ff1da for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:49.929057 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] Creating event network-changed:59e8f14e-0229-48db-bae6-a559e24b69a8 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:07:49.935078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1e427d91-90d9-4018-b14b-7d4a06813592 req-dd29dcfb-12ed-4ace-9fb2-7e52c93b295d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042726 Oct 02 01:07:49.942182 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 897/1721] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:49.947894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9a9004-7066-456c-8c1b-99e03b63b2e7", "name": "network-vif-unplugged", "status": "completed", "tag": "299976b2-a154-4fee-9940-050f8ca7645b"}, {"server_uuid": "7d3d7159-ba16-41d9-8d7b-c87ac671ad0a", "name": "network-vif-unplugged", "status": "completed", "tag": "41489c6e-295b-41a6-ac6e-ebde228cebf1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:49.962255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:49.963193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:49.963880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:49.982119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] Creating event network-vif-unplugged:299976b2-a154-4fee-9940-050f8ca7645b for instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 on n-h2-master-1 Oct 02 01:07:49.983478 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] Creating event network-vif-unplugged:41489c6e-295b-41a6-ac6e-ebde228cebf1 for instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a on n-h2-master-1 Oct 02 01:07:50.005282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1386ea93-2dd8-4507-a957-26dcfc1b1c41 req-7c8d3610-0a95-4e44-b0b3-bac64631184f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.061269 Oct 02 01:07:50.012792 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 898/1722] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:50.039575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:50.044914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:50.070435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:50.070972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:50.071422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:50.072142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:50.072603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:50.073026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.150517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:51.161747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:51.163548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:51.164947 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7368585-60c2-469b-b39b-488138ccede9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 1.633493 Oct 02 01:07:51.166043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 825/1723] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:49 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:51.172571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-efb0da3c-d43d-4a47-8238-670253989c2a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885613550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:51.205377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:51.216587 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5894fb0f-5d09-4369-bddb-77c52c6ea758 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1475 microversion: 2.1 time: 1.202400 Oct 02 01:07:51.225296 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 899/1724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:50 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1475 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:51.247373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:51.251210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:51.252189 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-efb0da3c-d43d-4a47-8238-670253989c2a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.084784 Oct 02 01:07:51.252803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 826/1725] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:51 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:51.270267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:51.271406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:51.272111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.273228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:51.273546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:51.273869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:51.274485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:51.275285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.287233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:51.287760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:51.288228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.288952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:51.289472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:51.289908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.380888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:51.391422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:51.392188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.392834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lazy-loading 'fault' on Instance uuid 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:51.405728 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:51.587421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c076d9dc75a7400f87b480d2b18dcc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c6b40e739146e8b98b38971b879e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:51.614117 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1de58049-fb9f-4319-9943-c17b09a5534d tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 200 len: 1306 microversion: 2.1 time: 0.348050 Oct 02 01:07:51.614835 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 827/1726] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:51 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 1306 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:51.620403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3d7159-ba16-41d9-8d7b-c87ac671ad0a", "name": "network-vif-deleted", "tag": "41489c6e-295b-41a6-ac6e-ebde228cebf1"}, {"name": "network-changed", "server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:51.634953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:51.635870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:51.636643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:51.667955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Creating event network-vif-deleted:41489c6e-295b-41a6-ac6e-ebde228cebf1 for instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a on n-h2-master-1 Oct 02 01:07:51.675879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Creating event network-changed:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h2-master-1 Oct 02 01:07:51.695440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:07:51.727972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-5b4bb3bd-8979-43ad-8a7c-5bfe567996cd req-57b47a0b-18b7-427f-abf1-ef358099adeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.111573 Oct 02 01:07:51.729225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 828/1727] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:52.281368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:52.290544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6186fd02-991e-4e63-9953-bcddc8735514 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1381 microversion: 2.1 time: 1.062768 Oct 02 01:07:52.299491 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 900/1728] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:51 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1381 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:52.309927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-af97ddeb-38f5-43c2-83f1-63ce2d1cd7c5 req-b41edd0e-2e08-47e0-b882-b156fd878dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "name": "network-vif-plugged", "status": "completed", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:52.351221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1724224741", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "2cda63f8-005b-4a13-b6ab-506ae9e96789"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:52.353798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-af97ddeb-38f5-43c2-83f1-63ce2d1cd7c5 req-b41edd0e-2e08-47e0-b882-b156fd878dbf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:52.359155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-af97ddeb-38f5-43c2-83f1-63ce2d1cd7c5 req-b41edd0e-2e08-47e0-b882-b156fd878dbf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:52.361862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-af97ddeb-38f5-43c2-83f1-63ce2d1cd7c5 req-b41edd0e-2e08-47e0-b882-b156fd878dbf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:52.390621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-af97ddeb-38f5-43c2-83f1-63ce2d1cd7c5 req-b41edd0e-2e08-47e0-b882-b156fd878dbf service nova] Creating event network-vif-plugged:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:07:52.425515 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-af97ddeb-38f5-43c2-83f1-63ce2d1cd7c5 req-b41edd0e-2e08-47e0-b882-b156fd878dbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124451 Oct 02 01:07:52.429500 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 901/1729] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:52.437177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:52.454886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:52.480136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:52.484391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:52.487028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:52.489912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:52.491309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] validate_networks() for [('2cda63f8-005b-4a13-b6ab-506ae9e96789', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:07:52.492298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:52.492745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:54.036245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:54.057353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:54.061600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:54.063215 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0db15072-c741-42b4-9656-91e2c51d3e58 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 1.631293 Oct 02 01:07:54.066060 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 902/1730] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:52 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:54.074593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:54.079507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:54.093093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:54.097644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:54.098795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:54.099766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:54.100178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:54.100610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:54.610583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:07:54.611676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:07:54.612842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:07:54.613641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:07:54.614481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:07:54.637471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:54.638258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:54.641550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:54.642593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:54.643332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:54.645399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:54.693097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Getting quotas for project 54fc9ec957ec4fa8a613c8f90a5a6bc5. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:54.705369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Getting quotas for user 26941bac262b4d78a1dc6f5f07c29b91 and project 54fc9ec957ec4fa8a613c8f90a5a6bc5. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:54.746936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:07:54.767974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:07:54.869841 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40425c9e-bf3b-44ce-9f07-f25e91cde26d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.792291 Oct 02 01:07:54.871239 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 829/1731] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:07:54.878922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42d9c0fd-9e6d-4c11-9812-17ae16ef83d3 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88561bc10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:54.940847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42d9c0fd-9e6d-4c11-9812-17ae16ef83d3 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.066855 Oct 02 01:07:54.952925 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 830/1732] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:54 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:55.308881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:55.312430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:55.370191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:55.370945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:55.371407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:55.377415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:55.379712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:55.380942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:55.563413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:55.577868 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68f2b65d-c016-4811-9e0d-9d060109f9dd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1475 microversion: 2.1 time: 1.510308 Oct 02 01:07:55.607061 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 903/1733] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:54 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1475 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:55.639261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:55.641806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] [instance: 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:55.668112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:55.671221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:55.675664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:55.677915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:55.682843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:55.683406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:55.734515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee012122-da5b-4407-b421-cae6bd51bcc2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1532 microversion: 2.1 time: 0.780378 Oct 02 01:07:55.735252 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 831/1734] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:54 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1532 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:55.750800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21c4d70e-8e88-4f05-9025-40d0d8f4e1d0 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:55.751756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21c4d70e-8e88-4f05-9025-40d0d8f4e1d0 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:55.774682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] HTTP exception thrown: Instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a could not be found. Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Request method failure captured: Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a HTTP/1.1 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOON_DOP5v2Fut7EiibW0z8hxazR-Kgl_5i-QZAXq1QAiVlZJF0LQDtO1OIr8fCOg47p4hw1aZOlLmdNbatgR4cqa7oGNFN01m8ZBKFI7kOku5QNuyU2q5VOBcprp9lkOa4qLHpFucwn5dea0oBlzQJSxxzIW2b8r3kvx3LYmTz14n1E Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70c6b40e739146e8b98b38971b879e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70c6b40e739146e8b98b38971b879e85"}]}] Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 70c6b40e739146e8b98b38971b879e85 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1530286374 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c076d9dc75a7400f87b480d2b18dcc14 Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersOnMultiNodesTest-1530286374-project Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a could not be found. Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7d3d7159-ba16-41d9-8d7b-c87ac671ad0a'} Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a could not be found. Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a could not be found. Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:07:55.786198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a could not be found. Oct 02 01:07:55.792060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:07:55.796989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] Returning 404 to user: Instance 7d3d7159-ba16-41d9-8d7b-c87ac671ad0a could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:07:55.811576 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eda236d4-d5b5-40e0-9849-542855e3ea32 tempest-ServersOnMultiNodesTest-1530286374 tempest-ServersOnMultiNodesTest-1530286374-project] 10.222.0.23 "GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a" status: 404 len: 111 microversion: 2.1 time: 0.196377 Oct 02 01:07:55.812609 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 904/1735] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:55 2022] GET /compute/v2.1/servers/7d3d7159-ba16-41d9-8d7b-c87ac671ad0a => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:55.825240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:55.844344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:55.878186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:55.878726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:55.879175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:55.879902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:55.880445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:55.880873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:55.988158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21c4d70e-8e88-4f05-9025-40d0d8f4e1d0 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:56.003147 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21c4d70e-8e88-4f05-9025-40d0d8f4e1d0 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1217 microversion: 2.1 time: 0.266565 Oct 02 01:07:56.009775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 832/1736] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:55 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:56.018050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:56.027295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:56.031073 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:56.052860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:56.053957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:56.056603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:56.059090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:56.064610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:56.065687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:56.771418 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-662ca511-a547-425b-8f1a-f2a6e22f8631 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1532 microversion: 2.1 time: 0.758701 Oct 02 01:07:56.780473 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 833/1737] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:56 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1532 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:56.799055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b5839b7-234d-44e5-96fe-934081973a9c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8856e3310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:56.853675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:56.884275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:56.899256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:56.905786 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09a8a928-f9d5-43bc-b520-73396c8356e9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1885 microversion: 2.42 time: 1.089266 Oct 02 01:07:56.909354 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 905/1738] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:55 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1885 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:56.928320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:56.933334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:56.945305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b5839b7-234d-44e5-96fe-934081973a9c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.163283 Oct 02 01:07:56.946389 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 834/1739] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:56 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:56.956255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:56.964174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:56.968853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:56.984177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:56.984629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:56.987976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:56.999388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:57.003017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:57.008782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:57.012139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:57.012944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:57.016413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:57.019345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:57.022279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:58.638031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:58.686889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc3a9343-af65-447e-964b-915a79c3558a tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 2423 microversion: 2.25 time: 1.775323 Oct 02 01:07:58.698638 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 906/1740] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:56 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 2423 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:07:58.698638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:58.698638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:58.699535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:58.699535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:58.700162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:58.702268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:58.702964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:58.767033 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-73b7a1d8-44d4-4fa3-a0d0-a27a388c39f2 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077961 Oct 02 01:07:58.771238 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 907/1741] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:07:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:58.796915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:58.832053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:58.843364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:58.856806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:58.858591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:58.859947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:58.862627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:58.880580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7286e54-ae80-4c27-82e5-083d229b12c6 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1473 microversion: 2.1 time: 1.932295 Oct 02 01:07:58.881775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 835/1742] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:56 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1473 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:58.885392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:58.886205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:58.904548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:58.905785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:58.940033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:58.940658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:58.941101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:58.941972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:58.948809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:58.949295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:59.438698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:59.447428 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1280fdbb-0b38-4498-984d-4ee720952c87 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1275 microversion: 2.1 time: 0.674831 Oct 02 01:07:59.459327 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 908/1743] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:58 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1275 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:59.471354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe3bc084-258e-4f8a-b78b-e7c96d703720 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885572a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:59.525432 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe3bc084-258e-4f8a-b78b-e7c96d703720 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.064430 Oct 02 01:07:59.526567 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 909/1744] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:59 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:59.533777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:59.536562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:59.543465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:59.544336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:59.544788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:59.546038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:59.546759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:59.547305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:59.586692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'flavor' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:07:59.614167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Going to try to live migrate instance to n-h2-master-1 {{(pid=122355) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:08:00.253519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:00.283255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:00.294330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:00.300449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01f821b8-4c00-41c9-8db9-ea658032f0df tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 1.416165 Oct 02 01:08:00.301352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 836/1745] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:07:58 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:00.332501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:00.335425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:00.344404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:00.345252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:00.345949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:00.347046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:00.347705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:00.348516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:00.387722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lazy-loading 'flavor' on Instance uuid 39831e69-dcd1-4272-9b0a-0b8717bdad39 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:00.405847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Going to try to live migrate instance to n-h2-master-1 {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:08:04.146887 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-292e715e-b3f5-4ba5-aa7f-e68e325398ba tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/action" status: 202 len: 0 microversion: 2.25 time: 4.618877 Oct 02 01:08:04.148572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 910/1746] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:07:59 2022] POST /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/action => generated 0 bytes in 4621 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:04.155497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:04.156397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:04.168155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:04.169692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:04.183007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:04.184029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:04.184672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:04.185336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:04.671214 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:04.701022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1528339e-014a-42bb-99af-9044b2fa6f68 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39/action" status: 202 len: 0 microversion: 2.1 time: 4.394614 Oct 02 01:08:04.706150 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 837/1747] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:08:00 2022] POST /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39/action => generated 0 bytes in 4402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:04.715647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "name": "network-vif-plugged", "status": "completed", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:04.749551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:04.750055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:04.750494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:04.790797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] Creating event network-vif-plugged:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h2-master-1 Oct 02 01:08:04.804455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:08:04.834103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-60755cf8-0a5c-4ace-89ac-c58753d9f9d7 req-de483236-9e92-4dd6-8a8a-7f9d73a3849e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126164 Oct 02 01:08:04.837159 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 838/1748] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:04.852562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:04.854136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:04.868815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:04.869318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:04.869761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:04.875022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:04.875518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:04.875961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:05.080543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:05.104361 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-55ff9edd-1dc2-42c5-bdc6-51ac06e67e9a tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1470 microversion: 2.1 time: 0.946806 Oct 02 01:08:05.105594 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 911/1749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:04 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1470 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:05.127797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9bc3d8bb-ace8-41e4-9592-c0fffab65afa tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885681160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:05.253035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9bc3d8bb-ace8-41e4-9592-c0fffab65afa tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.145977 Oct 02 01:08:05.255737 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 912/1750] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:05 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:05.265082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:05.271157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:05.285940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:05.290425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:05.291391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:05.292412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:05.293108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:05.293852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:05.979391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:05.989607 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ef6c0e5-c6cb-4d04-a387-900d3aeba254 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1317 microversion: 2.1 time: 1.148134 Oct 02 01:08:05.994788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 839/1751] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:04 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1317 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:06.000589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1333579886", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "69aa6672-de28-43ad-b979-262af927c059"}], "security_groups": [{"name": "tempest-securitygroup--328762953"}], "key_name": "tempest-keypair-2106632051", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ac57393e-cb75-449a-9c93-11748b53f8a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:06.023013 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:06.271535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:06.286096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:06.287598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:06.288846 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf8c4aaf-421c-47ec-bf2e-d506b190ff15 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 1.032052 Oct 02 01:08:06.289416 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 913/1752] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:05 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:06.300020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:06.307589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:06.320665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:06.321160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:06.321987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:06.322919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:06.327248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:06.327876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:06.501641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] validate_networks() for [('69aa6672-de28-43ad-b979-262af927c059', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:08:06.769090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:06.782302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:06.796915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:06.812413 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4549fbaf-54d2-4352-87be-8e91594691b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.514373 Oct 02 01:08:06.813087 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 914/1753] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:06 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:06.834375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:06.834375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:06.864959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:06.865520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:06.866027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:06.873922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:06.880206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:06.883381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:07.304937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:07.317218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0848de27-4ce0-4304-b209-ea4bfafcd987 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.502950 Oct 02 01:08:07.318251 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 915/1754] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:06 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:07.342522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:07.343084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:07.365812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:07.366668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:07.367268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:07.368165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:07.368620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:07.369043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:07.676699 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c93a7a94-34b0-4a5e-bad0-cef1c39b6dcd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "POST /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7/action" status: 202 len: 0 microversion: 2.1 time: 0.340535 Oct 02 01:08:07.678415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 916/1755] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:08:07 2022] POST /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:07.703533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f61d2ef6-f743-461a-8c47-06725946ca72 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885557160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:07.824165 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f61d2ef6-f743-461a-8c47-06725946ca72 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.143730 Oct 02 01:08:07.825493 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 917/1756] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:07 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:07.831645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c3a432d2-5f8a-4e2f-8682-b31020774510 req-d7227097-e7ec-4688-88a8-98a3bdf63050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c3ba73-c816-4229-ab88-94fb769ab4c2", "tag": "fbbc20bd-cce7-4e5d-8025-34e6c4b1da4c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:07.844816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c3a432d2-5f8a-4e2f-8682-b31020774510 req-d7227097-e7ec-4688-88a8-98a3bdf63050 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:07.845739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c3a432d2-5f8a-4e2f-8682-b31020774510 req-d7227097-e7ec-4688-88a8-98a3bdf63050 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:07.846345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c3a432d2-5f8a-4e2f-8682-b31020774510 req-d7227097-e7ec-4688-88a8-98a3bdf63050 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:07.862346 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c3a432d2-5f8a-4e2f-8682-b31020774510 req-d7227097-e7ec-4688-88a8-98a3bdf63050 service nova] Creating event network-changed:fbbc20bd-cce7-4e5d-8025-34e6c4b1da4c for instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 on n-h2-master-1 Oct 02 01:08:07.878903 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c3a432d2-5f8a-4e2f-8682-b31020774510 req-d7227097-e7ec-4688-88a8-98a3bdf63050 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051180 Oct 02 01:08:07.880733 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 918/1757] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:07.889191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:07.895344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:07.904938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:07.906125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:07.907405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:07.908765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:07.909411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:07.910013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:08.678989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:08.688617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-822842cc-daea-4f69-a246-58916fab25b1 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1317 microversion: 2.1 time: 0.805866 Oct 02 01:08:08.705676 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 919/1758] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:07 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:08.719291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:08.721966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:08.736131 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:08.738082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:08.738798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:08.744691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:08.745693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:08.746325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:08.747063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:09.481572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Getting quotas for project 8639be724fdc4c128da53dd69fbbc356. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:09.487742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:09.502670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:09.507671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:09.507892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Getting quotas for user ddc06a9186b9434d86d5815276c9b51d and project 8639be724fdc4c128da53dd69fbbc356. Resources: dict_keys(['metadata_items']) {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:09.511681 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0eeabe7f-0e65-4307-84c7-537e5d408134 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.804557 Oct 02 01:08:09.514921 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 920/1759] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:08 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:09.523593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:09.524490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:09.535029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:08:09.535445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:08:09.536019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:08:09.536436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:08:09.536847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:08:09.538240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:09.540577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:09.545761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:09.549575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:09.554303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:09.555004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:09.569320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:09.572113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:09.572723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:09.573658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:09.574781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:09.575389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:09.609425 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:09.620636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Getting quotas for project 8639be724fdc4c128da53dd69fbbc356. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:09.630326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Getting quotas for user ddc06a9186b9434d86d5815276c9b51d and project 8639be724fdc4c128da53dd69fbbc356. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:09.738559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:08:09.741297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac57393e-cb75-449a-9c93-11748b53f8a4',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:08:09.963268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:09.974766 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-37cf56bf-bc8c-4552-a6a6-d4de0104a46d tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 0.458715 Oct 02 01:08:09.975361 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 921/1760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:09 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:09.980267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:09.980860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:10.033215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:10.036156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:10.038231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:10.041911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:10.045711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:10.047079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:10.082397 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d09422e9-62fc-4871-bba4-94a17f724ebb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.083929 Oct 02 01:08:10.083307 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 840/1761] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:08:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 4088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:08:10.096927 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:10.104027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:10.105802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:10.128157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:10.129587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:10.131053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:10.133028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:10.134895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:10.136395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:11.417606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:11.447485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:11.449067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:11.464753 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e62c575d-6373-4fb5-8827-50e3717965f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 1.488105 Oct 02 01:08:11.466890 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 922/1762] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:09 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:11.473479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-afe075fe-fd1d-43de-8224-642b725a0901 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88161c040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:11.604506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-afe075fe-fd1d-43de-8224-642b725a0901 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.134803 Oct 02 01:08:11.609829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 923/1763] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:11 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:11.625269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:11.630777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:11.663177 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=85 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:11.665390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:11.666365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:11.667042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:11.667939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:11.668827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:11.669425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:11.772875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:11.792524 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b6bac0e-e22b-4dbe-9ab5-35f59980417e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 1.698838 Oct 02 01:08:11.815175 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 841/1764] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:10 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:11.863507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:11.865955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:11.890413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:11.891941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:11.892626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:11.893630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:11.895430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:11.896099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:12.144416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:12.158118 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7bd3f7d3-2c51-496f-8086-bac9fbbf0f09 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1220 microversion: 2.1 time: 0.338629 Oct 02 01:08:12.158816 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 842/1765] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:11 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1220 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:12.178443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:12.192054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:12.216453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:12.218201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:12.222829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:12.226402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:12.231811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:12.236318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:12.434062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:12.445380 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ab83d747-63bc-4ac8-9708-be8f05ec711c tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1317 microversion: 2.1 time: 0.833310 Oct 02 01:08:12.457489 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 924/1766] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:11 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:12.463891 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:12.466245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:12.480523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:12.483720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:12.485382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:12.488584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:12.489443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:12.490117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:13.325175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:13.350766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:13.366054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:13.367929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-051b3d91-b57b-4a8b-8f73-271651f205d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 1.200995 Oct 02 01:08:13.375378 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 843/1767] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:12 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:13.383013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:13.388421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:13.411001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:13.411812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:13.412476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:13.420653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:13.424872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:13.425645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.075235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:14.089552 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d74d05c7-f8ac-4cc2-9cc8-ab7bf57c88ba tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 1.627552 Oct 02 01:08:14.092725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 925/1768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:12 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:14.105094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-01aa18ae-b641-497d-8e31-734d2ab366b4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88554a3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:14.179177 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-01aa18ae-b641-497d-8e31-734d2ab366b4 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.081985 Oct 02 01:08:14.193086 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 926/1769] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:14 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:14.201946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:14.203612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:14.214385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.215186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.216559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.217671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.218492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.219266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.555175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:14.570343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:14.580505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:14.582022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd9aca13-9510-4042-9212-1d37d847a2af tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 1.205263 Oct 02 01:08:14.587906 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 844/1770] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:13 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:14.593698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:14.594313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:14.619045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.626346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.629324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.633309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.633995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.634662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.713070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:14.726974 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ca79ca0-bcd8-4c31-9715-658a3d123b85 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.527188 Oct 02 01:08:14.729707 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 927/1771] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:14 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:14.760098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:14.764131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:14.786750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.787528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.788146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.789740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.796390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.797110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.831258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:14.840964 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a8ad0af-97e7-48a9-be4d-30ad0008d1de tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1238 microversion: 2.1 time: 0.250985 Oct 02 01:08:14.850668 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 845/1772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:14 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1238 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:14.863037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:14.866015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:14.881649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.882512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.900002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:14.901094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:14.901946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:14.911400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:15.434362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:15.451604 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a97b6dd5-d05c-4819-8045-5951a7aeefeb tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1317 microversion: 2.1 time: 0.719635 Oct 02 01:08:15.453885 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 928/1773] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:14 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:15.477633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:15.480496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:15.534899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:15.534899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:15.534899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:15.534899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:15.534899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:15.534899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:17.733233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:17.749821 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41b454cf-669b-420d-8123-6438fb57c06e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 2.292198 Oct 02 01:08:17.750445 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 929/1774] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:15 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:17.785111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-89b5c4cb-3222-4a36-890e-9c86230d4e91 req-78b6f4cc-ac96-4419-afab-95b7f55a7253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c3ba73-c816-4229-ab88-94fb769ab4c2", "name": "network-vif-plugged", "status": "completed", "tag": "fbbc20bd-cce7-4e5d-8025-34e6c4b1da4c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:17.789174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:17.813222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:17.817733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:17.828683 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87772143-2eb8-4f8e-bfa3-31bb48f68007 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 2.972541 Oct 02 01:08:17.831061 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 846/1775] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:14 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 2980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:17.837615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-89b5c4cb-3222-4a36-890e-9c86230d4e91 req-78b6f4cc-ac96-4419-afab-95b7f55a7253 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:17.848591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-89b5c4cb-3222-4a36-890e-9c86230d4e91 req-78b6f4cc-ac96-4419-afab-95b7f55a7253 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:17.850764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-732ae9bd-eec8-4309-ab0b-33da66e86af1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885636af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:17.855090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-89b5c4cb-3222-4a36-890e-9c86230d4e91 req-78b6f4cc-ac96-4419-afab-95b7f55a7253 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:17.948094 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-89b5c4cb-3222-4a36-890e-9c86230d4e91 req-78b6f4cc-ac96-4419-afab-95b7f55a7253 service nova] Creating event network-vif-plugged:fbbc20bd-cce7-4e5d-8025-34e6c4b1da4c for instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 on n-h2-master-1 Oct 02 01:08:17.971885 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-89b5c4cb-3222-4a36-890e-9c86230d4e91 req-78b6f4cc-ac96-4419-afab-95b7f55a7253 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217942 Oct 02 01:08:17.978034 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 930/1776] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:18.000137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:18.012735 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-732ae9bd-eec8-4309-ab0b-33da66e86af1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1453 microversion: 2.1 time: 0.178079 Oct 02 01:08:18.019966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:18.043724 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 847/1777] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:17 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:18.081198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:18.082049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:18.084277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:18.087391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:18.088734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:18.089438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:18.092718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:18.103847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:18.129771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:18.133927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:18.136837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:18.138060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:18.145371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:18.145895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:18.164486 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:19.602082 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:19.640364 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:19.854577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:19.872085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:19.879117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:19.880574 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-05fa0f12-e170-48d8-9282-3734ca408e07 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 1.899717 Oct 02 01:08:19.883443 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 931/1778] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:17 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:19.889485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:19.890327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:19.897710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:19.898434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:19.899043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:19.899925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:19.900527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:19.901094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:19.932845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:19.944325 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-639b1fae-f1ca-4bff-9c0b-8237ce196976 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 1.899469 Oct 02 01:08:19.945588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 848/1779] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:18 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:19.953129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:19.954169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:19.963603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:19.964562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:19.965309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:19.967300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:19.968490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:19.969269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:20.467901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:20.478646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3e24f85-2c22-4ccc-ab2a-1f39d4188602 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1317 microversion: 2.1 time: 0.531332 Oct 02 01:08:20.479586 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 849/1780] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:19 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:20.485564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:20.486457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:20.493156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:20.493834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:20.494461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:20.495356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:20.496014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:20.496615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:20.604463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:20.620969 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0af7f93a-d8e7-47e4-a6f2-b9707f68cb04 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1305 microversion: 2.1 time: 0.736159 Oct 02 01:08:20.625540 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 932/1781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:19 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1305 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:20.640541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:20.643318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:20.656252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:20.658311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:20.659050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:20.660019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:20.661662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:20.663738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:20.834116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:20.848703 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1b53a48-27b7-4134-b0f3-a6d518d03a2b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 0.366968 Oct 02 01:08:20.852732 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 850/1782] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:20 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:20.866884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e79b36e8-ab03-4048-b9b6-e9ab01ae6490 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88566e9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:20.951042 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e79b36e8-ab03-4048-b9b6-e9ab01ae6490 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1462 microversion: 2.1 time: 0.096376 Oct 02 01:08:20.959802 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 851/1783] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:20 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:21.224985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:21.247895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:21.250504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:21.251811 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6177f6e5-b7e1-4b60-a1c1-bc2ce2cd7af8 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.625276 Oct 02 01:08:21.253017 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 933/1784] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:20 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:21.265156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:21.267748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:21.277285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.278392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.279122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:21.280266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.281156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.282019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:21.327647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d7d803d-8ac5-4b06-9421-7331f6d3b4c2 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Action: 'create', calling method: .version_select at 0x7fb885630e50>, body: {"keypair": {"name": "tempest-keypair-1806888045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJABLKAFbXPSfdfT1HkSJ43sxpGvSwJ0NACGSeoYdwwx2bgRohc2WMXtaswXjoJGnflqvlfb2U6lQ/2fJNvGdpKCvTMhHKkXSpzGoYIHwXw2DL2qpyCEAU4f9j2YSz76xA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:21.356347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1d7d803d-8ac5-4b06-9421-7331f6d3b4c2 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Getting quotas for project 76dd02a5b3d346168e6dde74ddb4d3e0. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:21.365873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1d7d803d-8ac5-4b06-9421-7331f6d3b4c2 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Getting quotas for user a8ae1a9c7c164923840b20e32c471cf3 and project 76dd02a5b3d346168e6dde74ddb4d3e0. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:21.399550 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d7d803d-8ac5-4b06-9421-7331f6d3b4c2 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.438317 Oct 02 01:08:21.402852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 852/1785] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:21.412180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "name": "network-vif-unplugged", "status": "completed", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:21.423463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.423992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.424423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:21.439236 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] Creating event network-vif-unplugged:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h1-master-1 Oct 02 01:08:21.446510 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:08:21.470078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3f0ef61f-db53-4829-a13a-79e8cd314ac7 req-629263bb-afdd-4fea-a436-ce7332f2a470 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065170 Oct 02 01:08:21.471326 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 853/1786] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:21.477971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-758c43b7-aab0-43c0-a581-9d0f728ab31d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88111b700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:21.568126 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-758c43b7-aab0-43c0-a581-9d0f728ab31d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 200 len: 1462 microversion: 2.1 time: 0.094684 Oct 02 01:08:21.570977 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 854/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:21 2022] GET /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 1462 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:21.583683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:21.585393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:21.600890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.603816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.604430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:21.605679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.607102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.608839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:21.838311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:21.860577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:21.865005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:21.869867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e37bc80-5f6b-4e73-84ba-32959d2de073 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.615784 Oct 02 01:08:21.873047 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 934/1788] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:21 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:21.886127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:21.887158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:21.908576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.913108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.913733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:21.914887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:21.915645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:21.916284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:22.346158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:22.362204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cefa5e93-7268-41da-b074-1e4430376e8f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.788745 Oct 02 01:08:22.363694 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 855/1789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:21 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:22.369443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:22.370948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:22.381217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:22.382103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:22.382821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:22.383770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:22.384572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:22.385290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:22.505639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:22.518166 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd3a063f-8857-46e3-82be-9df5fbb609ce tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1506 microversion: 2.1 time: 0.643084 Oct 02 01:08:22.519884 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 935/1790] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:21 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:22.526182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:22.527978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:22.537154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:22.538030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:22.539381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:22.540476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:22.541244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:22.541899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:23.390492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:23.409125 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45c744c8-5d32-4f15-b123-be652837b454 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 1467 microversion: 2.1 time: 1.042103 Oct 02 01:08:23.412088 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 856/1791] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:22 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 1467 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:23.422700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:23.423865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:23.431671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:23.432689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:23.433399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:23.434506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:23.435834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:23.436103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:23.659317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:23.674327 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a80f5753-8844-43c0-8841-af6259e2d14e tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1305 microversion: 2.1 time: 1.152695 Oct 02 01:08:23.675664 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 936/1792] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:22 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1305 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:23.680688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:23.681873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:23.690486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:23.692281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:23.692898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:23.693911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:23.694744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:23.695390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:23.973639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.000744 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-89f31925-a0b8-4661-8970-bc635e5a5936 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 0.587292 Oct 02 01:08:24.001436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 857/1793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:23 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:24.006771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:24.007307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:24.018056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.018556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.019017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.019733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.020191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.022311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.072666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.073837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-382adc51-7b5e-4244-8b32-597eae6ea691 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2/os-instance-actions/req-40425c9e-bf3b-44ce-9f07-f25e91cde26d" status: 200 len: 313 microversion: 2.1 time: 0.071318 Oct 02 01:08:24.074907 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 858/1794] 10.222.0.23 () {58 vars in 1419 bytes} [Sun Oct 2 01:08:24 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2/os-instance-actions/req-40425c9e-bf3b-44ce-9f07-f25e91cde26d => generated 313 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:24.080285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-df13ffb2-42ae-4ae9-9c16-075960190a93 req-197382bf-590d-463d-aac7-884247aaced5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "name": "network-vif-unplugged", "status": "completed", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:24.092870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df13ffb2-42ae-4ae9-9c16-075960190a93 req-197382bf-590d-463d-aac7-884247aaced5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.093331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df13ffb2-42ae-4ae9-9c16-075960190a93 req-197382bf-590d-463d-aac7-884247aaced5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.093766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df13ffb2-42ae-4ae9-9c16-075960190a93 req-197382bf-590d-463d-aac7-884247aaced5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.108319 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-df13ffb2-42ae-4ae9-9c16-075960190a93 req-197382bf-590d-463d-aac7-884247aaced5 service nova] Creating event network-vif-unplugged:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:08:24.114323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-df13ffb2-42ae-4ae9-9c16-075960190a93 req-197382bf-590d-463d-aac7-884247aaced5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038159 Oct 02 01:08:24.115532 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 859/1795] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:24.282081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.303493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:24.304552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:24.321385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.323054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.323746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.325134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.329468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.331666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.333065 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d33ee437-4895-4997-b77f-2641a6511352 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.656218 Oct 02 01:08:24.334131 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 937/1796] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:23 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:24.337970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.339279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.340390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:24.342135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:24.349674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.350172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.350634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.351327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:24.351991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:24.352459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:24.929784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.956540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.958075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.959358 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fad62cae-d7bb-47ae-a7cc-9e866afccea3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.842649 Oct 02 01:08:24.975241 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 860/1797] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:24 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:24.978430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:24.981595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-920e9550-5f45-4341-85c8-a9295c0c78fc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885636ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:24.988182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1f004104-ebb8-4971-8c48-05d582d1f22f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.652479 Oct 02 01:08:24.993480 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 938/1798] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:24 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:25.000555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}, {"name": "network-changed", "server_uuid": "04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342", "tag": "b36e4192-f4e3-4e22-90d4-be22b884336a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:25.016128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.016913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.017539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.044460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Creating event network-changed:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h1-master-1 Oct 02 01:08:25.046636 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Creating event network-changed:b36e4192-f4e3-4e22-90d4-be22b884336a for instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 on n-h2-master-1 Oct 02 01:08:25.054453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:08:25.086910 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0e50992c-c3f4-4dd8-a7c1-5fd990cfad52 req-74e97112-a0c7-4660-ac7e-69394abca6c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091889 Oct 02 01:08:25.088150 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 939/1799] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:25.099450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:25.109912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:25.131511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.132456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.133242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.134160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.134968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.135673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.203311 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-920e9550-5f45-4341-85c8-a9295c0c78fc tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-10-02T01%3A05%3A51Z" status: 200 len: 2375 microversion: 2.1 time: 0.224051 Oct 02 01:08:25.205107 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 861/1800] 10.222.0.23 () {58 vars in 1199 bytes} [Sun Oct 2 01:08:24 2022] GET /compute/v2.1/images?changes-since=2022-10-02T01%3A05%3A51Z => generated 2375 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:25.216355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:25.219635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:25.236314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.236824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.237259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.237976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.238427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.242722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.283098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a1f5999-94a7-4261-b00e-a37e36379a5a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "POST /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2/action" status: 202 len: 0 microversion: 2.1 time: 0.192493 Oct 02 01:08:25.285818 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 940/1801] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:08:25 2022] POST /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:25.297848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:25.298566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:25.315560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.316797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.317407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.318361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:25.319140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:25.319976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:25.327010 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:26.208080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:26.232031 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea72c7dd-1532-408e-8ec2-ddf29e07abfc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1305 microversion: 2.1 time: 1.022147 Oct 02 01:08:26.232750 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 862/1802] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:25 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1305 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:26.239710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3716332e-9413-4122-83a7-21b0d80b9bc1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855c4940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:26.267647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:26.304884 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fcbdf67-b904-4cb3-8cff-395c7a3a6ce5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 1.017114 Oct 02 01:08:26.305543 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 941/1803] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:25 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:26.321572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:26.321572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:26.331982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.332370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.332921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.333625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.334280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.335152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.376146 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3716332e-9413-4122-83a7-21b0d80b9bc1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-299105407" status: 200 len: 484 microversion: 2.1 time: 0.138978 Oct 02 01:08:26.377153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 863/1804] 10.222.0.23 () {58 vars in 1229 bytes} [Sun Oct 2 01:08:26 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-299105407 => generated 484 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:26.387733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:26.391089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:26.404129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.405536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.406821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.409049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.411519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.412506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.890541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:26.898562 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cdf02211-1224-40b3-9b3d-1ca452c35120 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1508 microversion: 2.1 time: 0.590666 Oct 02 01:08:26.899250 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 942/1805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:26 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1508 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:26.904527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:26.905289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:26.911527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.911959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.912403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.913231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.913860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.914299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.930437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:26.943045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:26.945320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:26.947057 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef413977-7330-4c40-a052-8c22d4c226d5 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.565865 Oct 02 01:08:26.959678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 864/1806] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:26 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:26.976765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:26.977734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:26.986208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.987163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.987836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:26.988854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:26.989652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:26.990643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:27.499034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:27.507776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:27.509198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:27.510367 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e21808c-471f-4186-b703-a9e60f3eb848 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.610147 Oct 02 01:08:27.510976 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 943/1807] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:26 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:27.515814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9596b7c-cb4c-443b-9898-e5ee2d70fba1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88550f5e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:27.524688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:27.533757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d56cdfab-95f8-44bd-9d6c-738a67aee007 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.572678 Oct 02 01:08:27.536028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 865/1808] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:26 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:27.546779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1254608082", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "891e10e4-4877-44c7-ac1b-d27f75a2886c"}], "security_groups": [{"name": "tempest-securitygroup--393371508"}], "key_name": "tempest-keypair-1806888045", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:27.634804 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f9596b7c-cb4c-443b-9898-e5ee2d70fba1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?server=24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 958 microversion: 2.1 time: 0.122531 Oct 02 01:08:27.635489 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 944/1809] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:08:27 2022] GET /compute/v2.1/images?server=24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 958 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:27.640928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:27.641661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:27.648997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:27.650046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:27.650722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:27.651665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:27.652355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:27.652996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:27.754272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] validate_networks() for [('891e10e4-4877-44c7-ac1b-d27f75a2886c', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:08:28.112406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:28.122257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9464c560-c3dd-4ca6-b837-6052b19dff7f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.485427 Oct 02 01:08:28.123576 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 945/1810] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:27 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:28.148054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:28.149017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:28.160673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.161468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.162534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.163589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.164351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.164947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.521863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:28.533673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7825ec7e-7f54-46af-974e-de07a284bcd2 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 0.408134 Oct 02 01:08:28.534329 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 946/1811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:28 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:28.556307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad90319e-4abf-467d-9894-53c85cd765ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881051d30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:28.616729 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad90319e-4abf-467d-9894-53c85cd765ac tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 484 microversion: 2.1 time: 0.068123 Oct 02 01:08:28.617640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 947/1812] 10.222.0.23 () {58 vars in 1317 bytes} [Sun Oct 2 01:08:28 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 484 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:28.628421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:28.628842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:28.635657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.636470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.636919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.637640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.638294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.639276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.920070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:08:28.920551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:08:28.921267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:08:28.922201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:08:28.922641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:08:28.933712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.934200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.934663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.936426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.937252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.937729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.978480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Getting quotas for project 76dd02a5b3d346168e6dde74ddb4d3e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:28.984326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Getting quotas for user a8ae1a9c7c164923840b20e32c471cf3 and project 76dd02a5b3d346168e6dde74ddb4d3e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:28.998837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:08:29.001153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:08:29.046689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.049771 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-989d2100-6f9d-4192-a707-7952e4a8e5d4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.513656 Oct 02 01:08:29.057476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 866/1813] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:08:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:08:29.063960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.064887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:29.074358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.075083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.075993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.077016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.077761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.078418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.086371 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b60f34b2-c197-423e-bd7d-424edbb14c90 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1513 microversion: 2.1 time: 0.461802 Oct 02 01:08:29.087196 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 948/1814] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:28 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1513 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.105564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.106219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:29.136599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.137299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.137945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.138868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.139512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.139937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.411865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.417656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.422498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.423979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.425307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d150194a-0774-4d94-8add-2e8aca623a69 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.336653 Oct 02 01:08:29.429115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.431930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.433631 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c829205d-7408-439c-8311-88ace0411162 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.374780 Oct 02 01:08:29.434622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 867/1815] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:29.440557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.441424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:29.442697 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 949/1816] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:29.448079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.448457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.448902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.449615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.450078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.450511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.451330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fc195fe-306c-4da8-bc38-a234d5848548 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855531f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.509052 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fc195fe-306c-4da8-bc38-a234d5848548 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 484 microversion: 2.1 time: 0.065079 Oct 02 01:08:29.509928 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 950/1817] 10.222.0.23 () {58 vars in 1303 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 484 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:29.521165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd7e10c0-51a0-4d68-964f-5f4bdc2ec874 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.522543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd7e10c0-51a0-4d68-964f-5f4bdc2ec874 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:29.591316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd7e10c0-51a0-4d68-964f-5f4bdc2ec874 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.600426 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd7e10c0-51a0-4d68-964f-5f4bdc2ec874 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1242 microversion: 2.1 time: 0.083341 Oct 02 01:08:29.601065 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 951/1818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.606192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.607044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:29.613256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.613949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.614385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.615304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.616039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.616473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.622069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.630407 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9917ea9f-9f18-4e7a-a424-34131edfded2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.194779 Oct 02 01:08:29.631027 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 868/1819] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.635403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5ccec05-6891-4a9f-bb31-115730b284ed tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885608f70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.750389 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5ccec05-6891-4a9f-bb31-115730b284ed tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.118295 Oct 02 01:08:29.751104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 869/1820] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.755675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.756295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:29.760935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.765001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.765562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.766003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.766893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:29.767360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:29.769542 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5957974e-ef3f-4163-a26a-7b781707dbd9 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.167135 Oct 02 01:08:29.770325 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 952/1821] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.781760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:29.788204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b883a408-810d-4faf-aa52-a43f25643f06 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885553dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.860317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b883a408-810d-4faf-aa52-a43f25643f06 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.076939 Oct 02 01:08:29.860914 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 953/1822] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.877212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1607445-9efa-4156-bd1c-1daaa14287da tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855b0dc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:29.928530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:29.933003 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d1607445-9efa-4156-bd1c-1daaa14287da tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.060872 Oct 02 01:08:29.933688 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 954/1823] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:08:29.939648 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c373208a-fadc-4f50-8fc5-f02e94de2524 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 0.187461 Oct 02 01:08:29.940219 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 870/1824] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:29.952687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-547be7fa-a97d-4576-85fe-200fa68f799c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88550f5e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.032440 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-547be7fa-a97d-4576-85fe-200fa68f799c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-10-02T01%3A05%3A46Z" status: 200 len: 6327 microversion: 2.1 time: 0.084254 Oct 02 01:08:30.033025 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 955/1825] 10.222.0.23 () {58 vars in 1220 bytes} [Sun Oct 2 01:08:29 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-02T01%3A05%3A46Z => generated 6327 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:30.052425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ca885e7-9eac-4c29-acc3-4cfb76e889f2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885608a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.099566 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ca885e7-9eac-4c29-acc3-4cfb76e889f2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-299105407" status: 200 len: 664 microversion: 2.1 time: 0.050874 Oct 02 01:08:30.100134 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 871/1826] 10.222.0.23 () {58 vars in 1250 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-299105407 => generated 664 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:30.110711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.111320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.115099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3f4adef-1015-4282-a726-7509b777a05e tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8856305e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.117475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.117957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.118388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.119104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.119559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.119988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.165628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3f4adef-1015-4282-a726-7509b777a05e tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1464 microversion: 2.1 time: 0.054083 Oct 02 01:08:30.166197 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 872/1827] 10.222.0.23 () {58 vars in 1338 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1464 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:30.181148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63b068ee-681f-4a04-bff6-e997f3f77fcf tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8856088b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.232634 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63b068ee-681f-4a04-bff6-e997f3f77fcf tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1464 microversion: 2.1 time: 0.055078 Oct 02 01:08:30.233552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 873/1828] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:30.249346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39f612f2-2088-4428-a04c-24c632e85942 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8856e38b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.256215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.264827 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa7d10d1-6d65-4489-9b59-c165cd8cc8a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1506 microversion: 2.1 time: 0.158361 Oct 02 01:08:30.265397 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 956/1829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:30.287239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '.version_select at 0x7fb885528280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.287790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.293816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.294289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.294750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.295491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.295885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.296302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.328261 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a168adaa-e887-4acf-a14b-f61ffa1b33b3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.044789 Oct 02 01:08:30.328974 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 957/1830] 10.222.0.23 () {58 vars in 1296 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2/os-instance-actions => generated 611 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:08:30.334548 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39f612f2-2088-4428-a04c-24c632e85942 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.089185 Oct 02 01:08:30.335155 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 874/1831] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:30.345042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.345042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.348221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.350067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.350067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.350290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.350707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.351135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.355415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6013b788-a270-4a3e-91a2-380d2c029750 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855c4550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.381715 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:30.422790 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6013b788-a270-4a3e-91a2-380d2c029750 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.071143 Oct 02 01:08:30.423440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 875/1832] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:30.441025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dbbf1bb6-fe61-4545-a1d8-3e979d15a4c1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855c4790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.461073 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5b8f3ae1-a30a-4773-a889-261e6a90793f tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "DELETE /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 204 len: 0 microversion: 2.1 time: 0.123539 Oct 02 01:08:30.461667 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 958/1833] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:30 2022] DELETE /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:30.466699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.467490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.473355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.473842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.474276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.475011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.475471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.475894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.486474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dbbf1bb6-fe61-4545-a1d8-3e979d15a4c1 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/d452563b-d97f-4ef2-b927-770421bd0406" status: 200 len: 784 microversion: 2.1 time: 0.049930 Oct 02 01:08:30.487111 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 876/1834] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/d452563b-d97f-4ef2-b927-770421bd0406 => generated 784 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:30.491636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.492247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.501991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.502474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.503033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.503758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.504210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.504810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.695826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.705598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.707072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.708258 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d8e5f28-05dc-448a-93b2-710940bc27dd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.245525 Oct 02 01:08:30.709014 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 959/1835] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:30.713669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.714274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.720372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.720858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.721465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.722448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.722934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.723362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.733471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.743697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.745124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.746277 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1042622-1bad-4eb8-8f64-b58123423149 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.258287 Oct 02 01:08:30.746869 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 877/1836] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:30.752055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a46e2e5d-b585-4ce7-98b5-43111598463c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb881451550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.815185 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a46e2e5d-b585-4ce7-98b5-43111598463c tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.066503 Oct 02 01:08:30.815766 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 878/1837] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:30.821079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.821862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.829970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.830384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.830840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.831534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.832182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.832647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.855408 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:30.890196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.899837 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c098b9b-1b2e-4f72-ae1f-d25ca3db6c6d tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1512 microversion: 2.1 time: 0.189620 Oct 02 01:08:30.900422 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 960/1838] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:30.914899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:30.915165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.915165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.915165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.915165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.915165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.915165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.915650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5c516ac-51a8-4bc1-9ca0-800857e87b81 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1246 microversion: 2.1 time: 0.098288 Oct 02 01:08:30.915752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.915915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.918787 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 879/1839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:30.925099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:30.925720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:30.938495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.939138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.939678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.940510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.941133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.941905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.318042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:31.325888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-76a52010-f303-4814-90e1-0210519bc691 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.424419 Oct 02 01:08:31.327493 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 961/1840] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:31.331378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:31.332971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77d5483f-e329-4a09-89aa-2de2d0f96162 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885508ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:31.339800 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ddc21ff-863a-4e4b-a0f8-c37846021d75 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.419756 Oct 02 01:08:31.341214 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 880/1841] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:30 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:31.348428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:31.348593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:31.356567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.356731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.357045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.357795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.358335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.358792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.500429 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:31.508630 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39bd2347-5244-4c70-badf-0fc8f6f5ec0f tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1469 microversion: 2.1 time: 0.165984 Oct 02 01:08:31.509128 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 881/1842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:31 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:31.737774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:31.738416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:31.744915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.745403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.745844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.746624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.747104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.747528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.956232 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-77d5483f-e329-4a09-89aa-2de2d0f96162 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc" status: 204 len: 0 microversion: 2.1 time: 0.627362 Oct 02 01:08:31.957720 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 962/1843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:31 2022] DELETE /compute/v2.1/images/b42830f0-ba79-4147-9ce3-8e831df0d6cc => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:31.966460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:31.969285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:31.985626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.989575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.990282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.993259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.994335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.996720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.052109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.072811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.077211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.078868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17acff85-740f-4b49-9a51-462979ef56fc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.345518 Oct 02 01:08:32.079996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 882/1844] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:31 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:32.102464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:32.103412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:32.114649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.115386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.115871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.116596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.117166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.117631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.442874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.455165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.456648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.460155 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5b7eda4f-7eb7-4241-bb2b-f8ffcad5a9f2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.497854 Oct 02 01:08:32.480497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 963/1845] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:31 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:32.480873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.482110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:32.484803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:32.490892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c9a2732-c4f9-4882-a95a-f36b4135060a tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1512 microversion: 2.1 time: 0.409579 Oct 02 01:08:32.497735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.507025 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 883/1846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:32 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:32.514856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c4302457-9e2d-4d3e-9e7e-5bdc9d98bfeb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8855d8a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:32.518309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.521507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.524788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.525439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.525976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.550145 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:32.616659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.625448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8d9a5d2-87ad-4e18-a135-3bc956692eed tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1294 microversion: 2.1 time: 0.156933 Oct 02 01:08:32.626312 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 964/1847] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:32 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:32.631918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:32.632828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:32.640120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.640863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.641297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.641998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.642443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.643065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.806127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.815939 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9c53f37-e49e-4727-9145-c74730bbf2c7 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.187713 Oct 02 01:08:32.823671 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 965/1848] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:32 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:32.834470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:32.835088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:32.842368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.842981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.843499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.844302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.844962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.845475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.069224 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c4302457-9e2d-4d3e-9e7e-5bdc9d98bfeb tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b" status: 204 len: 0 microversion: 2.1 time: 0.560936 Oct 02 01:08:33.069835 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 884/1849] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:32 2022] DELETE /compute/v2.1/images/88119f8b-70ac-4bd5-87fe-0e3c168b373b => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:33.079311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:33.080664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:33.089186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.090103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.090828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.092400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.093107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.093975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.164589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:33.174130 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9adeee82-d403-499a-87f9-506d5d5e63c1 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.346507 Oct 02 01:08:33.190937 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 966/1850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:32 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:33.196885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e13c8c90-0447-4b47-8908-354c9029b961 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb88552e1f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:33.456657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:33.467477 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a728f8d-8916-4386-97ce-594d99b154f8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1462 microversion: 2.1 time: 0.393003 Oct 02 01:08:33.473583 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 885/1851] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:33 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1462 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:33.480524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:33.481966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:33.490837 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:33.492442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.492909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.493872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.495065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.495737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.496700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.666119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e13c8c90-0447-4b47-8908-354c9029b961 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a" status: 204 len: 0 microversion: 2.1 time: 0.473604 Oct 02 01:08:33.666729 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 967/1852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:33 2022] DELETE /compute/v2.1/images/a425ecfd-d6e9-496e-b992-e0a11aaddb7a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:33.671372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:33.671986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:33.678166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.678710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.679124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.680016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.680480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.680902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.423392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.433454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.435337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.437961 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ff98b42-0eef-48d9-b548-6f2c05e36dfd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.961856 Oct 02 01:08:34.438770 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 886/1853] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:33 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:34.446721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-45f7ec4c-27cd-4789-9ce2-55049ce68db6 req-01cfa690-c961-4bf0-b5e9-01e5264e9230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458d4fea-512b-4a99-8b13-647e57ef0c93", "name": "network-vif-unplugged", "status": "completed", "tag": "1f80054f-e9ef-427a-a9f7-7d7d79b7a14e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:34.459553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-45f7ec4c-27cd-4789-9ce2-55049ce68db6 req-01cfa690-c961-4bf0-b5e9-01e5264e9230 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.460032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-45f7ec4c-27cd-4789-9ce2-55049ce68db6 req-01cfa690-c961-4bf0-b5e9-01e5264e9230 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.460460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-45f7ec4c-27cd-4789-9ce2-55049ce68db6 req-01cfa690-c961-4bf0-b5e9-01e5264e9230 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.475219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-45f7ec4c-27cd-4789-9ce2-55049ce68db6 req-01cfa690-c961-4bf0-b5e9-01e5264e9230 service nova] Creating event network-vif-unplugged:1f80054f-e9ef-427a-a9f7-7d7d79b7a14e for instance 458d4fea-512b-4a99-8b13-647e57ef0c93 on n-h1-master-1 Oct 02 01:08:34.480662 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-45f7ec4c-27cd-4789-9ce2-55049ce68db6 req-01cfa690-c961-4bf0-b5e9-01e5264e9230 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039749 Oct 02 01:08:34.481481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 887/1854] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:34.487189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:34.488574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:34.494883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.495368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.495982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.496681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.497133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.497552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.539006 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.549713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.551476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.552857 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3d68e11-a7fc-4921-9626-f4db2ed81d14 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.885199 Oct 02 01:08:34.553437 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 968/1855] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:33 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:34.570502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:34.573666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:34.580755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.581251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.581693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.582438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.582925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.583350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.991275 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf1330c0-f1c4-4639-917d-ab602ec51d18 tempest-MigrationsAdminTest-755750085 tempest-MigrationsAdminTest-755750085-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1613 microversion: 2.1 time: 0.508527 Oct 02 01:08:34.991869 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 888/1856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:34 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1613 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:34.998396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:34.999294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.005604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.006454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.007078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.007976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.008602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.009185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.040827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:35.052739 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8139a45a-f841-4c28-8db1-edc5a730a3a5 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1512 microversion: 2.1 time: 0.489743 Oct 02 01:08:35.055835 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 969/1857] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:34 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:35.061633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.062847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.070916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.072147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.072781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.073761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.074213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.074686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.105171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:35.149186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:35.161611 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d741880-9548-455f-bfb3-7980de7a27f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1300 microversion: 2.1 time: 0.168094 Oct 02 01:08:35.162970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 889/1858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:34 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:35.168180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.169279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.176839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.177712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.178441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.179796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.180545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.181252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.213960 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c304d5bb-0c2c-4cdd-9f6a-f8611fa3af64 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 204 len: 0 microversion: 2.1 time: 0.156613 Oct 02 01:08:35.215769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 970/1859] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:35 2022] DELETE /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:35.224937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.225867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.232036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.232795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.233505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.234282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.234796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.235247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.706570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:35.710101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:35.719470 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6f8d0a1-2de4-4042-806d-b6f58fef6bd4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.555175 Oct 02 01:08:35.720466 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 890/1860] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:35 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:35.722521 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40bc0beb-0481-4d24-893e-c4b07c726dac tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.505216 Oct 02 01:08:35.723113 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 971/1861] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:35 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:35.728527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.729303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.736210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.736477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.737051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.737243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.737817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.738783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.739406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.739878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.747542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.748164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.748827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.749545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.750186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.750829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.780509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:35.881255 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-497571c6-dd53-43b2-b9a1-eb1b2b1ae05e tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 204 len: 0 microversion: 2.1 time: 0.159291 Oct 02 01:08:35.882232 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 891/1862] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:35 2022] DELETE /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:35.888711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.889583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.896751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.897281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.897723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.898432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.899054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.899539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.034100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.044272 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e51d110c-419c-4f38-9662-b8837fe18add tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1474 microversion: 2.1 time: 0.319736 Oct 02 01:08:36.046408 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 972/1863] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:35 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:36.053687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:36.054616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:36.063918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.064437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.065008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.065914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.066694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.067273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.120783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.131817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.134088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.135628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-719398f4-103e-4022-a9a2-dfe8ef4bef9b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.252273 Oct 02 01:08:36.136423 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 892/1864] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:35 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:36.141349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:36.141952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:36.148564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.149050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.149491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.150172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.166770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.167473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.341320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.352829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.354550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.356048 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82aa1d8c-c3aa-46a7-b401-cbb61f2a6913 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.308224 Oct 02 01:08:36.356610 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 973/1865] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:36 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:36.362418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:36.366260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.368351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:36.376642 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88333806-7726-44b7-ab24-9ec7a12ec27b tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1468 microversion: 2.1 time: 0.238915 Oct 02 01:08:36.377271 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 893/1866] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:36 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1468 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:36.377643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.378312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.378713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.379463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.379921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.380356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.383555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:36.384366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:36.393165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.393721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.394324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.395302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.395763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.396188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.463791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26941bac262b4d78a1dc6f5f07c29b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.473098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-348e6f78-004d-4219-a085-fe678dea64f3 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 200 len: 1470 microversion: 2.1 time: 0.114490 Oct 02 01:08:36.473909 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 974/1867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:36 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 1470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:36.524533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458d4fea-512b-4a99-8b13-647e57ef0c93", "tag": "1f80054f-e9ef-427a-a9f7-7d7d79b7a14e"}, {"server_uuid": "75c3ba73-c816-4229-ab88-94fb769ab4c2", "name": "network-vif-deleted", "tag": "fbbc20bd-cce7-4e5d-8025-34e6c4b1da4c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:36.538308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.539025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.539633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.554617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] Creating event network-changed:1f80054f-e9ef-427a-a9f7-7d7d79b7a14e for instance 458d4fea-512b-4a99-8b13-647e57ef0c93 on n-h1-master-1 Oct 02 01:08:36.557650 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] Creating event network-vif-deleted:fbbc20bd-cce7-4e5d-8025-34e6c4b1da4c for instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 on n-h2-master-1 Oct 02 01:08:36.558263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.567410 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f3656e6d-564a-44b0-9d9f-9cbdd33ab5c2 req-6e28ede0-daec-49bf-bebd-5c67dd94ccfa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047590 Oct 02 01:08:36.568076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 975/1868] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:08:36.568515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60d22480-5053-460d-8651-0464456f1803 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.189217 Oct 02 01:08:36.569245 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 894/1869] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:36 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:36.746355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:36.747098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:36.748675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:36.749350 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:36.749475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:36.754645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.755137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.755574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.756315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.756971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.757399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.757511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.758103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.758895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.760081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:36.760537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:36.761003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:36.960080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.972276 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d5a9dab-c343-4224-b421-fb82b3784756 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.228590 Oct 02 01:08:36.972887 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 895/1870] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:36 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:36.984240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.995060 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-07da4c4e-1d99-4699-92ab-3b75b12bb9a2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.253069 Oct 02 01:08:36.995565 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 976/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:36 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:37.080898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:37.081713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:37.091549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.095064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.095675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.097869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.100655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.101304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.141540 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:37.168692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:37.169613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:37.177848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.178460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.179038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.179865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.180596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.181167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.621365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:37.628560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:37.630120 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2612a673-636d-4377-874a-32457871bbf2 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1474 microversion: 2.1 time: 0.554325 Oct 02 01:08:37.642665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 896/1872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:37 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1474 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:37.642665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6b81ebe3-86ed-4b71-8cfe-dffbec239dcc req-1234d5eb-1cea-48d5-9a67-eb3bfbf94738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342", "name": "network-vif-plugged", "status": "completed", "tag": "b36e4192-f4e3-4e22-90d4-be22b884336a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:37.645934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6b81ebe3-86ed-4b71-8cfe-dffbec239dcc req-1234d5eb-1cea-48d5-9a67-eb3bfbf94738 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.646417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6b81ebe3-86ed-4b71-8cfe-dffbec239dcc req-1234d5eb-1cea-48d5-9a67-eb3bfbf94738 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.646875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6b81ebe3-86ed-4b71-8cfe-dffbec239dcc req-1234d5eb-1cea-48d5-9a67-eb3bfbf94738 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.651272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:37.653417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:37.656537 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-749cc6cf-ed4f-4bf5-9565-c32e97b53290 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.491791 Oct 02 01:08:37.657124 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 977/1873] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:37 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:08:37.663053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:37.663674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:37.668749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6b81ebe3-86ed-4b71-8cfe-dffbec239dcc req-1234d5eb-1cea-48d5-9a67-eb3bfbf94738 service nova] Creating event network-vif-plugged:b36e4192-f4e3-4e22-90d4-be22b884336a for instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 on n-h2-master-1 Oct 02 01:08:37.672544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.673289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.673913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.675380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.675525 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6b81ebe3-86ed-4b71-8cfe-dffbec239dcc req-1234d5eb-1cea-48d5-9a67-eb3bfbf94738 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042836 Oct 02 01:08:37.676700 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 897/1874] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:37.676833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.676833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.681172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:37.681878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:37.688573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.689062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.689491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.690190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.690665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.691092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.481021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:38.492165 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-145a014f-f2b8-486c-ad55-5fc6d3271554 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1468 microversion: 2.1 time: 0.814868 Oct 02 01:08:38.493703 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 898/1875] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:37 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1468 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:38.500435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:38.506354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:38.512336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:38.513319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] [instance: 75c3ba73-c816-4229-ab88-94fb769ab4c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:38.517780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:38.518996 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5884d5aa-e787-4c26-a472-7b7be53a287b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.860745 Oct 02 01:08:38.530054 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 978/1876] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:37 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:38.530054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:38.530054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:38.532812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.533308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.533768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.534502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.535294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.535718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.543938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.544428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.550347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.551372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.551841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.552469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.559230 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] HTTP exception thrown: Instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 could not be found. Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Request method failure captured: Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 HTTP/1.1 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOORnWU8hMtFsMiQ1A5kbxSxf7fED-8QtTVoALYYKZRCx4PjpauQ4YJZXLKnrxr_D8435PWWCFyR2IeKIRonhO3mruMG2C6Ghhmdi9vor-tcHlgb5IExtiEKlZZRZAD1g_FAbh-Uhe1JNerMEWcMWgwikf3-xYOPCi9Fbe7bq6OW3dTg Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 54fc9ec957ec4fa8a613c8f90a5a6bc5 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-InstanceActionsTestJSON-70979408 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/54fc9ec957ec4fa8a613c8f90a5a6bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54fc9ec957ec4fa8a613c8f90a5a6bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/54fc9ec957ec4fa8a613c8f90a5a6bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_54fc9ec957ec4fa8a613c8f90a5a6bc5"}]}] Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-InstanceActionsTestJSON-70979408 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 54fc9ec957ec4fa8a613c8f90a5a6bc5 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-InstanceActionsTestJSON-70979408 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-InstanceActionsTestJSON-70979408-project Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 26941bac262b4d78a1dc6f5f07c29b91 Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-InstanceActionsTestJSON-70979408-project Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 could not be found. Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '75c3ba73-c816-4229-ab88-94fb769ab4c2'} Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 could not be found. Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 could not be found. Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:38.562391 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 could not be found. Oct 02 01:08:38.569454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:38.571601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] Returning 404 to user: Instance 75c3ba73-c816-4229-ab88-94fb769ab4c2 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:08:38.572631 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-489ff2d4-ed90-44bc-9d52-3bc56bd9b2b7 tempest-InstanceActionsTestJSON-70979408 tempest-InstanceActionsTestJSON-70979408-project] 10.222.0.23 "GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2" status: 404 len: 111 microversion: 2.1 time: 0.077838 Oct 02 01:08:38.578070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 899/1877] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:38 2022] GET /compute/v2.1/servers/75c3ba73-c816-4229-ab88-94fb769ab4c2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:38.580225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:38.581244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:38.588170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.588852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.589293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.590152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.591016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.591426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.955977 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:38.992354 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:39.089778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.101091 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bd94bfc7-822e-49de-9bb3-29b727e9af86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.578767 Oct 02 01:08:39.101667 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 979/1878] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:38 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:39.105174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.118095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:39.118730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:39.126695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a428134d-7c6a-497a-8924-ba830bb91092 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1293 microversion: 2.1 time: 0.551609 Oct 02 01:08:39.129042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.129700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.130349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.131269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.131725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.132149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.138763 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 900/1879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:38 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1293 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:39.146326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:39.148279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:39.160611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.165090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.165914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.166873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.167532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.167967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.307696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.320257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0d9d614-9397-49b3-b4a3-758a33349e8a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1432 microversion: 2.1 time: 0.179433 Oct 02 01:08:39.321358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 901/1880] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:39 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1432 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:39.326953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:39.327437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:39.335090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.335791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.336301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.337175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.337865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.338733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.535681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.542729 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:39.550005 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ec2a023-07c5-4318-b331-f2bd452abe70 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.447095 Oct 02 01:08:39.566755 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 980/1881] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:39 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:39.572175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-61d63c16-5893-4e0d-8d5f-9e1648c3e409 req-ae133aec-81f6-4f70-8c53-65300321ce08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c6d9e-2d3c-48cf-a06b-8445139851c7", "name": "network-vif-deleted", "tag": "b7920716-d29c-43db-8bf3-9ea1bfa90027"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:39.583797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-61d63c16-5893-4e0d-8d5f-9e1648c3e409 req-ae133aec-81f6-4f70-8c53-65300321ce08 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.584624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-61d63c16-5893-4e0d-8d5f-9e1648c3e409 req-ae133aec-81f6-4f70-8c53-65300321ce08 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.585383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-61d63c16-5893-4e0d-8d5f-9e1648c3e409 req-ae133aec-81f6-4f70-8c53-65300321ce08 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.598311 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:39.601993 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-61d63c16-5893-4e0d-8d5f-9e1648c3e409 req-ae133aec-81f6-4f70-8c53-65300321ce08 service nova] Creating event network-vif-deleted:b7920716-d29c-43db-8bf3-9ea1bfa90027 for instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 on n-h1-master-1 Oct 02 01:08:39.622512 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-61d63c16-5893-4e0d-8d5f-9e1648c3e409 req-ae133aec-81f6-4f70-8c53-65300321ce08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054181 Oct 02 01:08:39.629569 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 981/1882] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:39.636042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-544b45f1-473d-42ea-8981-864aee4825ad req-ca8d10f6-94f9-4fa0-94bd-385158b9af13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9a9004-7066-456c-8c1b-99e03b63b2e7", "name": "network-vif-deleted", "tag": "299976b2-a154-4fee-9940-050f8ca7645b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:39.648881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-544b45f1-473d-42ea-8981-864aee4825ad req-ca8d10f6-94f9-4fa0-94bd-385158b9af13 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.649370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-544b45f1-473d-42ea-8981-864aee4825ad req-ca8d10f6-94f9-4fa0-94bd-385158b9af13 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.649797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-544b45f1-473d-42ea-8981-864aee4825ad req-ca8d10f6-94f9-4fa0-94bd-385158b9af13 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.661872 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-544b45f1-473d-42ea-8981-864aee4825ad req-ca8d10f6-94f9-4fa0-94bd-385158b9af13 service nova] Creating event network-vif-deleted:299976b2-a154-4fee-9940-050f8ca7645b for instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 on n-h2-master-1 Oct 02 01:08:39.667430 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-544b45f1-473d-42ea-8981-864aee4825ad req-ca8d10f6-94f9-4fa0-94bd-385158b9af13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036221 Oct 02 01:08:39.668586 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 982/1883] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:39.674869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:39.675896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:39.683321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.684108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.684556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.685967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.686737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.687605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.723140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.723837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.724280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.724730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lazy-loading 'fault' on Instance uuid e57c6d9e-2d3c-48cf-a06b-8445139851c7 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:39.730772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.741162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.742789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.744336 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df1315f3-284e-4b82-94d1-da5f4cdbf229 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.421717 Oct 02 01:08:39.754662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 902/1884] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:39 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:39.754662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:39.754662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:39.762656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.762656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.762656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.762656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.762656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.762656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.811814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.820330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0eb9b448-4727-4000-9aa8-be07a9352fad tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 200 len: 1303 microversion: 2.1 time: 0.150284 Oct 02 01:08:39.821241 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 983/1885] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:39 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:40.127142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.127996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.133993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.134484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.134976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.135693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.136340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.136799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.149731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.163018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.171586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.172881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12c58a9e-e26b-4b79-a8c4-e072bc461d67 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.426332 Oct 02 01:08:40.176667 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 903/1886] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:39 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:40.181744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.182352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.193991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.194620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.195267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.196081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.196644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.197278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.565305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.573175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b95996b2-8651-40a6-8cf5-425c5d8130f6 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.451670 Oct 02 01:08:40.573759 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 984/1887] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:40.578764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.579504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.585336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.585827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.586262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.586999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.587439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.587861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.593441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.602091 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-faed637e-2094-4fba-96f4-64f3418ec0d5 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1484 microversion: 2.1 time: 0.424022 Oct 02 01:08:40.604124 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 904/1888] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1484 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:40.612619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.623844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.627574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.628184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.628692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.629279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lazy-loading 'fault' on Instance uuid 8c9a9004-7066-456c-8c1b-99e03b63b2e7 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:40.644214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.644736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.645204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.645951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.646412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.646921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.703220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.712560 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-062a48db-39e2-418d-8a3c-218315990149 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 200 len: 1308 microversion: 2.1 time: 0.137716 Oct 02 01:08:40.714856 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 985/1889] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 1308 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:40.719398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.720044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.727572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.728188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.728718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.730428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.731035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.731675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.884251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d52cf134-62dd-45db-adf1-666c716c4fca tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169804 Oct 02 01:08:40.884970 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 986/1890] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:40.894073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.894359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.901235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.901726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.902410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.904203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.906501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.907148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.910800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.934165 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b7afa66-dcaf-44e5-b2a4-a5fdafcbb232 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.329057 Oct 02 01:08:40.942879 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 905/1891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:40.948006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.948612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e57c6d9e-2d3c-48cf-a06b-8445139851c7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.960493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.961929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.962675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.964139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.965309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.965963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.983582 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] HTTP exception thrown: Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 could not be found. Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Request method failure captured: Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 HTTP/1.1 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLsFzhTkErIiIWDFyJEkHFBWLIHW_LUjnuzmGmCCQ5OiD61JyjwPit4Oz76to2CLhRYJQnIRGCtTSH-x6SHNTG8Oz4B3KyfUu0ec_t_j4nucM3kvcAHajX_M-Ml5U8XSPFDkBrQ1OpNrRj6ngIyfnrjqo9U3ASOX3LJFlnMP7G8PUM Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0e072a3f56045949210c8d4452298ce"}]}] Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 739083b66f9b433889944e555b0aef23 Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: exception: Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 could not be found. Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'e57c6d9e-2d3c-48cf-a06b-8445139851c7'} Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 could not be found. Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 could not be found. Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:40.985134 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 could not be found. Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Returning 404 to user: Instance e57c6d9e-2d3c-48cf-a06b-8445139851c7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-966f236e-d895-47d8-84d1-d8d10fca9b25 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7" status: 404 len: 111 microversion: 2.1 time: 0.042256 Oct 02 01:08:40.989828 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 906/1892] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/e57c6d9e-2d3c-48cf-a06b-8445139851c7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:40.996424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.996920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.003764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.004578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.005456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.006407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.007145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.007788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.035871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:41.131379 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a78e95b-7792-462c-8cd6-37dc8b215371 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 204 len: 0 microversion: 2.1 time: 0.139492 Oct 02 01:08:41.132547 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 907/1893] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:40 2022] DELETE /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:41.141304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:41.142010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.148722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.149447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.150220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.151152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.151774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.152362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.175530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.189094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.192856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.194405 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbf4e41e-af8d-441d-a74c-cec9b3a8f845 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.306504 Oct 02 01:08:41.195231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 987/1894] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:41.204864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:41.205783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.214960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.215786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.216428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.218420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.219135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.219765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.771024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.780044 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54e90030-b661-4566-8f7a-e96f84d66577 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1534 microversion: 2.1 time: 0.643126 Oct 02 01:08:41.781058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 908/1895] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:41 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1534 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:41.786334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:41.787200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.793372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.799593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.800281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.801082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.801818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.802310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.841682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.852522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.854211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.855883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2107fa04-d019-40a3-a739-97460c4c5659 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.655252 Oct 02 01:08:41.856848 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 988/1896] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:41 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:08:41.862318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e9a27c81-b095-4b42-832e-8968af3b9c49 req-75a51675-87c8-495e-b2aa-e9aa56b890f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e806fe-2261-4f84-a359-763dcf320803", "tag": "b400d3a7-3f20-475f-abc5-2148f7e6d67b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:41.872267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e9a27c81-b095-4b42-832e-8968af3b9c49 req-75a51675-87c8-495e-b2aa-e9aa56b890f6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.873547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e9a27c81-b095-4b42-832e-8968af3b9c49 req-75a51675-87c8-495e-b2aa-e9aa56b890f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.874489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e9a27c81-b095-4b42-832e-8968af3b9c49 req-75a51675-87c8-495e-b2aa-e9aa56b890f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.886092 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e9a27c81-b095-4b42-832e-8968af3b9c49 req-75a51675-87c8-495e-b2aa-e9aa56b890f6 service nova] Creating event network-changed:b400d3a7-3f20-475f-abc5-2148f7e6d67b for instance 79e806fe-2261-4f84-a359-763dcf320803 on n-h1-master-1 Oct 02 01:08:41.892118 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e9a27c81-b095-4b42-832e-8968af3b9c49 req-75a51675-87c8-495e-b2aa-e9aa56b890f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Oct 02 01:08:41.892962 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 989/1897] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:41.897983 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:41.899819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 8c9a9004-7066-456c-8c1b-99e03b63b2e7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.907538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.908313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.908960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.909733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.910392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.911049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.925081 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] HTTP exception thrown: Instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 could not be found. Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Request method failure captured: Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 HTTP/1.1 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOPp9Vd0eloLU_9HxSaeJrRRKt7PU3WKA-qG4xtc1uLCApwHzoQZTjBdP7ZBYdSKdw_g9xYPJHK9C8mtyhVuEPO8gIIG5yfuP3wc_avCOW7OP8LQGndFmEz3lHshgdIpWbks-_Vyv4BowbV8yjWLu3GozvafviNcidQOVXTaeCDzwbs Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7c58ca9b345e41538c7adb8abde0773f Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListImageFiltersTestJSON-834851447 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c58ca9b345e41538c7adb8abde0773f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c58ca9b345e41538c7adb8abde0773f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c58ca9b345e41538c7adb8abde0773f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c58ca9b345e41538c7adb8abde0773f"}]}] Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListImageFiltersTestJSON-834851447 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7c58ca9b345e41538c7adb8abde0773f Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-834851447 Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListImageFiltersTestJSON-834851447-project Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: d141ea927c214f978ffdc50892a0dc3c Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListImageFiltersTestJSON-834851447-project Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 could not be found. Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '8c9a9004-7066-456c-8c1b-99e03b63b2e7'} Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 could not be found. Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 could not be found. Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:41.927099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 could not be found. Oct 02 01:08:41.932440 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:41.933776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Returning 404 to user: Instance 8c9a9004-7066-456c-8c1b-99e03b63b2e7 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:08:41.934845 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46838850-daba-4966-b696-62b6a797fb9b tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7" status: 404 len: 111 microversion: 2.1 time: 0.040869 Oct 02 01:08:41.936127 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 990/1898] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:41 2022] GET /compute/v2.1/servers/8c9a9004-7066-456c-8c1b-99e03b63b2e7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:41.944335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:41.945167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.952162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.952910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.953751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.954844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.956205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.956933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.991023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:42.088566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:42.118220 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5da8b63-0682-4457-8b1f-44fa9626649a tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 204 len: 0 microversion: 2.1 time: 0.176822 Oct 02 01:08:42.119151 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 991/1899] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:41 2022] DELETE /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:42.119516 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6554f72a-98f9-4672-8e31-f7889fb01595 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.337070 Oct 02 01:08:42.120634 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 909/1900] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:41 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:42.125324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:42.126293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:42.127045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:42.127986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:42.136583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.137371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.138389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.140203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.141402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.141940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.144640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.145719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.151881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.152902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.153595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.154309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.473612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:42.481714 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1ecd9a9-e238-41f3-b43a-6f8805afd9fc tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1484 microversion: 2.1 time: 0.359891 Oct 02 01:08:42.500143 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 910/1901] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:42 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1484 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:42.505322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2d4147eb-82ba-49b8-9d7f-474fc17f5e5e req-50b680b0-9073-48b4-bca0-6cac2a4b0d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342", "tag": "b36e4192-f4e3-4e22-90d4-be22b884336a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:42.516327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d4147eb-82ba-49b8-9d7f-474fc17f5e5e req-50b680b0-9073-48b4-bca0-6cac2a4b0d92 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.517160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d4147eb-82ba-49b8-9d7f-474fc17f5e5e req-50b680b0-9073-48b4-bca0-6cac2a4b0d92 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.517873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d4147eb-82ba-49b8-9d7f-474fc17f5e5e req-50b680b0-9073-48b4-bca0-6cac2a4b0d92 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.529831 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2d4147eb-82ba-49b8-9d7f-474fc17f5e5e req-50b680b0-9073-48b4-bca0-6cac2a4b0d92 service nova] Creating event network-changed:b36e4192-f4e3-4e22-90d4-be22b884336a for instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 on n-h2-master-1 Oct 02 01:08:42.535807 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2d4147eb-82ba-49b8-9d7f-474fc17f5e5e req-50b680b0-9073-48b4-bca0-6cac2a4b0d92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033989 Oct 02 01:08:42.536753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 911/1902] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:42.543366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:42.544414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:42.552537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.553423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.553927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.554908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.555579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.556238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.620267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:42.631133 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8cc3d39a-36e9-41bb-ba57-c428e21ad0ac tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.510279 Oct 02 01:08:42.633189 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 992/1903] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:42 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:42.638278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:42.639592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:42.647201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.647692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.648124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.648823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.649278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.649706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.960950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:42.971422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:42.988184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c44ec1c8-2375-4d66-a229-a193aae2c3d5 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 1473 microversion: 2.1 time: 0.449986 Oct 02 01:08:42.989374 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 912/1904] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:42 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 1473 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:42.994187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3c49e430-6bf3-4626-8acf-f5726d339bf7 req-9a736cf0-684c-4f9a-a36b-1a759faf3f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:43.001109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.008859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.010169 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5651c243-572a-46f3-ba48-83129624a02a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.376004 Oct 02 01:08:43.010972 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 993/1905] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:42 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:43.012714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3c49e430-6bf3-4626-8acf-f5726d339bf7 req-9a736cf0-684c-4f9a-a36b-1a759faf3f73 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.014427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3c49e430-6bf3-4626-8acf-f5726d339bf7 req-9a736cf0-684c-4f9a-a36b-1a759faf3f73 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.014959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3c49e430-6bf3-4626-8acf-f5726d339bf7 req-9a736cf0-684c-4f9a-a36b-1a759faf3f73 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.017380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:43.018242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:43.027137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.028035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.029121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.030409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.032120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.032937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.035517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3c49e430-6bf3-4626-8acf-f5726d339bf7 req-9a736cf0-684c-4f9a-a36b-1a759faf3f73 service nova] Creating event network-vif-plugged:b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:43.044005 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3c49e430-6bf3-4626-8acf-f5726d339bf7 req-9a736cf0-684c-4f9a-a36b-1a759faf3f73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053286 Oct 02 01:08:43.044775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 913/1906] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:43.050539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:43.051165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:43.058983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.058983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.059365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.060122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.061192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.061813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.089979 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:43.526043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.536711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.538653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.540055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-addeeb50-77bc-4a24-afa6-baa312b35abc tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.493847 Oct 02 01:08:43.558877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.560333 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 914/1907] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:43 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:43.566401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:43.566628 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0bdef1b9-584c-43a8-ab04-e58401e5a7a8 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1534 microversion: 2.1 time: 0.554286 Oct 02 01:08:43.567476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:43.571912 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 994/1908] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:43 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1534 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:43.575334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.576102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.576606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.577385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.577925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.578416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.657714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:43.658340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:43.666422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.670994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.671443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.672174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:43.672631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:43.673058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.950890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.959992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05e05b33-8baa-49d6-8a76-6bc07ee631d1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.397612 Oct 02 01:08:43.960649 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 915/1909] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:43 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:44.013289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:44.014434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:44.025544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:44.026158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:44.026589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:44.027523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:44.028722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:44.030053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:44.056509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:44.065362 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68d0f5de-efae-4d22-a4a3-bb6debaa7f0a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.412992 Oct 02 01:08:44.079096 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 995/1910] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:43 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:44.086038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:44.086681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:44.102647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:44.103497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:44.103939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:44.104669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:44.105128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:44.105586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:45.047008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:45.059319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:45.063951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:45.065419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-593e87b4-930c-47f4-83d1-cf8ccb415cf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.985262 Oct 02 01:08:45.068345 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 996/1911] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:44 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:45.082474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:45.083816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:45.096583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:45.097253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:45.098475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:45.104274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:45.104883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:45.105429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:45.215365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:45.224828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fffd1e43-a035-4cfd-b043-b2045108272d tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 1473 microversion: 2.1 time: 1.215185 Oct 02 01:08:45.234996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 916/1912] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:44 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 1473 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:45.246423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:45.247443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:45.265240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:45.266118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:45.266853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:45.267831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:45.272422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:45.273169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.033172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.055124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.059266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.064593 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa007eb1-828c-406a-8c0e-0bfcc01cd211 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1534 microversion: 2.1 time: 0.828292 Oct 02 01:08:46.068917 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 917/1913] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:45 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1534 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:46.069870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.075841 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f475dbd-b95c-4a93-af40-35bceece3728 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 1.004817 Oct 02 01:08:46.086689 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 997/1914] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:45 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:46.094113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:46.095110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:46.099739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:46.103603 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:46.114846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.119072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.119895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.120360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.121112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.121296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.121580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.122000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.122147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.126585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.129308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.129871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.142504 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:46.722794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.740086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb2c0f23-1ce9-4be1-be3e-8623f9013923 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.669863 Oct 02 01:08:46.745472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 918/1915] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:46 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:46.752585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "f5e3966a-d368-487e-b5a2-ec22b74ff1da"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "179e51bf-6cf7-46dd-b434-82948432387b"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "59e8f14e-0229-48db-bae6-a559e24b69a8"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "d0d278c0-2d7f-4560-8593-274b58492b90"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:46.774059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.774933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.775542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.797558 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Creating event network-vif-plugged:f5e3966a-d368-487e-b5a2-ec22b74ff1da for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:46.798456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Creating event network-vif-plugged:179e51bf-6cf7-46dd-b434-82948432387b for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:46.805905 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Creating event network-vif-plugged:59e8f14e-0229-48db-bae6-a559e24b69a8 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:46.806559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Creating event network-vif-plugged:d0d278c0-2d7f-4560-8593-274b58492b90 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:46.808144 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] Creating event network-vif-plugged:25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:46.827093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a36421f4-2d95-44ed-94d0-fb1dec051f17 req-a982700f-43c3-44d7-af3b-e91f5333079a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.075787 Oct 02 01:08:46.828091 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 919/1916] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:46.834217 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:46.835205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:46.845397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.846163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.847008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.848082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.848712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.849329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.884333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.900355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-056ea514-9fae-42c5-bc15-7fc55532d320 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.819373 Oct 02 01:08:46.906108 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 998/1917] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:46 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:46.914673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2548c436-0ab8-47e2-a6bf-6d13a0d38896 req-1cf1435e-66f0-432e-b914-e813de1f91ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4081c15-ec76-44d4-81f3-4bb471661d4c", "name": "network-vif-deleted", "tag": "f6448729-2077-4bbe-a4c4-787dd48f315f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:46.927411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2548c436-0ab8-47e2-a6bf-6d13a0d38896 req-1cf1435e-66f0-432e-b914-e813de1f91ef service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.928761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2548c436-0ab8-47e2-a6bf-6d13a0d38896 req-1cf1435e-66f0-432e-b914-e813de1f91ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.929537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2548c436-0ab8-47e2-a6bf-6d13a0d38896 req-1cf1435e-66f0-432e-b914-e813de1f91ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.945334 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2548c436-0ab8-47e2-a6bf-6d13a0d38896 req-1cf1435e-66f0-432e-b914-e813de1f91ef service nova] Creating event network-vif-deleted:f6448729-2077-4bbe-a4c4-787dd48f315f for instance e4081c15-ec76-44d4-81f3-4bb471661d4c on n-h1-master-1 Oct 02 01:08:46.952661 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2548c436-0ab8-47e2-a6bf-6d13a0d38896 req-1cf1435e-66f0-432e-b914-e813de1f91ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044808 Oct 02 01:08:46.953897 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 999/1918] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:46.961076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:46.963444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:46.970458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.971371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.972015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.972932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.973700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.974331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.071071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd141ea927c214f978ffdc50892a0dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c58ca9b345e41538c7adb8abde0773f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.094407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a5e262b-75e2-41e3-8d87-fea4dcaae3d8 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 200 len: 1431 microversion: 2.1 time: 0.138700 Oct 02 01:08:47.096613 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1000/1919] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:46 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 1431 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:47.104278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6e3462cd-d0ea-4df5-bf37-7d94f1a154b6 req-9bc392ec-8564-4146-bbb8-001847c70f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f6fe8d-2f42-4d32-a65f-c5a32d5da33b", "name": "network-vif-deleted", "tag": "2801976e-8609-47c1-aedc-6a225d49cc57"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:47.129667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6e3462cd-d0ea-4df5-bf37-7d94f1a154b6 req-9bc392ec-8564-4146-bbb8-001847c70f05 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.130471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6e3462cd-d0ea-4df5-bf37-7d94f1a154b6 req-9bc392ec-8564-4146-bbb8-001847c70f05 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.130929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6e3462cd-d0ea-4df5-bf37-7d94f1a154b6 req-9bc392ec-8564-4146-bbb8-001847c70f05 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.146110 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6e3462cd-d0ea-4df5-bf37-7d94f1a154b6 req-9bc392ec-8564-4146-bbb8-001847c70f05 service nova] Creating event network-vif-deleted:2801976e-8609-47c1-aedc-6a225d49cc57 for instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b on n-h2-master-1 Oct 02 01:08:47.153109 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6e3462cd-d0ea-4df5-bf37-7d94f1a154b6 req-9bc392ec-8564-4146-bbb8-001847c70f05 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054468 Oct 02 01:08:47.154966 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1001/1920] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:47.162234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:47.163863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:47.184656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.188930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.189639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.190403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.191067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.191503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.219885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.251183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.253424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.254447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.255277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.255775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lazy-loading 'fault' on Instance uuid e4081c15-ec76-44d4-81f3-4bb471661d4c {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:47.261181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.263349 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4249da0-d995-46d6-b1f1-6d12a140a864 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.433842 Oct 02 01:08:47.269672 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 920/1921] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:46 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:47.278358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:47.280186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:47.305768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.306270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.306745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.307696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.308167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.309233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.424990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.439153 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c2af8ac2-22ed-4555-8171-a32f31eee9e3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 200 len: 1368 microversion: 2.1 time: 0.282289 Oct 02 01:08:47.451386 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1002/1922] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:47 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:47.741867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.766530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:47.767175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:47.768374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.770849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.773284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67fcec0d-d142-44a8-8258-c3c58d542748 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.502017 Oct 02 01:08:47.774829 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 921/1923] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:47 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:47.778762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.780094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.780546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.783611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.784297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.784894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.933272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:47.933996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:47.947868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.948389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.948855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.949760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.950373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.950906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.027263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:48.038979 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d59808a5-b2b1-4b48-bf01-321be62e11c4 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.276304 Oct 02 01:08:48.039699 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1003/1924] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:47 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:48.121921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.122535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] [instance: 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:48.130353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.130893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.131802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.133065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.133560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.134004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.150525 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] HTTP exception thrown: Instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b could not be found. Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Request method failure captured: Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b HTTP/1.1 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOPp9Vd0eloLU_9HxSaeJrRRKt7PU3WKA-qG4xtc1uLCApwHzoQZTjBdP7ZBYdSKdw_g9xYPJHK9C8mtyhVuEPO8gIIG5yfuP3wc_avCOW7OP8LQGndFmEz3lHshgdIpWbks-_Vyv4BowbV8yjWLu3GozvafviNcidQOVXTaeCDzwbs Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7c58ca9b345e41538c7adb8abde0773f Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListImageFiltersTestJSON-834851447 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c58ca9b345e41538c7adb8abde0773f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c58ca9b345e41538c7adb8abde0773f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c58ca9b345e41538c7adb8abde0773f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c58ca9b345e41538c7adb8abde0773f"}]}] Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListImageFiltersTestJSON-834851447 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7c58ca9b345e41538c7adb8abde0773f Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-834851447 Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListImageFiltersTestJSON-834851447-project Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: d141ea927c214f978ffdc50892a0dc3c Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListImageFiltersTestJSON-834851447-project Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b could not be found. Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '24f6fe8d-2f42-4d32-a65f-c5a32d5da33b'} Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b could not be found. Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b could not be found. Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:48.152397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b could not be found. Oct 02 01:08:48.158573 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.160318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Returning 404 to user: Instance 24f6fe8d-2f42-4d32-a65f-c5a32d5da33b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:08:48.161210 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a6d0858-55f3-4318-9e4f-89fe659cd104 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b" status: 404 len: 111 microversion: 2.1 time: 0.043794 Oct 02 01:08:48.161802 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1004/1925] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:48 2022] GET /compute/v2.1/servers/24f6fe8d-2f42-4d32-a65f-c5a32d5da33b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:08:48.171552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68385220-96cd-4410-b61c-691cec20fbd0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb8809f93a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.207072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:48.232347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9274f234-7b1c-42e9-bf19-d6913dce9817 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.308085 Oct 02 01:08:48.234333 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 922/1926] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:47 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:48.296453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.297421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:48.320804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.323275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.323947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.325467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.329730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.337019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.610518 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68385220-96cd-4410-b61c-691cec20fbd0 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/images/9ebc58fc-e2cb-4018-9da2-5a8aac50f01d" status: 204 len: 0 microversion: 2.1 time: 0.443918 Oct 02 01:08:48.611704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1005/1927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:48 2022] DELETE /compute/v2.1/images/9ebc58fc-e2cb-4018-9da2-5a8aac50f01d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:08:48.617508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.618241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: e4081c15-ec76-44d4-81f3-4bb471661d4c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:48.625444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.626070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.626796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.627595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.628164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.628668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.650068 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] HTTP exception thrown: Instance e4081c15-ec76-44d4-81f3-4bb471661d4c could not be found. Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Request method failure captured: Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c HTTP/1.1 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLsFzhTkErIiIWDFyJEkHFBWLIHW_LUjnuzmGmCCQ5OiD61JyjwPit4Oz76to2CLhRYJQnIRGCtTSH-x6SHNTG8Oz4B3KyfUu0ec_t_j4nucM3kvcAHajX_M-Ml5U8XSPFDkBrQ1OpNrRj6ngIyfnrjqo9U3ASOX3LJFlnMP7G8PUM Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0e072a3f56045949210c8d4452298ce"}]}] Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 739083b66f9b433889944e555b0aef23 Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: exception: Instance e4081c15-ec76-44d4-81f3-4bb471661d4c could not be found. Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'e4081c15-ec76-44d4-81f3-4bb471661d4c'} Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4081c15-ec76-44d4-81f3-4bb471661d4c could not be found. Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4081c15-ec76-44d4-81f3-4bb471661d4c could not be found. Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:48.652782 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4081c15-ec76-44d4-81f3-4bb471661d4c could not be found. Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:48.659507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Returning 404 to user: Instance e4081c15-ec76-44d4-81f3-4bb471661d4c could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:08:48.660266 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83fae477-a60e-4ed0-a054-0d2a3d3d2c86 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c" status: 404 len: 111 microversion: 2.1 time: 0.046192 Oct 02 01:08:48.661220 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1006/1928] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:48 2022] GET /compute/v2.1/servers/e4081c15-ec76-44d4-81f3-4bb471661d4c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:48.667223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af72a04f-c247-4971-b7fd-af531f4e6aaa tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb880a295e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.685263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:48.695315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:48.696803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:48.697952 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee0d22b4-1e1c-4dca-9e3f-a95ba0feec6b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.406446 Oct 02 01:08:48.698528 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 923/1929] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:48 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:48.723416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ffa69d2-15e2-4b44-9c8e-171883978b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '.version_select at 0x7fb8855a40d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.746794 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ffa69d2-15e2-4b44-9c8e-171883978b36 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706782710" status: 202 len: 0 microversion: 2.1 time: 0.047139 Oct 02 01:08:48.751241 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 924/1930] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706782710 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:48.801473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.802525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:48.824534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.825339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.825946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.828219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.828686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.829120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.985507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-af72a04f-c247-4971-b7fd-af531f4e6aaa tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/images/706578ae-7b0e-4e9e-be33-ed266072b50d" status: 204 len: 0 microversion: 2.1 time: 0.322227 Oct 02 01:08:48.986164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1007/1931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:48 2022] DELETE /compute/v2.1/images/706578ae-7b0e-4e9e-be33-ed266072b50d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:48.992755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-plugged", "status": "completed", "tag": "9d7260a1-4157-406c-8464-41223d149d9b"}, {"server_uuid": "79e806fe-2261-4f84-a359-763dcf320803", "name": "network-vif-plugged", "status": "completed", "tag": "b400d3a7-3f20-475f-abc5-2148f7e6d67b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:49.005510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.006268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.006895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:49.022818 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] Creating event network-vif-plugged:9d7260a1-4157-406c-8464-41223d149d9b for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:08:49.023641 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] Creating event network-vif-plugged:b400d3a7-3f20-475f-abc5-2148f7e6d67b for instance 79e806fe-2261-4f84-a359-763dcf320803 on n-h1-master-1 Oct 02 01:08:49.033830 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5b70a420-723c-4f9b-bc20-edaf8a7a24e2 req-81e91bb4-0e11-4000-ab2b-7ab660b9fe0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046232 Oct 02 01:08:49.035215 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1008/1932] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:49.041817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-279d0e77-e367-4146-8fb9-07c0267e5f15 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] Calling method '.version_select at 0x7fb885528310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:49.341319 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-279d0e77-e367-4146-8fb9-07c0267e5f15 tempest-ListImageFiltersTestJSON-834851447 tempest-ListImageFiltersTestJSON-834851447-project] 10.222.0.23 "DELETE /compute/v2.1/images/650e2e80-a0c5-487b-86c6-1f2288285a4f" status: 204 len: 0 microversion: 2.1 time: 0.304657 Oct 02 01:08:49.342928 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1009/1933] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:49 2022] DELETE /compute/v2.1/images/650e2e80-a0c5-487b-86c6-1f2288285a4f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:49.352156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:49.355363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:49.364023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.364713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.365755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:49.366487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.367171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.367811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:49.699119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:49.724643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:49.726621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:49.727830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f6bf6d3-9ae6-4a4e-890f-7abebe5d4806 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.930526 Oct 02 01:08:49.728749 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 925/1934] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:48 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:49.734206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:49.747594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:49.755193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.755944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.756624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:49.757849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.758554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.759229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:49.943591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:49.956469 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ab4f4cd-a02b-44a0-b4b8-706b65c120ba tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.612342 Oct 02 01:08:49.957135 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1010/1935] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:49 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:49.964432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:49.969981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:49.978792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.979590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.980858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:49.985155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:49.986768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:49.987471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:50.330307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:50.347521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c048fae-6c79-4f45-a776-5a7a1ac63eb9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.617508 Oct 02 01:08:50.359858 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 926/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:49 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:50.430216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:50.443919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:50.445700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:50.447147 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24c6d528-f405-4ff7-b102-320b68393234 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.487479 Oct 02 01:08:50.447725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1011/1937] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:49 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:50.763069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:50.763901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:50.773223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:50.779733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:50.783223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:50.784015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:50.784487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:50.784909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:50.985886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:50.986329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:50.993643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:50.994472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:50.995144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:50.996237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:50.996889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:50.997484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.338491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:51.365049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:51.370254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:51.371771 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af295366-9771-4783-b608-aec88f3ab67b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1873 microversion: 2.42 time: 0.618408 Oct 02 01:08:51.398051 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 927/1938] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:50 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1873 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:51.412560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:51.413061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:51.425237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.426932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.428085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.429470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.430186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.431730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.479615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:51.494905 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c0facd3-f68f-4f52-bf7c-5f080cf2dc3e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1367 microversion: 2.1 time: 0.517216 Oct 02 01:08:51.496315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1012/1939] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:50 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:51.499982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:51.519705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:51.524047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:51.539112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.541794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.543650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.544686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.547656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.548210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.653600 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:51.686092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f376c8d8-b226-4431-9f99-90d8bf25acc1 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 204 len: 0 microversion: 2.1 time: 0.281254 Oct 02 01:08:51.689767 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 928/1940] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:51 2022] DELETE /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:51.698122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:51.698487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:51.720815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.721320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.721766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.727433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.727936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.728386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.861528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:51.872064 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd7751db-43c1-4f61-8f32-b295a12c5b69 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.372310 Oct 02 01:08:51.884970 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1013/1941] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:51 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:51.897251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:51.897864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:51.906069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.906563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.907037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.907746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.908199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.908644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.083131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.094100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.096140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.098166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf1eadee-c3eb-4389-a18c-9648c81cdc64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1814 microversion: 2.25 time: 0.404931 Oct 02 01:08:52.098992 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 929/1942] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:51 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1814 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:52.269070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.282743 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5956a65-b5d5-45fe-87cc-8b2d9dddec99 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1468 microversion: 2.1 time: 0.398063 Oct 02 01:08:52.285185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1014/1943] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:51 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1468 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:52.396824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1af3855c-e266-4615-980c-52a29aed709d tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Action: 'create', calling method: .version_select at 0x7fb885630d30>, body: {"keypair": {"name": "tempest-keypair-385114239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjePiPWrSk4gyA8w5AiTM8Xrp0GKmAc27L/w6/yrT2NGO56bnlnkuQ5XnoZdsamlkN/8MvfsaBkppuqiv9Vu/2lDIZ4Zt5C8O1XDVru2ucq78deWZXcchbrZEci+DbBdA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:52.407181 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:52.408247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:52.428576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.429372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.432060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.438241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.439147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.439939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.455856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1af3855c-e266-4615-980c-52a29aed709d tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:52.463963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1af3855c-e266-4615-980c-52a29aed709d tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for user 5791be8e4cc8487b87389d46e9f8f980 and project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:52.511898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1af3855c-e266-4615-980c-52a29aed709d tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.411447 Oct 02 01:08:52.518470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 930/1944] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:52.530008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:52.531756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:52.539061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.539932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.540611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.541652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.542377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.542963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.799148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.816493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.817925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.819217 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba860176-da28-479e-b18a-6043a65fb4a6 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2828 microversion: 2.42 time: 0.417930 Oct 02 01:08:52.819788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1015/1945] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:52 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2828 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:08:52.828884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.845096 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05652f2b-b30d-4d79-98db-aaaa68b187ea tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1556 microversion: 2.1 time: 0.327536 Oct 02 01:08:52.846085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 931/1946] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:52 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1556 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:52.847685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8419d960-c0ad-4854-8292-b8a2dd6c016e tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb8809ffca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:52.859602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:52.860434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:52.863198 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8419d960-c0ad-4854-8292-b8a2dd6c016e tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-385114239" status: 200 len: 497 microversion: 2.1 time: 0.026351 Oct 02 01:08:52.866025 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1016/1947] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Oct 2 01:08:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-385114239 => generated 497 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:52.871171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.872045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.872824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.874305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.875435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.876124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.878054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:52.878558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:52.880728 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:52.891872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.892372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.892990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.893723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.894185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.894669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:53.034801 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6aac09d3-a3a1-40a7-ad2d-675d3a4ed925 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.186523 Oct 02 01:08:53.036473 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 932/1948] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:08:52 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26/os-interface => generated 1830 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:53.044029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-438ccd56-7c28-4b66-9191-7a6cff9d1aff tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb8855a4af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:53.085017 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-438ccd56-7c28-4b66-9191-7a6cff9d1aff tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385114239" status: 202 len: 0 microversion: 2.1 time: 0.046871 Oct 02 01:08:53.088670 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 933/1949] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:08:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385114239 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:53.101917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:53.102538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:53.113174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:53.113579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:53.114166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:53.115742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:53.116219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:53.116746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:53.276605 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-148fe52f-91eb-4f8f-8d17-54ae32d48ee7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.409402 Oct 02 01:08:53.277185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1017/1950] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:08:52 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:53.301649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-387cdb05-23e1-433d-859d-b9a19cf800be tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Action: 'create', calling method: .version_select at 0x7fb880a21820>, body: {"keypair": {"name": "tempest-keypair-78877506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6r0/dD1QcvpZQ/EieuaWCzKSGGdzOCMlkZoVbhDmAV8Jbx5vgELH49/al5VOK2gplb7OPCEXOjtYuYu5rCx3bQvhH9VdUjF5TQj9ASVzz46F/6OALd3UDT6DkperGF7Q=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:53.355137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-387cdb05-23e1-433d-859d-b9a19cf800be tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:53.369213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-387cdb05-23e1-433d-859d-b9a19cf800be tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for user 5791be8e4cc8487b87389d46e9f8f980 and project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:53.391875 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:53.426747 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-387cdb05-23e1-433d-859d-b9a19cf800be tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.119930 Oct 02 01:08:53.433853 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1018/1951] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:53.444714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:53.445790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:53.455072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:53.455942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:53.456620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:53.457571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:53.458254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:53.458947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.133884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:54.145487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-72bd72fe-e004-451b-80a7-97e5a566c8ce tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 1.053009 Oct 02 01:08:54.159190 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 934/1952] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:53 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:54.168360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:54.173570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:54.183650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.184156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.184599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.185318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.186531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.187332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.426525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:54.436190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:54.451723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:54.453589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9091257b-7130-4e08-976c-2ca46f770006 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1804 microversion: 2.25 time: 1.014247 Oct 02 01:08:54.457774 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1019/1953] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:53 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1804 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:54.463782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4cfc8bc-a422-4ec4-ad10-5c0c57ae5979 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb8809fa940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:54.497678 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4cfc8bc-a422-4ec4-ad10-5c0c57ae5979 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78877506" status: 202 len: 0 microversion: 2.1 time: 0.037820 Oct 02 01:08:54.499448 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1020/1954] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Oct 2 01:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78877506 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:54.508059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8323ec74-f701-44f9-b2f0-c8afc73e22ae tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '.version_select at 0x7fb8809ff820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:54.512187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8323ec74-f701-44f9-b2f0-c8afc73e22ae tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.512881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8323ec74-f701-44f9-b2f0-c8afc73e22ae tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.513535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8323ec74-f701-44f9-b2f0-c8afc73e22ae tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.540279 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8323ec74-f701-44f9-b2f0-c8afc73e22ae tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 4051 microversion: 2.25 time: 0.039428 Oct 02 01:08:54.541438 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1021/1955] 10.222.0.23 () {60 vars in 1184 bytes} [Sun Oct 2 01:08:54 2022] GET /compute/v2.1/os-migrations => generated 4051 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:54.548972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fdeac92f-d57c-450c-b935-6abf7a52637e tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Action: 'create', calling method: .version_select at 0x7fb880a19a60>, body: {"keypair": {"name": "tempest-keypair-1990157749", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:54.617064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-fdeac92f-d57c-450c-b935-6abf7a52637e tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:54.635929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-fdeac92f-d57c-450c-b935-6abf7a52637e tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for user 5791be8e4cc8487b87389d46e9f8f980 and project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:54.668983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fdeac92f-d57c-450c-b935-6abf7a52637e tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.126174 Oct 02 01:08:54.669645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1022/1956] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:54 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:54.675958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:54.676919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:54.686554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.690635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.691131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.692105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.692755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.693453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:55.235031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:55.243936 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afcfeb55-7f46-44a0-b7f2-38c599c83fbb tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1468 microversion: 2.1 time: 1.082576 Oct 02 01:08:55.244840 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 935/1957] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:54 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1468 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:55.264771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f4bea539-4326-45d2-8680-ca4bbdd5ca86 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb885593310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:55.297544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f4bea539-4326-45d2-8680-ca4bbdd5ca86 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990157749" status: 202 len: 0 microversion: 2.1 time: 0.037404 Oct 02 01:08:55.299314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 936/1958] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:08:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990157749 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:55.361835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1422094588", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "666b1736-fb97-477d-ba6f-cb0629f98a1a"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:55.429671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] validate_networks() for [('666b1736-fb97-477d-ba6f-cb0629f98a1a', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:08:55.944187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:55.958568 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95709b15-d53b-4539-93ec-58325276f1e7 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 2423 microversion: 2.25 time: 1.286448 Oct 02 01:08:55.968387 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1023/1959] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:54 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 2423 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:55.968387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:55.968387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:55.973815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:55.974523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:55.978387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:55.979707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:55.980417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:55.980853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:56.736256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:56.749102 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-019d26e8-c172-40d1-8d4b-a7b62091e24b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.788863 Oct 02 01:08:56.750058 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1024/1960] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:55 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:56.770668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b9d2069-b8b2-4808-b065-94923db07042 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Action: 'create', calling method: .version_select at 0x7fb8855b0f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1412965767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQMeQFywqyacgZWcDr+BB9138v/MGBpNuTe6FCxB1zRbO5fogm8eENQ25xjZLX7ZWOv8u1GEFOjyiOkKkjI3WoJ2kIlBvjULkQfOsKAcWA/jLKHxlwnQmgJwW/cUYfNGw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:56.787847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1b9d2069-b8b2-4808-b065-94923db07042 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:56.793655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1b9d2069-b8b2-4808-b065-94923db07042 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for user 5791be8e4cc8487b87389d46e9f8f980 and project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:56.831306 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b9d2069-b8b2-4808-b065-94923db07042 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.067287 Oct 02 01:08:56.831926 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1025/1961] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:56.836676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:56.837515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:56.847263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:56.847760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:56.848217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:56.848941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:56.849391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:56.850033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:56.880593 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:57.899249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:57.921552 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b6687f92-00fa-45ae-b263-e9e1b1dd218f tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 2423 microversion: 2.25 time: 1.088060 Oct 02 01:08:57.923107 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1026/1962] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:08:56 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 2423 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:08:57.931777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:57.932618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:57.942883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:57.943624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:57.944391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:57.945345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:57.946275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:57.947166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:57.981581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:08:57.983405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:08:57.984241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:08:57.985027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:08:57.985747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:08:58.011465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.022826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.025212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.027722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.031423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.032265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.055774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.056389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.056934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.057494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lazy-loading 'fault' on Instance uuid 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:58.106454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Getting quotas for project f9954f609dd340fa9e1ebbb77a5dff3f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:58.116997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Getting quotas for user 991f58b08b8e46f1a3fbbfa14d4fd23c and project f9954f609dd340fa9e1ebbb77a5dff3f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:58.145143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Going to run 2 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:08:58.152536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 1de463a7-eddf-4a6c-bdfa-c801c0e13953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:08:58.276120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:58.280853 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-686c2d1d-c765-4b3d-be5a-288b843a2cfd tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 200 len: 1302 microversion: 2.1 time: 0.356145 Oct 02 01:08:58.282442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=1de463a7-eddf-4a6c-bdfa-c801c0e13953,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:08:58.304939 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1027/1963] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:57 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 1302 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:58.310715 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4ef882a-b915-471f-ae8d-4bbff5084379 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Action: 'create', calling method: .version_select at 0x7fb8809ff280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-239503987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoETAOTfAaQ9jIvfqpVQ2OFnB7sQyW+8GEHSZwuT6ENc48HwX4XyQXNurbnHsRgo7L3gNYIUXO8ir6ctC846N7fGFWCeaLxqc7ikUUWvfQhTzymdgkWQiAwECxMm577/A=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:58.350534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a4ef882a-b915-471f-ae8d-4bbff5084379 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:58.365011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a4ef882a-b915-471f-ae8d-4bbff5084379 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for user 5791be8e4cc8487b87389d46e9f8f980 and project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:58.431082 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4ef882a-b915-471f-ae8d-4bbff5084379 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.124370 Oct 02 01:08:58.455468 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1028/1964] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:58.469565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0e577403-dd42-40d4-b5dc-f2e775c5f450 req-a2543382-703d-45e3-a5f6-2995ce16d80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3", "name": "network-vif-deleted", "tag": "34aae495-9601-4a7f-99a5-d4398c461a60"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:58.508500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d046c399-b827-48b5-974c-bb54c1bb4b15 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.201927 Oct 02 01:08:58.520432 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 937/1965] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:08:58.535281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0e577403-dd42-40d4-b5dc-f2e775c5f450 req-a2543382-703d-45e3-a5f6-2995ce16d80b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.535761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0e577403-dd42-40d4-b5dc-f2e775c5f450 req-a2543382-703d-45e3-a5f6-2995ce16d80b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.536194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0e577403-dd42-40d4-b5dc-f2e775c5f450 req-a2543382-703d-45e3-a5f6-2995ce16d80b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.537859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:58.538657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:58.554732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.555674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.556297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.557813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.559154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.563042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.583369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0e577403-dd42-40d4-b5dc-f2e775c5f450 req-a2543382-703d-45e3-a5f6-2995ce16d80b service nova] Creating event network-vif-deleted:34aae495-9601-4a7f-99a5-d4398c461a60 for instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 on n-h1-master-1 Oct 02 01:08:58.598576 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0e577403-dd42-40d4-b5dc-f2e775c5f450 req-a2543382-703d-45e3-a5f6-2995ce16d80b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141607 Oct 02 01:08:58.609271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1029/1966] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:58.614972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:58.615561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:58.635905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.636421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.636825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.637545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:58.638003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:58.638430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:58.879672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lazy-loading 'services' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:08:58.947011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:58.976069 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eb0b51cb-1b55-4938-af07-2c17adf50d63 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.451056 Oct 02 01:08:58.976714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 938/1967] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:58 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:58.995071 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ce578797-05c0-4537-b598-3bf4755732b5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments/2cd9679a-d575-445c-99bc-1eceff014c4d" status: 202 len: 0 microversion: 2.25 time: 0.384183 Oct 02 01:08:58.995746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d668654d-d9b6-4294-974e-59cbdbe45b1a tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Action: 'create', calling method: .version_select at 0x7fb8855a4940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-706950779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCscWkQDAtrha9d/YW1PrjJH+7G8iP4mAIFPz6a0tRFTstnvC1fXkov323RuzxyaqESItS2Iq02m26gLW5nemL/dbuIZFKoh6wFYWeuftPLqk1PNtWR5oE8ObKKbsX9zhQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:59.002449 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1030/1968] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Oct 2 01:08:58 2022] DELETE /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments/2cd9679a-d575-445c-99bc-1eceff014c4d => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:59.022068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.027066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:59.032153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Searching by: {'deleted': False, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:08:59.088124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.088677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.094783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.096711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d668654d-d9b6-4294-974e-59cbdbe45b1a tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:08:59.097395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.099150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.099946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.106984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d668654d-d9b6-4294-974e-59cbdbe45b1a tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Getting quotas for user 5791be8e4cc8487b87389d46e9f8f980 and project 719a4300966d4b9bbab4b7acea400a07. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:08:59.148555 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e90e85a-41a0-45d7-910d-0a0029cb30ec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.150578 Oct 02 01:08:59.157526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1031/1969] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:08:58 2022] GET /compute/v2.1/servers => generated 677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:59.163048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.165734 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:59.177073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.179059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.179807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.180818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.181712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.182912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.200778 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d668654d-d9b6-4294-974e-59cbdbe45b1a tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.217621 Oct 02 01:08:59.201579 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 939/1970] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:08:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:59.227962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d03ea8a6-38c5-4ba4-a252-c0d45da434f4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.228601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d03ea8a6-38c5-4ba4-a252-c0d45da434f4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:59.278024 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-151dfacb-90f8-4ec5-9157-67e614d695f1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115578 Oct 02 01:08:59.280010 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1032/1971] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:08:59 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:08:59.304831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20d483d5-8da4-413f-b643-f52dd823ef9b tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb880a595e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.310570 n-d-master-1 devstack@n-api.service[122355]: WARNING oslo_db.sqlalchemy.utils [None req-20d483d5-8da4-413f-b643-f52dd823ef9b tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 02 01:08:59.335557 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20d483d5-8da4-413f-b643-f52dd823ef9b tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.053806 Oct 02 01:08:59.338084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1033/1972] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:08:59 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:59.352031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.353684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:59.374321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.375410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.378462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.380206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.381059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.381784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.382785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d03ea8a6-38c5-4ba4-a252-c0d45da434f4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:59.394883 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d03ea8a6-38c5-4ba4-a252-c0d45da434f4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1220 microversion: 2.1 time: 0.178134 Oct 02 01:08:59.407268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] HTTP exception thrown: Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 could not be found. Oct 02 01:08:59.410859 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 940/1973] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:59 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Request method failure captured: Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 HTTP/1.1 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOLsFzhTkErIiIWDFyJEkHFBWLIHW_LUjnuzmGmCCQ5OiD61JyjwPit4Oz76to2CLhRYJQnIRGCtTSH-x6SHNTG8Oz4B3KyfUu0ec_t_j4nucM3kvcAHajX_M-Ml5U8XSPFDkBrQ1OpNrRj6ngIyfnrjqo9U3ASOX3LJFlnMP7G8PUM Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0e072a3f56045949210c8d4452298ce"}]}] Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 739083b66f9b433889944e555b0aef23 Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 could not be found. Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3'} Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 could not be found. Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 could not be found. Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:08:59.412334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 could not be found. Oct 02 01:08:59.422478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:08:59.424802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04d5fed0-7c5f-44bc-b0c5-f1dbea7ab327 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb8855b48b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.433232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Returning 404 to user: Instance 9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:08:59.434407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30cd4a9f-fe22-4609-a7f1-32f76ddd80a5 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3" status: 404 len: 111 microversion: 2.1 time: 0.095145 Oct 02 01:08:59.435079 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1034/1974] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:59 2022] GET /compute/v2.1/servers/9f1f29e5-90d4-4ccc-9e3a-ee3ef4eb01a3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:59.461109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.464077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:59.474341 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04d5fed0-7c5f-44bc-b0c5-f1dbea7ab327 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-706950779" status: 202 len: 0 microversion: 2.1 time: 0.062205 Oct 02 01:08:59.475228 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 941/1975] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-706950779 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:59.494359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.495172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.495979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.497043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.497871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.499165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.502448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53d20400-0aee-4023-ac9d-f52ffe595399 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb8855a4c10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.538294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:08:59.573334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53d20400-0aee-4023-ac9d-f52ffe595399 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-239503987" status: 202 len: 0 microversion: 2.1 time: 0.092472 Oct 02 01:08:59.579078 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 942/1976] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-239503987 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:59.588214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-52354bd9-8470-4a6d-a9e2-14dfc7e0c899 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] Calling method '.version_select at 0x7fb885554430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.651878 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-52354bd9-8470-4a6d-a9e2-14dfc7e0c899 tempest-KeyPairsV2TestJSON-1051270582 tempest-KeyPairsV2TestJSON-1051270582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1412965767" status: 202 len: 0 microversion: 2.1 time: 0.071073 Oct 02 01:08:59.652853 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 943/1977] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1412965767 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:59.672448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed9ed430-f299-4aa6-8058-184e8f0040a3 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 204 len: 0 microversion: 2.1 time: 0.223173 Oct 02 01:08:59.677622 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1035/1978] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:08:59 2022] DELETE /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:08:59.684007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:59.685081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:59.696432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.700853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.702888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:59.705517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:59.707777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:59.710404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.007775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:00.008489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:00.036236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:00.036642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.037297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.041536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.042327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.042941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.043699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.049096 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-52d35e12-3281-4fe9-ae63-3688e0bdaa54 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1468 microversion: 2.1 time: 0.369519 Oct 02 01:09:00.049699 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 944/1979] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:59 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1468 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:00.293671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:00.296611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:00.316810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.317309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.317749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.318464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.318952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.319377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.455998 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bcb07b22-7dd5-4b80-b024-8dc7b79cd09b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.166835 Oct 02 01:09:00.457055 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 945/1980] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:00 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:00.462222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:00.463270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:00.472989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.473980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.475759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.476666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.477288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.477958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.493471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:00.513033 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b9d84b1-9c61-4799-857d-9c669e944400 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.512389 Oct 02 01:09:00.513668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1036/1981] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:59 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:00.660830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "tag": "d0d278c0-2d7f-4560-8593-274b58492b90"}, {"name": "network-changed", "server_uuid": "79e806fe-2261-4f84-a359-763dcf320803", "tag": "b400d3a7-3f20-475f-abc5-2148f7e6d67b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:00.664761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:00.675607 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a96b6d98-fabb-45a9-a62b-2ca3f7c6da5a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1216 microversion: 2.1 time: 0.217168 Oct 02 01:09:00.678496 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 946/1982] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:00 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1216 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:00.682709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:00.683196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:00.686297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:00.714048 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] Creating event network-changed:d0d278c0-2d7f-4560-8593-274b58492b90 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:09:00.714570 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] Creating event network-changed:b400d3a7-3f20-475f-abc5-2148f7e6d67b for instance 79e806fe-2261-4f84-a359-763dcf320803 on n-h1-master-1 Oct 02 01:09:00.742866 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-47f1a7cc-6dfb-4835-987c-e970372bfa87 req-becd3c27-31f2-4b6c-9e4a-30bfc8e086dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086663 Oct 02 01:09:00.749140 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1037/1983] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:09:01.075814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:01.077330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:01.096583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.097455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.100394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.101826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.102322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.104783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.472861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:01.474834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:01.507165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.508452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.509780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.512928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.515090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.516205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.626804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:01.651579 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6759346-378b-4bdf-88b5-6fcc69b7ce57 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1468 microversion: 2.1 time: 0.579015 Oct 02 01:09:01.652098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-070c6400-bd6e-439e-9233-caa429ea3898 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.185374 Oct 02 01:09:01.653119 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1038/1984] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:01 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:01.653257 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 947/1985] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:01 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1468 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:01.671092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:01.672884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:01.688553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.690478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.691637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.694943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.695672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.696225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.706242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:01.707412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:01.720231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.723491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.724198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:01.725527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:01.727340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:01.729971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:02.022118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:02.042338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b039bf0c-41fd-4421-9f50-0e336e1247a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1272 microversion: 2.1 time: 0.342145 Oct 02 01:09:02.048428 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1039/1986] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:01 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:02.429325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:02.444761 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45b5c190-ce97-4417-8873-c7004a3696d9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.789603 Oct 02 01:09:02.463695 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 948/1987] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:01 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:02.666791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:02.669054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:02.680947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:02.681742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:02.695764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:02.696166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:02.696833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:02.698365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:02.698502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:02.698983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:02.700024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:02.700976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:02.702667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:02.703283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:02.703594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:02.704750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:02.849733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f195f65-84e1-428d-a76d-6a7df7bfdfc2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187634 Oct 02 01:09:02.851821 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1040/1988] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:02 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:09:02.862396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-15ffa60c-0f95-46d8-8547-70ce58573cc2 req-d71dccf2-32f9-4459-b3c2-d36aaf14a31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0530656d-9d5c-4a05-bfc3-94cf67b19dcf", "name": "network-vif-deleted", "tag": "3e02bdab-8b46-4fdf-91fc-2e60947189c5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:02.876457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-15ffa60c-0f95-46d8-8547-70ce58573cc2 req-d71dccf2-32f9-4459-b3c2-d36aaf14a31c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:02.877407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-15ffa60c-0f95-46d8-8547-70ce58573cc2 req-d71dccf2-32f9-4459-b3c2-d36aaf14a31c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:02.879429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-15ffa60c-0f95-46d8-8547-70ce58573cc2 req-d71dccf2-32f9-4459-b3c2-d36aaf14a31c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:02.909491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739083b66f9b433889944e555b0aef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e072a3f56045949210c8d4452298ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:02.920117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-15ffa60c-0f95-46d8-8547-70ce58573cc2 req-d71dccf2-32f9-4459-b3c2-d36aaf14a31c service nova] Creating event network-vif-deleted:3e02bdab-8b46-4fdf-91fc-2e60947189c5 for instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf on n-h2-master-1 Oct 02 01:09:02.923120 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e32f7687-0d97-4fbb-9b64-6661c17c8623 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 200 len: 1426 microversion: 2.1 time: 0.246495 Oct 02 01:09:02.924525 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 949/1989] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:02 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 1426 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:02.935283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-15ffa60c-0f95-46d8-8547-70ce58573cc2 req-d71dccf2-32f9-4459-b3c2-d36aaf14a31c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073139 Oct 02 01:09:02.935283 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1041/1990] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:03.073969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:03.075004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:03.098722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.099231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.119422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.122205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.122909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.123920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.251871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ac7cadb-1a23-4de3-a380-77a7bed1cbe7 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1365975007", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:03.261136 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2ac7cadb-1a23-4de3-a380-77a7bed1cbe7 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] HTTP exception thrown: min_count must be <= max_count Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ac7cadb-1a23-4de3-a380-77a7bed1cbe7 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Request method failure captured: Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 184 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOSuZ9tRcnaZbzmTDJ9wgFglze68ztZWeCIXfWe7hg1kQ9-DqFITK1TY1GZqhIqXGytxrGNoow9yEwtZ6kfM3EyR8sBPYASv3hh2sAk6U5HROkzbLFZP0txDIZPG7scQwPlFYSn__7yU9mreWEzI253BoRXePhzoxpy4Fc7MR_U9IQI Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba074ad312cf49778a1df7150186f8bc"}]}] Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8d5c11eb2c6546fa81a3972df28dd594 Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1365975007", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: exception: min_count must be <= max_count Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1365975007', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 02 01:09:03.273156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.286150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ac7cadb-1a23-4de3-a380-77a7bed1cbe7 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Returning 400 to user: min_count must be <= max_count {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:03.287639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ac7cadb-1a23-4de3-a380-77a7bed1cbe7 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.358031 Oct 02 01:09:03.303846 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1042/1991] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 375 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:03.380235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:03.411491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6d15bb-6d53-4c0c-ab41-1946fab48774 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1105729207", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "max_count": 0}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:03.412222 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3327cf1a-b676-4689-b323-f8d5ce004621 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1278 microversion: 2.1 time: 0.341687 Oct 02 01:09:03.414651 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 950/1992] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:03 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1278 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6d15bb-6d53-4c0c-ab41-1946fab48774 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Request method failure captured: Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 168 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOSuZ9tRcnaZbzmTDJ9wgFglze68ztZWeCIXfWe7hg1kQ9-DqFITK1TY1GZqhIqXGytxrGNoow9yEwtZ6kfM3EyR8sBPYASv3hh2sAk6U5HROkzbLFZP0txDIZPG7scQwPlFYSn__7yU9mreWEzI253BoRXePhzoxpy4Fc7MR_U9IQI Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba074ad312cf49778a1df7150186f8bc"}]}] Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8d5c11eb2c6546fa81a3972df28dd594 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1105729207", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "max_count": 0}} Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1105729207', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'max_count': 0}}} Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 0 Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:09:03.442119 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.448526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6d15bb-6d53-4c0c-ab41-1946fab48774 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:03.451231 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e6d15bb-6d53-4c0c-ab41-1946fab48774 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.043863 Oct 02 01:09:03.454640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1043/1993] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:09:03.482031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:03.483814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:03.486493 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=5 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:03.497318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.499149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.500019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.501390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.502268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.503048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.544479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b46caf0f-16bc-442a-bf5f-31d89fb7700b tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1403430658", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "max_count": 2.5}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b46caf0f-16bc-442a-bf5f-31d89fb7700b tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Request method failure captured: Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 170 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOSuZ9tRcnaZbzmTDJ9wgFglze68ztZWeCIXfWe7hg1kQ9-DqFITK1TY1GZqhIqXGytxrGNoow9yEwtZ6kfM3EyR8sBPYASv3hh2sAk6U5HROkzbLFZP0txDIZPG7scQwPlFYSn__7yU9mreWEzI253BoRXePhzoxpy4Fc7MR_U9IQI Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba074ad312cf49778a1df7150186f8bc"}]}] Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8d5c11eb2c6546fa81a3972df28dd594 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1403430658", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "max_count": 2.5}} Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1403430658', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'max_count': 2.5}}} Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 2.5 Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:09:03.551106 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.558182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b46caf0f-16bc-442a-bf5f-31d89fb7700b tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:03.561549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b46caf0f-16bc-442a-bf5f-31d89fb7700b tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017423 Oct 02 01:09:03.562661 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1044/1994] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:09:03.628219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a58c2393-dd75-4f64-8213-286484a00120 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-177377328", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 0}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a58c2393-dd75-4f64-8213-286484a00120 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Request method failure captured: Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 167 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOSuZ9tRcnaZbzmTDJ9wgFglze68ztZWeCIXfWe7hg1kQ9-DqFITK1TY1GZqhIqXGytxrGNoow9yEwtZ6kfM3EyR8sBPYASv3hh2sAk6U5HROkzbLFZP0txDIZPG7scQwPlFYSn__7yU9mreWEzI253BoRXePhzoxpy4Fc7MR_U9IQI Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba074ad312cf49778a1df7150186f8bc"}]}] Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8d5c11eb2c6546fa81a3972df28dd594 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-177377328", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 0}} Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-177377328', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'min_count': 0}}} Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 0 Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:09:03.635721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a58c2393-dd75-4f64-8213-286484a00120 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a58c2393-dd75-4f64-8213-286484a00120 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016849 Oct 02 01:09:03.644060 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1045/1995] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:09:03.725710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e97fda85-c60e-4964-914b-c52091fe44f5 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-261802132", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 2.5}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e97fda85-c60e-4964-914b-c52091fe44f5 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Request method failure captured: Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 169 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOSuZ9tRcnaZbzmTDJ9wgFglze68ztZWeCIXfWe7hg1kQ9-DqFITK1TY1GZqhIqXGytxrGNoow9yEwtZ6kfM3EyR8sBPYASv3hh2sAk6U5HROkzbLFZP0txDIZPG7scQwPlFYSn__7yU9mreWEzI253BoRXePhzoxpy4Fc7MR_U9IQI Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba074ad312cf49778a1df7150186f8bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba074ad312cf49778a1df7150186f8bc"}]}] Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ba074ad312cf49778a1df7150186f8bc Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-822818696 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8d5c11eb2c6546fa81a3972df28dd594 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-822818696-project Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-261802132", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 2.5}} Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-261802132', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'min_count': 2.5}}} Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 2.5 Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:09:03.729933 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e97fda85-c60e-4964-914b-c52091fe44f5 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e97fda85-c60e-4964-914b-c52091fe44f5 tempest-MultipleCreateNegativeTestJSON-822818696 tempest-MultipleCreateNegativeTestJSON-822818696-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010501 Oct 02 01:09:03.738031 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1046/1996] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:09:03.855355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:03.865303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:03.867927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb361c5b-0b5d-49c2-a74e-ffc07b6cd492 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.391070 Oct 02 01:09:03.870130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:03.870634 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 951/1997] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:03 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:03.884207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.887285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.887743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.889167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.889845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.891969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.978580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:03.980244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] [instance: 0530656d-9d5c-4a05-bfc3-94cf67b19dcf] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:03.988748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.991762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.992429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:03.996500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:03.997178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:03.997807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:04.000669 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f9ce739-0886-4ba5-ba07-f76d052664e0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134952 Oct 02 01:09:04.001630 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1047/1998] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:03 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:04.021655 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] HTTP exception thrown: Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf could not be found. Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Request method failure captured: Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf HTTP/1.1 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOLsFzhTkErIiIWDFyJEkHFBWLIHW_LUjnuzmGmCCQ5OiD61JyjwPit4Oz76to2CLhRYJQnIRGCtTSH-x6SHNTG8Oz4B3KyfUu0ec_t_j4nucM3kvcAHajX_M-Ml5U8XSPFDkBrQ1OpNrRj6ngIyfnrjqo9U3ASOX3LJFlnMP7G8PUM Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0e072a3f56045949210c8d4452298ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0e072a3f56045949210c8d4452298ce"}]}] Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-MigrationsAdminTest-1625359501 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: c0e072a3f56045949210c8d4452298ce Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-MigrationsAdminTest-1625359501 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 739083b66f9b433889944e555b0aef23 Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-MigrationsAdminTest-1625359501-project Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf could not be found. Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0530656d-9d5c-4a05-bfc3-94cf67b19dcf'} Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf could not be found. Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf could not be found. Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:04.024445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf could not be found. Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:04.029295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] Returning 404 to user: Instance 0530656d-9d5c-4a05-bfc3-94cf67b19dcf could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:04.035003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aafb87ca-5e94-412f-af0b-2ed1c01f3e24 tempest-MigrationsAdminTest-1625359501 tempest-MigrationsAdminTest-1625359501-project] 10.222.0.23 "GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf" status: 404 len: 111 microversion: 2.1 time: 0.080776 Oct 02 01:09:04.037633 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 952/1999] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:03 2022] GET /compute/v2.1/servers/0530656d-9d5c-4a05-bfc3-94cf67b19dcf => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:09:04.448294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:04.449030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:04.456679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9786ed91-344a-4e4e-87de-3dd592ebacf1 req-63cb14f5-2db1-4950-b5fc-598a34ecaf53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de463a7-eddf-4a6c-bdfa-c801c0e13953", "tag": "d0b7cefc-5f29-4e2d-8fdc-3c3af33a4295"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:04.460500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:04.461057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:04.461738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:04.462691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:04.463401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:04.471293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:04.487028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9786ed91-344a-4e4e-87de-3dd592ebacf1 req-63cb14f5-2db1-4950-b5fc-598a34ecaf53 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:04.488302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9786ed91-344a-4e4e-87de-3dd592ebacf1 req-63cb14f5-2db1-4950-b5fc-598a34ecaf53 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:04.489956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9786ed91-344a-4e4e-87de-3dd592ebacf1 req-63cb14f5-2db1-4950-b5fc-598a34ecaf53 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:04.529975 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9786ed91-344a-4e4e-87de-3dd592ebacf1 req-63cb14f5-2db1-4950-b5fc-598a34ecaf53 service nova] Creating event network-changed:d0b7cefc-5f29-4e2d-8fdc-3c3af33a4295 for instance 1de463a7-eddf-4a6c-bdfa-c801c0e13953 on n-h1-master-1 Oct 02 01:09:04.545211 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9786ed91-344a-4e4e-87de-3dd592ebacf1 req-63cb14f5-2db1-4950-b5fc-598a34ecaf53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094067 Oct 02 01:09:04.545829 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 953/2000] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:09:04.896741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:04.898198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:04.906263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:04.926911 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a4d3223-6823-440e-bf31-579feca62e7b tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1278 microversion: 2.1 time: 0.482063 Oct 02 01:09:04.927685 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1048/2001] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:04 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1278 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:04.928592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:04.929394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:04.930074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:04.931993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:04.932864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:04.933554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:05.016930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:05.019915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:05.047837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:05.048823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:05.050646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:05.054133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:05.054960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:05.056878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:05.130346 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f53fc7d9-7dbf-49a5-ba9c-51ba6c542eb2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120495 Oct 02 01:09:05.131329 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1049/2002] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:05 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:05.247111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:05.263408 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08380b38-55b1-4d6d-bbe0-4abe079b5e0c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.373097 Oct 02 01:09:05.279073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 954/2003] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:04 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:05.954711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:05.955425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:05.967313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:05.970553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:05.971932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:05.974296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:05.975054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:05.976774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:06.026812 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:06.143064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:06.145987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:06.153923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:06.154964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:06.155724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:06.156685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:06.157359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:06.158005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:06.234657 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4f6c12eb-ac11-47cb-907e-6fd13320c266 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096092 Oct 02 01:09:06.237074 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 955/2004] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:06 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:09:06.290407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:06.291238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:06.303495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:06.305848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:06.310442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:06.312156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:06.312715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:06.313478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:06.326941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:06.336876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83fe8df9-8f33-4c9a-bd2c-85001eea2f03 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.386406 Oct 02 01:09:06.355599 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1050/2005] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:05 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:06.633768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:06.652861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-118dd64c-1329-4e28-97ff-d6998fbf023c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.361465 Oct 02 01:09:06.653480 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 956/2006] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:06 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:06.687039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-dc79d1f2-6a11-4f42-8859-fe2e344484a2 req-1f8834c0-dd34-4a86-ad85-e457c859000f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d40cd8-8f37-45d4-954c-d6b928842f8f", "tag": "652950fa-89dc-4aad-9c2b-9d5e14ee8a2e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:06.715583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dc79d1f2-6a11-4f42-8859-fe2e344484a2 req-1f8834c0-dd34-4a86-ad85-e457c859000f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:06.719090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dc79d1f2-6a11-4f42-8859-fe2e344484a2 req-1f8834c0-dd34-4a86-ad85-e457c859000f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:06.721097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dc79d1f2-6a11-4f42-8859-fe2e344484a2 req-1f8834c0-dd34-4a86-ad85-e457c859000f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:06.746878 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dc79d1f2-6a11-4f42-8859-fe2e344484a2 req-1f8834c0-dd34-4a86-ad85-e457c859000f service nova] Creating event network-changed:652950fa-89dc-4aad-9c2b-9d5e14ee8a2e for instance c0d40cd8-8f37-45d4-954c-d6b928842f8f on n-h2-master-1 Oct 02 01:09:06.766365 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-dc79d1f2-6a11-4f42-8859-fe2e344484a2 req-1f8834c0-dd34-4a86-ad85-e457c859000f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084600 Oct 02 01:09:06.768334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1051/2007] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:07.248977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:07.252194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:07.266944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:07.268323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:07.269767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:07.272470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:07.272979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:07.273501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:07.330084 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfe4d82f-58ef-4b8b-8138-f3f571a7043f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085467 Oct 02 01:09:07.334325 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 957/2008] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:07 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:07.378454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:07.383210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:07.397385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:07.398449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:07.403460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:07.405294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:07.405927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:07.406495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:07.608998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:07.623741 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66fdde5e-0a8f-4c3c-81db-22d3b7c832d4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.258171 Oct 02 01:09:07.626433 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1052/2009] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:07 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:07.680147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:07.680859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:07.688442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:07.689182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:07.689619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:07.690327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:07.690860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:07.691273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:07.696068 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:07.906006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:07.919347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef83be4b-bfe0-4640-90bb-13135ce6f405 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.243015 Oct 02 01:09:07.920476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 958/2010] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:07 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:08.346663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:08.348925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:08.358617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:08.362661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:08.367697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:08.368672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:08.371309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:08.372021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:08.403873 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:08.461002 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-269a98f7-2165-4d67-802b-36cc583ea822 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119307 Oct 02 01:09:08.469551 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1053/2011] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:08 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:08.655396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:08.656176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:08.658539 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:08.676635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:08.679259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:08.680675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:08.681685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:08.683624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:08.684799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:08.945909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Action: 'update', calling method: .version_select at 0x7fb8809da280>, body: {"quota_set": {"ram": "5120"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:09.061751 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:09.089287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.094229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.095285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.096250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.097640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.098819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.140552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:09.149005 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2999037b-de74-4727-b4d9-07c9d4cbccd2 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.498228 Oct 02 01:09:09.160097 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 959/2012] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:08 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:09.165116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:09.165739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:09.178169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.181131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.182896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.183896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.184595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.185250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.280568 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4aea9860-6733-40a7-95c1-663b774c818d tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3" status: 200 len: 148 microversion: 2.57 time: 0.485122 Oct 02 01:09:09.289619 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1054/2013] 10.222.0.23 () {62 vars in 1303 bytes} [Sun Oct 2 01:09:08 2022] PUT /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3 => generated 148 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:09:09.307621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Calling method '.version_select at 0x7fb8809d61f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:09.390691 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:09.487004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.489495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.490015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.491156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.492219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.492654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.543693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:09.548808 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f6688f1-4fad-456c-bc4c-daafc9dcf3cd tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3/detail" status: 200 len: 463 microversion: 2.57 time: 0.257698 Oct 02 01:09:09.558719 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1055/2014] 10.222.0.23 () {60 vars in 1304 bytes} [Sun Oct 2 01:09:09 2022] GET /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3/detail => generated 463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:09.564382 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0c54a583-821e-431d-8c0c-3e9f825fba5d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.401536 Oct 02 01:09:09.567496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:09.576731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:09.583041 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 960/2015] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:09 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:09.596733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.597230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.597667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.600015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:09.600506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:09.602072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:09.745511 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc4cc0c0-edcf-42be-bd05-b229c9167894 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.194045 Oct 02 01:09:09.746989 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1056/2016] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:09 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:09.879300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Action: 'update', calling method: .version_select at 0x7fb88554d820>, body: {"quota_set": {"ram": "2048"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:10.012573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.013240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.015994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.016969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.017504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.018126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.060549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.061480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.062161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.062925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.063639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.064066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.135393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bcfd83c-6279-41a4-8f5f-5d9352bc90f2 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3?user_id=663c32ffbf804a4bb2833cc3eb798a7d" status: 200 len: 148 microversion: 2.57 time: 0.261941 Oct 02 01:09:10.138072 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 961/2017] 10.222.0.23 () {62 vars in 1384 bytes} [Sun Oct 2 01:09:09 2022] PUT /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3?user_id=663c32ffbf804a4bb2833cc3eb798a7d => generated 148 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:10.148972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4dbe42f9-b440-4041-93e0-877f03b212f9 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Calling method '.version_select at 0x7fb8809ccf70>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:10.186963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:10.188872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:10.197267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.198331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.199259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.200734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.202535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.203495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.276482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4dbe42f9-b440-4041-93e0-877f03b212f9 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3?user_id=663c32ffbf804a4bb2833cc3eb798a7d" status: 200 len: 190 microversion: 2.57 time: 0.131551 Oct 02 01:09:10.286007 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1057/2018] 10.222.0.23 () {60 vars in 1364 bytes} [Sun Oct 2 01:09:10 2022] GET /compute/v2.1/os-quota-sets/ed6f8f8b2adf42e8969ca74f151330b3?user_id=663c32ffbf804a4bb2833cc3eb798a7d => generated 190 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:10.397147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:10.409457 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6d0a299-856b-4a72-9987-08bc91a4acbe tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.229611 Oct 02 01:09:10.410945 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 962/2019] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:10 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:10.592744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:10.594130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:10.609525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.611266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.612017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.612927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.615031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.616924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.761879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:10.765748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:10.786919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.787419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.787871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.789993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:10.790701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:10.791551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:10.844246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-caa97823-d5e1-4c29-8acf-8713d5cdfcd5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087932 Oct 02 01:09:10.845344 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 963/2020] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:10 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:09:11.017484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:11.026663 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d8a9671-dc4e-47e9-82b5-d007de504fe9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.439508 Oct 02 01:09:11.027252 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1058/2021] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:10 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:11.438669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:11.439266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:11.452920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:11.453537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:11.454942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:11.458291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:11.458877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:11.459373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:11.738669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:11.750959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d2a65ff-9e6c-47c1-84c0-2703611d7003 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.316804 Oct 02 01:09:11.753859 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 964/2022] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:11 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:11.860427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:11.863588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:11.882825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:11.885408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:11.888033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:11.890455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:11.891470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:11.893629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:11.944864 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9ac46dc-81fb-46dc-9ff8-2079d6cb1a64 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.089010 Oct 02 01:09:11.951835 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1059/2023] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:09:11 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:12.057892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:12.058518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:12.076023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:12.083971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:12.084491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:12.093599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:12.096561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:12.097055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:12.437022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:12.451951 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-64c88175-a59e-49ec-a1b4-cbba571a4f17 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.397606 Oct 02 01:09:12.453852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 965/2024] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:12 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:12.784657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:12.785576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:12.802420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:12.805614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:12.806473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:12.809107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:12.811885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:12.812701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:13.098935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:13.120987 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-19bc90da-b36a-40b3-999f-21dbd8ff33c5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.340181 Oct 02 01:09:13.127875 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1060/2025] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:12 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:13.485218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-cae67485-d2fb-49f8-9b9f-1e28fcefa8ca req-995c3d42-ce74-45f9-ab3a-21ebee962ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de463a7-eddf-4a6c-bdfa-c801c0e13953", "name": "network-vif-plugged", "status": "completed", "tag": "d0b7cefc-5f29-4e2d-8fdc-3c3af33a4295"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:13.487573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:13.489390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:13.535928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:13.536474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:13.539945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:13.541896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:13.543731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:13.544091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cae67485-d2fb-49f8-9b9f-1e28fcefa8ca req-995c3d42-ce74-45f9-ab3a-21ebee962ad1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:13.544730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:13.546876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cae67485-d2fb-49f8-9b9f-1e28fcefa8ca req-995c3d42-ce74-45f9-ab3a-21ebee962ad1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:13.548608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cae67485-d2fb-49f8-9b9f-1e28fcefa8ca req-995c3d42-ce74-45f9-ab3a-21ebee962ad1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:13.582302 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-cae67485-d2fb-49f8-9b9f-1e28fcefa8ca req-995c3d42-ce74-45f9-ab3a-21ebee962ad1 service nova] Creating event network-vif-plugged:d0b7cefc-5f29-4e2d-8fdc-3c3af33a4295 for instance 1de463a7-eddf-4a6c-bdfa-c801c0e13953 on n-h1-master-1 Oct 02 01:09:13.597692 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-cae67485-d2fb-49f8-9b9f-1e28fcefa8ca req-995c3d42-ce74-45f9-ab3a-21ebee962ad1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121671 Oct 02 01:09:13.601807 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1061/2026] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:14.157730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:14.159908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:14.183474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:14.187531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:14.188326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:14.189618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:14.191022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:14.192737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:14.231511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:14.242575 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b480cf01-3a63-4d5a-817e-73b56029d315 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.768600 Oct 02 01:09:14.259511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 966/2027] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:13 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:14.456594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:14.473553 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30d52809-3125-43b7-bcd1-3c7d0f771296 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.321962 Oct 02 01:09:14.488609 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1062/2028] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:14 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:15.276221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:15.277455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:15.294099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:15.295635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:15.297234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:15.298148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:15.298925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:15.299322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:15.568971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-725937862", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:15.657925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:15.675752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] validate_networks() for [('3dd30ef3-dbf2-41ac-9ca2-f8025479410f', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:09:15.691506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0f8f4629-abeb-4c6c-9897-0361c75505c4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.423245 Oct 02 01:09:15.693141 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 967/2029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:15 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:15.703130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:15.703842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:15.710637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:15.711797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:15.712581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:15.713518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:15.714193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:15.715124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:16.001115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:16.010655 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c935c4da-1a1d-4630-917e-7a2093b5f555 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.311829 Oct 02 01:09:16.012447 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 968/2030] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:15 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:16.018517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3083c1fe-7f24-44b9-b6bd-984e74ab9519 req-8cf9bcf3-420a-4bb7-88fc-0e33e2889875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d40cd8-8f37-45d4-954c-d6b928842f8f", "name": "network-vif-plugged", "status": "completed", "tag": "652950fa-89dc-4aad-9c2b-9d5e14ee8a2e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:16.040082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3083c1fe-7f24-44b9-b6bd-984e74ab9519 req-8cf9bcf3-420a-4bb7-88fc-0e33e2889875 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:16.041096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3083c1fe-7f24-44b9-b6bd-984e74ab9519 req-8cf9bcf3-420a-4bb7-88fc-0e33e2889875 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:16.043717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3083c1fe-7f24-44b9-b6bd-984e74ab9519 req-8cf9bcf3-420a-4bb7-88fc-0e33e2889875 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:16.074099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3083c1fe-7f24-44b9-b6bd-984e74ab9519 req-8cf9bcf3-420a-4bb7-88fc-0e33e2889875 service nova] Creating event network-vif-plugged:652950fa-89dc-4aad-9c2b-9d5e14ee8a2e for instance c0d40cd8-8f37-45d4-954c-d6b928842f8f on n-h2-master-1 Oct 02 01:09:16.080922 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3083c1fe-7f24-44b9-b6bd-984e74ab9519 req-8cf9bcf3-420a-4bb7-88fc-0e33e2889875 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066487 Oct 02 01:09:16.081904 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 969/2031] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:16.399985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:09:16.400580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:09:16.401209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:09:16.402311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:09:16.402849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:09:16.424077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:16.424580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:16.425024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:16.425793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:16.426198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:16.426649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:16.448069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:09:16.463926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for user df46881c91e8419e84b8679ad474ba44 and project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:09:16.479838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:09:16.482320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:16.577173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b1fdebf-9cd0-4978-8aef-2fd421956a11 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.287151 Oct 02 01:09:16.578322 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1063/2032] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:09:16.593699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28f3e1b8-d449-421b-ad1c-642d786b2432 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:16.595486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28f3e1b8-d449-421b-ad1c-642d786b2432 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:16.708905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-28f3e1b8-d449-421b-ad1c-642d786b2432 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:16.720496 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28f3e1b8-d449-421b-ad1c-642d786b2432 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1221 microversion: 2.1 time: 0.134231 Oct 02 01:09:16.731245 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 970/2033] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:16 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:16.731245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:16.731245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:16.749446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:16.750391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:16.751630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:16.752597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:16.753435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:16.754036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:16.913710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-153929772", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:16.992560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:17.008621 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc1a143b-db89-41a0-bb02-8146c1a61ca9 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.285204 Oct 02 01:09:17.011204 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 971/2034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:16 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:17.030664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-500107551", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:17.034283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:09:17.115106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] validate_networks() for [('3dd30ef3-dbf2-41ac-9ca2-f8025479410f', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:09:17.467511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:09:17.468273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:09:17.468765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:09:17.469293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:09:17.469680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:09:17.499703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:17.500753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:17.501403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:17.502373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:17.502855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:17.503642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:17.534278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Getting quotas for project 352d900890d9490c9ab92fdc7c889532. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:09:17.540379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Getting quotas for user 7736193e78da4210ad696e5e61ca088c and project 352d900890d9490c9ab92fdc7c889532. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:09:17.568275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:09:17.575864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:17.677588 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06bf734b-80e5-40c3-81ca-539f8f88882b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069942 Oct 02 01:09:17.679399 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1064/2035] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:09:17.688135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:17.689318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:17.701901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:17.702537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:17.703023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:17.703743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:17.704198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:17.705042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:17.951164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:09:17.952372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:09:17.953320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:09:17.953862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:09:17.954287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:09:17.967129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:17.967848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:17.968292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:17.969544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:17.970074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:17.970509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:17.986958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:17.993402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:09:17.998772 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5dea5117-1fa4-4343-9440-04a803920341 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1320 microversion: 2.1 time: 0.317072 Oct 02 01:09:17.999381 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1065/2036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:17 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:18.000153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for user df46881c91e8419e84b8679ad474ba44 and project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:09:18.004997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b03dd42-d3d4-41b5-ba57-380ff1d9413a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:18.005771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7b03dd42-d3d4-41b5-ba57-380ff1d9413a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:18.019757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:09:18.022260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:18.093227 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7b03dd42-d3d4-41b5-ba57-380ff1d9413a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:18.103640 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7b03dd42-d3d4-41b5-ba57-380ff1d9413a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1221 microversion: 2.1 time: 0.103168 Oct 02 01:09:18.105904 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1066/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:17 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:18.119904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:18.121411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:18.135111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:18.139542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:18.139542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:18.139723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:18.140104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:18.140689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:18.145728 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b95a6277-60a2-4bfc-a27e-f3f99377cf36 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.131911 Oct 02 01:09:18.148979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 972/2038] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:09:18.162299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a933c14a-6680-4f76-a650-0094b2774276 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:18.163572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a933c14a-6680-4f76-a650-0094b2774276 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:18.260663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a933c14a-6680-4f76-a650-0094b2774276 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:18.275813 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a933c14a-6680-4f76-a650-0094b2774276 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1221 microversion: 2.1 time: 0.118897 Oct 02 01:09:18.292199 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 973/2039] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:18 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:18.401465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:18.411268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a50e726-31a5-43c8-b62b-4b659f1d6d06 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.304228 Oct 02 01:09:18.413003 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1067/2040] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:18 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:19.026110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:19.026984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:19.046417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.055005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.055495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.056254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.056738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.057171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.133826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:19.135248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:19.148261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.149533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.150586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.152112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.153821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.154633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.258547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:19.269698 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3bbdbc1c-eb70-4fe6-9021-a066b19b609d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1273 microversion: 2.1 time: 0.140294 Oct 02 01:09:19.270296 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1068/2041] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:19 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:19.314457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:19.315443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:19.347175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.348368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.349716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.353737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.354266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.355780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.400082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:19.412198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08b9a3dd-c2ce-442c-8c2f-cfca2303b713 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 200 len: 1509 microversion: 2.1 time: 0.392028 Oct 02 01:09:19.417269 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 974/2042] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:19 2022] GET /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:19.446933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:19.447857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:19.460905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.462389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.464669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.468585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.469245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.472067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.480782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:19.492168 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a3dd8081-aec5-443d-8c47-cc7a28544138 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1217 microversion: 2.1 time: 0.186441 Oct 02 01:09:19.492887 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1069/2043] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:19 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:19.510878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:19.511538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 1de463a7-eddf-4a6c-bdfa-c801c0e13953] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:19.518678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.524332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.524790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.525547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.526004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.526480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.743806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:19.754231 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b97a9bed-9913-46ce-9c6e-f18cbe705863 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.314352 Oct 02 01:09:19.754846 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 975/2044] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:19 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:19.783950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:19.797455 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-79ae89fa-2478-4d10-972e-22919da87dec tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/1de463a7-eddf-4a6c-bdfa-c801c0e13953" status: 200 len: 1509 microversion: 2.1 time: 0.302885 Oct 02 01:09:19.801972 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1070/2045] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:19 2022] GET /compute/v2.1/servers/1de463a7-eddf-4a6c-bdfa-c801c0e13953 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:19.836558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:19.837418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 1de463a7-eddf-4a6c-bdfa-c801c0e13953] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:19.846893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.847565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.848104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.848946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:19.849476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:19.850057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:19.883634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 1de463a7-eddf-4a6c-bdfa-c801c0e13953] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:19.949386 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:20.014959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f6ffeb1-27ff-4976-bbe3-21bc11441ba5 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1de463a7-eddf-4a6c-bdfa-c801c0e13953" status: 204 len: 0 microversion: 2.1 time: 0.180604 Oct 02 01:09:20.016359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 976/2046] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:19 2022] DELETE /compute/v2.1/servers/1de463a7-eddf-4a6c-bdfa-c801c0e13953 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:20.025342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:20.025840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:20.040127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.040970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.041419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.044141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.044622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.048168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.099525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: c0d40cd8-8f37-45d4-954c-d6b928842f8f] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:20.222189 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:20.296309 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97878c02-b24e-4753-9ef8-abac8d135da4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f" status: 204 len: 0 microversion: 2.1 time: 0.274625 Oct 02 01:09:20.296943 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1071/2047] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:20 2022] DELETE /compute/v2.1/servers/c0d40cd8-8f37-45d4-954c-d6b928842f8f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:20.308576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:20.309357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:20.329496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.330220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.332012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.333162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.334659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.335299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.488532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-949549362", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "666b1736-fb97-477d-ba6f-cb0629f98a1a"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:20.510801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:20.525905 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7513294-4692-4f0f-aad9-66c0fb2744b8 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1273 microversion: 2.1 time: 0.230880 Oct 02 01:09:20.527215 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 977/2048] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:20 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:20.545191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:20.546587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:20.560158 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:20.562908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.563594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.564460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.566728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.567584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.568269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.589672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] validate_networks() for [('666b1736-fb97-477d-ba6f-cb0629f98a1a', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:09:20.671858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:20.682183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5315cac9-d0d5-4709-9b37-51a6174f79f4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1217 microversion: 2.1 time: 0.151141 Oct 02 01:09:20.683952 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 978/2049] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:20 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:20.786747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:20.787783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:20.797359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.797856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.798302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:20.799331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:20.799970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:20.800569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:21.486631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:21.495922 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2a5fb8b-5dd2-45af-a80d-097c8b5bdda3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.714624 Oct 02 01:09:21.497042 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 979/2050] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:20 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:21.503944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e16d2965-049d-47ea-a1c1-b0f0dce6cc20 req-af41436b-a976-432f-8551-cb49bde04672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39831e69-dcd1-4272-9b0a-0b8717bdad39", "name": "network-vif-unplugged", "status": "completed", "tag": "04589599-8f46-424b-93a0-f62bdc1ad661"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:21.520086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e16d2965-049d-47ea-a1c1-b0f0dce6cc20 req-af41436b-a976-432f-8551-cb49bde04672 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:21.522276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e16d2965-049d-47ea-a1c1-b0f0dce6cc20 req-af41436b-a976-432f-8551-cb49bde04672 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:21.523148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e16d2965-049d-47ea-a1c1-b0f0dce6cc20 req-af41436b-a976-432f-8551-cb49bde04672 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:21.547088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e16d2965-049d-47ea-a1c1-b0f0dce6cc20 req-af41436b-a976-432f-8551-cb49bde04672 service nova] Creating event network-vif-unplugged:04589599-8f46-424b-93a0-f62bdc1ad661 for instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 on n-h1-master-1 Oct 02 01:09:21.554747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e16d2965-049d-47ea-a1c1-b0f0dce6cc20 req-af41436b-a976-432f-8551-cb49bde04672 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056113 Oct 02 01:09:21.557876 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 980/2051] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:21.571084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:21.572935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:21.589561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:21.589978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:21.590425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:21.591179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:21.591637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:21.592590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:21.830054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:21.843960 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a5a2996-e8db-41e2-9302-7ea724ed4e3c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1273 microversion: 2.1 time: 0.272454 Oct 02 01:09:21.864587 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 981/2052] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:21 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:21.884638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:21.887332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:21.908059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:21.912826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:21.913519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:21.914441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:21.917576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:21.918636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.150715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:22.158985 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-148c5fc2-d360-412b-aebe-afdb34677022 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1217 microversion: 2.1 time: 0.289522 Oct 02 01:09:22.159586 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 982/2053] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:21 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:22.360798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a2be46c9-d29e-42b3-b82e-948cf608cdbb req-a96a860f-90a0-4168-8604-b4d339650bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b0a9d17-5cc3-4882-96fc-08b6bc217ec4", "tag": "ebf1e937-96c7-4f57-8cda-5b451e0c686f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:22.385865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a2be46c9-d29e-42b3-b82e-948cf608cdbb req-a96a860f-90a0-4168-8604-b4d339650bba service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.386351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a2be46c9-d29e-42b3-b82e-948cf608cdbb req-a96a860f-90a0-4168-8604-b4d339650bba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.387123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a2be46c9-d29e-42b3-b82e-948cf608cdbb req-a96a860f-90a0-4168-8604-b4d339650bba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.416814 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a2be46c9-d29e-42b3-b82e-948cf608cdbb req-a96a860f-90a0-4168-8604-b4d339650bba service nova] Creating event network-changed:ebf1e937-96c7-4f57-8cda-5b451e0c686f for instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 on n-h1-master-1 Oct 02 01:09:22.425818 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a2be46c9-d29e-42b3-b82e-948cf608cdbb req-a96a860f-90a0-4168-8604-b4d339650bba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067399 Oct 02 01:09:22.428199 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 983/2054] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:22.523159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:22.524834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:22.540969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.541466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.541911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.542645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.543113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.543591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.593685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:09:22.594808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:09:22.595491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:09:22.596500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:09:22.596931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:09:22.608732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.609545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.610148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.611080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.611738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.612651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.638217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Getting quotas for project f9954f609dd340fa9e1ebbb77a5dff3f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:09:22.647390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Getting quotas for user 991f58b08b8e46f1a3fbbfa14d4fd23c and project f9954f609dd340fa9e1ebbb77a5dff3f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:09:22.649436 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:22.667188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Going to run 2 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:09:22.669870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:22.719805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=3e913515-edff-433c-91e1-7e0f6490ea66,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:22.822241 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fb612c81-32ce-42eb-9f35-2db2fa3953a0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.337725 Oct 02 01:09:22.824813 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1072/2055] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 2342 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:09:22.846450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:22.855983 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:22.860153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Searching by: {'deleted': False, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:09:22.901135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.901943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.902561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.903511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:22.904150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:22.905960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:22.948396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:09:22.999782 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa2b488b-2836-4142-9558-d63c4d1b11da tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.170148 Oct 02 01:09:23.000967 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1073/2056] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:09:22 2022] GET /compute/v2.1/servers => generated 1335 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:23.012893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:23.014087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:23.032416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:23.033201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:23.034950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:23.036697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:23.037350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:23.039104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:23.183860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:23.198071 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8f03bd5-0245-4730-a3f2-3c129af3d73c tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.676079 Oct 02 01:09:23.199508 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 984/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:22 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:23.210045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-009fe046-08bc-4f29-a274-6bf3593485fd tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:23.214927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-009fe046-08bc-4f29-a274-6bf3593485fd tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:23.412601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:23.430699 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71a8885e-fdea-42a6-8557-ef382037575c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1279 microversion: 2.1 time: 0.427525 Oct 02 01:09:23.432487 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1074/2058] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:23 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1279 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:23.445127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:23.449844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:23.485874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:23.488535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:23.492720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:23.493628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:23.495110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:23.497491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:23.502248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-009fe046-08bc-4f29-a274-6bf3593485fd tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:23.510030 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-009fe046-08bc-4f29-a274-6bf3593485fd tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1217 microversion: 2.1 time: 0.309243 Oct 02 01:09:23.528652 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 985/2059] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:23 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1217 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:23.719575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-78007f92-0354-47e3-808b-a9add8fef892 req-3feb2f07-6233-4f14-a47e-db5349ac49df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39831e69-dcd1-4272-9b0a-0b8717bdad39", "tag": "04589599-8f46-424b-93a0-f62bdc1ad661"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:23.743320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78007f92-0354-47e3-808b-a9add8fef892 req-3feb2f07-6233-4f14-a47e-db5349ac49df service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:23.743951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78007f92-0354-47e3-808b-a9add8fef892 req-3feb2f07-6233-4f14-a47e-db5349ac49df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:23.744597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78007f92-0354-47e3-808b-a9add8fef892 req-3feb2f07-6233-4f14-a47e-db5349ac49df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:23.766823 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-78007f92-0354-47e3-808b-a9add8fef892 req-3feb2f07-6233-4f14-a47e-db5349ac49df service nova] Creating event network-changed:04589599-8f46-424b-93a0-f62bdc1ad661 for instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 on n-h1-master-1 Oct 02 01:09:23.783183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-78007f92-0354-47e3-808b-a9add8fef892 req-3feb2f07-6233-4f14-a47e-db5349ac49df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067503 Oct 02 01:09:23.785332 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 986/2060] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:09:23.980634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:23.992642 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-857b7674-d40b-4209-b01f-511962c8bb6e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1291 microversion: 2.1 time: 0.557334 Oct 02 01:09:23.995777 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1075/2061] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:23 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1291 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:24.244107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:24.245150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:24.260671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:24.261350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:24.262107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:24.263050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:24.265139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:24.265940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:24.465196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:24.465867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:24.478933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:24.479680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:24.481144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:24.484992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:24.486460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:24.487177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:24.708336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:24.723803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3645e29f-5e49-4a98-8604-24ec74070288 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1279 microversion: 2.1 time: 0.263776 Oct 02 01:09:24.725126 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1076/2062] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:24 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:24.734878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:24.735873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:24.737142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:24.755455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:24.760149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:24.761257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:24.764268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:24.764685 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4217d59c-13d3-4e71-af3d-b0a92777386f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.536733 Oct 02 01:09:24.764842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:24.765307 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 987/2063] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:24 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:24.772207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:25.020849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:25.021635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:25.033699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:25.037685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:25.038543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:25.040331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:25.041167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:25.049701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:25.049701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:25.050104 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27339ff8-63b0-4602-8f6b-da14a79bbdb7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1221 microversion: 2.1 time: 0.322718 Oct 02 01:09:25.051517 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1077/2064] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:24 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1221 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:25.492349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:25.502254 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82cac239-ac78-4a0e-ae20-04c44d199bc0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.485113 Oct 02 01:09:25.515324 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 988/2065] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:25 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:25.756381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:25.758644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:25.786784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:25.791671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:25.792317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:25.793474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:25.797059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:25.797059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:25.797059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:25.798379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:25.838514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:25.839080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:25.840045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:25.840813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:25.841279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:25.842005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.374693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:26.385023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f89effeb-3941-47dc-9976-ad3773fdcdbe tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.635442 Oct 02 01:09:26.385669 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1078/2066] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:25 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:26.405953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:26.406582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:26.418486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.419024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.419457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.420688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.422148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.423186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.450359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:26.461139 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e17a805a-aa96-4b9b-a9dd-bc55dc1e622b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.675502 Oct 02 01:09:26.461741 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 989/2067] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:25 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:26.482345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-207584f0-9184-46d8-98bb-2f3b51805e28 req-035695f0-f924-4850-ba1c-75bb8e84be5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ff56fa-0255-4a23-af32-50537ccd587e", "tag": "2de8cfb8-b5be-4fc0-9d78-52af73579fb0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:26.507580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-207584f0-9184-46d8-98bb-2f3b51805e28 req-035695f0-f924-4850-ba1c-75bb8e84be5c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.510788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-207584f0-9184-46d8-98bb-2f3b51805e28 req-035695f0-f924-4850-ba1c-75bb8e84be5c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.511547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-207584f0-9184-46d8-98bb-2f3b51805e28 req-035695f0-f924-4850-ba1c-75bb8e84be5c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.529365 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-207584f0-9184-46d8-98bb-2f3b51805e28 req-035695f0-f924-4850-ba1c-75bb8e84be5c service nova] Creating event network-changed:2de8cfb8-b5be-4fc0-9d78-52af73579fb0 for instance 01ff56fa-0255-4a23-af32-50537ccd587e on n-h2-master-1 Oct 02 01:09:26.535119 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-207584f0-9184-46d8-98bb-2f3b51805e28 req-035695f0-f924-4850-ba1c-75bb8e84be5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058421 Oct 02 01:09:26.536870 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 990/2068] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:26.544131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de463a7-eddf-4a6c-bdfa-c801c0e13953", "name": "network-vif-deleted", "tag": "d0b7cefc-5f29-4e2d-8fdc-3c3af33a4295"}, {"server_uuid": "c0d40cd8-8f37-45d4-954c-d6b928842f8f", "name": "network-vif-deleted", "tag": "652950fa-89dc-4aad-9c2b-9d5e14ee8a2e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:26.558657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.559420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.560058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.576727 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] Creating event network-vif-deleted:d0b7cefc-5f29-4e2d-8fdc-3c3af33a4295 for instance 1de463a7-eddf-4a6c-bdfa-c801c0e13953 on n-h1-master-1 Oct 02 01:09:26.577240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] Creating event network-vif-deleted:652950fa-89dc-4aad-9c2b-9d5e14ee8a2e for instance c0d40cd8-8f37-45d4-954c-d6b928842f8f on n-h2-master-1 Oct 02 01:09:26.586732 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f9e6347c-61c0-4cae-a5f3-8dcd0a859e5f req-e91a5339-a727-43e6-95d8-e42f4c9d8f03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047965 Oct 02 01:09:26.588003 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 991/2069] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:26.592432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:26.594631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:26.595535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:26.600541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10524bbe-5a3b-4414-b39a-1cd587b26a0a tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1221 microversion: 2.1 time: 0.213674 Oct 02 01:09:26.603281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1079/2070] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:26 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1221 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:26.603655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.604342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.605117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.606057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.606691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.607323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.798019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:26.812613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:26.814624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Searching by: {'deleted': False, 'project_id': '8639be724fdc4c128da53dd69fbbc356'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:09:26.837003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.837646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.838384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.839391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:26.840697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:26.841549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:26.903857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:09:26.987446 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68953809-038f-42ee-9fc1-543cb6801d4b tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.194280 Oct 02 01:09:26.988737 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1080/2071] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:09:26 2022] GET /compute/v2.1/servers => generated 344 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:27.002255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:27.002957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:27.010829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ea45770-8deb-42f2-91ff-9263d337ae8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.421348 Oct 02 01:09:27.011437 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 992/2072] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:26 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:27.038104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:27.040599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Searching by: {'deleted': False, 'project_id': '8639be724fdc4c128da53dd69fbbc356'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:09:27.054127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.057635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.059347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.061045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.063737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.066826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.140252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:09:27.269471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:27.278237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.282309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.283991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.416263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:27.417025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:27.447917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.449164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.451916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.455809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.456534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.457194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.712337 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36215371-70fc-4e28-86ad-122b396061c4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.714510 Oct 02 01:09:27.714084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1081/2073] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:09:26 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:27.734224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:27.735023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:27.744825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.746470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.747666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.749202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:27.749927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:27.750565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:27.981857 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:28.025833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:28.063947 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93406a0e-0aad-4785-8e94-24043c0fa95a tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.655740 Oct 02 01:09:28.065259 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 993/2074] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:27 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:28.078858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:28.079690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:28.089764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.093042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.093399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.094236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.096032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.096702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.362142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:28.372047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-596fc33f-73e6-4ed0-bd71-b0e0a1767f65 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1213 microversion: 2.1 time: 0.305253 Oct 02 01:09:28.374797 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 994/2075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:28 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1213 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:28.385260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2dcbe06b-9557-4664-9b2b-5ea95c99b835 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:28.408565 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2dcbe06b-9557-4664-9b2b-5ea95c99b835 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031626 Oct 02 01:09:28.409560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 995/2076] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:09:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:28.416511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:28.439890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:28.441112 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd90ae84-18b7-4c60-b230-06f1508a05eb tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.725660 Oct 02 01:09:28.445584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:28.446066 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1082/2077] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:27 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:28.477152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.477956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.478589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.479514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.480139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.480741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.690037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-cc806a58-77e2-4fb0-b3ff-220a13d3856b req-f63e320c-b99d-4295-a826-1ede8df6990e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f", "tag": "cc879e24-fb3f-4928-9e8f-95cbc0448644"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:28.711997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cc806a58-77e2-4fb0-b3ff-220a13d3856b req-f63e320c-b99d-4295-a826-1ede8df6990e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.713254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cc806a58-77e2-4fb0-b3ff-220a13d3856b req-f63e320c-b99d-4295-a826-1ede8df6990e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.713940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cc806a58-77e2-4fb0-b3ff-220a13d3856b req-f63e320c-b99d-4295-a826-1ede8df6990e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.739555 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-cc806a58-77e2-4fb0-b3ff-220a13d3856b req-f63e320c-b99d-4295-a826-1ede8df6990e service nova] Creating event network-changed:cc879e24-fb3f-4928-9e8f-95cbc0448644 for instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f on n-h2-master-1 Oct 02 01:09:28.756582 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-cc806a58-77e2-4fb0-b3ff-220a13d3856b req-f63e320c-b99d-4295-a826-1ede8df6990e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070290 Oct 02 01:09:28.757210 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1083/2078] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:09:28.762341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:28.763229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:28.783387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.783888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.784357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.785067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:28.785886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:28.786027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:28.829469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:28.862051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:28.909097 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0def401-5ab6-417c-a5ad-823bac969a93 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.488938 Oct 02 01:09:28.932039 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 996/2079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:28 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:29.041633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7a61049-0cee-4356-9fe4-dd90345cd30a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 204 len: 0 microversion: 2.1 time: 0.282737 Oct 02 01:09:29.048012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1084/2080] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:28 2022] DELETE /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:29.057544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:29.058427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:29.075551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.077896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.084451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.087153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.087930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.089741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.090742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:29.091711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:29.108035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.109055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.109687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.110635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.111488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.119392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.730100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:29.749176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67b937f1-5326-43d6-a6b2-89637c4a2c6d tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1608 microversion: 2.1 time: 0.692228 Oct 02 01:09:29.750463 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 997/2081] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:29 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1608 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:29.754625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:29.761690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:29.765674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:29.768495 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-988c3650-f0cf-42bd-9e35-ced02d59a8e4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.680965 Oct 02 01:09:29.771041 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1085/2082] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:29 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:29.776372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:29.777712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:29.785104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.785868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.786513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.787502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.787980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.788454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.808960 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:29.844654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.845165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.847975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.848735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.849208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.852278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.987578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:29.990187 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:29.999604 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfd80be8-56d5-4586-b37b-d1f3cb4dc8d1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1269 microversion: 2.1 time: 0.246677 Oct 02 01:09:30.001342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 998/2083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:29 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1269 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:30.006869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:30.007639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:30.014633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.015517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.016214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:30.017305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.018015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.018738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:30.051614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:30.063928 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f4ae98e-a8fa-4af2-98f8-0ef57fede988 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.290406 Oct 02 01:09:30.067755 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1086/2084] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:29 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:30.230885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:30.243760 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e7e05a5-425c-4858-8b71-9911c47a2aee tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.240901 Oct 02 01:09:30.245876 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 999/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:30 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:30.671231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-de99d4be-7841-4f96-aaad-b88eb4fa49c1 req-63cb7798-5a0f-49a3-8442-5e6fa837f9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a9d17-5cc3-4882-96fc-08b6bc217ec4", "name": "network-vif-plugged", "status": "completed", "tag": "ebf1e937-96c7-4f57-8cda-5b451e0c686f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:30.687237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-de99d4be-7841-4f96-aaad-b88eb4fa49c1 req-63cb7798-5a0f-49a3-8442-5e6fa837f9fa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.695041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-de99d4be-7841-4f96-aaad-b88eb4fa49c1 req-63cb7798-5a0f-49a3-8442-5e6fa837f9fa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.695693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-de99d4be-7841-4f96-aaad-b88eb4fa49c1 req-63cb7798-5a0f-49a3-8442-5e6fa837f9fa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:30.728105 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-de99d4be-7841-4f96-aaad-b88eb4fa49c1 req-63cb7798-5a0f-49a3-8442-5e6fa837f9fa service nova] Creating event network-vif-plugged:ebf1e937-96c7-4f57-8cda-5b451e0c686f for instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 on n-h1-master-1 Oct 02 01:09:30.741674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-de99d4be-7841-4f96-aaad-b88eb4fa49c1 req-63cb7798-5a0f-49a3-8442-5e6fa837f9fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074411 Oct 02 01:09:30.749642 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1087/2086] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:30.782418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:30.783426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:30.799187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:30.799927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:30.821560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.825039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.825579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.827110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.828313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:30.836611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.837500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:30.838568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:30.840643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.842056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:30.842589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:30.843750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.508239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:31.509980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:31.517633 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f07c3ed-9478-41d3-86ee-0eb73607c491 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1608 microversion: 2.1 time: 0.741282 Oct 02 01:09:31.521562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1000/2087] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:30 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1608 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:31.532775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:31.535530 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1c2064d-15f3-4a5f-91b7-61e80968350d tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.740474 Oct 02 01:09:31.535936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:31.545807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.546544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.547012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.547749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.548348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.548778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.563112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1088/2088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:30 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:31.573571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:31.574179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:31.603321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.604075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.604661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.605538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.611918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.612592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.849118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:31.870892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3db15039-5568-4a06-bda3-9a0d30a0f97d tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1275 microversion: 2.1 time: 0.347219 Oct 02 01:09:31.873305 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1001/2089] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:31 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1275 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:31.879525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:31.881437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:31.891505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.892291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.892944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.893834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.895735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.896343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:32.125967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:32.133894 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5761105b-80bb-43fb-802a-8a0e6e7d5dd3 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.569637 Oct 02 01:09:32.134478 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1089/2090] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:31 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:32.477278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:32.487773 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e13e74f7-b4b0-4a99-a593-06b7406a65fa tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.612432 Oct 02 01:09:32.488418 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1002/2091] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:31 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:32.548676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:32.549311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:32.559085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:32.559832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:32.560506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:32.563037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:32.563690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:32.564545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:32.570298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:32.570298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:32.583144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:32.585552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:32.586860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:32.587814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:32.590158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:32.591792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.506638 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=24 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:33.507368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:33.524528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-34e25c11-1a23-4774-a994-6d6d64f96dc4 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1608 microversion: 2.1 time: 0.980495 Oct 02 01:09:33.525153 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1090/2092] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:32 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1608 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:33.540353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d2f704d7-030c-45dc-a76d-e06dc2bb3473 req-966d273c-8a3b-4cd0-8351-b488f7abef60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e913515-edff-433c-91e1-7e0f6490ea66", "tag": "825eaf95-3166-4b0a-ac2b-5000382bd516"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:33.558256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d2f704d7-030c-45dc-a76d-e06dc2bb3473 req-966d273c-8a3b-4cd0-8351-b488f7abef60 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.559116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d2f704d7-030c-45dc-a76d-e06dc2bb3473 req-966d273c-8a3b-4cd0-8351-b488f7abef60 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.560364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d2f704d7-030c-45dc-a76d-e06dc2bb3473 req-966d273c-8a3b-4cd0-8351-b488f7abef60 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.562912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:33.574234 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-864378fa-3de9-448a-bc39-2d8e8f10dbf7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 1.010456 Oct 02 01:09:33.579119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d2f704d7-030c-45dc-a76d-e06dc2bb3473 req-966d273c-8a3b-4cd0-8351-b488f7abef60 service nova] Creating event network-changed:825eaf95-3166-4b0a-ac2b-5000382bd516 for instance 3e913515-edff-433c-91e1-7e0f6490ea66 on n-h1-master-1 Oct 02 01:09:33.587245 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d2f704d7-030c-45dc-a76d-e06dc2bb3473 req-966d273c-8a3b-4cd0-8351-b488f7abef60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057389 Oct 02 01:09:33.588295 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1091/2093] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:33.589791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1003/2094] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:32 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:33.601448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:33.603784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:33.610935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:33.611545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:33.618703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.619963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.622034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.625001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.626264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.627328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.629372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.631124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.631643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.632601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.635075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.640346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.897613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:33.907238 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ccfcb800-8d62-4121-9d4f-413d79cf9396 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1275 microversion: 2.1 time: 0.317178 Oct 02 01:09:33.913367 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1092/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:33 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1275 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:33.924384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:33.925647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:33.947883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.949707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.950369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.951870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.952922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.953695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.986375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:34.001775 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54286bbe-93b0-4e05-aea8-031fa475e83d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.410666 Oct 02 01:09:34.009337 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1004/2096] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:33 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:34.300867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:34.313054 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bac7717c-cf35-43f2-ba60-01de10ab9219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.396848 Oct 02 01:09:34.329754 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1093/2097] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:33 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:34.474388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8796a39a-d729-4493-bea9-688810a81ece req-b143993c-a889-4b7b-b123-7d2766b96426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ff56fa-0255-4a23-af32-50537ccd587e", "name": "network-vif-plugged", "status": "completed", "tag": "2de8cfb8-b5be-4fc0-9d78-52af73579fb0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:34.503719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8796a39a-d729-4493-bea9-688810a81ece req-b143993c-a889-4b7b-b123-7d2766b96426 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.506930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8796a39a-d729-4493-bea9-688810a81ece req-b143993c-a889-4b7b-b123-7d2766b96426 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.507425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8796a39a-d729-4493-bea9-688810a81ece req-b143993c-a889-4b7b-b123-7d2766b96426 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.541290 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8796a39a-d729-4493-bea9-688810a81ece req-b143993c-a889-4b7b-b123-7d2766b96426 service nova] Creating event network-vif-plugged:2de8cfb8-b5be-4fc0-9d78-52af73579fb0 for instance 01ff56fa-0255-4a23-af32-50537ccd587e on n-h2-master-1 Oct 02 01:09:34.554969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:34.556505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:34.571056 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8796a39a-d729-4493-bea9-688810a81ece req-b143993c-a889-4b7b-b123-7d2766b96426 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105055 Oct 02 01:09:34.573064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.573768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.574202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.575165 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1005/2098] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:34.577158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.578123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.579865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.606793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:34.609129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:34.625906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.627078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.629675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.632987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.633870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.635958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.736760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:34.751255 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1d88e6b2-bbc8-4195-8cec-24b76a0984b0 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1541 microversion: 2.1 time: 0.200913 Oct 02 01:09:34.752774 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1094/2099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:34 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1541 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:34.962101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:34.962764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:34.973587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.976716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.977475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.978370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.979768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.981336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.263794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:35.277190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff9465e1-e55d-45ab-af90-253a7b875a15 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.676798 Oct 02 01:09:35.278362 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1006/2100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:34 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:35.283626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:35.284576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:35.296372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.297355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.297942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.298872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.299469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.300211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.405752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:35.417446 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba43d8cf-c838-4e6c-9d11-f29722006cbc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.459871 Oct 02 01:09:35.432067 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1095/2101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:34 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:35.448950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:35.449732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:35.458648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.459619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.460256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.461195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.461792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.462704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.581981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:35.590754 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-787509bd-ff68-44cb-8a81-52936957e17e tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1391 microversion: 2.1 time: 0.311085 Oct 02 01:09:35.595393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1007/2102] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:35 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:35.606762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4407f837-d3e6-4279-8e7c-2112c9311488 req-dc0ec20c-83b9-43e4-9b26-45263f37826f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342", "name": "network-vif-deleted", "tag": "b36e4192-f4e3-4e22-90d4-be22b884336a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:35.631367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4407f837-d3e6-4279-8e7c-2112c9311488 req-dc0ec20c-83b9-43e4-9b26-45263f37826f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.631852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4407f837-d3e6-4279-8e7c-2112c9311488 req-dc0ec20c-83b9-43e4-9b26-45263f37826f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.632281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4407f837-d3e6-4279-8e7c-2112c9311488 req-dc0ec20c-83b9-43e4-9b26-45263f37826f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.650955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4407f837-d3e6-4279-8e7c-2112c9311488 req-dc0ec20c-83b9-43e4-9b26-45263f37826f service nova] Creating event network-vif-deleted:b36e4192-f4e3-4e22-90d4-be22b884336a for instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 on n-h2-master-1 Oct 02 01:09:35.661331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4407f837-d3e6-4279-8e7c-2112c9311488 req-dc0ec20c-83b9-43e4-9b26-45263f37826f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064350 Oct 02 01:09:35.663265 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1008/2103] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:35.780882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:35.781929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:35.793134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.793623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.795316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.798509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.799102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.799529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.902143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:35.909811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:35.919181 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95ec2a81-ed05-4d43-9cdc-4ae507899422 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1253 microversion: 2.1 time: 0.143032 Oct 02 01:09:35.920985 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1009/2104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:35 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1253 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:35.922734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-77befd73-394b-4827-9494-87a8c175067e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1321 microversion: 2.1 time: 0.488015 Oct 02 01:09:35.956690 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1096/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:35 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:36.301987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:36.302625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:36.308954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.309454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.309978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.310931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.311398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.311835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.446944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:36.448642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:36.458299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.459123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.460177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.461106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.461730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.462424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.526859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:36.538464 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-486717e1-bc0f-4930-aef3-78d234239479 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.240359 Oct 02 01:09:36.539584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1010/2106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:36 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:36.593215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9a7903d7-aa68-4441-a016-969fb23ea27f req-778156d8-4953-4392-a9db-81e394590ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f", "name": "network-vif-plugged", "status": "completed", "tag": "cc879e24-fb3f-4928-9e8f-95cbc0448644"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:36.610517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9a7903d7-aa68-4441-a016-969fb23ea27f req-778156d8-4953-4392-a9db-81e394590ad4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.611708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9a7903d7-aa68-4441-a016-969fb23ea27f req-778156d8-4953-4392-a9db-81e394590ad4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.614897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9a7903d7-aa68-4441-a016-969fb23ea27f req-778156d8-4953-4392-a9db-81e394590ad4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.647887 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9a7903d7-aa68-4441-a016-969fb23ea27f req-778156d8-4953-4392-a9db-81e394590ad4 service nova] Creating event network-vif-plugged:cc879e24-fb3f-4928-9e8f-95cbc0448644 for instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f on n-h2-master-1 Oct 02 01:09:36.659318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9a7903d7-aa68-4441-a016-969fb23ea27f req-778156d8-4953-4392-a9db-81e394590ad4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070274 Oct 02 01:09:36.661038 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1011/2107] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:09:36.672330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:36.673120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:36.680605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.681657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.682496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.683583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.684409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.685161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.793878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:36.810354 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1f62f553-11cb-4664-a42a-47647d3c32af tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.368369 Oct 02 01:09:36.812959 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1097/2108] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:36 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:36.946294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:36.947688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:36.957650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.959187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.967019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.968198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.968905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.969525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.099029 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=18 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:37.262833 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=36 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:37.301023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:37.311213 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66424ef2-1416-4792-9054-9196e9369648 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1253 microversion: 2.1 time: 0.368699 Oct 02 01:09:37.327112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1098/2109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:36 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1253 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:37.337342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:37.338034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:37.346476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.347187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.347316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:37.355913 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4124e56-d65e-465b-86d7-14993eefe568 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1381 microversion: 2.1 time: 0.690291 Oct 02 01:09:37.362457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1012/2110] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:36 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1381 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:37.380432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.383600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.384108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.385800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.386489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d75aeb7b-42a5-43a8-b38c-c4ee09eb08c6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '.version_select at 0x7fb885566280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:37.391143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d75aeb7b-42a5-43a8-b38c-c4ee09eb08c6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.392488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d75aeb7b-42a5-43a8-b38c-c4ee09eb08c6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.392943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d75aeb7b-42a5-43a8-b38c-c4ee09eb08c6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.414636 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d75aeb7b-42a5-43a8-b38c-c4ee09eb08c6 tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.032038 Oct 02 01:09:37.415445 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1013/2111] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:09:37 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:37.434290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:37.434949 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:37.445642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.446374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.446888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.451620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.452142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.452605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.740450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:37.750292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9028ab48-fdda-4811-aa67-95674d3f55d0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1515 microversion: 2.1 time: 0.418434 Oct 02 01:09:37.751273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1099/2112] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:37 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:37.770433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:37.776256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:37.780398 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88f33c59-d225-442d-b2e6-0656141c7c2f tempest-LiveMigrationTest-1559447379 tempest-LiveMigrationTest-1559447379-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1532 microversion: 2.1 time: 0.348775 Oct 02 01:09:37.783899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.784552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.785210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.786193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.786821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.787383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.791665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1014/2113] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:37 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1532 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:37.808353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-13c504c8-e638-45a8-943d-c746020ba676 req-e13d20e0-c81d-4f76-894f-ef9e04570be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c573da-4599-46b6-b067-b5e01badaa1f", "tag": "07d69cb8-6d88-4253-bd80-222290adf393"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:37.820694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-13c504c8-e638-45a8-943d-c746020ba676 req-e13d20e0-c81d-4f76-894f-ef9e04570be7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.821483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-13c504c8-e638-45a8-943d-c746020ba676 req-e13d20e0-c81d-4f76-894f-ef9e04570be7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.822558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-13c504c8-e638-45a8-943d-c746020ba676 req-e13d20e0-c81d-4f76-894f-ef9e04570be7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.838295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-13c504c8-e638-45a8-943d-c746020ba676 req-e13d20e0-c81d-4f76-894f-ef9e04570be7 service nova] Creating event network-changed:07d69cb8-6d88-4253-bd80-222290adf393 for instance 94c573da-4599-46b6-b067-b5e01badaa1f on n-h1-master-1 Oct 02 01:09:37.844871 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-13c504c8-e638-45a8-943d-c746020ba676 req-e13d20e0-c81d-4f76-894f-ef9e04570be7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050299 Oct 02 01:09:37.846121 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1015/2114] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:37.852222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:37.855058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:37.862801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.863544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.864123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.864969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.865596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.866206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.893324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'flavor' on Instance uuid 01ff56fa-0255-4a23-af32-50537ccd587e {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:09:37.957399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:37.967586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4be5964c-e889-483b-8fc1-70aad66fbc67 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1321 microversion: 2.1 time: 0.199962 Oct 02 01:09:37.982161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1100/2115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:37 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:37.990499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:37.991276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:37.999353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.000024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.000619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.001618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.002457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.004568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.039223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:38.047722 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:38.063203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-123d2d2f-7687-4a52-ab04-5bb24fb3e7fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action" status: 200 len: 32 microversion: 2.1 time: 0.214603 Oct 02 01:09:38.066720 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1016/2116] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:09:37 2022] POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:09:38.070812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:38.071604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:38.079416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.079943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.080472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.081255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.081862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.082350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.147271 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea35a2ee-0bdb-446f-8e84-390b311ea01f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 204 len: 0 microversion: 2.1 time: 0.162673 Oct 02 01:09:38.148006 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1101/2117] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:37 2022] DELETE /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:38.155259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:38.155988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:38.165047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.165704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.166141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.166887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.167328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.167751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.335686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:38.347077 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c928fcf-53c7-43fd-ab6c-d2dd5f827614 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.280562 Oct 02 01:09:38.363639 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1017/2118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:38 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:38.368568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:38.369177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:38.370197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:38.373398 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:38.377147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.377647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.378087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.378857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.379314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.379742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.386542 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62e0e9aa-b3bc-44d8-81eb-2dc0c60045bd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.237236 Oct 02 01:09:38.399937 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1102/2119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:38 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:38.412170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:38.412872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:38.421996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.422693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.423188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.424032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.424568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.425307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.542928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:38.552495 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a45c741b-adf0-4845-8750-1a47ede5ceb2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1387 microversion: 2.1 time: 0.187620 Oct 02 01:09:38.555666 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1018/2120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:38 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1387 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:38.601956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:38.612289 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d42ebfa5-bc8b-4d2b-ac2f-7424c7d8039a tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1253 microversion: 2.1 time: 0.209962 Oct 02 01:09:38.624514 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1103/2121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:38 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1253 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:38.997167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:38.997873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:39.005749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:39.006305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:39.006971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:39.007677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:39.008134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:39.008560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:39.169460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:39.179349 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a86ca8a-2df1-4d9d-9e01-e094cc95b81b tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1470 microversion: 2.1 time: 0.186418 Oct 02 01:09:39.180547 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1019/2122] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:38 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:39.261090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fc6c1ce-0c03-4484-95c2-8354f0cb5fbd tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:39.262367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2fc6c1ce-0c03-4484-95c2-8354f0cb5fbd tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] [instance: 50b7ea6b-5823-4d91-bf1e-452b30147624] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:39.269961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2fc6c1ce-0c03-4484-95c2-8354f0cb5fbd tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] HTTP exception thrown: Instance 50b7ea6b-5823-4d91-bf1e-452b30147624 could not be found. Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fc6c1ce-0c03-4484-95c2-8354f0cb5fbd tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Request method failure captured: Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/50b7ea6b-5823-4d91-bf1e-452b30147624/action HTTP/1.1 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 15 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOS8idEv9WVjz7_9N8UCIijx-LJVV7GN4fyncBr316y09xwAhMHO74x1SsoqPdReMP0ksa84N9caWMMJ12tuZK9-p_bHCZXV8z-iXF-Z0i6oWj9e2N75tQQxR9aEMgYHdn9Er_V-ZsVbJliNbxc994do2XPkE0NiBD1vjrz9X-LQjYk Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4bda47c12c134b48bed286a205e88e3e"}]}] Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: be7b7c6ca9d84c19884aeeb452fe9909 Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: {"migrate": {}} Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 50b7ea6b-5823-4d91-bf1e-452b30147624 could not be found. Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '50b7ea6b-5823-4d91-bf1e-452b30147624', 'body': {'migrate': {}}} Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b7ea6b-5823-4d91-bf1e-452b30147624 could not be found. Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b7ea6b-5823-4d91-bf1e-452b30147624 could not be found. Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:39.274193 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:39.277701 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:39.277701 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:39.277701 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:39.277701 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:39.277701 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b7ea6b-5823-4d91-bf1e-452b30147624 could not be found. Oct 02 01:09:39.277701 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:09:39.280254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fc6c1ce-0c03-4484-95c2-8354f0cb5fbd tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Returning 404 to user: Instance 50b7ea6b-5823-4d91-bf1e-452b30147624 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:39.281354 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2fc6c1ce-0c03-4484-95c2-8354f0cb5fbd tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/50b7ea6b-5823-4d91-bf1e-452b30147624/action" status: 404 len: 111 microversion: 2.1 time: 0.081781 Oct 02 01:09:39.291024 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1104/2123] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:09:39 2022] POST /compute/v2.1/servers/50b7ea6b-5823-4d91-bf1e-452b30147624/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:09:39.369977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:39.370591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:39.371086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1765935135", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:39.386086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:39.389386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:39.389895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:39.390626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:39.391121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:39.395249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:39.453780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:09:40.002418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:40.017324 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea05dceb-d7cf-4171-b785-687eb93dc4cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.650696 Oct 02 01:09:40.018645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1105/2124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:39 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:40.039292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:40.039856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:40.047223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.047868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.048188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.048948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.049589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.050011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.158930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:09:40.160035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:09:40.160724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:09:40.173106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:09:40.173814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:09:40.195118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.196110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.196733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.201225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.202518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.203154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.230636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Getting quotas for project 352d900890d9490c9ab92fdc7c889532. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:09:40.237404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Getting quotas for user 7736193e78da4210ad696e5e61ca088c and project 352d900890d9490c9ab92fdc7c889532. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:09:40.252393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:09:40.254756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:40.316852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8e6622f-5598-4784-a190-711c4e3f8e86 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949160 Oct 02 01:09:40.324720 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1020/2125] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:09:40.334803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:40.335452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:40.339997 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:40.345616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.346106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.346542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.347278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.347963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.348196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.477540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:40.486232 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1c305b38-7ada-4447-9aae-de30bd9c6c01 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.466836 Oct 02 01:09:40.487188 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1106/2126] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:40 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:40.491805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:40.492415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:40.514956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.515935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.516650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.517813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.518411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.519292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.672675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:40.688570 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44d23357-8c43-4268-a858-70f6a246de4f tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1253 microversion: 2.1 time: 0.199878 Oct 02 01:09:40.689982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1107/2127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:40 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1253 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:40.695758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1eade975-4e4e-4b3e-831f-7ea98637a9ac tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:40.704292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1eade975-4e4e-4b3e-831f-7ea98637a9ac tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:40.889311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1eade975-4e4e-4b3e-831f-7ea98637a9ac tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:40.908349 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1eade975-4e4e-4b3e-831f-7ea98637a9ac tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1222 microversion: 2.1 time: 0.213111 Oct 02 01:09:40.910759 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1108/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:40 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:41.042186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:41.042847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:41.044757 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:41.054753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.055255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.065970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.067982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.068626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.069213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.494199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:41.505851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70f2b855-e91b-42b3-8942-ff57320fdf16 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1387 microversion: 2.1 time: 1.179661 Oct 02 01:09:41.524528 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1021/2129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:40 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1387 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:41.537692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e59ec9f0-c331-4c0d-bcdc-63cadf4f3be6 req-ce73a72b-b0f2-4bbd-a014-547d2d2c2866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e913515-edff-433c-91e1-7e0f6490ea66", "name": "network-vif-plugged", "status": "completed", "tag": "825eaf95-3166-4b0a-ac2b-5000382bd516"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:41.550383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e59ec9f0-c331-4c0d-bcdc-63cadf4f3be6 req-ce73a72b-b0f2-4bbd-a014-547d2d2c2866 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.551220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e59ec9f0-c331-4c0d-bcdc-63cadf4f3be6 req-ce73a72b-b0f2-4bbd-a014-547d2d2c2866 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.551924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e59ec9f0-c331-4c0d-bcdc-63cadf4f3be6 req-ce73a72b-b0f2-4bbd-a014-547d2d2c2866 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.568367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e59ec9f0-c331-4c0d-bcdc-63cadf4f3be6 req-ce73a72b-b0f2-4bbd-a014-547d2d2c2866 service nova] Creating event network-vif-plugged:825eaf95-3166-4b0a-ac2b-5000382bd516 for instance 3e913515-edff-433c-91e1-7e0f6490ea66 on n-h1-master-1 Oct 02 01:09:41.575426 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e59ec9f0-c331-4c0d-bcdc-63cadf4f3be6 req-ce73a72b-b0f2-4bbd-a014-547d2d2c2866 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048432 Oct 02 01:09:41.577247 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1022/2130] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:41.583775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:41.584741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:41.592611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.593572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.594384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.595379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.596193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.597152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.802485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:41.819937 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3843f172-0f17-47f2-8ca2-86d94f28fe0e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.779477 Oct 02 01:09:41.838866 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1109/2131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:41 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:41.849935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:41.853824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:41.867191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.869038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.869673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.871618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.875255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.875893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.047268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:42.057862 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-698d3b33-a6c3-4635-88cf-8614655aae61 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.478907 Oct 02 01:09:42.059040 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1023/2132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:41 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:42.065303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:42.066378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:42.072724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.073485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.074215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.075439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.076038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.077954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.163526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:42.192052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d15c9312-15f7-4ddd-9184-c5337f3ac465 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1274 microversion: 2.1 time: 0.131672 Oct 02 01:09:42.192674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1024/2133] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:42 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:42.214247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b61138ff-ff67-46b6-813d-953255a30191 req-33715839-fad1-4677-851a-b3f18cb34951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39831e69-dcd1-4272-9b0a-0b8717bdad39", "name": "network-vif-deleted", "tag": "04589599-8f46-424b-93a0-f62bdc1ad661"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:42.230452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b61138ff-ff67-46b6-813d-953255a30191 req-33715839-fad1-4677-851a-b3f18cb34951 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.231157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b61138ff-ff67-46b6-813d-953255a30191 req-33715839-fad1-4677-851a-b3f18cb34951 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.231619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b61138ff-ff67-46b6-813d-953255a30191 req-33715839-fad1-4677-851a-b3f18cb34951 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.274791 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b61138ff-ff67-46b6-813d-953255a30191 req-33715839-fad1-4677-851a-b3f18cb34951 service nova] Creating event network-vif-deleted:04589599-8f46-424b-93a0-f62bdc1ad661 for instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 on n-h2-master-1 Oct 02 01:09:42.282227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b61138ff-ff67-46b6-813d-953255a30191 req-33715839-fad1-4677-851a-b3f18cb34951 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088336 Oct 02 01:09:42.283595 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1025/2134] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:42.289143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1920403814", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9a195c53-3350-481b-9278-75a22d79ccc3"}], "block_device_mapping_v2": [{"uuid": "63f8e75d-70a7-4a9c-be69-17952a3e0c61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:42.297663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc06a9186b9434d86d5815276c9b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8639be724fdc4c128da53dd69fbbc356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:42.323643 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fed53c3b-d1a7-46e6-bd97-dcaabf6c2f01 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 200 len: 1253 microversion: 2.1 time: 0.469595 Oct 02 01:09:42.328835 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1110/2135] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:41 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 1253 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:42.367543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] validate_networks() for [('9a195c53-3350-481b-9278-75a22d79ccc3', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:09:42.541643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:42.542282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:42.549638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.550266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.550852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.551689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.552268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.552759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.636003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:42.645056 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d57f1158-111d-4dad-b723-67e771a5d7cf tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1183 microversion: 2.1 time: 0.108305 Oct 02 01:09:42.646532 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1111/2136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:42 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:42.844336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:42.845168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:42.852528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.858094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.858709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.862055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.862697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.863235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.864386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:09:42.865310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:09:42.865946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:09:42.866744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:09:42.867947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:09:42.885286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.886745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.887366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.888553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.890291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.891331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.915484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:09:42.923242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Getting quotas for user d44f8d053e07440699d217cd63c94d0d and project 4b8fabf5bc8740b09c77687c9d4e1e77. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:09:42.997904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:09:43.001192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63f8e75d-70a7-4a9c-be69-17952a3e0c61',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:09:43.254219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:43.268647 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e407cb1a-4eda-406c-ac5a-2d6f1fbe4b23 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.427145 Oct 02 01:09:43.269433 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1112/2137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:42 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:43.275734 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:43.276625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:43.283752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:43.285220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:43.285887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:43.287997 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f2be062-94aa-4f11-9f95-d02280cdaaa4 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.002856 Oct 02 01:09:43.288775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1026/2138] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:09:43.290187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:43.290956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:43.291740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:43.302489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:43.303162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:43.325106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:43.325600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:43.326040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:43.326855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:43.327308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:43.327732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:43.840139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:43.850201 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ebf1938-d17f-46c3-a448-19b7c25a5488 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1280 microversion: 2.1 time: 0.558722 Oct 02 01:09:43.850821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1027/2139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:43 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1280 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:43.877061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50dcb3fa-3194-4940-af68-ec098ffcd6a3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:43.877667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50dcb3fa-3194-4940-af68-ec098ffcd6a3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:44.002864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50dcb3fa-3194-4940-af68-ec098ffcd6a3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:44.014446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50dcb3fa-3194-4940-af68-ec098ffcd6a3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:44.017846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50dcb3fa-3194-4940-af68-ec098ffcd6a3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:44.020539 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50dcb3fa-3194-4940-af68-ec098ffcd6a3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1104 microversion: 2.25 time: 0.147286 Oct 02 01:09:44.021225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1028/2140] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:43 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1104 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:44.030440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:44.032067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] [instance: 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:44.044535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.046095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.046810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.047565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.048062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.048491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.053742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:44.062334 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b013e620-a2ce-4679-bce9-dea98adfc648 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.790551 Oct 02 01:09:44.063279 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1113/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:43 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:44.084800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:44.085741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:44.086821 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] HTTP exception thrown: Instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 could not be found. Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Request method failure captured: Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 HTTP/1.1 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOORCAvTb91j8hH0LscXDtcr3LTrI_GkWMdciBqEJWQb8g3k3UbJ9Xw6mNcAXmxJUsMyX0a5U9XT_H_5jbOgIqCmEbT3TCWpZC0NG_rSaps9_uVBZHb7CPiZZzHSi__LP4PVH5Qy3AzibJHkqshsnEb4KTeRzabBPf7q_jcyZXqBP2as Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8639be724fdc4c128da53dd69fbbc356 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestBootFromVolume-1106838917 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8639be724fdc4c128da53dd69fbbc356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8639be724fdc4c128da53dd69fbbc356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8639be724fdc4c128da53dd69fbbc356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8639be724fdc4c128da53dd69fbbc356"}]}] Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestBootFromVolume-1106838917 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8639be724fdc4c128da53dd69fbbc356 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1106838917 Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestBootFromVolume-1106838917-project Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: ddc06a9186b9434d86d5815276c9b51d Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestBootFromVolume-1106838917-project Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 could not be found. Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342'} Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 could not be found. Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 could not be found. Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:44.088837 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 could not be found. Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Returning 404 to user: Instance 04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:44.092766 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ec87152-4c36-4213-b1b4-2eb59d8a7af7 tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342" status: 404 len: 111 microversion: 2.1 time: 0.067774 Oct 02 01:09:44.095308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1029/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:44 2022] GET /compute/v2.1/servers/04f2e26d-6cb6-47cd-b9c6-eeb8ca6c2342 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:09:44.099078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.101089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a28c76fa-a1a5-4aaa-9c2e-0aaebfee7dcb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] Calling method '.version_select at 0x7fb885519c10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:44.101402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.102030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.105843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.107050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.108814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.125162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a28c76fa-a1a5-4aaa-9c2e-0aaebfee7dcb tempest-ServersTestBootFromVolume-1106838917 tempest-ServersTestBootFromVolume-1106838917-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106632051" status: 202 len: 0 microversion: 2.1 time: 0.028058 Oct 02 01:09:44.126376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1030/2143] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106632051 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:09:44.229643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:44.258355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c40a3083-ca86-4964-b2d8-d55870aca3b4 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1183 microversion: 2.1 time: 0.185824 Oct 02 01:09:44.269724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1114/2144] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:44 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:44.303847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:44.305265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:44.317526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.318360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.319045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.319832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.320770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.321274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.619646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:44.629544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a978d21c-42db-483c-a5db-623ceca469e4 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.339383 Oct 02 01:09:44.643831 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1031/2145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:44 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:44.882084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:44.882755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:44.894021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.896431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.897701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.913832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.914593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.915281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.047290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:45.048877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:45.059721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.063528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.064111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.065208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.067620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.068133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.171188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:45.185035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:45.190119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:45.193712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-477d5a84-7546-4a8f-b511-22be6cc83bf6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1233 microversion: 2.25 time: 0.151661 Oct 02 01:09:45.211177 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1032/2146] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:45 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1233 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:45.221372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:45.222293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:45.229221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.230169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.230874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.236012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.236753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.237387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.620287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:45.636646 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c909b602-bb92-4f28-a981-ee3ac9d16cdf tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.753101 Oct 02 01:09:45.637351 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1115/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:44 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:45.652328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:45.652487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:45.665164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.672775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.673445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.674345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.675333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.675929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.796694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:45.817743 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5607e76e-5edf-46d7-9750-f1fa91a0a888 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1183 microversion: 2.1 time: 0.178874 Oct 02 01:09:45.818906 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1116/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:45 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:45.824379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:45.825156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:45.842989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.843497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.843945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.844662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:45.845125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:45.845556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:45.932274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:45.940541 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1bcfe5c6-6b1f-431a-8384-4b23f8478943 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.727812 Oct 02 01:09:45.941125 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1033/2149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:45 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:45.969965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2b9e8333-07f9-4555-9612-7f4e2395ebde req-8cf08228-80a3-428c-b59e-b9cf32f92c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c573da-4599-46b6-b067-b5e01badaa1f", "name": "network-vif-plugged", "status": "completed", "tag": "07d69cb8-6d88-4253-bd80-222290adf393"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:46.003443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2b9e8333-07f9-4555-9612-7f4e2395ebde req-8cf08228-80a3-428c-b59e-b9cf32f92c5a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.004162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2b9e8333-07f9-4555-9612-7f4e2395ebde req-8cf08228-80a3-428c-b59e-b9cf32f92c5a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.004781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2b9e8333-07f9-4555-9612-7f4e2395ebde req-8cf08228-80a3-428c-b59e-b9cf32f92c5a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.033320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2b9e8333-07f9-4555-9612-7f4e2395ebde req-8cf08228-80a3-428c-b59e-b9cf32f92c5a service nova] Creating event network-vif-plugged:07d69cb8-6d88-4253-bd80-222290adf393 for instance 94c573da-4599-46b6-b067-b5e01badaa1f on n-h1-master-1 Oct 02 01:09:46.041661 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2b9e8333-07f9-4555-9612-7f4e2395ebde req-8cf08228-80a3-428c-b59e-b9cf32f92c5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079282 Oct 02 01:09:46.050920 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1034/2150] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:46.229331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:46.230287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:46.256972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.259829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.260434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.261303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.262171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:46.262857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.266784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.274975 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b2cdd99-1d27-4560-a7ba-d7627ad74904 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.454736 Oct 02 01:09:46.278445 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1117/2151] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:45 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:46.453838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:46.462767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:46.464714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:46.466076 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16852f4c-6f30-4538-8d6f-23fd734f1b75 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1251 microversion: 2.25 time: 0.242229 Oct 02 01:09:46.479602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1035/2152] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:46 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1251 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:46.661806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:46.663232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:46.683628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.684139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.684597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.686002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.688231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.690049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.845334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:46.850902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:46.879214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.882160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.883640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.885814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.887327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.887481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.063587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:47.083166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47d39f2e-08d8-42c8-8036-0d997275b604 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 200 len: 1183 microversion: 2.1 time: 0.245361 Oct 02 01:09:47.085751 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1036/2153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:46 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 1183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:47.104675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:47.114833 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3df50d24-a27b-4005-a33a-488986172b59 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.457519 Oct 02 01:09:47.115409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1118/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:46 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:47.119550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:47.125604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:47.141546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.145844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.146708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.148382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.149237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.161751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-50a5d2a1-1c26-42b5-9db0-28c662904952 req-0d599f79-3ae9-47eb-8bd0-b55f067a33ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74385b84-b103-409c-af81-52642aeacb7c", "tag": "1778b1af-17f6-4a29-b457-0a3a065b2133"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:47.199951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.241506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-50a5d2a1-1c26-42b5-9db0-28c662904952 req-0d599f79-3ae9-47eb-8bd0-b55f067a33ab service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.242295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-50a5d2a1-1c26-42b5-9db0-28c662904952 req-0d599f79-3ae9-47eb-8bd0-b55f067a33ab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.245544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-50a5d2a1-1c26-42b5-9db0-28c662904952 req-0d599f79-3ae9-47eb-8bd0-b55f067a33ab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.277879 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-50a5d2a1-1c26-42b5-9db0-28c662904952 req-0d599f79-3ae9-47eb-8bd0-b55f067a33ab service nova] Creating event network-changed:1778b1af-17f6-4a29-b457-0a3a065b2133 for instance 74385b84-b103-409c-af81-52642aeacb7c on n-h2-master-1 Oct 02 01:09:47.291230 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-50a5d2a1-1c26-42b5-9db0-28c662904952 req-0d599f79-3ae9-47eb-8bd0-b55f067a33ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135186 Oct 02 01:09:47.294728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1119/2155] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:47.307896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:47.309662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:47.319365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.320139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.320813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.321880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.322682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.323314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.668459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:47.685635 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5d2b1883-814f-46bb-b738-f7f6c827d557 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.593960 Oct 02 01:09:47.687963 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1037/2156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:47 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:47.697127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:47.699979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:47.714922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:47.719209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.724323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.724938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.725761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.726382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.726929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.732232 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-131cf624-3aff-447c-857c-0f5eb86983a9 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1317 microversion: 2.1 time: 0.428781 Oct 02 01:09:47.735631 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1120/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:47 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:47.883325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:47.884604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:47.893112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.893937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.894744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.895675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.896328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.897098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:48.985108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.009611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.015081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.017105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5ea2f1e-f128-4ea7-8e84-7f59c7608397 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 1.327130 Oct 02 01:09:49.019775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1038/2158] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:47 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:49.033403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:49.034419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 39831e69-dcd1-4272-9b0a-0b8717bdad39] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:49.053405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.054163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.054897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.056230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.056882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.057729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.059879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.077581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.080805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.087621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc89c7d0-3d4d-4e3b-89ea-115e15ed71e2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2946 microversion: 2.42 time: 1.209675 Oct 02 01:09:49.090018 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] HTTP exception thrown: Instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 could not be found. Oct 02 01:09:49.093746 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1121/2159] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:47 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2946 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Request method failure captured: Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 HTTP/1.1 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOL04t2Jw1t5tcXd0DNuZ8iOq7fu8_FegQ6oktfhUDyJSRXvnCQTX31HsORMecgGBHr4POTJ1B5fhnag9fOAUvtqr6BxUEbzVpYO_unyFLm3TcenqLNwf2GiYlaW2xrs7A0JC4c-fGmrtKgvRPZ9NOB8GVQx2JpQW8UOa_0y6U-cp7g Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffe656702bb24b6a9b459ff1b19a0d8c"}]}] Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-LiveMigrationTest-796707941 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-LiveMigrationTest-796707941-project Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 6da1976f703f402788953f3332a281de Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-LiveMigrationTest-796707941-project Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 could not be found. Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '39831e69-dcd1-4272-9b0a-0b8717bdad39'} Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 could not be found. Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 could not be found. Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:49.095617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 could not be found. Oct 02 01:09:49.101198 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:49.103077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Returning 404 to user: Instance 39831e69-dcd1-4272-9b0a-0b8717bdad39 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:49.103931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:49.104470 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ca104b4-acba-4ad8-8e2f-f20861a0c496 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39" status: 404 len: 111 microversion: 2.1 time: 0.077244 Oct 02 01:09:49.104592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:49.112511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1039/2160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:49 2022] GET /compute/v2.1/servers/39831e69-dcd1-4272-9b0a-0b8717bdad39 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:09:49.119371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:49.120236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:49.127538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.128159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.128610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.129336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.129802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.130327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.132730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.133657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.133866 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:49.134454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.136758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.137387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.138012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.158893 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:49.633610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.662646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2a59fcb8-663d-47fb-a583-8f2037cd542e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.548262 Oct 02 01:09:49.663868 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1040/2161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:49 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:49.672710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:49.674865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:49.685443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.686217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.686830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.687776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.688849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.689506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.739811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:49.752541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e5407ee2-d436-4831-8a48-6d77b5e99055 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.657648 Oct 02 01:09:49.754239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1122/2162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:49 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:49.759995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:49.760779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:49.767799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.768640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.769246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.770088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.770710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.771274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.044592 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4334ada0-2c6d-485b-b4c6-a526a389e099 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.288267 Oct 02 01:09:50.046044 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1123/2163] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:09:49 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26/os-interface => generated 1830 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:50.058741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:50.059563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:50.074081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.085211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.085907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.087006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.088676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.093147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.146515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:50.171177 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2041a2a-9bc1-4e66-8512-d7f0152c07f1 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 200 len: 1506 microversion: 2.1 time: 0.505445 Oct 02 01:09:50.173895 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1041/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:49 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:50.200323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:50.201215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:50.209284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.210127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.210738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.212690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.213489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.214058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.498814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:50.512024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:50.514851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:50.516369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8b45a2c-59cd-4f06-af2c-7e2eb0dc8087 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 0.468295 Oct 02 01:09:50.517904 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1124/2165] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:50 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:50.524175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-71c483ef-2fc1-46d9-8d52-19a8bd083635 req-838232f0-46eb-44f9-a085-ab63f1c8708c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3933092-3252-458b-a700-ccb965d9f875", "tag": "85e768a1-234d-44b8-8b27-020683b0f9cb"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:50.538192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-71c483ef-2fc1-46d9-8d52-19a8bd083635 req-838232f0-46eb-44f9-a085-ab63f1c8708c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.539137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-71c483ef-2fc1-46d9-8d52-19a8bd083635 req-838232f0-46eb-44f9-a085-ab63f1c8708c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.539779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-71c483ef-2fc1-46d9-8d52-19a8bd083635 req-838232f0-46eb-44f9-a085-ab63f1c8708c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.554946 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-71c483ef-2fc1-46d9-8d52-19a8bd083635 req-838232f0-46eb-44f9-a085-ab63f1c8708c service nova] Creating event network-changed:85e768a1-234d-44b8-8b27-020683b0f9cb for instance a3933092-3252-458b-a700-ccb965d9f875 on n-h1-master-1 Oct 02 01:09:50.563848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-71c483ef-2fc1-46d9-8d52-19a8bd083635 req-838232f0-46eb-44f9-a085-ab63f1c8708c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043612 Oct 02 01:09:50.565698 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1125/2166] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:50.696557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:50.697343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:50.711951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.712452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.712895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.713637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.714101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.714532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.802542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:50.816649 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-886739a8-6075-40c9-9a5a-d05a9dd2b609 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66" status: 200 len: 1505 microversion: 2.1 time: 0.620198 Oct 02 01:09:50.834782 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1042/2167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:50 2022] GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 => generated 1505 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:50.851763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:50.852749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:50.870998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.871602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.872091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.872776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.873758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.874198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.897736 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:51.297430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:51.310190 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-346705bb-f796-4153-9778-cb5d819159b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.617716 Oct 02 01:09:51.313451 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1126/2168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:50 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:51.319926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:51.320623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:51.328960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.329792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.330389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.331240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.332279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.332719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.378964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:51.393185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:51.401720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afe73d94-eeb2-4a59-93af-49a880080be7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.565407 Oct 02 01:09:51.409926 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1043/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:50 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:51.536701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7e16ce8-aab4-404d-8389-942dc0e22ff7 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66" status: 204 len: 0 microversion: 2.1 time: 0.221228 Oct 02 01:09:51.538052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1127/2170] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:51 2022] DELETE /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:51.549062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:51.549789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:51.565483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.566055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.566500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.575687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.576680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.577703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.582345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:51.586382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:51.595197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.595964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.596581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.597466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.598080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.598680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.617266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:51.731864 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c16cb0f-342c-469a-bfb7-ac2baf235daf tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "DELETE /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 204 len: 0 microversion: 2.1 time: 0.188882 Oct 02 01:09:51.733956 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1044/2171] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:51 2022] DELETE /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:51.744060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:51.744895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:51.753719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.754395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.755042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.755856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.757111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.757832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.002544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:52.016799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:52.018329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:52.031870 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be48ff2a-286a-4b7c-9132-a03a4fd6c25b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 0.476426 Oct 02 01:09:52.035033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1128/2172] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:51 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:52.275937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:52.285269 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d10c4a04-b749-4969-b8b2-90a8d99cab3c tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66" status: 200 len: 1511 microversion: 2.1 time: 0.545789 Oct 02 01:09:52.286334 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1045/2173] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:51 2022] GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:52.337229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:52.338476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:52.348568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:52.349244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:52.349779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.350533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:52.351063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:52.351494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.430664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:52.431976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:52.441255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:52.441789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:52.442431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.443596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:52.444237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:52.444850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.535102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:52.547138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32586ffe-731f-4b22-9d86-07cefea12767 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.213872 Oct 02 01:09:52.549249 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1129/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:52 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:52.691793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:52.700574 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99dcf780-1aef-4855-a4bc-5db8b6740c4c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.275396 Oct 02 01:09:52.701173 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1046/2175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:52 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:53.057189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:53.058015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:53.065996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.066727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.067350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.068266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.068875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.069591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.296332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:53.310563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:53.311678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:53.323742 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:53.328617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:53.347896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.348643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.352060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:53.353397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.354304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.354753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.355213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.356966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e2cd4ea-fb14-400d-bff0-cba0b340d8f6 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 0.303774 Oct 02 01:09:53.374847 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1130/2176] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:53 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:53.573757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:53.574292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:53.593784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.594289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.594755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.595479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.595932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.596531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.784017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:53.795055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-71899d98-e5c5-47ba-ac34-2f154e072b5e tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66" status: 200 len: 1511 microversion: 2.1 time: 0.489202 Oct 02 01:09:53.809527 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1047/2177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:53 2022] GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:53.823682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:53.824624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:53.831082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.831927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.832514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.833383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.834013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.834588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.009470 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=14 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:54.049749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:54.067168 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3de8a2f-c1db-4711-9a85-3124a57b4202 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.490561 Oct 02 01:09:54.068024 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1131/2178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:53 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:54.137681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:54.151953 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4044d5a7-5479-485f-91c5-8480f372d2fc tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.339099 Oct 02 01:09:54.164478 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1048/2179] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:53 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:54.322804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-bb3769ce-d21d-4770-913d-e693637e9a3d req-168ed414-3c46-4993-85e1-2047ce04ac51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74385b84-b103-409c-af81-52642aeacb7c", "name": "network-vif-plugged", "status": "completed", "tag": "1778b1af-17f6-4a29-b457-0a3a065b2133"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:54.344144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bb3769ce-d21d-4770-913d-e693637e9a3d req-168ed414-3c46-4993-85e1-2047ce04ac51 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.345422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bb3769ce-d21d-4770-913d-e693637e9a3d req-168ed414-3c46-4993-85e1-2047ce04ac51 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.346013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bb3769ce-d21d-4770-913d-e693637e9a3d req-168ed414-3c46-4993-85e1-2047ce04ac51 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.360889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-bb3769ce-d21d-4770-913d-e693637e9a3d req-168ed414-3c46-4993-85e1-2047ce04ac51 service nova] Creating event network-vif-plugged:1778b1af-17f6-4a29-b457-0a3a065b2133 for instance 74385b84-b103-409c-af81-52642aeacb7c on n-h2-master-1 Oct 02 01:09:54.367404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-bb3769ce-d21d-4770-913d-e693637e9a3d req-168ed414-3c46-4993-85e1-2047ce04ac51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049158 Oct 02 01:09:54.368736 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1132/2180] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:54.392697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:54.393599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:54.410782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.411450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.413509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.417379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.418114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.418958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.828158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:54.828848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:54.846057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.846550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.847200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.848077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.848679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.849364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:55.949433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:55.980079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:55.985323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:55.990813 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85e179c2-691c-4127-9c3d-877b6ee24150 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 1.604935 Oct 02 01:09:55.996465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1049/2181] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:54 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:56.020030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:56.046776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:56.088678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:56.095396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:56.096119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:56.097080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:56.097980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:56.099401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:56.639980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f58b08b8e46f1a3fbbfa14d4fd23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:56.657076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58c31a0c-1a4c-47ba-ada3-80d66d7c6ee6 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66" status: 200 len: 1511 microversion: 2.1 time: 1.833018 Oct 02 01:09:56.660587 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1133/2182] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:54 2022] GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 => generated 1511 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:09:56.678924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:56.680074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:56.705521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:56.707412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:56.709479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:56.711899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:56.712459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:56.712907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.045357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:57.059529 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d248e684-7ef8-4723-adec-24db74e218b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 1.058176 Oct 02 01:09:57.060367 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1050/2183] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:55 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:57.079633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7f781c73-180f-42f8-87d2-4ca0918394a4 req-87574bb0-31d2-472c-a8ce-391483a98a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e913515-edff-433c-91e1-7e0f6490ea66", "name": "network-vif-deleted", "tag": "825eaf95-3166-4b0a-ac2b-5000382bd516"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:57.094619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7f781c73-180f-42f8-87d2-4ca0918394a4 req-87574bb0-31d2-472c-a8ce-391483a98a89 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.096565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7f781c73-180f-42f8-87d2-4ca0918394a4 req-87574bb0-31d2-472c-a8ce-391483a98a89 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.107404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7f781c73-180f-42f8-87d2-4ca0918394a4 req-87574bb0-31d2-472c-a8ce-391483a98a89 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.133009 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7f781c73-180f-42f8-87d2-4ca0918394a4 req-87574bb0-31d2-472c-a8ce-391483a98a89 service nova] Creating event network-vif-deleted:825eaf95-3166-4b0a-ac2b-5000382bd516 for instance 3e913515-edff-433c-91e1-7e0f6490ea66 on n-h1-master-1 Oct 02 01:09:57.142966 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7f781c73-180f-42f8-87d2-4ca0918394a4 req-87574bb0-31d2-472c-a8ce-391483a98a89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081074 Oct 02 01:09:57.144050 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1051/2184] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:57.160552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:57.174341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:57.193174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.193897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.194490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.209056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.209609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.210078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.599003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:57.617472 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-815c4a52-c7a9-4a20-8d67-3aed1f5a9ace tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1322 microversion: 2.1 time: 0.955352 Oct 02 01:09:57.626338 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1134/2185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:56 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1322 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:57.658205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:57.659076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:57.674318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.685225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.686412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.693383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.693913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.694364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.787151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:09:57.913396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:57.925172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:57.927394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:57.930755 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-51271976-91f2-4728-afa4-699b167c3832 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 0.785317 Oct 02 01:09:57.934770 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1052/2186] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:57 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:09:57.945711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:57.947085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 3e913515-edff-433c-91e1-7e0f6490ea66] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.012747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.021369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.022266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.024691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.025882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.026517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.036165 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89180d32-2e70-4469-bb83-247256fc60ec tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 204 len: 0 microversion: 2.1 time: 0.389659 Oct 02 01:09:58.038712 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1135/2187] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:09:57 2022] DELETE /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:09:58.054516 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:58.057924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.081792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.081910 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] HTTP exception thrown: Instance 3e913515-edff-433c-91e1-7e0f6490ea66 could not be found. Oct 02 01:09:58.084114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.084592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Request method failure captured: Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 HTTP/1.1 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOSmpVuaElp5apL5lSnnt9tfe64_-l37esuc3j7ur9mGWxp5WvQXgzTE3pFwnRHayLvIHTWE5aaSGb6HtyVOttLlZoEZuNvvsXxOI-dnJ8GfpZuUwUTrie5VAFgheiiOigPhOhao0guAhLRbcRa9_rCfhAVo5ZMOkWhp5rxEeztrvcQ Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: f9954f609dd340fa9e1ebbb77a5dff3f Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-MultipleCreateTestJSON-1829050799 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9954f609dd340fa9e1ebbb77a5dff3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9954f609dd340fa9e1ebbb77a5dff3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9954f609dd340fa9e1ebbb77a5dff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9954f609dd340fa9e1ebbb77a5dff3f"}]}] Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-MultipleCreateTestJSON-1829050799 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: f9954f609dd340fa9e1ebbb77a5dff3f Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1829050799 Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-MultipleCreateTestJSON-1829050799-project Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 991f58b08b8e46f1a3fbbfa14d4fd23c Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-MultipleCreateTestJSON-1829050799-project Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3e913515-edff-433c-91e1-7e0f6490ea66 could not be found. Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3e913515-edff-433c-91e1-7e0f6490ea66'} Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e913515-edff-433c-91e1-7e0f6490ea66 could not be found. Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e913515-edff-433c-91e1-7e0f6490ea66 could not be found. Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:58.084757 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e913515-edff-433c-91e1-7e0f6490ea66 could not be found. Oct 02 01:09:58.088712 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.089128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.089128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.089551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.105562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Returning 404 to user: Instance 3e913515-edff-433c-91e1-7e0f6490ea66 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:58.111058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-360e0e18-b5dd-4dbe-a905-2e655884d0cc tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66" status: 404 len: 111 microversion: 2.1 time: 0.174609 Oct 02 01:09:58.112178 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1053/2188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:57 2022] GET /compute/v2.1/servers/3e913515-edff-433c-91e1-7e0f6490ea66 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:09:58.120152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:58.134095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.153143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.155711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.157544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.161971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.164773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.166074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.746831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:58.758361 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c76609be-f945-4078-bf89-a10d9ecb1bc4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.644937 Oct 02 01:09:58.767784 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1054/2189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:58 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:58.783017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:58.784040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] [instance: 94c573da-4599-46b6-b067-b5e01badaa1f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.793218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:58.814578 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31fe5883-6015-474f-b018-0a96c566da6d tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1667 microversion: 2.1 time: 0.772023 Oct 02 01:09:58.819548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.820404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.821183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.823468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.831812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.832235 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1136/2190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:58 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1667 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:58.834099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.841752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:58.852439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.881522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.882198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.882914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.883885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.884574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.885246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.898931 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] HTTP exception thrown: Instance 94c573da-4599-46b6-b067-b5e01badaa1f could not be found. Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Request method failure captured: Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f HTTP/1.1 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOSmpVuaElp5apL5lSnnt9tfe64_-l37esuc3j7ur9mGWxp5WvQXgzTE3pFwnRHayLvIHTWE5aaSGb6HtyVOttLlZoEZuNvvsXxOI-dnJ8GfpZuUwUTrie5VAFgheiiOigPhOhao0guAhLRbcRa9_rCfhAVo5ZMOkWhp5rxEeztrvcQ Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: f9954f609dd340fa9e1ebbb77a5dff3f Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-MultipleCreateTestJSON-1829050799 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9954f609dd340fa9e1ebbb77a5dff3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9954f609dd340fa9e1ebbb77a5dff3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9954f609dd340fa9e1ebbb77a5dff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9954f609dd340fa9e1ebbb77a5dff3f"}]}] Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-MultipleCreateTestJSON-1829050799 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: f9954f609dd340fa9e1ebbb77a5dff3f Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1829050799 Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-MultipleCreateTestJSON-1829050799-project Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 991f58b08b8e46f1a3fbbfa14d4fd23c Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-MultipleCreateTestJSON-1829050799-project Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 94c573da-4599-46b6-b067-b5e01badaa1f could not be found. Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '94c573da-4599-46b6-b067-b5e01badaa1f'} Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c573da-4599-46b6-b067-b5e01badaa1f could not be found. Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c573da-4599-46b6-b067-b5e01badaa1f could not be found. Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:09:58.900492 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c573da-4599-46b6-b067-b5e01badaa1f could not be found. Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] Returning 404 to user: Instance 94c573da-4599-46b6-b067-b5e01badaa1f could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:09:58.908114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a5fc176-070e-4d37-9d26-08a162ac47c0 tempest-MultipleCreateTestJSON-1829050799 tempest-MultipleCreateTestJSON-1829050799-project] 10.222.0.23 "GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f" status: 404 len: 111 microversion: 2.1 time: 0.132762 Oct 02 01:09:58.914993 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1055/2191] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:58 2022] GET /compute/v2.1/servers/94c573da-4599-46b6-b067-b5e01badaa1f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:09:58.941132 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:58.977239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:58.977771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.994020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.994507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.997004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.997894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.999568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.008469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.567819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:59.578028 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:59.590286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:59.591844 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9445b59-3322-430d-998c-a3a3a9c2c8cc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1293 microversion: 2.25 time: 0.625221 Oct 02 01:09:59.607013 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1056/2192] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:09:58 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1293 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:09:59.626898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9c5e5987-8996-4989-9937-b59ba300d56a req-0ed17531-0c84-484f-b4cc-382b170fa747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c573da-4599-46b6-b067-b5e01badaa1f", "name": "network-vif-deleted", "tag": "07d69cb8-6d88-4253-bd80-222290adf393"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:59.647801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c5e5987-8996-4989-9937-b59ba300d56a req-0ed17531-0c84-484f-b4cc-382b170fa747 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.648650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c5e5987-8996-4989-9937-b59ba300d56a req-0ed17531-0c84-484f-b4cc-382b170fa747 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.649296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c5e5987-8996-4989-9937-b59ba300d56a req-0ed17531-0c84-484f-b4cc-382b170fa747 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.666190 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:59.673151 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9c5e5987-8996-4989-9937-b59ba300d56a req-0ed17531-0c84-484f-b4cc-382b170fa747 service nova] Creating event network-vif-deleted:07d69cb8-6d88-4253-bd80-222290adf393 for instance 94c573da-4599-46b6-b067-b5e01badaa1f on n-h1-master-1 Oct 02 01:09:59.696138 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9c5e5987-8996-4989-9937-b59ba300d56a req-0ed17531-0c84-484f-b4cc-382b170fa747 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086754 Oct 02 01:09:59.697415 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1057/2193] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:59.793880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:59.794805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:59.817961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.818728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.819301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.820274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.820856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.821399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.903319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:09:59.917544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-037ed30e-d829-47d2-825d-f87dc9b428f6 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1472 microversion: 2.1 time: 1.080430 Oct 02 01:09:59.943319 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1137/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:58 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1472 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:59.955705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:59.956691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:59.974784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.975903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.976592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.977552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.978267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.979028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.446118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:00.461922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-efc01608-99cf-4eac-a8c4-667872bf2d0b tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1667 microversion: 2.1 time: 0.514996 Oct 02 01:10:00.463131 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1138/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:59 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1667 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:00.478772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:00.478772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:00.478992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:00.479097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.479234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.479712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.480429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.481034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.481679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.490190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ddf8217-c529-4433-b651-5a8b6e564aeb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.699596 Oct 02 01:10:00.492513 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1058/2196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:09:59 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:00.512046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lazy-loading 'flavor' on Instance uuid 74385b84-b103-409c-af81-52642aeacb7c {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:00.624143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:00.624968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:00.627164 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2098881-e941-457f-8e62-47c29a8f90f5 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c/action" status: 202 len: 0 microversion: 2.1 time: 0.159076 Oct 02 01:10:00.627882 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1139/2197] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:00 2022] POST /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:10:00.632559 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:00.634904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.635786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.636737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.637709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.640058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.640879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.659369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:00.671399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:00.677969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.678479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.679023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.679745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.680207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.680639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.909345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:00.924070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:00.928766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:00.932982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87ba82a0-dae5-4ce5-bf9f-10cb8ba5c984 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.313835 Oct 02 01:10:00.935673 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1059/2198] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:00 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:01.122935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b29f3179-3a20-4502-9ced-bc3b12b50d35 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1631 microversion: 2.1 time: 0.478374 Oct 02 01:10:01.132127 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1140/2199] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:00 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1631 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:01.493348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:01.494180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:01.502020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.502761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.503338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.504179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.504771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.505360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.521378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:01.521998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:01.532734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.533242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.533684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.534403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.534889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.535318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.714179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:01.726392 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45e43ef9-8fb7-4e45-aa89-dd81fe08249a tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1667 microversion: 2.1 time: 0.236857 Oct 02 01:10:01.727731 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1060/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:01 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1667 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:01.886071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:01.896429 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d641e306-4f5f-446a-8d4c-1a2b70653594 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.379299 Oct 02 01:10:01.898229 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1141/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:01 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:01.965966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:01.966943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:01.978392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.979023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.979632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.980590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.981579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.981990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.156375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:02.160624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:02.168084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.168857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.170375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.171392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.172075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.172778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.181894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:02.201820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:02.203611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:02.206367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-426049aa-83fa-4bff-a450-0c6d9393298b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.244912 Oct 02 01:10:02.208415 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1061/2202] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:01 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:02.364277 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59b68a31-ade3-4a75-b59d-2504026a9626 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1614 microversion: 2.1 time: 0.211065 Oct 02 01:10:02.366749 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1142/2203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:02 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1614 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:02.389857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:02.390563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:02.396754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.399229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.399862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.401212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.402551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.403457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.433039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] HTTP exception thrown: Cannot 'migrate' instance 74385b84-b103-409c-af81-52642aeacb7c while it is in vm_state suspended Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Request method failure captured: Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c/action HTTP/1.1 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 15 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS8idEv9WVjz7_9N8UCIijx-LJVV7GN4fyncBr316y09xwAhMHO74x1SsoqPdReMP0ksa84N9caWMMJ12tuZK9-p_bHCZXV8z-iXF-Z0i6oWj9e2N75tQQxR9aEMgYHdn9Er_V-ZsVbJliNbxc994do2XPkE0NiBD1vjrz9X-LQjYk Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4bda47c12c134b48bed286a205e88e3e"}]}] Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: be7b7c6ca9d84c19884aeeb452fe9909 Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: {"migrate": {}} Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'migrate' instance 74385b84-b103-409c-af81-52642aeacb7c while it is in vm_state suspended Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '74385b84-b103-409c-af81-52642aeacb7c', 'body': {'migrate': {}}} Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74385b84-b103-409c-af81-52642aeacb7c in vm_state suspended. Cannot resize while the instance is in this state. Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:02.435212 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 74385b84-b103-409c-af81-52642aeacb7c while it is in vm_state suspended Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 74385b84-b103-409c-af81-52642aeacb7c while it is in vm_state suspended Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.439205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Returning 409 to user: Cannot 'migrate' instance 74385b84-b103-409c-af81-52642aeacb7c while it is in vm_state suspended {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:02.440092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ecc147e-2ef7-47f6-b1f7-835bd286022c tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c/action" status: 409 len: 148 microversion: 2.1 time: 0.054102 Oct 02 01:10:02.442788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1062/2204] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:02 2022] POST /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c/action => generated 148 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:10:02.452257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11d4f86e-33f1-44fc-b835-4555bc6eaf1e tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11d4f86e-33f1-44fc-b835-4555bc6eaf1e tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Request method failure captured: Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f/action HTTP/1.1 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 39 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOS8idEv9WVjz7_9N8UCIijx-LJVV7GN4fyncBr316y09xwAhMHO74x1SsoqPdReMP0ksa84N9caWMMJ12tuZK9-p_bHCZXV8z-iXF-Z0i6oWj9e2N75tQQxR9aEMgYHdn9Er_V-ZsVbJliNbxc994do2XPkE0NiBD1vjrz9X-LQjYk Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4bda47c12c134b48bed286a205e88e3e"}]}] Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: be7b7c6ca9d84c19884aeeb452fe9909 Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: {"os-resetState": {"state": "invalid"}} Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'd2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'invalid' Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:10:02.456249 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 02 01:10:02.460284 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.460998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11d4f86e-33f1-44fc-b835-4555bc6eaf1e tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:02.461816 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-11d4f86e-33f1-44fc-b835-4555bc6eaf1e tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f/action" status: 400 len: 144 microversion: 2.1 time: 0.014484 Oct 02 01:10:02.463267 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1143/2205] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:02 2022] POST /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f/action => generated 144 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:10:02.474076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e41cd8e-213f-46b4-b592-daf365db5d09 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e41cd8e-213f-46b4-b592-daf365db5d09 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Request method failure captured: Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f/action HTTP/1.1 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 31 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS8idEv9WVjz7_9N8UCIijx-LJVV7GN4fyncBr316y09xwAhMHO74x1SsoqPdReMP0ksa84N9caWMMJ12tuZK9-p_bHCZXV8z-iXF-Z0i6oWj9e2N75tQQxR9aEMgYHdn9Er_V-ZsVbJliNbxc994do2XPkE0NiBD1vjrz9X-LQjYk Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4bda47c12c134b48bed286a205e88e3e"}]}] Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: be7b7c6ca9d84c19884aeeb452fe9909 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: {"os-resetState": {"state": 1}} Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f', 'body': {'os-resetState': {'state': 1}}} Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 1 Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 02 01:10:02.477758 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e41cd8e-213f-46b4-b592-daf365db5d09 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e41cd8e-213f-46b4-b592-daf365db5d09 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f/action" status: 400 len: 120 microversion: 2.1 time: 0.009490 Oct 02 01:10:02.481839 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1063/2206] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:02 2022] POST /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:10:02.490474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3419b82f-d89c-4152-adb0-f70b2a0fa832 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:02.492974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3419b82f-d89c-4152-adb0-f70b2a0fa832 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Failed to fetch instance by id 999 {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:10:02.493746 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-3419b82f-d89c-4152-adb0-f70b2a0fa832 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3419b82f-d89c-4152-adb0-f70b2a0fa832 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Request method failure captured: Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 37 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOS8idEv9WVjz7_9N8UCIijx-LJVV7GN4fyncBr316y09xwAhMHO74x1SsoqPdReMP0ksa84N9caWMMJ12tuZK9-p_bHCZXV8z-iXF-Z0i6oWj9e2N75tQQxR9aEMgYHdn9Er_V-ZsVbJliNbxc994do2XPkE0NiBD1vjrz9X-LQjYk Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4bda47c12c134b48bed286a205e88e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4bda47c12c134b48bed286a205e88e3e"}]}] Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4bda47c12c134b48bed286a205e88e3e Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-558659833 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: be7b7c6ca9d84c19884aeeb452fe9909 Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersAdminNegativeTestJSON-558659833-project-admin Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: {"os-resetState": {"state": "error"}} Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 999 could not be found. Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:02.498442 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:02.502587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:02.502587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 02 01:10:02.502587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:02.506915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3419b82f-d89c-4152-adb0-f70b2a0fa832 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:02.506915 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3419b82f-d89c-4152-adb0-f70b2a0fa832 tempest-ServersAdminNegativeTestJSON-558659833 tempest-ServersAdminNegativeTestJSON-558659833-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.017901 Oct 02 01:10:02.506915 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1144/2207] 10.222.0.23 () {60 vars in 1179 bytes} [Sun Oct 2 01:10:02 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:10:02.518262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:02.519022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:02.525202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.525845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.526293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.527040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.527565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.528004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.559587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:10:02.695059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fbd060dc-9198-4d05-aa4b-7d0f203025ee tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 204 len: 0 microversion: 2.1 time: 0.184539 Oct 02 01:10:02.696503 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1064/2208] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:10:02 2022] DELETE /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:10:02.705922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:02.706569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:02.715101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.715991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.716659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.718275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.718998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.719654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.754891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:02.756371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:02.783907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.784561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.785009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.785920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.786474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.786941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.006829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:03.019601 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-55cb1b45-29fd-4601-89ea-501f0e7195f1 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 200 len: 1600 microversion: 2.1 time: 0.269261 Oct 02 01:10:03.022994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1065/2209] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:02 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 1600 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:03.029150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c1bab162-5f0d-49ca-99a9-66e0bd8ebd91 req-7948b7f4-2290-40db-aabb-9460459db8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb1a15c-d52b-476c-a4e3-50bbdbaef041", "name": "network-vif-deleted", "tag": "08aace31-2f62-4fd1-ab2a-13fc3014b4c9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:03.059153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c1bab162-5f0d-49ca-99a9-66e0bd8ebd91 req-7948b7f4-2290-40db-aabb-9460459db8e3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.059707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c1bab162-5f0d-49ca-99a9-66e0bd8ebd91 req-7948b7f4-2290-40db-aabb-9460459db8e3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.060243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c1bab162-5f0d-49ca-99a9-66e0bd8ebd91 req-7948b7f4-2290-40db-aabb-9460459db8e3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.073136 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:03.080706 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c1bab162-5f0d-49ca-99a9-66e0bd8ebd91 req-7948b7f4-2290-40db-aabb-9460459db8e3 service nova] Creating event network-vif-deleted:08aace31-2f62-4fd1-ab2a-13fc3014b4c9 for instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 on n-h1-master-1 Oct 02 01:10:03.085325 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30cf8578-d049-421a-a4c3-7766117dc9e3 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1469 microversion: 2.1 time: 0.384653 Oct 02 01:10:03.101195 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1145/2210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:02 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:03.109693 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c1bab162-5f0d-49ca-99a9-66e0bd8ebd91 req-7948b7f4-2290-40db-aabb-9460459db8e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084851 Oct 02 01:10:03.113187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:03.113358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1066/2211] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:03.114240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:03.124338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.125126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.126345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.127395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.128013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.128635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.236778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:03.237449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:03.244023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.244545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.246264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.247072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.247544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.247969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.401815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:03.428139 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95b7bc96-ea5f-4c9f-b43b-d5732e474d9d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.325385 Oct 02 01:10:03.429530 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1146/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:03 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:03.480980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:03.493768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:03.495425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:03.496572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65249707-9eaa-4322-beb8-18b5bb9d569b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.265122 Oct 02 01:10:03.512808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1067/2213] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:03 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:04.049653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:04.050542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4bb1a15c-d52b-476c-a4e3-50bbdbaef041] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:04.068547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.069058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.069514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.071237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.071657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.074326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.104526 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] HTTP exception thrown: Instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 could not be found. Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Request method failure captured: Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 HTTP/1.1 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOL04t2Jw1t5tcXd0DNuZ8iOq7fu8_FegQ6oktfhUDyJSRXvnCQTX31HsORMecgGBHr4POTJ1B5fhnag9fOAUvtqr6BxUEbzVpYO_unyFLm3TcenqLNwf2GiYlaW2xrs7A0JC4c-fGmrtKgvRPZ9NOB8GVQx2JpQW8UOa_0y6U-cp7g Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffe656702bb24b6a9b459ff1b19a0d8c"}]}] Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveMigrationTest-796707941 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveMigrationTest-796707941-project Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6da1976f703f402788953f3332a281de Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveMigrationTest-796707941-project Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 could not be found. Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '4bb1a15c-d52b-476c-a4e3-50bbdbaef041'} Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 could not be found. Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 could not be found. Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:04.112428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 could not be found. Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:04.116050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Returning 404 to user: Instance 4bb1a15c-d52b-476c-a4e3-50bbdbaef041 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:04.116474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:04.116474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:04.120094 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8943a3bd-15ba-47f6-b0ef-3d0ff61d658f tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041" status: 404 len: 111 microversion: 2.1 time: 0.070869 Oct 02 01:10:04.124926 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1147/2214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:04 2022] GET /compute/v2.1/servers/4bb1a15c-d52b-476c-a4e3-50bbdbaef041 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:10:04.134291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e283e3e-1348-4bd3-8c5b-d9282aff23e0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '.version_select at 0x7fb880a49310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:04.142314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.147172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.148242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.150152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.151903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.152529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.184700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e283e3e-1348-4bd3-8c5b-d9282aff23e0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428944896" status: 202 len: 0 microversion: 2.1 time: 0.057972 Oct 02 01:10:04.185447 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1148/2215] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428944896 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:10:04.452641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:04.453699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:04.461556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.462309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.462938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.463856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.464469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.465049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:05.095880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:05.107120 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9dcd46d-7718-4916-82e0-dbadac56f1e7 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1469 microversion: 2.1 time: 0.996477 Oct 02 01:10:05.108617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1068/2216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:04 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1469 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:05.118295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:05.118295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:05.129389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:05.129888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:05.130323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:05.131107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:05.131896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:05.131991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:05.382039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:05.396154 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a21d9441-31a3-4cad-b9aa-54eb708c6703 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.947328 Oct 02 01:10:05.403164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1149/2217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:04 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:05.572612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3964c49-a7a3-48f5-a1e1-cba8a7978a6e tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Action: 'create', calling method: .version_select at 0x7fb8809d6310>, body: {"keypair": {"name": "tempest-keypair-1044879790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuWAtBVY5oKeBePCIthxrACCPrYSBvbSbfNnazprwPwQ0gJJ7sC/NE0VwVldkH5lpcMg22EfdpnRTR7LsUu3WS6dRSKeImXa81D+FN90JvagdSYpO2afSr77diGaxYaKA=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:05.601294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c3964c49-a7a3-48f5-a1e1-cba8a7978a6e tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Getting quotas for project 918bcae48ada42b48ffd801791f5df22. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:05.603682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:05.609299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c3964c49-a7a3-48f5-a1e1-cba8a7978a6e tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Getting quotas for user 214ad89f7fde4314a25b19d1e3479e9f and project 918bcae48ada42b48ffd801791f5df22. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:05.612825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:05.614507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:05.616535 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b413529-3bb5-44e7-a093-e1e3bae9f3b1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.506670 Oct 02 01:10:05.630989 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:05.631697 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1069/2218] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:05 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:05.645442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c3964c49-a7a3-48f5-a1e1-cba8a7978a6e tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240253 Oct 02 01:10:05.646969 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1150/2219] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:10:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:06.141097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:06.141859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:06.153859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.156023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.157386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.160649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.161450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.163186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.246574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c8edba46-d7d0-403e-91c7-478bec7d144c req-67345983-1eb6-4c9c-a65a-82bebd7f6952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74385b84-b103-409c-af81-52642aeacb7c", "name": "network-vif-deleted", "tag": "1778b1af-17f6-4a29-b457-0a3a065b2133"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:06.294767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c8edba46-d7d0-403e-91c7-478bec7d144c req-67345983-1eb6-4c9c-a65a-82bebd7f6952 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.296602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c8edba46-d7d0-403e-91c7-478bec7d144c req-67345983-1eb6-4c9c-a65a-82bebd7f6952 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.306952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c8edba46-d7d0-403e-91c7-478bec7d144c req-67345983-1eb6-4c9c-a65a-82bebd7f6952 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.345569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c8edba46-d7d0-403e-91c7-478bec7d144c req-67345983-1eb6-4c9c-a65a-82bebd7f6952 service nova] Creating event network-vif-deleted:1778b1af-17f6-4a29-b457-0a3a065b2133 for instance 74385b84-b103-409c-af81-52642aeacb7c on n-h2-master-1 Oct 02 01:10:06.363084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c8edba46-d7d0-403e-91c7-478bec7d144c req-67345983-1eb6-4c9c-a65a-82bebd7f6952 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118404 Oct 02 01:10:06.364873 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1151/2220] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:06.430981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:06.433037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:06.446164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.453792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.455421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.458686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.459350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.461158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.730700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:06.746166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f9ec686-0617-4b24-9d85-c4b93c07c0eb tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 200 len: 1427 microversion: 2.1 time: 0.613067 Oct 02 01:10:06.765564 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1070/2221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:06 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 1427 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:06.771948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:06.773927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:06.781952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.782724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.784039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.785054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.785665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.786248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.822456 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:06.844782 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-617b9c6a-bbe8-4898-b584-276292201c82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.417939 Oct 02 01:10:06.844782 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1152/2222] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:06 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:06.849443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:06.849955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:06.859672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.871114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.871723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.875388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.875903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.876351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.917595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:10:07.032990 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c567944-c3ec-44de-a244-f7856a182fab tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 204 len: 0 microversion: 2.1 time: 0.186964 Oct 02 01:10:07.033587 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1153/2223] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:10:06 2022] DELETE /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:10:07.042405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:07.043411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:07.051363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.051845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.052280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.052989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.053444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.054056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.073448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:07.083036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:07.084484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:07.085625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ce9860d8-538c-4f57-9f15-0d3f537ab962 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.318839 Oct 02 01:10:07.086203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1071/2224] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:06 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:07.261122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:07.273673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da96e854-bcf0-4451-a5c5-86be891f96fc tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1484 microversion: 2.1 time: 0.235731 Oct 02 01:10:07.275758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1154/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:07 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1484 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:07.775857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:07.777167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: 74385b84-b103-409c-af81-52642aeacb7c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:07.817966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.818881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.819338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.820621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.821235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.821776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.839257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] HTTP exception thrown: Instance 74385b84-b103-409c-af81-52642aeacb7c could not be found. Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Request method failure captured: Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c HTTP/1.1 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7JzNXx1FHLzUNTAW04jVA33Fc3_FXELvwG5pi4p7QD1LpS99v8QF0KdULyZYFBg0EXG3taBtFg55rYujKpR8xclk4KuyUJ6gKgQVT20SjidL-WJMDF2ktZTI3xMS4PY-jjph6igEZQh6Hzh2hETJHC-z0am6xv5LsKShVdFnOCKg Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 352d900890d9490c9ab92fdc7c889532 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-778161867 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/352d900890d9490c9ab92fdc7c889532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/352d900890d9490c9ab92fdc7c889532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/352d900890d9490c9ab92fdc7c889532"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_352d900890d9490c9ab92fdc7c889532"}]}] Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-778161867 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 352d900890d9490c9ab92fdc7c889532 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-778161867 Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-778161867-project Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7736193e78da4210ad696e5e61ca088c Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-778161867-project Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 74385b84-b103-409c-af81-52642aeacb7c could not be found. Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '74385b84-b103-409c-af81-52642aeacb7c'} Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74385b84-b103-409c-af81-52642aeacb7c could not be found. Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74385b84-b103-409c-af81-52642aeacb7c could not be found. Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:07.841583 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74385b84-b103-409c-af81-52642aeacb7c could not be found. Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Returning 404 to user: Instance 74385b84-b103-409c-af81-52642aeacb7c could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:07.844892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2afe7c2-a05e-456b-9b95-60e9028f12c0 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c" status: 404 len: 111 microversion: 2.1 time: 0.072825 Oct 02 01:10:07.846972 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1072/2226] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:07 2022] GET /compute/v2.1/servers/74385b84-b103-409c-af81-52642aeacb7c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:10:07.853729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:07.854254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:07.864407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.864911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.865362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.866363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.866872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.867579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.875934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:07.877895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:07.886821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.887822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.888481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.891014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.891744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.892412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.911588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:10:07.915186 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:08.085160 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de3fc05d-d2bf-42cd-b81c-342e43b94403 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 204 len: 0 microversion: 2.1 time: 0.234896 Oct 02 01:10:08.086742 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1155/2227] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:10:07 2022] DELETE /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:10:08.114676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:08.118217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:08.126478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:08.142781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e88b346-8984-491a-ad19-475dc900ffa8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.266718 Oct 02 01:10:08.161109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.161753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1073/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:07 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:08.161880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.162290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.163056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.163677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.164372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.174125 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:08.175070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:08.182626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.183682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.184330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.185558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.186514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.196049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.433940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:08.443990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:08.457414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:08.457414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:08.462066 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cee85960-ab6b-464d-b223-d53ec4eadb5d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.298156 Oct 02 01:10:08.463713 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1074/2229] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:08 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:08.464656 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41c29ac7-4e50-4ebf-963d-a2df2c52e0a4 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1476 microversion: 2.1 time: 0.371420 Oct 02 01:10:08.485070 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1156/2230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:08 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:08.491335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:08.492013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:08.499216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.500373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.501099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.502008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.502706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.503381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.524163 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:08.725174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:08.736899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93a2d61f-c929-40f0-a0df-e1e33bb187f5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 200 len: 1484 microversion: 2.1 time: 0.249354 Oct 02 01:10:08.739033 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1075/2231] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:08 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 1484 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:09.060609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "3bd9dc4e-2192-40ed-9fdb-324fcfe9aa9e"}], "security_groups": [{"name": "tempest-securitygroup--1720062728"}], "key_name": "tempest-keypair-1044879790", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:09.179119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:09.179749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:09.194834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.195365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.207030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.209274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.210014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.210565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.249728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] validate_networks() for [('3bd9dc4e-2192-40ed-9fdb-324fcfe9aa9e', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:10:09.493211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:09.503049 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f100b4b-fedd-497d-b2be-7227ded635f5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.328836 Oct 02 01:10:09.503958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1076/2232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:09 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:09.509972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d3e9c5ae-14c3-49b8-96b9-a23d24afd5d4 req-94e484f1-3fc3-4125-ae7f-9f8e599e480d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9b6852-851e-4c47-bd2f-93dc631f2581", "name": "network-vif-deleted", "tag": "0f4fa885-d86a-49bd-943d-0ec893b75c7e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:09.538071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d3e9c5ae-14c3-49b8-96b9-a23d24afd5d4 req-94e484f1-3fc3-4125-ae7f-9f8e599e480d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.538752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d3e9c5ae-14c3-49b8-96b9-a23d24afd5d4 req-94e484f1-3fc3-4125-ae7f-9f8e599e480d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.539290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d3e9c5ae-14c3-49b8-96b9-a23d24afd5d4 req-94e484f1-3fc3-4125-ae7f-9f8e599e480d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.573795 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d3e9c5ae-14c3-49b8-96b9-a23d24afd5d4 req-94e484f1-3fc3-4125-ae7f-9f8e599e480d service nova] Creating event network-vif-deleted:0f4fa885-d86a-49bd-943d-0ec893b75c7e for instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 on n-h1-master-1 Oct 02 01:10:09.591305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d3e9c5ae-14c3-49b8-96b9-a23d24afd5d4 req-94e484f1-3fc3-4125-ae7f-9f8e599e480d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086003 Oct 02 01:10:09.596199 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1077/2233] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:09.601970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:09.612132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:09.621904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.622501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.623506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.624773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.625452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.626145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.985450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:09.996452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:09.999188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:10.001442 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6904ac44-aec6-4cc6-85dd-9c127662fbca tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.403304 Oct 02 01:10:10.015155 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1078/2234] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:09 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:10.025584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.026477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.034220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.035004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.035656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.037025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.037652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.038769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.066664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:10.067239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:10.067763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:10.068412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:10.068901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:10.087129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.087850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.088383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.089234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.090758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.092363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.123285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Getting quotas for project 918bcae48ada42b48ffd801791f5df22. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:10.129805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Getting quotas for user 214ad89f7fde4314a25b19d1e3479e9f and project 918bcae48ada42b48ffd801791f5df22. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:10.142955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:10:10.145594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:10:10.201270 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d5f84b9-dc64-48c4-a4b3-e583ac1e1f1a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.145222 Oct 02 01:10:10.209219 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1157/2235] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:10:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:10:10.209219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.209668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4b9b6852-851e-4c47-bd2f-93dc631f2581] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.216477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.218963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.219376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.220101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.220557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.220985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.238117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] HTTP exception thrown: Instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 could not be found. Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Request method failure captured: Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 HTTP/1.1 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOL04t2Jw1t5tcXd0DNuZ8iOq7fu8_FegQ6oktfhUDyJSRXvnCQTX31HsORMecgGBHr4POTJ1B5fhnag9fOAUvtqr6BxUEbzVpYO_unyFLm3TcenqLNwf2GiYlaW2xrs7A0JC4c-fGmrtKgvRPZ9NOB8GVQx2JpQW8UOa_0y6U-cp7g Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffe656702bb24b6a9b459ff1b19a0d8c"}]}] Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveMigrationTest-796707941 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveMigrationTest-796707941-project Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6da1976f703f402788953f3332a281de Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveMigrationTest-796707941-project Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 could not be found. Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '4b9b6852-851e-4c47-bd2f-93dc631f2581'} Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 could not be found. Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 could not be found. Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:10.240884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 could not be found. Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Returning 404 to user: Instance 4b9b6852-851e-4c47-bd2f-93dc631f2581 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f8ca8f6-dbfb-470c-b717-ddec4e9a2024 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581" status: 404 len: 111 microversion: 2.1 time: 0.038359 Oct 02 01:10:10.245271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1158/2236] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:10 2022] GET /compute/v2.1/servers/4b9b6852-851e-4c47-bd2f-93dc631f2581 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:10:10.251512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d520b621-dbd8-4a10-a383-cb31cd697b64 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.252137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d520b621-dbd8-4a10-a383-cb31cd697b64 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.366060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d520b621-dbd8-4a10-a383-cb31cd697b64 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:10.378153 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d520b621-dbd8-4a10-a383-cb31cd697b64 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1226 microversion: 2.1 time: 0.133835 Oct 02 01:10:10.379174 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1159/2237] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:10 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:10.385788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.386480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.395610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:10.399449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.400104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.400765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.401695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.402357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.405169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.409491 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd148db0-3a25-428e-af38-8d1a40fb6b83 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1476 microversion: 2.1 time: 0.392169 Oct 02 01:10:10.412402 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1079/2238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:10 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:10.442798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:10:10.538146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.539099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.554688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.556695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.557763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.559897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.562063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.562705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.577880 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9e90813-aead-448c-bdd2-abcefb09c5a0 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 204 len: 0 microversion: 2.1 time: 0.197019 Oct 02 01:10:10.579911 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1160/2239] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:10:10 2022] DELETE /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:10:10.592542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.594261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.605911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.607385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.608979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.610197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.611400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.612189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.338380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.347003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9adbae5-355f-4ba2-af4e-6b6fb36d8ea7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1521 microversion: 2.1 time: 0.820704 Oct 02 01:10:11.347583 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1080/2240] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:10 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:11.352157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:11.352767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:11.359325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.360006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.360449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.361326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.361792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.362353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.371461 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.391295 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-674c196c-8fa0-41df-922d-8ce0b121e737 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1499 microversion: 2.1 time: 0.803762 Oct 02 01:10:11.409008 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1161/2241] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:10 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1499 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:11.418442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:11.419363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:11.429294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.430103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.430817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.431761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.432369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.432948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.594870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.604059 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe7c9e2c-a82f-4909-98f7-1185d88160ab tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1278 microversion: 2.1 time: 0.194074 Oct 02 01:10:11.619048 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1162/2242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:11 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:11.627964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:11.628819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:11.635523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.636323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.636941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.638143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.639124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.640118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.774944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7736193e78da4210ad696e5e61ca088c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d900890d9490c9ab92fdc7c889532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.785139 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2ff7dbb-af7a-4a89-8dc8-57757f400f91 tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 200 len: 1434 microversion: 2.1 time: 0.164931 Oct 02 01:10:11.798630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.799177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1163/2243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:11 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 1434 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:11.815646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.817699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:11.819115 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb0791fa-5a91-47aa-98e8-c1589651e55a tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.470553 Oct 02 01:10:11.819852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1081/2244] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:11 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:11.823126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-04b05c1f-441c-422b-ad80-86cdf5c30d64 req-9e04a8eb-422e-4607-a0ea-23cfbe3eb2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f", "name": "network-vif-deleted", "tag": "cc879e24-fb3f-4928-9e8f-95cbc0448644"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:11.834312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-04b05c1f-441c-422b-ad80-86cdf5c30d64 req-9e04a8eb-422e-4607-a0ea-23cfbe3eb2d7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.835076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-04b05c1f-441c-422b-ad80-86cdf5c30d64 req-9e04a8eb-422e-4607-a0ea-23cfbe3eb2d7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.835860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-04b05c1f-441c-422b-ad80-86cdf5c30d64 req-9e04a8eb-422e-4607-a0ea-23cfbe3eb2d7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.848995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-04b05c1f-441c-422b-ad80-86cdf5c30d64 req-9e04a8eb-422e-4607-a0ea-23cfbe3eb2d7 service nova] Creating event network-vif-deleted:cc879e24-fb3f-4928-9e8f-95cbc0448644 for instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f on n-h2-master-1 Oct 02 01:10:11.854878 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-04b05c1f-441c-422b-ad80-86cdf5c30d64 req-9e04a8eb-422e-4607-a0ea-23cfbe3eb2d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054261 Oct 02 01:10:11.856143 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1164/2245] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:12.335674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1a63d985-77cb-4d83-92d9-4c2c10c7f0e1 req-d600ad0c-9217-42ba-b479-d26da64be5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3933092-3252-458b-a700-ccb965d9f875", "name": "network-vif-plugged", "status": "completed", "tag": "85e768a1-234d-44b8-8b27-020683b0f9cb"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:12.347321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1a63d985-77cb-4d83-92d9-4c2c10c7f0e1 req-d600ad0c-9217-42ba-b479-d26da64be5f7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.347969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1a63d985-77cb-4d83-92d9-4c2c10c7f0e1 req-d600ad0c-9217-42ba-b479-d26da64be5f7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.348632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1a63d985-77cb-4d83-92d9-4c2c10c7f0e1 req-d600ad0c-9217-42ba-b479-d26da64be5f7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:12.365914 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1a63d985-77cb-4d83-92d9-4c2c10c7f0e1 req-d600ad0c-9217-42ba-b479-d26da64be5f7 service nova] Creating event network-vif-plugged:85e768a1-234d-44b8-8b27-020683b0f9cb for instance a3933092-3252-458b-a700-ccb965d9f875 on n-h1-master-1 Oct 02 01:10:12.372793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1a63d985-77cb-4d83-92d9-4c2c10c7f0e1 req-d600ad0c-9217-42ba-b479-d26da64be5f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041700 Oct 02 01:10:12.374292 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1082/2246] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:12.376748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:12.377579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:12.386342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.386939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.387570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:12.388517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.389778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.390299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:12.431161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:12.432040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:12.461800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.470429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.472074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:12.473217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.474236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.474809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.053487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.083304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.083846 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6f83032e-9db0-4902-97d9-dcd2972895e2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1501 microversion: 2.1 time: 0.715686 Oct 02 01:10:13.086564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1165/2247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:12 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1501 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:13.097215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad8029fe-44ac-447f-8a3e-f0bd493e5cd5 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1499 microversion: 2.1 time: 0.679147 Oct 02 01:10:13.099902 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1083/2248] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:12 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1499 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:13.110874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:13.110874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:13.115940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:13.117398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.117987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.118122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] [instance: d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:13.118680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.119669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.120137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.120768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.142687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.146617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.147175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.154535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.156068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.156815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.232254 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] HTTP exception thrown: Instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f could not be found. Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Request method failure captured: Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f HTTP/1.1 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7JzNXx1FHLzUNTAW04jVA33Fc3_FXELvwG5pi4p7QD1LpS99v8QF0KdULyZYFBg0EXG3taBtFg55rYujKpR8xclk4KuyUJ6gKgQVT20SjidL-WJMDF2ktZTI3xMS4PY-jjph6igEZQh6Hzh2hETJHC-z0am6xv5LsKShVdFnOCKg Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 352d900890d9490c9ab92fdc7c889532 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-778161867 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/352d900890d9490c9ab92fdc7c889532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/352d900890d9490c9ab92fdc7c889532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/352d900890d9490c9ab92fdc7c889532"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_352d900890d9490c9ab92fdc7c889532"}]}] Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-778161867 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 352d900890d9490c9ab92fdc7c889532 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-778161867 Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-778161867-project Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7736193e78da4210ad696e5e61ca088c Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-778161867-project Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f could not be found. Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f'} Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f could not be found. Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f could not be found. Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:13.241388 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f could not be found. Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] Returning 404 to user: Instance d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:13.245131 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50ec76f0-ef73-4215-8d23-57fe7a2e2b2c tempest-ServersAdminNegativeTestJSON-778161867 tempest-ServersAdminNegativeTestJSON-778161867-project] 10.222.0.23 "GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f" status: 404 len: 111 microversion: 2.1 time: 0.143120 Oct 02 01:10:13.246762 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1084/2249] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:13 2022] GET /compute/v2.1/servers/d2e1b9f9-7ee0-4e1d-83d3-118adc89ed8f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:10:13.273157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:13.274775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:13.296667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.304160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.304807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.305675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.313507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.315065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.549472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.565212 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f94b750-9144-4f44-b056-5826dbf74199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1284 microversion: 2.1 time: 0.477087 Oct 02 01:10:13.565800 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1166/2250] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:13 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1284 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:13.571120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6f724ee9-8e95-41b9-8980-273cfce6e478 req-c67f55bc-3165-43b1-8c6e-13f0056add4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323b7a8-83c0-44c2-ab5a-d2af274f5731", "name": "network-vif-deleted", "tag": "aeec07f9-b729-423e-876c-5cf7a45c459b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:13.597565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f724ee9-8e95-41b9-8980-273cfce6e478 req-c67f55bc-3165-43b1-8c6e-13f0056add4a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.598068 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f724ee9-8e95-41b9-8980-273cfce6e478 req-c67f55bc-3165-43b1-8c6e-13f0056add4a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.598497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f724ee9-8e95-41b9-8980-273cfce6e478 req-c67f55bc-3165-43b1-8c6e-13f0056add4a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.631335 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6f724ee9-8e95-41b9-8980-273cfce6e478 req-c67f55bc-3165-43b1-8c6e-13f0056add4a service nova] Creating event network-vif-deleted:aeec07f9-b729-423e-876c-5cf7a45c459b for instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 on n-h1-master-1 Oct 02 01:10:13.640536 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6f724ee9-8e95-41b9-8980-273cfce6e478 req-c67f55bc-3165-43b1-8c6e-13f0056add4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072861 Oct 02 01:10:13.646932 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1167/2251] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:13.653182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:13.660297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:13.668190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.674737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.675574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.676576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.678865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.679428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.768614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.778166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.785001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.787635 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1228ef10-a99f-4d7c-b410-c793dc269368 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1281 microversion: 2.25 time: 0.525862 Oct 02 01:10:13.789474 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1085/2252] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:13 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1281 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:13.969289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:13.990639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41232ffd-4edc-4272-889f-7e876f43afd0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1514 microversion: 2.1 time: 0.342149 Oct 02 01:10:13.991572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1168/2253] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:13 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:14.018730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b1f3d76-37f7-42f8-8cdf-1dc79c55e7b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:14.021683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7b1f3d76-37f7-42f8-8cdf-1dc79c55e7b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: e357e2b3-3589-4fe2-8c20-c2590f6d8716] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:14.027890 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7b1f3d76-37f7-42f8-8cdf-1dc79c55e7b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Instance e357e2b3-3589-4fe2-8c20-c2590f6d8716 could not be found. Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b1f3d76-37f7-42f8-8cdf-1dc79c55e7b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/e357e2b3-3589-4fe2-8c20-c2590f6d8716/action HTTP/1.1 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 14 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: {"rescue": {}} Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: exception: Instance e357e2b3-3589-4fe2-8c20-c2590f6d8716 could not be found. Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'e357e2b3-3589-4fe2-8c20-c2590f6d8716', 'body': {'rescue': {}}} Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e357e2b3-3589-4fe2-8c20-c2590f6d8716 could not be found. Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e357e2b3-3589-4fe2-8c20-c2590f6d8716 could not be found. Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:14.040283 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e357e2b3-3589-4fe2-8c20-c2590f6d8716 could not be found. Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b1f3d76-37f7-42f8-8cdf-1dc79c55e7b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 404 to user: Instance e357e2b3-3589-4fe2-8c20-c2590f6d8716 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:14.044680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b1f3d76-37f7-42f8-8cdf-1dc79c55e7b6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/e357e2b3-3589-4fe2-8c20-c2590f6d8716/action" status: 404 len: 111 microversion: 2.1 time: 0.028942 Oct 02 01:10:14.052617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1086/2254] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:14 2022] POST /compute/v2.1/servers/e357e2b3-3589-4fe2-8c20-c2590f6d8716/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:10:14.056854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:14.057404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:14.068962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.070939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.071623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.073118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.074489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.075172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.128837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:14.130177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:14.177608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.181125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.182275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.184261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.184564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.190890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.338420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d0f044a7-f6e2-49fd-9c34-8f02a21b177e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.288033 Oct 02 01:10:14.339435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1169/2255] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:14 2022] POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:10:14.348196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:14.352203 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:14.371312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.371848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.372294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.375153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.375641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.378358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.382014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.382518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.383005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.383465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lazy-loading 'fault' on Instance uuid 4323b7a8-83c0-44c2-ab5a-d2af274f5731 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:14.637794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1976f703f402788953f3332a281de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:14.652586 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba89a85f-0119-4e73-a57d-9c8fb58a99c2 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 200 len: 1300 microversion: 2.1 time: 0.532901 Oct 02 01:10:14.655402 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1087/2256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:14 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 1300 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:14.664841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:14.666115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:14.694068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.694849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.697991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.699060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.702832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.704019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.987204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:15.015106 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-74c21434-2cfc-4d1c-beba-adc4e8b67c13 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1519 microversion: 2.1 time: 0.670458 Oct 02 01:10:15.023335 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1170/2257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:14 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1519 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:15.063974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:15.066997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:15.086121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.088795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.090443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.091452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.094999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.096115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.407020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:15.416448 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-786d5bf4-3463-41bb-b238-b9b5a443858f tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.758411 Oct 02 01:10:15.417525 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1088/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:14 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:15.441070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a42d682c-c5e1-4169-88a7-38bd499b689e"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:15.444729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:15.469526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.470277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.472282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.473169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.475363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.476983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.578763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:15.583425 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:15.594125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:15.596105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:15.600484 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23037430-4bef-4cf7-925b-7e341308f13d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1477 microversion: 2.25 time: 0.575864 Oct 02 01:10:15.605667 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1171/2259] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:15 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1477 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:15.630950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:15.631598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:15.645969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.646836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.647486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.648387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.648993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.650294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.872334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5715ca93-85e7-48b7-84b8-1baa1c480c84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "POST /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453238 Oct 02 01:10:15.878917 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1089/2260] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:10:15 2022] POST /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:15.905720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:15.906802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] [instance: 4323b7a8-83c0-44c2-ab5a-d2af274f5731] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:15.919530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.920810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.923094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.924242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.929090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.929577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.985639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid a3933092-3252-458b-a700-ccb965d9f875 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:15.992636 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] HTTP exception thrown: Instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 could not be found. Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Request method failure captured: Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 HTTP/1.1 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOL04t2Jw1t5tcXd0DNuZ8iOq7fu8_FegQ6oktfhUDyJSRXvnCQTX31HsORMecgGBHr4POTJ1B5fhnag9fOAUvtqr6BxUEbzVpYO_unyFLm3TcenqLNwf2GiYlaW2xrs7A0JC4c-fGmrtKgvRPZ9NOB8GVQx2JpQW8UOa_0y6U-cp7g Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffe656702bb24b6a9b459ff1b19a0d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffe656702bb24b6a9b459ff1b19a0d8c"}]}] Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-LiveMigrationTest-796707941 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ffe656702bb24b6a9b459ff1b19a0d8c Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-LiveMigrationTest-796707941 Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-LiveMigrationTest-796707941-project Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 6da1976f703f402788953f3332a281de Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-LiveMigrationTest-796707941-project Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 could not be found. Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '4323b7a8-83c0-44c2-ab5a-d2af274f5731'} Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 could not be found. Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 could not be found. Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:15.994947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 could not be found. Oct 02 01:10:16.000753 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:16.002400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] Returning 404 to user: Instance 4323b7a8-83c0-44c2-ab5a-d2af274f5731 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:16.003764 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca888d39-ffec-4eb6-8c26-dd88b674b463 tempest-LiveMigrationTest-796707941 tempest-LiveMigrationTest-796707941-project] 10.222.0.23 "GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731" status: 404 len: 111 microversion: 2.1 time: 0.129045 Oct 02 01:10:16.004892 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1090/2261] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:15 2022] GET /compute/v2.1/servers/4323b7a8-83c0-44c2-ab5a-d2af274f5731 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:10:16.016112 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e9fcd06-6f86-4f78-897e-2c53396bd248 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1970 microversion: 2.25 time: 0.388830 Oct 02 01:10:16.016721 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1172/2262] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:15 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1970 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:16.053942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:16.055449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:16.056622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:16.058214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:16.083563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:16.087760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:16.090720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:16.091690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:16.092641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:16.093741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:16.095954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:16.097364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:16.097734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:16.100497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:16.101215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:16.103255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.055235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:17.063489 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f770598f-c407-4ed7-b193-a48e850cc9ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1499 microversion: 2.1 time: 1.014484 Oct 02 01:10:17.064626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1173/2263] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:16 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1499 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:17.069930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:17.075706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:17.105754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.106272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.106755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.107491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.117273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.118429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.204707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid a3933092-3252-458b-a700-ccb965d9f875 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:17.249505 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf39f708-72de-4c97-b3f7-ca2d84c8deaf tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1970 microversion: 2.25 time: 1.207894 Oct 02 01:10:17.252846 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1091/2264] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:16 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1970 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:17.268812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:17.277778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:17.295139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.297422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.297984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.298854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.301793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.302306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.353318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'flavor' on Instance uuid 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:17.369332 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Cannot 'rescue' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state paused Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action HTTP/1.1 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 14 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: {"rescue": {}} Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'rescue' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state paused Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7b0a9d17-5cc3-4882-96fc-08b6bc217ec4', 'body': {'rescue': {}}} Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 in vm_state paused. Cannot rescue while the instance is in this state. Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state paused Oct 02 01:10:17.370968 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state paused Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 409 to user: Cannot 'rescue' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state paused {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11de6a29-2bce-42db-95e5-63aba577fa18 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action" status: 409 len: 144 microversion: 2.1 time: 0.117682 Oct 02 01:10:17.374437 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1092/2265] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:17 2022] POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action => generated 144 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:10:17.379824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:17.386938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.387576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.388036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.388787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.389784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.390223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.422788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4089a369-1f6b-4deb-87a2-0c4c1b9c0b89 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047614 Oct 02 01:10:17.423722 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1093/2266] 10.222.0.23 () {60 vars in 1217 bytes} [Sun Oct 2 01:10:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:10:17.431134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:17.431872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:17.441050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.442351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.443769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.445018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.445645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.446246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.465530 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:17.573204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe7e839e-36b8-4fb6-9c16-f3e53d30bca3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.147764 Oct 02 01:10:17.574207 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1094/2267] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:17 2022] POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:10:17.585550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:17.594018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:17.610031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.613574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.614256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.615190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.616867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.618652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.684826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'flavor' on Instance uuid a3933092-3252-458b-a700-ccb965d9f875 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:17.721647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: a3933092-3252-458b-a700-ccb965d9f875] Going to try to live migrate instance to n-h2-master-1 {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:10:17.912085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:17.930758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ddba073-68af-4995-87f1-5d92162680eb tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.861783 Oct 02 01:10:17.946629 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1174/2268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:17 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:17.949095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:17.953223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:17.989103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.990250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.991630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.994551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.995176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.997060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:19.159361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:19.172237 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5362e693-2d83-41a2-a0d6-2973288b182b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1514 microversion: 2.1 time: 1.238012 Oct 02 01:10:19.175304 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1175/2269] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:17 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1514 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:19.182044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:19.183141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:19.195644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:19.225637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:19.232884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:19.233972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:19.234696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:19.235366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:19.776874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:19.796435 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a3f3d69-d901-49b8-8ef2-e5c5455889b4 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.618754 Oct 02 01:10:19.798308 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1176/2270] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:19 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:19.915442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3e0e81ea-5a83-4e9b-86a9-5415344dad7a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'create', calling method: .version_select at 0x7fb885572e50>, body: {"keypair": {"name": "tempest-keypair-1315291376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5QfD1iXCWXo6O7+SkHhosFW5+aHIpiQSSaOSIaFJlW8h7hjIxkvggqXDUipJhauaqyuqaZaHq8G9dcS5hbMTzejY9NX6LgVfhmW5aJy6r8YT8WCKPbuQoJKbKWYQahDQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:19.959039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-3e0e81ea-5a83-4e9b-86a9-5415344dad7a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for project 3c94ca45e7684b3c818871e232e08342. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:19.966228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-3e0e81ea-5a83-4e9b-86a9-5415344dad7a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for user 66a9d6a142d444be90b2101f23603522 and project 3c94ca45e7684b3c818871e232e08342. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:19.979026 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:20.026910 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3e0e81ea-5a83-4e9b-86a9-5415344dad7a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227084 Oct 02 01:10:20.051934 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1177/2271] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:10:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:20.061780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e450dbc9-4407-4fce-9bec-a8d3e5e6f7cf req-e8027fa1-e330-4277-a401-48c99308082a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218e500e-43b6-4c99-af78-3607ae5f9b23", "tag": "9b2a702c-7189-4a97-ab39-ae072c6da628"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:20.091549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e450dbc9-4407-4fce-9bec-a8d3e5e6f7cf req-e8027fa1-e330-4277-a401-48c99308082a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.093191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e450dbc9-4407-4fce-9bec-a8d3e5e6f7cf req-e8027fa1-e330-4277-a401-48c99308082a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.100657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e450dbc9-4407-4fce-9bec-a8d3e5e6f7cf req-e8027fa1-e330-4277-a401-48c99308082a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:20.126150 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:20.133427 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e450dbc9-4407-4fce-9bec-a8d3e5e6f7cf req-e8027fa1-e330-4277-a401-48c99308082a service nova] Creating event network-changed:9b2a702c-7189-4a97-ab39-ae072c6da628 for instance 218e500e-43b6-4c99-af78-3607ae5f9b23 on n-h1-master-1 Oct 02 01:10:20.143785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e450dbc9-4407-4fce-9bec-a8d3e5e6f7cf req-e8027fa1-e330-4277-a401-48c99308082a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087768 Oct 02 01:10:20.146672 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1178/2272] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:20.232213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-473546971", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:20.315044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:20.315958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:20.320243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:20.321214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:20.321854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:20.335855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.336593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.337238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:20.338176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.338872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.339489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:20.376999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Getting quotas for project 43ccfc72930a48ed8a9578968a8e0ee0. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:20.397523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Getting quotas for user c6bc89a846ec4240bd21f1052b90be8f and project 43ccfc72930a48ed8a9578968a8e0ee0. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:20.429428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:10:20.435247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:10:20.554884 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f2683510-418b-4b70-bc00-126e5b2ec4b5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.406395 Oct 02 01:10:20.558984 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1179/2273] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:10:20.601245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-616d2ede-4a74-42d9-9926-38bb23cb0d8a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:20.602131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-616d2ede-4a74-42d9-9926-38bb23cb0d8a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:20.747210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-616d2ede-4a74-42d9-9926-38bb23cb0d8a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:20.765981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-616d2ede-4a74-42d9-9926-38bb23cb0d8a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:20.774838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-616d2ede-4a74-42d9-9926-38bb23cb0d8a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:20.804242 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-616d2ede-4a74-42d9-9926-38bb23cb0d8a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1452 microversion: 2.91 time: 0.222167 Oct 02 01:10:20.806910 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1180/2274] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:20 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1452 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:20.825795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:20.827674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:20.877122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.877681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.879446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:20.881490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.882182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.884195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:21.598967 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56053fc7-9e37-4fea-8d78-2e725731d889 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875/action" status: 202 len: 0 microversion: 2.25 time: 4.023382 Oct 02 01:10:21.599603 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1095/2275] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:10:17 2022] POST /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875/action => generated 0 bytes in 4025 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:10:21.611769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:21.613380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:21.620905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:21.621670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:21.622261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:21.623969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:21.624940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:21.625637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:21.790431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:21.802889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23b777db-6477-40ab-96ba-d10786f8b41a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.983313 Oct 02 01:10:21.803853 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1181/2276] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:20 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:21.839023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:21.840126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:21.846817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:21.853630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:21.854079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:21.854886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:21.855826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:21.863341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.082384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.083973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.092021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.099380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.101019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.102458 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25a3e655-2906-43d4-b977-fef9003cc2f0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.497354 Oct 02 01:10:22.104440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.114363 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1437cd59-0363-4aa8-b7f2-0f597b8641f7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1448 microversion: 2.91 time: 0.279384 Oct 02 01:10:22.115429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1096/2277] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:21 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:22.128859 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1182/2278] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:21 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1448 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:22.131551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:22.133962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:22.146327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.147002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.147605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.148472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.149044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.149707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.193988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'flavor' on Instance uuid 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:22.370935 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5f34e29-5d99-4f20-875a-1319a54d589b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action" status: 200 len: 32 microversion: 2.1 time: 0.254274 Oct 02 01:10:22.372717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1097/2279] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:22 2022] POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:10:22.384057 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:22.386248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:22.400244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.401073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.401721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.402486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.403106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.403486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.833795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:22.837759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:22.874318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.877315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.878591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.883572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.884090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.885886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.926282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:22.935141 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa7ec47e-ae5f-4732-9c33-6ccf10efe578 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.555795 Oct 02 01:10:22.937288 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1183/2280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:22 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:23.134866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:23.136422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:23.153499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:23.154017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:23.154469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:23.161684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:23.162551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:23.163285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.070555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.094447 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e12b6595-d842-4350-bd21-9e2fdc066b90 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 1.269404 Oct 02 01:10:24.099123 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1098/2281] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:22 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:24.106209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:24.111067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:24.132246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:24.133111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:24.134262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.135767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:24.138383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:24.139798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.252662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.269484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.273211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.276282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea42a044-d807-4068-8551-ee78fb0a248e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 1.146971 Oct 02 01:10:24.284422 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1184/2282] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:23 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:24.293661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:24.305711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:24.324938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:24.331471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:24.332166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.333137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:24.333811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:24.334722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.512462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.530952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.532755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:24.552671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7792fb52-168d-4be4-998b-be755039b8a3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1510 microversion: 2.91 time: 0.450137 Oct 02 01:10:24.553599 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1099/2283] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:24 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:24.633210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-680151248", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2"}], "security_groups": [{"name": "tempest-securitygroup--26496022"}], "key_name": "tempest-keypair-1315291376", "user_data": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:25.043707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] validate_networks() for [('ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:10:25.057996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:25.069733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4493437b-e8c7-437d-88e2-55a3e4724dd4 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.783401 Oct 02 01:10:25.070897 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1185/2284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:24 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:25.128608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:25.129484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:25.136626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:25.141582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:25.142379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:25.144034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:25.144773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:25.145543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:25.731476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:25.746364 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81f401e9-0895-456c-8e2f-ddfe7bf9ac28 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.622030 Oct 02 01:10:25.766379 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1186/2285] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:25 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:25.775264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:25.776192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:25.785050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:25.785750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:25.786529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:25.787637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:25.788295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:25.789115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.185901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:26.200219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:26.201885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:26.211822 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ebb67be2-64b8-4306-b7e8-ebb54ae719c5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.443452 Oct 02 01:10:26.212511 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1187/2286] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:25 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:26.217845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:26.220127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:26.238398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.238827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.239535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.240461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.240921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.241354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.558257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:26.576179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:26.578828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:26.588438 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bea7d4c0-1802-41e0-8902-e3a56adf5694 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1531 microversion: 2.91 time: 0.374591 Oct 02 01:10:26.589390 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1188/2287] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:26 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1531 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:26.594341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:26.599014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:26.622291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.623096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.623774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.624748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.625347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.626166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.702305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:26.705944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:26.706846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:26.707458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:26.707883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:26.725489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.726261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.759750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.760684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.761179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.761624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.785822 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:26.800319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:26.836937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for user 66a9d6a142d444be90b2101f23603522 and project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:26.903194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:10:26.911124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:10:27.010432 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bc6059d-aac1-4b7e-a36b-fcba204c18bb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.381798 Oct 02 01:10:27.012359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1100/2288] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:10:24 2022] POST /compute/v2.1/servers => generated 407 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:10:27.102563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:27.103731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:27.112392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.113152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.113962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.115956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.116701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.117914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.508691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lazy-loading 'services' on Instance uuid de3d36f4-2336-489c-80d3-939cc4bee2db {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:27.566490 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa208548-d72d-4190-9c31-4106f9810ac0 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1936 microversion: 2.91 time: 0.552470 Oct 02 01:10:27.567386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1101/2289] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:27 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1936 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:27.590678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:27.590678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:27.600328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.600851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.601296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.604845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.605328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.605774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.617990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:27.633510 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b05184aa-3b89-476e-b77a-1e696edcdc41 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 1.042766 Oct 02 01:10:27.648962 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1189/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:26 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:27.667989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4482d71-d721-4bf6-b485-6f133502d0db tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:27.670479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4482d71-d721-4bf6-b485-6f133502d0db tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:27.930483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4482d71-d721-4bf6-b485-6f133502d0db tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:27.938700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4482d71-d721-4bf6-b485-6f133502d0db tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1238 microversion: 2.1 time: 0.288420 Oct 02 01:10:27.939308 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1190/2291] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:27 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1238 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:27.955775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:27.956459 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:27.977621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.978307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.978964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.979864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.980681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.981285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.089257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:28.101295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26066840-3541-4c36-b47b-fd68835897db tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.532776 Oct 02 01:10:28.102955 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1102/2292] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:27 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:28.114354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:28.115424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:28.134285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.135229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.135912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.136838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.137361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.137891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.261981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lazy-loading 'services' on Instance uuid de3d36f4-2336-489c-80d3-939cc4bee2db {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:28.273004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:28.282523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:28.297143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:28.298873 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36d450a2-a472-414f-aaa4-a5ff5a0e1ac1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.358491 Oct 02 01:10:28.302978 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1191/2293] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:27 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:28.322466 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccefc221-4c85-46ef-b0dd-e50603c5cdb8 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1936 microversion: 2.91 time: 0.218209 Oct 02 01:10:28.334938 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1103/2294] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:28 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1936 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:28.357455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:28.363014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.363509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.363959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.364702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.365166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.365598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.430736 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-28185c70-2478-42ef-ae8e-38d94f228164 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.076783 Oct 02 01:10:28.441011 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1192/2295] 10.222.0.23 () {60 vars in 1217 bytes} [Sun Oct 2 01:10:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:10:28.445400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:28.446140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:28.453906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.454685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.455393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.456348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.457520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.458024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.483954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lazy-loading 'flavor' on Instance uuid de3d36f4-2336-489c-80d3-939cc4bee2db {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:28.541624 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:28.678044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:28.678992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:28.693501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.706015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.706631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.707402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.712965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.719881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.734574 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:28.807782 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3d5e620a-0723-46eb-9bc4-8610a7994156 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action" status: 202 len: 0 microversion: 2.91 time: 0.366559 Oct 02 01:10:28.808485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1104/2296] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:10:28 2022] POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:10:28.831320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:28.834842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:28.849993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.850832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.851630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.852537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.853057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.853557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.974448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:28.983712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:28.987970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.003921 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2cc0edbc-1c0c-46a2-8ecf-1a6603baa6cb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.187017 Oct 02 01:10:29.005086 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1105/2297] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:28 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:29.010254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3501a6ba-8ba4-4744-8842-74f2202fba05 req-980ee1d7-76bb-4e6f-aaa9-586595c73dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218e500e-43b6-4c99-af78-3607ae5f9b23", "name": "network-vif-plugged", "status": "completed", "tag": "9b2a702c-7189-4a97-ab39-ae072c6da628"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:29.027873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3501a6ba-8ba4-4744-8842-74f2202fba05 req-980ee1d7-76bb-4e6f-aaa9-586595c73dfc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.037377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3501a6ba-8ba4-4744-8842-74f2202fba05 req-980ee1d7-76bb-4e6f-aaa9-586595c73dfc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.038199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3501a6ba-8ba4-4744-8842-74f2202fba05 req-980ee1d7-76bb-4e6f-aaa9-586595c73dfc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.062396 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3501a6ba-8ba4-4744-8842-74f2202fba05 req-980ee1d7-76bb-4e6f-aaa9-586595c73dfc service nova] Creating event network-vif-plugged:9b2a702c-7189-4a97-ab39-ae072c6da628 for instance 218e500e-43b6-4c99-af78-3607ae5f9b23 on n-h1-master-1 Oct 02 01:10:29.075853 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3501a6ba-8ba4-4744-8842-74f2202fba05 req-980ee1d7-76bb-4e6f-aaa9-586595c73dfc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069330 Oct 02 01:10:29.077225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1106/2298] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:29.084860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:29.089688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:29.103929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.107208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.107768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.110072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.111054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.111516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.116095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.138994 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f078e4cf-532a-4fd1-ac62-64980f3531a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.464970 Oct 02 01:10:29.157221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1193/2299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:28 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:29.165026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:29.165932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:29.175377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.176041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.177302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.178195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.179735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.180382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.375161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.389710 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b70d87ee-fd24-4d83-a1e6-1ed39bff59ac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1290 microversion: 2.1 time: 0.310833 Oct 02 01:10:29.403168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1107/2300] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:29 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1290 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:29.410453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:29.412591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:29.421720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.422318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.422839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.423886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.424364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.424864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.655567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.665472 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-af658ef0-4f6e-4330-a0d7-e36006363199 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.506757 Oct 02 01:10:29.666071 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1194/2301] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:29 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:29.771756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.782080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.784480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:29.786824 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c44d956c-90fd-40a9-9643-98b29db92ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.381934 Oct 02 01:10:29.802631 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1108/2302] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:29 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:30.037660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:30.039698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:30.048104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.048811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.049592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.050579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.051260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.051932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.137638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:30.172548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:30.173162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:30.180073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:30.183647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:30.187011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.187749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.188378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.189248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.189968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da21a77f-e126-459b-a500-308ec451b0d3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.158000 Oct 02 01:10:30.191052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1195/2303] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:30 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:30.215138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.215825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.413901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:30.415557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:30.424818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.425600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.426199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.427106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.427719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.428446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.458349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:30.475301 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d42fcf34-7ae5-4ac5-a00e-08604224133a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.303833 Oct 02 01:10:30.488147 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1109/2304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:30 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:30.691163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:30.691786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:30.704939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.705453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.705894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.706630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.716247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.716854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.726998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:30.738953 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88e38155-be52-4286-9fea-5699d6c0f1f8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.329327 Oct 02 01:10:30.740077 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1196/2305] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:30 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:30.819754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:30.820716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:30.831842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.835443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.836239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.837148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.843570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.844259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.172416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.193356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.195077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.196457 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22e78da8-f7b1-498d-a8d6-d4dfa6351ba1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.383319 Oct 02 01:10:31.197494 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1197/2306] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:30 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:31.223736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:31.223928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:31.232810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.234147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.241228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.242430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.242964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.243568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.245730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.257047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9041c8e1-dc7d-4c14-be86-013ba9f96da3 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1352 microversion: 2.1 time: 0.570514 Oct 02 01:10:31.260296 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1110/2307] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:30 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1352 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:31.395253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.409014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.412668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.446309 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c07cd84-1d15-49fa-a35f-6c8805d7b791 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.221340 Oct 02 01:10:31.449095 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1198/2308] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:31 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:31.507846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:31.509243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:31.533383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.539397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.539829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.542500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.543055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.546154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.767167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:31.767814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:31.774868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.775378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.775828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.776723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.777201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.783359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.974019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:31.983404 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a8870c4-761c-43eb-8ebf-193899457c02 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.482330 Oct 02 01:10:31.983998 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1111/2309] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:31 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:32.166736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.175282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56250102-9ea6-468e-9d7a-c84baff21487 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.414323 Oct 02 01:10:32.183721 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1199/2310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:31 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:32.226318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:32.227143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:32.236170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.237810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.238375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.239242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.243827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.244823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.374847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "479b86b6-edd3-4471-8ec8-8a0f661c384f"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:32.377408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:32.385855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.386355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.387202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.388163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.388633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.389061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.513892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.528293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.533693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.535435 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-946eb216-7214-42ee-859b-07be9adf12d9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.313412 Oct 02 01:10:32.552771 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1200/2311] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:32 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:32.562654 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] HTTP exception thrown: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. Oct 02 01:10:32.565441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:32.566259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:32.574673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.575589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.576194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.578189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.579058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.579705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Request method failure captured: Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments/a42d682c-c5e1-4169-88a7-38bd499b689e HTTP/1.1 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 74 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOSDrqsRnzsHTwHn7kOc8G-fK4LHa8ta4hPF3kKMx_-dM6aov8zY5x_4s62jIpGLxvL6-rU_5N_cm1Rn1pHPdq5KGHXkUjooFyhaCXt2AMLOaf7lbkCaqjrURR-dZmFM87j_GheusZy9jXjsWiERMM3SyygsSqGguuqo2hZYUwnPnkA Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2025441a9e3a4e848c695b77bb33b9e2 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesAdminNegativeTest-1766094081 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2025441a9e3a4e848c695b77bb33b9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2025441a9e3a4e848c695b77bb33b9e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2025441a9e3a4e848c695b77bb33b9e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2025441a9e3a4e848c695b77bb33b9e2"}]}] Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesAdminNegativeTest-1766094081 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2025441a9e3a4e848c695b77bb33b9e2 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1766094081 Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesAdminNegativeTest-1766094081-project-admin Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: f13f3cf87e5148cf9ba45f4d24961f6e Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesAdminNegativeTest-1766094081-project-admin Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: {"volumeAttachment": {"volumeId": "479b86b6-edd3-4471-8ec8-8a0f661c384f"}} Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: exception: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '79e806fe-2261-4f84-a359-763dcf320803', 'id': 'a42d682c-c5e1-4169-88a7-38bd499b689e', 'body': {'volumeAttachment': {'volumeId': '479b86b6-edd3-4471-8ec8-8a0f661c384f'}}} Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. (HTTP 404) (Request-ID: req-6fdb4a4c-1bb7-476a-9042-6c27934ad9ee) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:10:32.598848 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Returning 400 to user: Volume 479b86b6-edd3-4471-8ec8-8a0f661c384f could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0200e16f-7327-4446-8f46-aee0b4649a34 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments/a42d682c-c5e1-4169-88a7-38bd499b689e" status: 400 len: 107 microversion: 2.1 time: 0.470004 Oct 02 01:10:32.602486 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1112/2312] 10.222.0.23 () {60 vars in 1433 bytes} [Sun Oct 2 01:10:32 2022] PUT /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments/a42d682c-c5e1-4169-88a7-38bd499b689e => generated 107 bytes in 472 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:10:32.606628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:32.607319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:32.630195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.630856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.631313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.634202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.634983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.636191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.815965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.834222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.836104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:32.855503 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d58134a3-1540-4b3d-9736-9a98a7d8ca31 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.252687 Oct 02 01:10:32.856100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1113/2313] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:32 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:32.870687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e0354dd6-3062-4531-a60f-40d6c50a71eb req-4cca2f35-f812-41c1-afc6-16c3ffd6729a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:32.904365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e0354dd6-3062-4531-a60f-40d6c50a71eb req-4cca2f35-f812-41c1-afc6-16c3ffd6729a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.905458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e0354dd6-3062-4531-a60f-40d6c50a71eb req-4cca2f35-f812-41c1-afc6-16c3ffd6729a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.908605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e0354dd6-3062-4531-a60f-40d6c50a71eb req-4cca2f35-f812-41c1-afc6-16c3ffd6729a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.946227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e0354dd6-3062-4531-a60f-40d6c50a71eb req-4cca2f35-f812-41c1-afc6-16c3ffd6729a service nova] Creating event network-changed:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:10:32.979282 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e0354dd6-3062-4531-a60f-40d6c50a71eb req-4cca2f35-f812-41c1-afc6-16c3ffd6729a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121416 Oct 02 01:10:32.980754 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1114/2314] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:32.989036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:32.990154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:32.998461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.000469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.003036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.004324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.005029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.005812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.036774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:33.050458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0453cdfa-e415-4ae9-a2e6-25a9d2c5f7fd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1542 microversion: 2.1 time: 0.495176 Oct 02 01:10:33.065463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1201/2315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:32 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1542 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:33.073178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:33.075625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:33.095294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.096146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.096758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.097706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.098326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.099114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.194786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lazy-loading 'services' on Instance uuid 79e806fe-2261-4f84-a359-763dcf320803 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:33.365164 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d20a32a4-30d0-47de-a5d3-0632257b0e76 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments/a42d682c-c5e1-4169-88a7-38bd499b689e" status: 202 len: 0 microversion: 2.1 time: 0.381792 Oct 02 01:10:33.366651 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1115/2316] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:10:32 2022] DELETE /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments/a42d682c-c5e1-4169-88a7-38bd499b689e => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:10:33.382828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:33.383476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:33.387668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:33.391178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.391677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.392177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.393572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.394030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.394462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.408079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81138cf6-e557-4f66-9ce1-42deab00594e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.347121 Oct 02 01:10:33.409291 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1202/2317] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:33 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:33.417449 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:33.418075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:33.443227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.443725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.444169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.444888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.445344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.445761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.662357 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bebfb69a-ddda-4e4a-b378-ab503ba760dc tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.292921 Oct 02 01:10:33.666204 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1116/2318] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:10:33 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:33.671678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:33.677067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:33.700556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.701064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.701508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.708762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.710134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.710877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.796107 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6bcc0b3a-de44-4bae-a62a-c76d21572fb1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127728 Oct 02 01:10:33.798951 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1117/2319] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:33 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:33.813503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:33.815451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:33.828587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.829436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.830088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.831076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.832468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.833120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.344578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.356527 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d57ded12-8a93-4c1c-8a0c-77a35e6d6a44 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.945955 Oct 02 01:10:34.375207 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1203/2320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:33 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:34.397716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:34.398663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:34.416997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.418920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.421050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.422440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.424543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.425169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.631012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.640705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.646128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.658406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7915e6b0-41e1-43c2-bd42-7be2eabb0a5d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.278724 Oct 02 01:10:34.660830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1204/2321] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:34 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:34.677144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:34.678075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:34.692440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.693169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.693820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.694795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.696520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.697175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.853045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.866911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.868400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:34.869837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17c00eef-9065-4c44-85a6-0cf9e25a21c2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 1.069286 Oct 02 01:10:34.870511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1118/2322] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:33 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:34.876251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:34.878834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:34.885437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.886168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.886893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.887823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.888488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.889769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.926700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f5ff20b-e81d-46b3-94d2-13c3d034fcd1 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054766 Oct 02 01:10:34.927721 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1119/2323] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:34 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:35.088043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:35.101444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6f931ec9-f111-4bca-969d-ab7f387281c6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.439276 Oct 02 01:10:35.102043 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1205/2324] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:34 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:35.386643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:35.387696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:35.398694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.399518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.400069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.401041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.401741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.402436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.591239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:35.608217 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63da70ad-6087-4c5b-bff8-7d61999a9c6a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.225704 Oct 02 01:10:35.609914 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1120/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:35 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:35.694959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:35.695474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:35.704534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.706496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.708517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.710473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.711191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.711835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.887125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:35.900220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:35.902209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:35.915307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.916680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.917802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:35.918421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.921698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.922758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.923483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.929064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:35.937566 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c025d821-7504-4fac-a400-411e9d45d68e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.246895 Oct 02 01:10:35.939088 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1206/2326] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:35 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:35.946315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:35.949294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:35.960742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.961595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.962299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.963432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.964130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.964785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.017768 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a68443a-1893-4e4b-8d63-6537fa98532f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077111 Oct 02 01:10:36.020725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1207/2327] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:35 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:36.128317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:36.129357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:36.141731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.143520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.146372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.150710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.151516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.152520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.236245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:36.246868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:36.251719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:36.252935 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-634a91ad-e712-4c4d-8bd1-8c2bb3127e92 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.360282 Oct 02 01:10:36.253502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1121/2328] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:35 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:36.276047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-81c38885-3d20-4188-ad5e-ce80eeca455e req-5835f037-1a02-42c1-8cd1-60ceb819b913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218e500e-43b6-4c99-af78-3607ae5f9b23", "tag": "9b2a702c-7189-4a97-ab39-ae072c6da628"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:36.287639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-81c38885-3d20-4188-ad5e-ce80eeca455e req-5835f037-1a02-42c1-8cd1-60ceb819b913 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.288178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-81c38885-3d20-4188-ad5e-ce80eeca455e req-5835f037-1a02-42c1-8cd1-60ceb819b913 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.288683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-81c38885-3d20-4188-ad5e-ce80eeca455e req-5835f037-1a02-42c1-8cd1-60ceb819b913 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.297458 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:36.306089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-81c38885-3d20-4188-ad5e-ce80eeca455e req-5835f037-1a02-42c1-8cd1-60ceb819b913 service nova] Creating event network-changed:9b2a702c-7189-4a97-ab39-ae072c6da628 for instance 218e500e-43b6-4c99-af78-3607ae5f9b23 on n-h1-master-1 Oct 02 01:10:36.311849 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-81c38885-3d20-4188-ad5e-ce80eeca455e req-5835f037-1a02-42c1-8cd1-60ceb819b913 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043813 Oct 02 01:10:36.313053 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1122/2329] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:36.481892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:36.491143 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b4338ab-a766-4b6c-a552-ff774d659705 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.369416 Oct 02 01:10:36.503924 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1208/2330] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:36 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:36.634673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:36.635483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:36.645294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.646050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.646710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.647578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.648194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.655344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.781999 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:36.874929 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:36.923899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:36.935742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd4a334d-6b4f-44bf-929e-60cc15151be7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.305282 Oct 02 01:10:36.937357 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1123/2331] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:36 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:36.972132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:36.972757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:36.975239 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:36.990790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.997167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.998092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.000311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.000858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.003129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.033315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:37.035800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:37.049235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.055338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.056054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.056957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.057697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.058289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.129821 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b10d6bc-b913-4d27-b613-f39d4ab751f3 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101622 Oct 02 01:10:37.130430 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1124/2332] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:37 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:37.146691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.156156 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:37.165070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.167895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.178647 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78243a1b-e379-4d3c-8ab4-841633e62297 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.210259 Oct 02 01:10:37.180035 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1209/2333] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:36 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:37.280684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:37.281437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:37.288298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.289643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.290328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.291305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.291979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.292716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.445391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.454679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.456128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.457320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38534d5e-9aa5-4ec0-8300-0152a9097850 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.181619 Oct 02 01:10:37.457958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1125/2334] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:37 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:37.518056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:37.518786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:37.525874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.526381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.527096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.528047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.528637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.528944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.711269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:37.721781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c711dfe-4fe5-4853-b1de-83d54eeafef1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.209315 Oct 02 01:10:37.722394 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1210/2335] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:37 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:37.924945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1137160847", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:37.960293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:37.961161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:37.965525 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=26 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:37.978719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.979257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.979648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.980883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.981496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.981941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.019286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:38.019709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:38.020253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:38.020659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:38.021067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:38.033565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.034341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.034861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.036075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.036678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.037270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.061643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Getting quotas for project c1893a97eaf94d85b113cb3d03c3ef85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:38.070816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Getting quotas for user 49da406fdd2e4aa980c1a7343af9a321 and project c1893a97eaf94d85b113cb3d03c3ef85. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:38.088358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:10:38.091163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:10:38.182678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-131d3fb5-e068-4bee-b5e6-749ee431481a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.417423 Oct 02 01:10:38.183656 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1126/2336] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:10:38.197851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:38.201358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.211497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.212373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.213549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.214582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.215260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.216069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.228702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.240884 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-565160df-6a3f-4914-9cac-51a47c4c9e0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.284687 Oct 02 01:10:38.242039 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1211/2337] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:37 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:38.251062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02adab20-0187-4abe-851a-d42a1865d607 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:38.263099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02adab20-0187-4abe-851a-d42a1865d607 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.274662 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a27222a-bbdf-452d-8c2d-ed570a7a5f05 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082762 Oct 02 01:10:38.284757 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1127/2338] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:38 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:38.289755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:38.295670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.311224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.311891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.312740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.313555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.316174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.316876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.372119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02adab20-0187-4abe-851a-d42a1865d607 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.381595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02adab20-0187-4abe-851a-d42a1865d607 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.383078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02adab20-0187-4abe-851a-d42a1865d607 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.387643 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:38.390075 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02adab20-0187-4abe-851a-d42a1865d607 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "PUT /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1359 microversion: 2.75 time: 0.146356 Oct 02 01:10:38.402625 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1212/2339] 10.222.0.23 () {62 vars in 1297 bytes} [Sun Oct 2 01:10:38 2022] PUT /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:38.424071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7968996f-b1e1-4219-bd04-a3f427ae9d4c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:38.424692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7968996f-b1e1-4219-bd04-a3f427ae9d4c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.474637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.486590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.488328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.493894 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60b5b1e1-1f33-4793-a825-dcc3db03f9e3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.212156 Oct 02 01:10:38.494532 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1128/2340] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:38 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:38.499189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:38.499474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7968996f-b1e1-4219-bd04-a3f427ae9d4c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.499804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.512562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7968996f-b1e1-4219-bd04-a3f427ae9d4c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.513878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7968996f-b1e1-4219-bd04-a3f427ae9d4c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.521529 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7968996f-b1e1-4219-bd04-a3f427ae9d4c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1359 microversion: 2.75 time: 0.103488 Oct 02 01:10:38.523076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1213/2341] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:38 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1359 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:38.524307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.524805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.525247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.528708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.529216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.529766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.725298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.741074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.745867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.747247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:38.748281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.753016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d51cd85e-d923-40bf-a6e5-38bd66747012 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.256177 Oct 02 01:10:38.758675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1129/2342] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:38 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:38.761868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.762671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.763343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.764282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.765197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.765883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.945992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:38.975726 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-644a3a6a-2690-41b0-9330-60d6964820b0 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1500 microversion: 2.1 time: 0.216871 Oct 02 01:10:38.977126 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1214/2343] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:38 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1500 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:39.004172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c326b559-a2b4-4d88-9662-f9c617344ef7"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:39.009299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.022750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.023422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.023920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.024741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.025316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.025921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.059817 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Cannot 'attach_volume' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state rescued Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/os-volume_attachments HTTP/1.1 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 74 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: {"volumeAttachment": {"volumeId": "c326b559-a2b4-4d88-9662-f9c617344ef7"}} Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'attach_volume' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state rescued Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '7b0a9d17-5cc3-4882-96fc-08b6bc217ec4', 'body': {'volumeAttachment': {'volumeId': 'c326b559-a2b4-4d88-9662-f9c617344ef7'}}} Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 02 01:10:39.062493 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state rescued Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state rescued Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 409 to user: Cannot 'attach_volume' instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 while it is in vm_state rescued {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85c590cb-b348-464d-8796-a13c97edac38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065368 Oct 02 01:10:39.069597 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1130/2344] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:10:38 2022] POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:10:39.073454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:39.074243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.082904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.083402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.084007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.084794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.085307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.085889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.169180 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c80aeafe-d1e2-41e2-887b-2c03e9e49533 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.099337 Oct 02 01:10:39.171426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1215/2345] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:10:39 2022] POST /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:10:39.179642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.180529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.198379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.199130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.199865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.200651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.201180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.201676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.267117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.267805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.287140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.288969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.290389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.297413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.299889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.300659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.463320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.476193 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8ac4a81-7e31-42cd-a84e-8030ff7fef69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1508 microversion: 2.1 time: 0.300112 Oct 02 01:10:39.478796 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1131/2346] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:39.485288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.487980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.495608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.497095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.497741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.498973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.499783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.500410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.505632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.517202 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-471fc8ef-f470-45be-8b9a-46dd3c1c6585 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.255236 Oct 02 01:10:39.520050 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1216/2347] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:39.537343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.538038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.558987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.560418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.561033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.563353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.564968 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-15b8cf8d-0bf5-4aa0-8efa-043aa53dc689 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084784 Oct 02 01:10:39.565329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.565749 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1132/2348] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:39.567835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.574163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.575181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.578855 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:39.583147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.584860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.585498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.586719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.587701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.588526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.673768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.682645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.685423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.693117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc760be9-f65e-4e33-9b07-e1113e40dd3c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.171978 Oct 02 01:10:39.693897 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1217/2349] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:39.694249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.703538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.705186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:39.710229 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2282829-cda2-4e57-b4f5-1d989a2d23a0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1411 microversion: 2.75 time: 0.143529 Oct 02 01:10:39.710915 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1133/2350] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1411 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:39.779160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.780061 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.787686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.788308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.788929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.789683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.790146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.790576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.990591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.004778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.007059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.008866 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6314591a-84ed-43ca-a20b-33829dee9271 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.233826 Oct 02 01:10:40.009479 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1218/2351] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:40.132620 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-5d13c33b-2923-4afe-8a9b-afcc238ed5b3 req-a62707d8-1757-42b5-a8b2-b0480860fc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-plugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:40.145652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5d13c33b-2923-4afe-8a9b-afcc238ed5b3 req-a62707d8-1757-42b5-a8b2-b0480860fc40 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.146211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5d13c33b-2923-4afe-8a9b-afcc238ed5b3 req-a62707d8-1757-42b5-a8b2-b0480860fc40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.146923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5d13c33b-2923-4afe-8a9b-afcc238ed5b3 req-a62707d8-1757-42b5-a8b2-b0480860fc40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.167952 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5d13c33b-2923-4afe-8a9b-afcc238ed5b3 req-a62707d8-1757-42b5-a8b2-b0480860fc40 service nova] Creating event network-vif-plugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:10:40.179022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-5d13c33b-2923-4afe-8a9b-afcc238ed5b3 req-a62707d8-1757-42b5-a8b2-b0480860fc40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052927 Oct 02 01:10:40.181742 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1134/2352] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:40.500489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:40.501100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:40.508977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.509421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.509942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.510810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.511272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.511774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.550409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:40.551254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:40.558015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.558622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.559164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.559947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.560500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.560999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.716951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.726775 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26886e2c-6efc-4c49-b5ef-979b3e1b73a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1508 microversion: 2.1 time: 0.230609 Oct 02 01:10:40.727373 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1219/2353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:40 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:40.745277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.748177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:40.751106 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:40.753340 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c275bfa5-6b0f-4142-9ade-91164579ff19 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1362 microversion: 2.1 time: 0.208479 Oct 02 01:10:40.753921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1135/2354] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:40 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:40.757234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.757729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.758176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.758352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:40.758911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.759026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:40.759638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.760220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.765145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.765894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.766323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.767230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.767683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.768104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.791974 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32f8befe-e6a8-4c28-8718-9e876f083b17 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047963 Oct 02 01:10:40.792573 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1220/2355] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:40 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:10:40.797126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:40.797759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:40.804212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.804859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.805164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.805915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.806375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.806852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.840526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.850151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.851663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.856781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6af19939-e480-4b1b-8083-f197d894cddb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.101930 Oct 02 01:10:40.857348 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1136/2356] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:40 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:40.887584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.896303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.897753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:40.902990 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-626d0d65-eb4f-4a81-a7e7-7847e03b7a70 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1417 microversion: 2.75 time: 0.109395 Oct 02 01:10:40.903567 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1221/2357] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:40 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1417 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:40.965989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1961303134", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "891e10e4-4877-44c7-ac1b-d27f75a2886c"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:41.021486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] validate_networks() for [('891e10e4-4877-44c7-ac1b-d27f75a2886c', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:10:41.036108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:41.036806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:41.042857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.043447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.043974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.044659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.045110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.046101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.240651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:41.249401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:41.250899 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:41.252083 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71bdc94c-2979-456e-8f54-2bd5e59e3d5b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.219887 Oct 02 01:10:41.252654 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1222/2358] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:41 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:41.477145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:41.477639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:41.478019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:41.478426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:41.478856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:41.487847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.488322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.488750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.489459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.489913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.490329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.507024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Getting quotas for project 76dd02a5b3d346168e6dde74ddb4d3e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:41.512114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Getting quotas for user a8ae1a9c7c164923840b20e32c471cf3 and project 76dd02a5b3d346168e6dde74ddb4d3e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:41.524595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:10:41.526908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:10:41.572385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd523699-8bca-40e7-896e-350c59857c62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610213 Oct 02 01:10:41.572947 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1137/2359] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:10:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:10:41.584637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f541e01f-522b-43b8-baca-31b31c4992f8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:41.585285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f541e01f-522b-43b8-baca-31b31c4992f8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:41.640779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f541e01f-522b-43b8-baca-31b31c4992f8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:41.647770 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f541e01f-522b-43b8-baca-31b31c4992f8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1218 microversion: 2.1 time: 0.067085 Oct 02 01:10:41.648336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1223/2360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:41 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:41.754569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:41.755226 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:41.762022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.762516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.763015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.763718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.764181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.764932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.776813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:41.777439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:41.787129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.787629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.788101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.792318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.792857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.793494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.014779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.017826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.023893 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12595d0b-4bd6-4d20-81cc-b8909a1186d3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1508 microversion: 2.1 time: 0.273724 Oct 02 01:10:42.024482 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1138/2361] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:41 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:42.025628 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58c5c55b-b5a8-44ac-b73b-72f4666990cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1549 microversion: 2.1 time: 0.252745 Oct 02 01:10:42.032218 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1224/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:41 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1549 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:42.032357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:42.032357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:42.036986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.037376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:42.037496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.037918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.038652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:42.038777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.039125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.039547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.046021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.046630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.047066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.047774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.048238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.048668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.115770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.124568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.125711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.130796 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f62eaa57-e492-4e46-8b63-20129a804738 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.105284 Oct 02 01:10:42.131378 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1139/2363] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:42 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:42.135115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.135978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:42.136462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:42.143688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.144379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.144741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.144908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.145490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.145941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.146358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.146707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.151739 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a31f464-f4b6-4e35-a9da-2501e440f47d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1417 microversion: 2.75 time: 0.124178 Oct 02 01:10:42.152312 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1225/2364] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:42 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1417 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:42.224637 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-07930e21-59c4-45f9-8944-88b2e7c6c799 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092188 Oct 02 01:10:42.225238 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1140/2365] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:10:42 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:42.279089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:42.279817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:42.286584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.287099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.287554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.288238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.288692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.289116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.423178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.431542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.432993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.434166 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e82faa2-11a6-44ea-8308-88a2558315da tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.159015 Oct 02 01:10:42.434759 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1226/2366] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:42 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:42.672126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:42.672780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:42.678904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.679389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.679823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.680526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.680981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.681405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.744797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:42.753014 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6132103b-f503-4db6-b274-4cab502cfd93 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1270 microversion: 2.1 time: 0.085513 Oct 02 01:10:42.753590 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1141/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:42 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:43.047886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:43.049471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:43.058346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.059216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.060028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.061579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.062359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.062919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.161268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:43.163038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:43.170273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.170912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.172008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.173054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.173729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.174647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.197641 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:43.608577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.615488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.621301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.624540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.629573 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02bea1c5-57bf-473d-961a-4c2981fbfe38 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1508 microversion: 2.1 time: 0.585512 Oct 02 01:10:43.630956 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1227/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:43 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1508 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:43.632247 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5026e987-7087-4fdd-b528-8d1e1c83ae9d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.477341 Oct 02 01:10:43.632916 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1142/2369] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:43 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:43.637690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8a39c5f0-0cb3-4268-9320-6cb327853685 req-f00f95fd-eac4-4465-bddb-d75917bbda7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:43.648638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8a39c5f0-0cb3-4268-9320-6cb327853685 req-f00f95fd-eac4-4465-bddb-d75917bbda7a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.649190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8a39c5f0-0cb3-4268-9320-6cb327853685 req-f00f95fd-eac4-4465-bddb-d75917bbda7a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.649710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8a39c5f0-0cb3-4268-9320-6cb327853685 req-f00f95fd-eac4-4465-bddb-d75917bbda7a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.656595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:43.657271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:43.664656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.665117 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8a39c5f0-0cb3-4268-9320-6cb327853685 req-f00f95fd-eac4-4465-bddb-d75917bbda7a service nova] Creating event network-changed:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:10:43.665249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.665710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.666882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.667734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.668169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.673264 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8a39c5f0-0cb3-4268-9320-6cb327853685 req-f00f95fd-eac4-4465-bddb-d75917bbda7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038029 Oct 02 01:10:43.677666 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1143/2370] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:43.684889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:43.686423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:43.694052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.695313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.695755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.696788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.697364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.698331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.698462 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:43.887479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.899066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.900604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:43.906085 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ede60cc-dfdc-41aa-b8b1-d043b54447e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1417 microversion: 2.75 time: 0.273861 Oct 02 01:10:43.912974 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1228/2371] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:43 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1417 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:43.931939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-257d7187-7bad-4bff-a0a1-cf5ce0716e96 req-24a86ec9-c7e6-45f9-836f-9b9cebe4f2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3933092-3252-458b-a700-ccb965d9f875", "name": "network-vif-unplugged", "status": "completed", "tag": "85e768a1-234d-44b8-8b27-020683b0f9cb"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:43.944592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-257d7187-7bad-4bff-a0a1-cf5ce0716e96 req-24a86ec9-c7e6-45f9-836f-9b9cebe4f2bb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.945367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-257d7187-7bad-4bff-a0a1-cf5ce0716e96 req-24a86ec9-c7e6-45f9-836f-9b9cebe4f2bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.945799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-257d7187-7bad-4bff-a0a1-cf5ce0716e96 req-24a86ec9-c7e6-45f9-836f-9b9cebe4f2bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.961507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-257d7187-7bad-4bff-a0a1-cf5ce0716e96 req-24a86ec9-c7e6-45f9-836f-9b9cebe4f2bb service nova] Creating event network-vif-unplugged:85e768a1-234d-44b8-8b27-020683b0f9cb for instance a3933092-3252-458b-a700-ccb965d9f875 on n-h1-master-1 Oct 02 01:10:43.966438 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-257d7187-7bad-4bff-a0a1-cf5ce0716e96 req-24a86ec9-c7e6-45f9-836f-9b9cebe4f2bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050673 Oct 02 01:10:43.966779 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1229/2372] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:43.973953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:43.974702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:43.986006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.986508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.986981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.988652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.989133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.989566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.116300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.126420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-15ff0368-8901-470b-a274-69ee0b4e38cf tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1270 microversion: 2.1 time: 0.157368 Oct 02 01:10:44.127756 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1230/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:43 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:44.191838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.201092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.202836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.204121 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aaca6b3a-0861-449e-81b8-d4d1e3603e32 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.525197 Oct 02 01:10:44.205130 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1144/2374] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:43 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:44.660141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:44.660141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:44.665762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:44.666677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:44.682752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:44.685326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:44.686710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:44.687430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.688379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:44.688630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.689344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:44.689798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:44.690224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.695948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:44.696431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:44.696870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.832435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.852519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.855732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.867751 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c8b58e5-e7f0-4360-8654-349e1c42838d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.205992 Oct 02 01:10:44.872318 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1145/2375] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:44 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:44.939733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:44.941420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:44.949650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:44.957407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:44.958732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:44.959240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.960098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:44.960770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:44.961373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:44.975170 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45fa0c89-e95a-4092-b569-6e1a6124e350 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1508 microversion: 2.1 time: 0.320908 Oct 02 01:10:44.987941 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1231/2376] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:44 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:45.073968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.089138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.090723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.107927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b51c034-37cb-4008-b950-ea368aaa8c4d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1417 microversion: 2.75 time: 0.175700 Oct 02 01:10:45.109568 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1146/2377] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:44 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1417 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:45.153401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:45.154209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:45.162148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.162730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.163262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.164024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.164663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.165200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.231946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:45.232644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:45.236127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.242017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.242813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.243466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.253686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.253981 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc4bcac1-ca55-4d87-bbc0-1a95c13bd22e tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1270 microversion: 2.1 time: 0.104615 Oct 02 01:10:45.255187 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1232/2378] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:45 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:45.255984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.256753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.401689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.411234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.412653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.413860 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-901df3f0-fb1b-4208-9414-2bc2d8e5f3d3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.186095 Oct 02 01:10:45.414423 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1147/2379] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:45 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:45.904110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:45.904725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:45.910780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.911270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.911718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.912415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.912927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.913359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.978337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.988233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.989727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:45.991419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6ebc00ef-e9dc-4349-b747-00aa3d8ff862 req-d7e8fc63-2a12-41ab-aa09-1a9a37d724fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3933092-3252-458b-a700-ccb965d9f875", "tag": "85e768a1-234d-44b8-8b27-020683b0f9cb"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:45.994966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30e7603a-08fe-4906-98fb-4dc768097e98 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.094710 Oct 02 01:10:45.995546 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1233/2380] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:45 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:46.002034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6ebc00ef-e9dc-4349-b747-00aa3d8ff862 req-d7e8fc63-2a12-41ab-aa09-1a9a37d724fb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.002513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6ebc00ef-e9dc-4349-b747-00aa3d8ff862 req-d7e8fc63-2a12-41ab-aa09-1a9a37d724fb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.002979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6ebc00ef-e9dc-4349-b747-00aa3d8ff862 req-d7e8fc63-2a12-41ab-aa09-1a9a37d724fb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.013970 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6ebc00ef-e9dc-4349-b747-00aa3d8ff862 req-d7e8fc63-2a12-41ab-aa09-1a9a37d724fb service nova] Creating event network-changed:85e768a1-234d-44b8-8b27-020683b0f9cb for instance a3933092-3252-458b-a700-ccb965d9f875 on n-h1-master-1 Oct 02 01:10:46.015603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:46.016238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:46.019090 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6ebc00ef-e9dc-4349-b747-00aa3d8ff862 req-d7e8fc63-2a12-41ab-aa09-1a9a37d724fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031160 Oct 02 01:10:46.019678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1148/2381] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:46.023232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.023723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.024167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.024878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.025337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.025767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.138260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:46.138892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:46.145967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.146474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.146941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.147646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.148104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.148532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.163755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.173683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5e90f65-62a3-4b79-9e24-d8ed879d9b88 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1514 microversion: 2.1 time: 0.162624 Oct 02 01:10:46.174290 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1234/2382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:46 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:46.223357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.232344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.234722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.241025 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d434c899-a59c-4c88-9902-c0e45269be3e tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1417 microversion: 2.75 time: 0.107349 Oct 02 01:10:46.241604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1149/2383] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:46 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1417 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:46.278169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:46.278815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:46.285582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.286152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.286726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.287466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.287919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.288346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.361609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.370400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c64fe2dd-9f13-4a5a-a9e5-1ee361205640 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1270 microversion: 2.1 time: 0.095947 Oct 02 01:10:46.371076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1235/2384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:46 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:46.444200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:46.444849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:46.453200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.454549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.455311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.456059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.456509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.456933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.595264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.603663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.605085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:46.606243 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8aa03840-a2d3-47a5-8aab-1b7071f3f896 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.168961 Oct 02 01:10:46.607067 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1150/2385] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:46 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:47.023003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:47.023622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.029716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.030326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.030799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.031510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.031972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.032410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.100236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.108628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.110165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.115477 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-996fc1f5-0ed2-4d4b-9c89-00d64e2b4eae tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.096456 Oct 02 01:10:47.116059 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1236/2386] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:47 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:47.285608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:47.286184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.293315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.293802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.294232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.294965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.295414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.296919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.376224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.384483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.385904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.390973 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e9ef8fa-4071-44bd-b4f3-8113347ba36b tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1438 microversion: 2.75 time: 0.110018 Oct 02 01:10:47.391788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1151/2387] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:47 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:47.397198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:47.397846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.404735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.405914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.406628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.407511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.408116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.408692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.418740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:47.422267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.428564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.429247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.429954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.430894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.431501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.432077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.476686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.487871 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c998fc5-f3d9-4223-8857-1f500fd4db3f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1278 microversion: 2.1 time: 0.094554 Oct 02 01:10:47.488877 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1237/2388] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:47 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:47.569966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:47.570578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:47.571179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:47.571836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:47.572546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:47.578102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5ccb5c7-14ad-42b4-ae4c-bfb4ae6e8e24 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'create', calling method: .version_select at 0x7fb8856ad790>, body: {"keypair": {"name": "tempest-keypair-1205326892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBAOLswL8swFRLwMTViQbyyq/YyvvUwr/x7nkqZ4eNHAvo8ZRoMYIbL5FJgm5yQBrH3yUVAZcgyvIzREatN++ivQMUbxOeKei/0XpNH/AuXraCcWcnwvhEiJju6mcGx/Q=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:47.597877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c5ccb5c7-14ad-42b4-ae4c-bfb4ae6e8e24 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:47.605692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c5ccb5c7-14ad-42b4-ae4c-bfb4ae6e8e24 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for user df46881c91e8419e84b8679ad474ba44 and project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:47.636749 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5ccb5c7-14ad-42b4-ae4c-bfb4ae6e8e24 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063160 Oct 02 01:10:47.637724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1238/2389] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:10:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:47.645349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:47.645349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.649953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.650452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.650935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.651651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.652114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.652544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.670347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.677740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.678153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.678672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.679506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.680028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.680460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.819574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.845201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.846990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:47.858158 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca9b578d-386a-42b9-91c3-21b3236d7e55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "POST /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc/action" status: 202 len: 1495 microversion: 2.75 time: 0.440573 Oct 02 01:10:47.860350 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1152/2390] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:10:47 2022] POST /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc/action => generated 1495 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 02 01:10:47.885631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:47.886174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.899670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.900687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.900687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.901289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.901855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.902297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.027888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.036311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.046791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.051922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.056813 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1e93036-7caa-45c0-a634-129c871ec4e3 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.417910 Oct 02 01:10:48.057012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.060789 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1239/2391] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:47 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:48.063962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.079484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96fe6edf-1e91-4e8a-8112-4c8db16121db tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.197633 Oct 02 01:10:48.081152 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1153/2392] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:47 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:48.145858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:48.146567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:48.148577 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:48.158475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:48.159011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:48.159465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.167346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:48.168530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:48.168530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.262535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.272338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.274356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.281061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b7b58ce7-1031-4c0e-8dc7-a50882bcd4c5 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.139255 Oct 02 01:10:48.281740 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1240/2393] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:48 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:48.512484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:48.514158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:48.526098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:48.527183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:48.527810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.529678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:48.531499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:48.532194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.728583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:48.737569 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7086f6e3-9dbf-41bf-a9dc-4262fdb320f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.229780 Oct 02 01:10:48.738838 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1154/2394] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:48 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:49.091701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:49.095738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:49.114109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:49.116837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:49.128851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.131865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.133030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.134573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.135229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.137707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.139104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.141823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.142215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.144719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.146550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.147340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.340993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.363613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.369195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.383838 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-59093b8d-98c6-4acf-91a5-d7f9d6b8eb2f tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.276666 Oct 02 01:10:49.386172 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1155/2395] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:49 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:49.394917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:49.396922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:49.418730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.419493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.420342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.422220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.423593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.424219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.589353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.592986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.601414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.601414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.602439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-15107e0a-235b-4aae-a663-91ef02a0dd86 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.516558 Oct 02 01:10:49.603315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1241/2396] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:49 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:49.610700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1900153328", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dd30ef3-dbf2-41ac-9ca2-f8025479410f"}], "security_groups": [{"name": "tempest-securitygroup--1112508499"}], "key_name": "tempest-keypair-1205326892", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:49.610919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.612568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:49.619615 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab899c56-973d-4dd2-bbc9-95bf7435f60e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.232193 Oct 02 01:10:49.620457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1156/2397] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:49 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:49.762902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:49.763993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:49.771790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.772555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.773174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.774081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.774729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.775307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.810073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] validate_networks() for [('3dd30ef3-dbf2-41ac-9ca2-f8025479410f', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:10:50.119930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:50.122284 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:50.129639 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cbc64c20-344a-4e35-bec6-67bf8662cde7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.370502 Oct 02 01:10:50.131125 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1157/2398] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:49 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:10:50.260311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0324f0d4-7baa-4581-805a-f787d81caa75 req-8643a76a-1875-496f-bb18-cff34d9bf77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a", "tag": "24bbb3e7-de5a-4fea-892c-0a4fe56b78da"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:50.271043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0324f0d4-7baa-4581-805a-f787d81caa75 req-8643a76a-1875-496f-bb18-cff34d9bf77f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.271528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0324f0d4-7baa-4581-805a-f787d81caa75 req-8643a76a-1875-496f-bb18-cff34d9bf77f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.271971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0324f0d4-7baa-4581-805a-f787d81caa75 req-8643a76a-1875-496f-bb18-cff34d9bf77f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.295381 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0324f0d4-7baa-4581-805a-f787d81caa75 req-8643a76a-1875-496f-bb18-cff34d9bf77f service nova] Creating event network-changed:24bbb3e7-de5a-4fea-892c-0a4fe56b78da for instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a on n-h1-master-1 Oct 02 01:10:50.301535 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0324f0d4-7baa-4581-805a-f787d81caa75 req-8643a76a-1875-496f-bb18-cff34d9bf77f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044766 Oct 02 01:10:50.302453 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1158/2399] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:50.423435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:50.424447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:50.431785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.432353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.432801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.433505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.433968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.434403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.571087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:50.582909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:50.584790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:50.591215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1dd95ba-77b5-4409-9e40-367f8403fdb4 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.173835 Oct 02 01:10:50.592119 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1159/2400] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:50 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:50.641187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:50.642015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:50.648638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.649298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.650094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.650974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.651771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.652213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.663758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:10:50.663758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:10:50.664721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:10:50.664721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:10:50.664721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:10:50.675194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.676366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.677047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.678183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.678928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.679684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.703728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:10:50.709973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Getting quotas for user df46881c91e8419e84b8679ad474ba44 and project 2b2d3a5d2c4f4761b3bb73e4967ed345. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:10:50.725005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:10:50.727516 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:10:50.783531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c2b4855b-943e-43bb-aa5e-9b92404fbae1 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.178483 Oct 02 01:10:50.784617 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1242/2401] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:10:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:10:50.795524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:50.796309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:50.807593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.808199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.808728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.809590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.810396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.810935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.110000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.129002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.130664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.138786 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6646eead-90e3-4b49-a7dd-f9b58b44bee2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.352824 Oct 02 01:10:51.140828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1243/2402] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:50 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:51.154408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46eb1de5-1ec5-4362-9f72-10bf4abb0f39 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:51.155778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46eb1de5-1ec5-4362-9f72-10bf4abb0f39 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:51.275454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46eb1de5-1ec5-4362-9f72-10bf4abb0f39 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.286625 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46eb1de5-1ec5-4362-9f72-10bf4abb0f39 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1246 microversion: 2.1 time: 0.144355 Oct 02 01:10:51.287577 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1244/2403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:51 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1246 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:51.293143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.311146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:51.312272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.315144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:51.315572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.320101 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e60ec522-a17d-4f26-b0f5-ab831d4d6b02 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.684576 Oct 02 01:10:51.320860 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1160/2404] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:50 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:51.326217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:51.327045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:51.327898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.328894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:51.329504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:51.330080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.493890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.504406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7da1687e-35f8-4a14-8785-93d4d5009438 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.215111 Oct 02 01:10:51.505289 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1245/2405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:51 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:51.622095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:51.622802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:51.626213 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:51.627490 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:51.629608 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:51.634838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:51.635628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:51.636332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.637003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:51.637468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:51.638127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.727026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.735937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.737379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:51.742395 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40aad509-f78e-42d6-9c7e-d235275d959d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.125256 Oct 02 01:10:51.743008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1161/2406] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:51 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:52.171132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:52.171921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:52.178892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.179379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.179818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.180513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.180970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.181393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.249050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.257573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.259170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.265313 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-54275a35-e4b1-4e8e-8168-f032f42cfc7b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.097679 Oct 02 01:10:52.265313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1246/2407] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:52 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:52.315786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:52.316424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:52.322748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.323301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.323714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.324490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.324952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.325384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.354583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:52.355221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:52.362772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.363484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.364121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.364913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.365481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.365977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.391067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.399106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef48aba4-d91c-4f1f-8677-4b8288de7c12 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1298 microversion: 2.1 time: 0.087804 Oct 02 01:10:52.399829 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1162/2408] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:52 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:52.503460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.512016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.513566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.515188 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c95b930-df07-4ade-9a50-e0bc15e634f2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.164322 Oct 02 01:10:52.515899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1247/2409] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:52 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:52.531453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:52.532307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:52.538280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.538797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.539233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.539917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.540455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.540987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.770878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:52.771595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:52.779070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.779957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.781442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.782713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.783563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.784164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.787295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.795779 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c41be0d-963e-4593-8d2a-bfacfee1826c tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.268625 Oct 02 01:10:52.796618 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1163/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:52 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:52.802254 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:52.860591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.869762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.871329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:52.877017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-03f41858-ba10-4f5f-9c5c-e17139fff1bc tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.110634 Oct 02 01:10:52.877616 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1248/2411] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:52 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:53.293590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:53.294196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:53.301132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.301720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.302168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.302904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.303364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.303792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.398512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.407850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.409350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.414816 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b03f05d2-b924-4a58-8e59-ad8ef2091239 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.125021 Oct 02 01:10:53.423190 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1164/2412] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:53 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:53.432014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:53.432780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:53.440024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.440595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.441108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.441881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.442413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.443194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.544704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:53.545396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:53.552274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.552771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.553211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.553928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.554397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.554860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.793689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.806824 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eac13718-eda8-4c4f-a2cd-9c65a9fe3d5b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.378176 Oct 02 01:10:53.809062 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1249/2413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:53 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:53.821375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:53.821997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:53.830165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.830961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.831558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.832450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.833566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.834487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.837770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.857341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.859614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:53.865833 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fcf2c5cf-0e57-4dd8-9eb0-ae882813b3aa tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.325809 Oct 02 01:10:53.874834 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1165/2414] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:53 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:53.914539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:53.914978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:53.927397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.929083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.930191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.930923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.934345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.937483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.089204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.098854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.100544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.106554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18489fde-adfb-4ea1-ae61-0efbf815894c tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.196640 Oct 02 01:10:54.113918 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1166/2415] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:53 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:54.186206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.197910 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4742a78-4f09-4bef-8dde-163205e5e6d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.380278 Oct 02 01:10:54.199597 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1250/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:53 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:54.445545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:54.446269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:54.453233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.453878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.454508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.455523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.456232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.456729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.581534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.590433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.592025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:54.598643 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e7842a69-50e4-49c4-9ef8-71432a411f79 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.158033 Oct 02 01:10:54.599458 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1167/2417] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:54 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:54.839894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:54.841023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:54.851300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.852901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.853675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.854724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.855598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.856091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.902467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:54.903439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:54.915363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.916132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.916719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.917614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.918078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.918506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.295087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.305662 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71d9a3a9-c6e8-4f06-947f-22a041fbfbfb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.471761 Oct 02 01:10:55.306267 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1251/2418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:54 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:55.311314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:55.312911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:55.320749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.322538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.331908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.332822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.333322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.333773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.340785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.355072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.356712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.357984 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-faf01185-cdda-45e9-a0b4-bddd4ac5d336 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1487 microversion: 2.25 time: 0.459435 Oct 02 01:10:55.358919 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1168/2419] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:54 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1487 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:55.363498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:55.364391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:55.370973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.371874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.372520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.373999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.375888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.376542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.449544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.460245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.474889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.483724 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45f2f836-47b0-473c-bb9b-41c7ba289907 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.176252 Oct 02 01:10:55.484409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1252/2420] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:55 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:55.575424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4f5cb950-fc59-4b8a-bc62-43cd814268df req-32e57060-7af9-4f8b-a81c-c83ca4cf3e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481845ee-ce3d-4b19-95a4-4eeda0435f4d", "tag": "225eff9c-49dd-4284-907a-878dd594d1bf"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:55.588365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4f5cb950-fc59-4b8a-bc62-43cd814268df req-32e57060-7af9-4f8b-a81c-c83ca4cf3e1c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.589081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4f5cb950-fc59-4b8a-bc62-43cd814268df req-32e57060-7af9-4f8b-a81c-c83ca4cf3e1c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.589670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4f5cb950-fc59-4b8a-bc62-43cd814268df req-32e57060-7af9-4f8b-a81c-c83ca4cf3e1c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.605304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4f5cb950-fc59-4b8a-bc62-43cd814268df req-32e57060-7af9-4f8b-a81c-c83ca4cf3e1c service nova] Creating event network-changed:225eff9c-49dd-4284-907a-878dd594d1bf for instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d on n-h2-master-1 Oct 02 01:10:55.613401 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4f5cb950-fc59-4b8a-bc62-43cd814268df req-32e57060-7af9-4f8b-a81c-c83ca4cf3e1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Oct 02 01:10:55.614481 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1253/2421] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:55.630315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:55.631217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:55.637645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.638724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.639248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.640189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.640189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.641074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.684045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.693256 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-261e5a71-bbad-42f6-aada-1dd92269905a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.333232 Oct 02 01:10:55.693852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1169/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:55 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:55.793652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.805598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.807253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:55.813654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e64a08a-3d17-4728-8a4f-7769c522656d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.189698 Oct 02 01:10:55.814405 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1254/2423] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:55 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:56.334622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.335246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.342137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.342654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.343655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.344436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.344888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.345316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.384447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.385888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.393779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.394190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.394856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.395749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.396306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.396771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.546839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.554954 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-531d878f-8628-4482-b20d-4c3a4cec57a2 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.224136 Oct 02 01:10:56.565272 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1170/2424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:56.565272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.565272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.567323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.567812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.568502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.569397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.569905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.570498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.579727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.591609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.594159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.595862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fec638ae-df24-4077-80f9-b494fa1ec1c1 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1477 microversion: 2.25 time: 0.215439 Oct 02 01:10:56.596728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1255/2425] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:56.626464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8da21748-0c5b-4adb-8224-9658af2bad31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '.version_select at 0x7fb881938550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.630341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8da21748-0c5b-4adb-8224-9658af2bad31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.631329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8da21748-0c5b-4adb-8224-9658af2bad31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.631871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8da21748-0c5b-4adb-8224-9658af2bad31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.643140 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8da21748-0c5b-4adb-8224-9658af2bad31 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.021152 Oct 02 01:10:56.643775 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1256/2426] 10.222.0.23 () {60 vars in 1184 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:56.647151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.656182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.657874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.661104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.661910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.664231 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c97c3bb-f56c-44e3-859b-a55ed3f5bcf6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.106897 Oct 02 01:10:56.665145 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1171/2427] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:56.668692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.669311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.669698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.670401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.670895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.671481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.716511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.717309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.725349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.725848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.726367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.727223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.728626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.729244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.877509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] Lazy-loading 'services' on Instance uuid a3933092-3252-458b-a700-ccb965d9f875 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:10:56.894183 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a7cf580-5058-4d6c-8c93-7c31995c8390 tempest-LiveAutoBlockMigrationV225Test-1490634556 tempest-LiveAutoBlockMigrationV225Test-1490634556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1970 microversion: 2.25 time: 0.238983 Oct 02 01:10:56.895014 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1257/2428] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1970 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:56.900165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.900735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.908595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.909201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.909777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.910667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.911174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.911642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.956175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:56.973342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb21a259-411d-4523-bc73-fbec42f26b0a tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.260606 Oct 02 01:10:56.988020 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1172/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:57.004899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-67e3ec0f-e431-4162-977f-7cd7261e6791 req-f25e4740-46f7-48d4-a1b1-f503a3309169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a", "name": "network-vif-plugged", "status": "completed", "tag": "24bbb3e7-de5a-4fea-892c-0a4fe56b78da"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:57.005168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.016001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.017475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.023565 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d12d1a35-3d3f-4789-8dd2-ff228c0b1162 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.127567 Oct 02 01:10:57.024338 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1258/2430] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:57.024448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-67e3ec0f-e431-4162-977f-7cd7261e6791 req-f25e4740-46f7-48d4-a1b1-f503a3309169 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.024699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-67e3ec0f-e431-4162-977f-7cd7261e6791 req-f25e4740-46f7-48d4-a1b1-f503a3309169 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.025196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-67e3ec0f-e431-4162-977f-7cd7261e6791 req-f25e4740-46f7-48d4-a1b1-f503a3309169 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.030108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:57.031171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:57.037457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.037960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.038355 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-67e3ec0f-e431-4162-977f-7cd7261e6791 req-f25e4740-46f7-48d4-a1b1-f503a3309169 service nova] Creating event network-vif-plugged:24bbb3e7-de5a-4fea-892c-0a4fe56b78da for instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a on n-h1-master-1 Oct 02 01:10:57.038504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.039417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.040042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.040482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.043848 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-67e3ec0f-e431-4162-977f-7cd7261e6791 req-f25e4740-46f7-48d4-a1b1-f503a3309169 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044801 Oct 02 01:10:57.044824 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1173/2431] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:57.067506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:10:57.148826 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64043ae2-e59a-49e8-a2a0-b3ca7dbaf587 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 204 len: 0 microversion: 2.25 time: 0.123273 Oct 02 01:10:57.149454 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1259/2432] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:10:57 2022] DELETE /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:10:57.160314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:57.160990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:57.168266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.168837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.169280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.170039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.170503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.171806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.361007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.370994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.372737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.374819 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76571b8f-224a-4d8a-87f3-0f03d4459ba2 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1483 microversion: 2.25 time: 0.220072 Oct 02 01:10:57.375994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1174/2433] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:57 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1483 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:57.582492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:57.583391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:57.590798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.591366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.591812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.592622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.593728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.594293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.696111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:57.696832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:57.707524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.708116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.708559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.709414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.709908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.710341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.784523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.787153 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:57.797049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.799015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.805233 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-581b3376-9b05-485e-954b-56335aead358 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.114123 Oct 02 01:10:57.806408 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1175/2434] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:57 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:57.811315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:57.821108 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1f56045-e78c-4aa5-93c2-2f30342e13a7 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.243220 Oct 02 01:10:57.821924 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1260/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:57 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:58.005649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:58.006480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:58.012521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.013267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.013770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.014546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.015597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.016265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.055188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:58.056161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:58.066072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.066583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.067198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.067940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.068666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.069534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.379128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.387357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.388784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.394336 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-acd32160-e740-42bf-911a-9310f3368fca tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.343577 Oct 02 01:10:58.394824 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1261/2436] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:58 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:58.413567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:58.414839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:58.424144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.425174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.426060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.427081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.427810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.428251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.544467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.552819 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77e12e05-8c0d-4edf-b441-75ce483cd02f tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1318 microversion: 2.1 time: 0.551263 Oct 02 01:10:58.553388 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1176/2437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:58 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:58.780138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.788748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.790289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.791500 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d6da652-0b1c-44a0-847c-e76d1342aa7b tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1483 microversion: 2.25 time: 0.382975 Oct 02 01:10:58.792276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1262/2438] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:58 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1483 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:10:58.842000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:58.842863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:58.849607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.850183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.850730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.851109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:58.851723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.851882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:58.852508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.853139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.859440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.860321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.861158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.862093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.862785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.863415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.975072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.986156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.987627 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:58.994887 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3443fa0e-86ce-4f39-9b3c-99c3c2cf54c6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.157135 Oct 02 01:10:58.995794 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1177/2439] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:58 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:59.208315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.216121 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec665385-4b63-40cc-abed-530dac98eb91 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.368909 Oct 02 01:10:59.216699 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1263/2440] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:58 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:59.402914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2d8fed63-aaa5-4c22-b170-c39f614bf059 req-09074d9d-7ea3-439e-ac36-06234dd58082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3933092-3252-458b-a700-ccb965d9f875", "name": "network-vif-deleted", "tag": "85e768a1-234d-44b8-8b27-020683b0f9cb"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:10:59.413310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d8fed63-aaa5-4c22-b170-c39f614bf059 req-09074d9d-7ea3-439e-ac36-06234dd58082 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.413795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d8fed63-aaa5-4c22-b170-c39f614bf059 req-09074d9d-7ea3-439e-ac36-06234dd58082 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.414232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d8fed63-aaa5-4c22-b170-c39f614bf059 req-09074d9d-7ea3-439e-ac36-06234dd58082 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.421708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:59.422645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:59.425937 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2d8fed63-aaa5-4c22-b170-c39f614bf059 req-09074d9d-7ea3-439e-ac36-06234dd58082 service nova] Creating event network-vif-deleted:85e768a1-234d-44b8-8b27-020683b0f9cb for instance a3933092-3252-458b-a700-ccb965d9f875 on n-h2-master-1 Oct 02 01:10:59.428632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.430159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.430801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.431071 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2d8fed63-aaa5-4c22-b170-c39f614bf059 req-09074d9d-7ea3-439e-ac36-06234dd58082 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Oct 02 01:10:59.431947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.432057 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1178/2441] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:59.432229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.432664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.450363 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:59.505119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.513428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.515421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.520400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36523901-0d9e-4542-a557-6bc7d66f8bc1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.103036 Oct 02 01:10:59.520978 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1264/2442] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:59 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:10:59.578066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:59.579112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:59.585224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.585711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.586352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.587081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.587534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.587954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.731692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.740726 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-292ff9c4-d199-4553-80c8-879488bd7366 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1507 microversion: 2.1 time: 0.167356 Oct 02 01:10:59.741897 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1179/2443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:10:59 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:10:59.817506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:59.819054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:59.826364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.827111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.827817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.828806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.829490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.830060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.901858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.912670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.914115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:10:59.916171 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e5bbaba-ce74-4bdb-9a17-b37d5436b69e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1266 microversion: 2.25 time: 0.101712 Oct 02 01:10:59.917236 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1265/2444] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:10:59 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:00.026485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:00.027610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:00.046931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.047922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.048512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.049750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.050661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.051690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.139701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.150191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.152151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.159432 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3035a01-78d5-4fcb-9dc3-8d705d09b45d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.137940 Oct 02 01:11:00.160710 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1180/2445] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:00 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:00.239252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:00.240204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:00.246837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.247652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.248329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.249500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.250168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.250860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.399560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.408420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-afa93b43-5ffe-41c1-beb0-f0828908e5ba tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.172920 Oct 02 01:11:00.409298 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1266/2446] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:00 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:00.549495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:00.550138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:00.557336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.557871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.558518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.559311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.559839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.560334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.626761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.635721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.637281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:00.643101 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-338b91a0-2403-4bee-a17a-a9a1224af06a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1558 microversion: 2.91 time: 0.098484 Oct 02 01:11:00.643766 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1181/2447] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:00 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1558 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:00.943056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:00.944130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:00.946396 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:00.953861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.954289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.955002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.955787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.956335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.956832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.044389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.053688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.055185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.056361 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc115332-d78c-48e4-b050-1ad0ad91c9fd tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1266 microversion: 2.25 time: 0.117472 Oct 02 01:11:01.056953 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1267/2448] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:00 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:01.188103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:01.188913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:01.195259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.195855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.196391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.197184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.197807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.198431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.198788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5a860f98-5dc4-436c-b4a9-bca3e61ffc06"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:01.201244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:01.208164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.208661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.209105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.209808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.210272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.210731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.262372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] HTTP exception thrown: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Request method failure captured: Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a/os-volume_attachments/732190b6-1033-4f59-9d0d-b72e59b3d6d6 HTTP/1.1 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 74 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOSDrqsRnzsHTwHn7kOc8G-fK4LHa8ta4hPF3kKMx_-dM6aov8zY5x_4s62jIpGLxvL6-rU_5N_cm1Rn1pHPdq5KGHXkUjooFyhaCXt2AMLOaf7lbkCaqjrURR-dZmFM87j_GheusZy9jXjsWiERMM3SyygsSqGguuqo2hZYUwnPnkA Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2025441a9e3a4e848c695b77bb33b9e2 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesAdminNegativeTest-1766094081 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2025441a9e3a4e848c695b77bb33b9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2025441a9e3a4e848c695b77bb33b9e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2025441a9e3a4e848c695b77bb33b9e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2025441a9e3a4e848c695b77bb33b9e2"}]}] Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesAdminNegativeTest-1766094081 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2025441a9e3a4e848c695b77bb33b9e2 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1766094081 Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesAdminNegativeTest-1766094081-project-admin Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: f13f3cf87e5148cf9ba45f4d24961f6e Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesAdminNegativeTest-1766094081-project-admin Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: {"volumeAttachment": {"volumeId": "5a860f98-5dc4-436c-b4a9-bca3e61ffc06"}} Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: exception: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a', 'id': '732190b6-1033-4f59-9d0d-b72e59b3d6d6', 'body': {'volumeAttachment': {'volumeId': '5a860f98-5dc4-436c-b4a9-bca3e61ffc06'}}} Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. (HTTP 404) (Request-ID: req-8ff7251f-b773-4da6-8681-44f084743391) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:11:01.266775 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] Returning 404 to user: Volume 732190b6-1033-4f59-9d0d-b72e59b3d6d6 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dfeaef0d-2826-485a-b2b7-2eb3cbf512d9 tempest-VolumesAdminNegativeTest-1766094081 tempest-VolumesAdminNegativeTest-1766094081-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a/os-volume_attachments/732190b6-1033-4f59-9d0d-b72e59b3d6d6" status: 404 len: 109 microversion: 2.1 time: 0.073498 Oct 02 01:11:01.270996 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1268/2449] 10.222.0.23 () {60 vars in 1433 bytes} [Sun Oct 2 01:11:01 2022] PUT /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a/os-volume_attachments/732190b6-1033-4f59-9d0d-b72e59b3d6d6 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:11:01.282022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.293312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.294970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.301462 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26e4e187-1a69-4132-acd9-6053f6ff4c79 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.117888 Oct 02 01:11:01.302547 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1182/2450] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:01 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:01.429402 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=18 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:01.434254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:01.435016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:01.442485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.444143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.444957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.445940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.446803 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.447553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.602336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.612744 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ace60019-e3d5-4f41-bda0-37b349e81d7e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.184145 Oct 02 01:11:01.613512 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1269/2451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:01 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:01.672911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:01.674269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:01.682019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.682442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.682912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.683653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.684147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.684582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.756165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.764650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.766906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:01.772121 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c29f9cb3-074e-4077-8c60-109ed8fe2abe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1558 microversion: 2.91 time: 0.103760 Oct 02 01:11:01.772693 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1183/2452] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:01 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1558 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:02.082191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:02.082841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:02.086518 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:02.097372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.100268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.103241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.104037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.105493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.105976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.214221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.227656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.229389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.231523 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b84f36d-d424-4834-9009-7cf01d23e132 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1266 microversion: 2.25 time: 0.153819 Oct 02 01:11:02.232841 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1270/2453] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:02 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:02.277289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1653fc56-0ae3-4ecd-8f8b-e4698ac66513 req-5ed489ed-8d57-4433-bac4-5c9159812927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481845ee-ce3d-4b19-95a4-4eeda0435f4d", "name": "network-vif-plugged", "status": "completed", "tag": "225eff9c-49dd-4284-907a-878dd594d1bf"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:02.295781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1653fc56-0ae3-4ecd-8f8b-e4698ac66513 req-5ed489ed-8d57-4433-bac4-5c9159812927 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.296863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1653fc56-0ae3-4ecd-8f8b-e4698ac66513 req-5ed489ed-8d57-4433-bac4-5c9159812927 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.297781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1653fc56-0ae3-4ecd-8f8b-e4698ac66513 req-5ed489ed-8d57-4433-bac4-5c9159812927 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.313987 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1653fc56-0ae3-4ecd-8f8b-e4698ac66513 req-5ed489ed-8d57-4433-bac4-5c9159812927 service nova] Creating event network-vif-plugged:225eff9c-49dd-4284-907a-878dd594d1bf for instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d on n-h2-master-1 Oct 02 01:11:02.320782 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1653fc56-0ae3-4ecd-8f8b-e4698ac66513 req-5ed489ed-8d57-4433-bac4-5c9159812927 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131492 Oct 02 01:11:02.321862 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1184/2454] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:02.335630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:02.336336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:02.354136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.354758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.355268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.356043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.356590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.357084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.492571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.503745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.505741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.518197 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78747838-88c1-4aa1-982c-412362bd6ba0 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.187298 Oct 02 01:11:02.520841 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1271/2455] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:02 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:02.637739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:02.638450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:02.645150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.645851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.646287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.647189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.647646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.648260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.801626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:02.802443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:02.821818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.826139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.826842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.828462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.829012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.830780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.878238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.894095 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6dc6ee3-517b-4828-870a-896e9614128b tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1372 microversion: 2.1 time: 0.255648 Oct 02 01:11:02.908284 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1185/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:02 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:02.957121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.970851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.972668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:02.979894 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff38373f-800d-4846-8af9-c1d912af6912 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.182059 Oct 02 01:11:02.981144 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1272/2457] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:02 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:03.257341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:03.258055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:03.264642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.265799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.266264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.266976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.267431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.267857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.364654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:03.373662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:03.377005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:03.378302 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20f5904e-67dd-44b1-823b-5bf26220571f tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1266 microversion: 2.25 time: 0.125093 Oct 02 01:11:03.379336 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1186/2458] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:03 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:03.548828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:03.550069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:03.569327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.569818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.570260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.571005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.571477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.571889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.724252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:03.734464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:03.750260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:03.769673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c92a0e83-92af-4048-9982-424c97994794 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.224849 Oct 02 01:11:03.770937 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1273/2459] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:03 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:03.919771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:03.920601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:03.945364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.955527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.955994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.959691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.960223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.964785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.011259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:04.011886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:04.033367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.033913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.034361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.035177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.035609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.036039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.170882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.189044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.192190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.198717 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b51a8a2b-ea15-488c-9c8a-3611c370afb8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.192358 Oct 02 01:11:04.215142 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1274/2460] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:04 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:04.288726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.298735 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75eb0d4f-fefa-4a53-a8db-9bdee1e41ae6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1565 microversion: 2.1 time: 0.383422 Oct 02 01:11:04.299652 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1187/2461] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:03 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1565 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:04.322465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:04.323016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:04.330057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.330610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.331093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.331820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.332290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.332726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.405517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:04.406339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:04.415125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.415613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.416057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.416763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.417214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.417639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.436412 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0bc19f24-ecb3-4917-8485-5ab7286cc397 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118030 Oct 02 01:11:04.437807 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1275/2462] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:11:04 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:04.498866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.508294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.509955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:04.511175 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ced2f207-18cf-4a29-99f4-5406c2cd054c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 200 len: 1266 microversion: 2.25 time: 0.109610 Oct 02 01:11:04.512059 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1188/2463] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:04 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:04.603843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:04.605249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:04.613579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.614559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.615368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.616363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.617204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.617881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.662091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:04.807014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:04.809630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:04.834987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.836156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.836919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.838021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.838721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.844121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.866662 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0821cb08-23ce-4cff-92c9-e49bd6d966b8 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "DELETE /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 204 len: 0 microversion: 2.1 time: 0.268517 Oct 02 01:11:04.875658 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1276/2464] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:11:04 2022] DELETE /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:11:04.892601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:04.893546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:04.911034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.911235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.911740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.912843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:04.913847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:04.914429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:04.979970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.001344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.004622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.017923 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e39fbf8b-f7e2-4a45-bac6-dc1625e901e1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.219671 Oct 02 01:11:05.020938 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1189/2465] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:04 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:05.232924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:05.234912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:05.251914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:05.254028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:05.255490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:05.256019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.256980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:05.258582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:05.261979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:05.267466 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ddc11608-94e5-43db-afc3-e30b94a88f25 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1513 microversion: 2.1 time: 0.386706 Oct 02 01:11:05.268201 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1277/2466] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:04 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:05.383594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.395376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.397271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:05.402834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8bf6ec9f-3489-4abd-ac5f-a30a248bdc3d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.178086 Oct 02 01:11:05.403438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1190/2467] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:05 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:05.537114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:05.538204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: a3933092-3252-458b-a700-ccb965d9f875] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:05.544663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:05.545483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:05.546239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:05.547216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:05.547891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:05.548651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:05.580394 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] HTTP exception thrown: Instance a3933092-3252-458b-a700-ccb965d9f875 could not be found. Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Request method failure captured: Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 HTTP/1.1 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOONTneYK8cEXs-q1fqwq4rWQv8uwLoKp-1PJs1Cxcs4gC81RXlnIxxnnlwDOZArojhkklCGUtk1klW1ZllgGZvP6wxLybZiOb6nbyr0twToZy42n_Drp-Rq_sX1rQGFWUdjaOjVmstG0ZJ6_lDevp86N7e9XBXq1IwdK8MbFN-IMMNo Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.25 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b8fabf5bc8740b09c77687c9d4e1e77"}]}] Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: d44f8d053e07440699d217cd63c94d0d Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: exception: Instance a3933092-3252-458b-a700-ccb965d9f875 could not be found. Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'a3933092-3252-458b-a700-ccb965d9f875'} Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3933092-3252-458b-a700-ccb965d9f875 could not be found. Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3933092-3252-458b-a700-ccb965d9f875 could not be found. Oct 02 01:11:05.585158 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3933092-3252-458b-a700-ccb965d9f875 could not be found. Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:05.588640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Returning 404 to user: Instance a3933092-3252-458b-a700-ccb965d9f875 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:05.589884 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59381a21-b67d-428d-8906-275e4e8968d0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875" status: 404 len: 111 microversion: 2.25 time: 0.056006 Oct 02 01:11:05.590480 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1278/2468] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:05 2022] GET /compute/v2.1/servers/a3933092-3252-458b-a700-ccb965d9f875 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:11:06.051405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:06.052560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:06.068337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.069609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.070971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.075642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.076341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.076963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.232514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.249907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.255436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.271261 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50a49b36-6023-4121-995e-d547e9d33026 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.223721 Oct 02 01:11:06.272240 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1191/2469] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:06 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:06.298632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:06.299621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:06.302879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-24b68c8c-90ab-4b1d-b967-46c5f55d3f2d req-7a525269-21d5-4071-b738-fd1e49ae33ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481845ee-ce3d-4b19-95a4-4eeda0435f4d", "tag": "225eff9c-49dd-4284-907a-878dd594d1bf"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:06.311466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.315125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.316187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.317906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.318939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.323775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-24b68c8c-90ab-4b1d-b967-46c5f55d3f2d req-7a525269-21d5-4071-b738-fd1e49ae33ea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.335703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.350056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-24b68c8c-90ab-4b1d-b967-46c5f55d3f2d req-7a525269-21d5-4071-b738-fd1e49ae33ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.351860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-24b68c8c-90ab-4b1d-b967-46c5f55d3f2d req-7a525269-21d5-4071-b738-fd1e49ae33ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.371142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-24b68c8c-90ab-4b1d-b967-46c5f55d3f2d req-7a525269-21d5-4071-b738-fd1e49ae33ea service nova] Creating event network-changed:225eff9c-49dd-4284-907a-878dd594d1bf for instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d on n-h2-master-1 Oct 02 01:11:06.377058 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-24b68c8c-90ab-4b1d-b967-46c5f55d3f2d req-7a525269-21d5-4071-b738-fd1e49ae33ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086365 Oct 02 01:11:06.381255 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1279/2470] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:06.438145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:06.439814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:06.451076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.457705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.458438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.459640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.460524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.461191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.685956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.706084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.716140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.734969 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f04d413-2f23-4bbe-89fd-9e2c22d72da4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.301715 Oct 02 01:11:06.746666 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1280/2471] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:06 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:06.823362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:06.836623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d67597ad-e457-49a8-aa7b-2bdfc59f0d62 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1513 microversion: 2.1 time: 0.543289 Oct 02 01:11:06.839210 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1192/2472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:06 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1513 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:07.305411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:07.306665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:07.319306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.322017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.325582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.326558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.328749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.329399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.372762 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:07.695090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:07.704126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:07.705585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:07.714846 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-596aaefc-690d-40a5-b954-45dd1784d510 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.413271 Oct 02 01:11:07.715476 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1281/2473] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:07 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:07.776647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:07.777288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:07.786978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.787479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.787927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.788649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.789111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.789543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.873711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:07.874584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:07.917394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.918050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.918613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.920291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.921471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.922050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.995671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:07.998328 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:08.014262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:08.016348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:08.038346 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-815e6616-7f93-4504-8c8a-61a6d41e4508 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.265668 Oct 02 01:11:08.038346 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1193/2474] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:07 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:08.145107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:08.153881 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7127119f-e780-4120-bbc0-c0fca347b550 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 200 len: 1471 microversion: 2.1 time: 0.284120 Oct 02 01:11:08.154537 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1282/2475] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:07 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:08.392981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b12a42b4-0e5f-43b2-b84d-2fae785b217c req-bdf9b71d-bd2e-4652-b344-659ea98ec1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a", "name": "network-vif-deleted", "tag": "24bbb3e7-de5a-4fea-892c-0a4fe56b78da"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:08.417654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b12a42b4-0e5f-43b2-b84d-2fae785b217c req-bdf9b71d-bd2e-4652-b344-659ea98ec1c7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:08.417654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b12a42b4-0e5f-43b2-b84d-2fae785b217c req-bdf9b71d-bd2e-4652-b344-659ea98ec1c7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:08.417968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b12a42b4-0e5f-43b2-b84d-2fae785b217c req-bdf9b71d-bd2e-4652-b344-659ea98ec1c7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:08.432578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b12a42b4-0e5f-43b2-b84d-2fae785b217c req-bdf9b71d-bd2e-4652-b344-659ea98ec1c7 service nova] Creating event network-vif-deleted:24bbb3e7-de5a-4fea-892c-0a4fe56b78da for instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a on n-h1-master-1 Oct 02 01:11:08.448438 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b12a42b4-0e5f-43b2-b84d-2fae785b217c req-bdf9b71d-bd2e-4652-b344-659ea98ec1c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057142 Oct 02 01:11:08.450632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1194/2476] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:08.750835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:08.751445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:08.764849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:08.765486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:08.766124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:08.767961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:08.768783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:08.769394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:08.927219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:08.962896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:08.964600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:08.974008 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2df4fe7b-0eae-4718-b377-0188c2be2351 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.228310 Oct 02 01:11:08.974627 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1283/2477] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:08 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:09.073539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:09.075722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:09.087061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:09.088507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:09.089643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:09.091294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:09.092027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:09.093845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:09.178869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:09.180241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:09.188307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:09.189021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:09.189631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:09.190501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:09.191127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:09.191694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:09.196090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:09.205351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:09.206837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:09.209759 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] HTTP exception thrown: Instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a could not be found. Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Request method failure captured: Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a HTTP/1.1 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOR47M3bKHcaG66Q6GxoumXOE2e7Hl8MRkF92P7msk4zuI2y2v6DO1245hT7TrYDHxhe9Mte14qHM-sDjs1vV9tRMDTTGfimDUuCH_JxEhRVFcgmHjfp3CXR92pzAcL146o5gu9SRo08UTWh7gTPDbd92_K7C1knKxRLR5vWm_ddmDA Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 76dd02a5b3d346168e6dde74ddb4d3e0 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesAdminNegativeTest-1425676500 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/76dd02a5b3d346168e6dde74ddb4d3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76dd02a5b3d346168e6dde74ddb4d3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76dd02a5b3d346168e6dde74ddb4d3e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_76dd02a5b3d346168e6dde74ddb4d3e0"}]}] Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesAdminNegativeTest-1425676500 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 76dd02a5b3d346168e6dde74ddb4d3e0 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1425676500 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesAdminNegativeTest-1425676500-project Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a8ae1a9c7c164923840b20e32c471cf3 Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesAdminNegativeTest-1425676500-project Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a could not be found. Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a'} Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a could not be found. Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a could not be found. Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:09.211747 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a could not be found. Oct 02 01:11:09.216099 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:09.216554 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:09.216554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f366694a-359c-4a9c-a8a3-ab2ed2d0607b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.145386 Oct 02 01:11:09.216554 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1195/2478] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:09 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:09.217814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Returning 404 to user: Instance 70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:09.220084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22b36b97-11f9-4220-9dbc-11cc48a614d7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a" status: 404 len: 111 microversion: 2.1 time: 0.044811 Oct 02 01:11:09.221248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1284/2479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:09 2022] GET /compute/v2.1/servers/70ea4dd8-63f4-4f4c-8b58-c9b9e5227f6a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:11:10.009299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:10.010177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:10.023786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:10.024516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:10.025560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:10.027343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:10.027963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:10.028645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:10.189338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:10.204550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:10.206127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:10.227264 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dcfcf621-d932-4978-93ba-a1ca9f5a6f00 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.221519 Oct 02 01:11:10.228658 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1196/2480] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:10 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:10.245772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:10.246412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:10.256168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:10.256661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:10.257110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:10.267693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:10.270740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:10.271202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:10.396543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:10.408453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:10.409904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:10.422074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d7a131e-555d-43a6-ad08-deea3a65747a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.179357 Oct 02 01:11:10.442990 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1285/2481] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:10 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:11.260572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:11.261759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:11.284607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.285114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.285565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.286325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.286819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.287444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.336349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:11.336865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:11.360867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.361494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.362047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.362908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.363453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.363962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.415179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:11.440568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.449288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.450870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.465588 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f051ffd9-1892-4829-aa24-a833c9da4532 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.208906 Oct 02 01:11:11.466510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1197/2482] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:11 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:11.473589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:11.475678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:11.492191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.493078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.493755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.494728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.495502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.495982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.622534 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-77c98150-5b6f-41f3-aacc-b0c4fb7f67f8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 204 len: 0 microversion: 2.25 time: 0.289824 Oct 02 01:11:11.623177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1286/2483] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:11:11 2022] DELETE /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:11:11.641029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:11.641719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:11.646887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.657082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.658642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.673444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.674348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.674926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.675660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.676130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.676569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.678858 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-175499b1-7620-45da-9861-633c137c773f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.202424 Oct 02 01:11:11.680169 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1198/2484] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:11 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:11.842094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.852298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.854030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:11.855269 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d2d34cc6-63a8-4c07-be44-f784f531a7d5 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1732 microversion: 2.25 time: 0.219373 Oct 02 01:11:11.873168 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1287/2485] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:11 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:12.498101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:12.498767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:12.509415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.513551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.517416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.519680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.520493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.521287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.649827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:12.663582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:12.665296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:12.681292 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf8de325-87ee-49aa-87c0-e4618933b97d tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.187567 Oct 02 01:11:12.681906 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1199/2486] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:12 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:12.716973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:12.719361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:12.740223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.741104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.741779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.756584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.758188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.758681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.872795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:12.882075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:12.882870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:12.885566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:12.888036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:12.893933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.894435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.894910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.895042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f25b987-19b3-451f-944d-9eac5a182161 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.184852 Oct 02 01:11:12.895629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.896187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.896613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.896829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1288/2487] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:12 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:13.104527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:13.121378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:13.122910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:13.124158 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd42a70f-1d3f-43e5-8906-87834c8b316d tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1732 microversion: 2.25 time: 0.247171 Oct 02 01:11:13.125440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1200/2488] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:12 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:13.714564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:13.715330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:13.729647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.730180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.730660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.731499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.733015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.733459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.787737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-70845c87-1e7b-4742-aad7-0670027ac004 req-281ecd02-c07f-4995-97ef-d7eaaae9aa4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458d4fea-512b-4a99-8b13-647e57ef0c93", "name": "network-vif-deleted", "tag": "1f80054f-e9ef-427a-a9f7-7d7d79b7a14e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:13.810392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70845c87-1e7b-4742-aad7-0670027ac004 req-281ecd02-c07f-4995-97ef-d7eaaae9aa4b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.810923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70845c87-1e7b-4742-aad7-0670027ac004 req-281ecd02-c07f-4995-97ef-d7eaaae9aa4b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.811434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70845c87-1e7b-4742-aad7-0670027ac004 req-281ecd02-c07f-4995-97ef-d7eaaae9aa4b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.864295 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-70845c87-1e7b-4742-aad7-0670027ac004 req-281ecd02-c07f-4995-97ef-d7eaaae9aa4b service nova] Creating event network-vif-deleted:1f80054f-e9ef-427a-a9f7-7d7d79b7a14e for instance 458d4fea-512b-4a99-8b13-647e57ef0c93 on n-h2-master-1 Oct 02 01:11:13.872071 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-70845c87-1e7b-4742-aad7-0670027ac004 req-281ecd02-c07f-4995-97ef-d7eaaae9aa4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212333 Oct 02 01:11:13.873273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1289/2489] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:13.889814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:13.891022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:13.904272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.907460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.909311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.910338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.917560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.918392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.963510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:13.989067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.001984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.010432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.042528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a80ba08-4ddc-4137-98d6-aa28101940f8 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.331985 Oct 02 01:11:14.054699 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1201/2490] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:13 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:14.054699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:14.054699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:14.064179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.065025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.065724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.066737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.067399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.068050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.140347 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-905d9a04-0fb4-4a18-9c5a-d0678932ff86 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 204 len: 0 microversion: 2.1 time: 0.265277 Oct 02 01:11:14.141356 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1290/2491] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:11:13 2022] DELETE /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:11:14.150203 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:14.152619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:14.165522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.169337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.169987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.170941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.173865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.175090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.186633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.211428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.213122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.231266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6fbaaeb-f989-4a4a-9a73-9d865fcd8876 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.185477 Oct 02 01:11:14.236574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1202/2492] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:14 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:14.253081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:14.254851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:14.279017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.281809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.282302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.283059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.283522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.283951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.370754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.371399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.371765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.372240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lazy-loading 'fault' on Instance uuid 458d4fea-512b-4a99-8b13-647e57ef0c93 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:14.501714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.511663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.513649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.514881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a098ab4b-98d7-43c4-9c22-18861f7fa4c8 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 200 len: 1376 microversion: 2.25 time: 0.276993 Oct 02 01:11:14.536844 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1203/2493] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:14 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 1376 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:14.543886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:14.556950 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0f32bed3-ca1a-427d-bf78-787bef249601 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1681 microversion: 2.1 time: 0.410893 Oct 02 01:11:14.557613 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1291/2494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:14 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:15.088826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:15.090076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:15.101896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.102726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.103456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.104543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.105777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.106240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.205359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:15.213830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:15.215592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:15.224541 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a552d1b-4d0a-4107-af77-b47a16e35188 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.141441 Oct 02 01:11:15.225696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1204/2495] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:15 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:15.266044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:15.267558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:15.274488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.275028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.275580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.276220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.276749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.277380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.354361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:15.365048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:15.366507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:15.372243 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50d8eba9-dd97-4278-92d8-090b0b5bf24d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.110739 Oct 02 01:11:15.387816 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1292/2496] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:15 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:15.553236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:15.553970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 458d4fea-512b-4a99-8b13-647e57ef0c93] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:15.561318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.562263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.563018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.564250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.564722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.565144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.579986 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] HTTP exception thrown: Instance 458d4fea-512b-4a99-8b13-647e57ef0c93 could not be found. Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Request method failure captured: Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 HTTP/1.1 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOONTneYK8cEXs-q1fqwq4rWQv8uwLoKp-1PJs1Cxcs4gC81RXlnIxxnnlwDOZArojhkklCGUtk1klW1ZllgGZvP6wxLybZiOb6nbyr0twToZy42n_Drp-Rq_sX1rQGFWUdjaOjVmstG0ZJ6_lDevp86N7e9XBXq1IwdK8MbFN-IMMNo Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.25 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b8fabf5bc8740b09c77687c9d4e1e77"}]}] Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: d44f8d053e07440699d217cd63c94d0d Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 458d4fea-512b-4a99-8b13-647e57ef0c93 could not be found. Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '458d4fea-512b-4a99-8b13-647e57ef0c93'} Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 458d4fea-512b-4a99-8b13-647e57ef0c93 could not be found. Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 458d4fea-512b-4a99-8b13-647e57ef0c93 could not be found. Oct 02 01:11:15.581828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 458d4fea-512b-4a99-8b13-647e57ef0c93 could not be found. Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Returning 404 to user: Instance 458d4fea-512b-4a99-8b13-647e57ef0c93 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:15.585669 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0937adbe-685d-4cea-8e9a-2fca2a6ace97 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93" status: 404 len: 111 microversion: 2.25 time: 0.034397 Oct 02 01:11:15.587093 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1205/2497] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:15 2022] GET /compute/v2.1/servers/458d4fea-512b-4a99-8b13-647e57ef0c93 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:11:15.589863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:15.593910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fea5b793-0ca0-47b3-9349-d184946fb46c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '.version_select at 0x7fb8813a9d30>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:15.598923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:15.613625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.614978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.615603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.616330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.616789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.617227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.620517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fea5b793-0ca0-47b3-9349-d184946fb46c tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891448116" status: 204 len: 0 microversion: 2.25 time: 0.032447 Oct 02 01:11:15.621456 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1206/2498] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891448116 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:11:16.169880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.189995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52d03ae2-f578-4356-860d-f7678ee3fa84 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1681 microversion: 2.1 time: 0.602063 Oct 02 01:11:16.190670 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1293/2499] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:15 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1681 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:16.252421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:16.254003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:16.277249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.277747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.278185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.280119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.280585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.282431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.383583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.395797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.397713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.403049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:16.403671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:16.411973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.412461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.413224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.414110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.415242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ea03ee2-2da1-47a1-a4eb-08fe3bf8207a tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.167130 Oct 02 01:11:16.415539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.422678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1207/2500] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:16 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:16.423527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.508999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.517865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.519586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:16.525187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-201b65bb-ba53-410f-984e-afb2aad8f7d0 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.126126 Oct 02 01:11:16.539489 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1294/2501] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:16 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:16.856290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:16.856783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:16.867811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.868578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.869541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.870788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.871450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.872078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.911084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:17.012792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3748a68d-6b10-4417-9594-ccf6aba67939 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 204 len: 0 microversion: 2.25 time: 0.160208 Oct 02 01:11:17.016255 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1208/2502] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:11:16 2022] DELETE /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:11:17.024325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:17.024967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:17.041601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.042499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.043247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.044202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.044862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.045531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.218499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:17.219371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:17.240152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.241217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.242120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.243509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.244117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.244685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.259147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.278740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.280835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.294530 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad598dd3-7a43-4f2d-80e0-621362688883 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1547 microversion: 2.25 time: 0.274215 Oct 02 01:11:17.310702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1295/2503] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:17 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1547 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:17.310702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-59872036-c53b-499f-a75e-ac8751a499a5 req-38a30dbc-1cbf-4ce4-8257-9db8e7a8d2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e806fe-2261-4f84-a359-763dcf320803", "name": "network-vif-deleted", "tag": "b400d3a7-3f20-475f-abc5-2148f7e6d67b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:17.326919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-59872036-c53b-499f-a75e-ac8751a499a5 req-38a30dbc-1cbf-4ce4-8257-9db8e7a8d2f5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.327402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-59872036-c53b-499f-a75e-ac8751a499a5 req-38a30dbc-1cbf-4ce4-8257-9db8e7a8d2f5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.327906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-59872036-c53b-499f-a75e-ac8751a499a5 req-38a30dbc-1cbf-4ce4-8257-9db8e7a8d2f5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.343023 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:17.359913 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-59872036-c53b-499f-a75e-ac8751a499a5 req-38a30dbc-1cbf-4ce4-8257-9db8e7a8d2f5 service nova] Creating event network-vif-deleted:b400d3a7-3f20-475f-abc5-2148f7e6d67b for instance 79e806fe-2261-4f84-a359-763dcf320803 on n-h1-master-1 Oct 02 01:11:17.366400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-59872036-c53b-499f-a75e-ac8751a499a5 req-38a30dbc-1cbf-4ce4-8257-9db8e7a8d2f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068727 Oct 02 01:11:17.370313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1296/2504] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:17.445687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:17.446670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:17.447425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ae1a9c7c164923840b20e32c471cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dd02a5b3d346168e6dde74ddb4d3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.459695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a34fced-1fab-4fd7-a219-44cf589da207 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 200 len: 1614 microversion: 2.1 time: 0.247530 Oct 02 01:11:17.461290 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1209/2505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:17 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 1614 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:17.477953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.479976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.480638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.482217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.482921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.483602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.555973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:17.556584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:17.567174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.567667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.570313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.571120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.574433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.574433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.618025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.647704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.653035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.667961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe5ab893-26e0-4a66-a321-2d495ec7cbf9 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.225759 Oct 02 01:11:17.669888 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1297/2506] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:17 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:17.771829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.774444 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:17.783401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.784913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:17.810572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f3801c1-1c07-4119-a537-4647a21b0056 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.258908 Oct 02 01:11:17.827140 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1210/2507] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:17 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:18.311367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-57f11ead-aace-48fb-b26a-00adb83d25dd req-4fd773d0-429c-4649-bb3b-a42b9e9e6c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d0527-6134-4260-829e-1a3c714713a3", "name": "network-vif-deleted", "tag": "328c8fa1-2bb1-40ea-89ce-8c35f58d851e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:18.323714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-57f11ead-aace-48fb-b26a-00adb83d25dd req-4fd773d0-429c-4649-bb3b-a42b9e9e6c16 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.324579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-57f11ead-aace-48fb-b26a-00adb83d25dd req-4fd773d0-429c-4649-bb3b-a42b9e9e6c16 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.325375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-57f11ead-aace-48fb-b26a-00adb83d25dd req-4fd773d0-429c-4649-bb3b-a42b9e9e6c16 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.333939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:18.334770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:18.343626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.346032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.349394 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-57f11ead-aace-48fb-b26a-00adb83d25dd req-4fd773d0-429c-4649-bb3b-a42b9e9e6c16 service nova] Creating event network-vif-deleted:328c8fa1-2bb1-40ea-89ce-8c35f58d851e for instance 5d8d0527-6134-4260-829e-1a3c714713a3 on n-h2-master-1 Oct 02 01:11:18.350234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.351281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.351970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.352657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.366340 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-57f11ead-aace-48fb-b26a-00adb83d25dd req-4fd773d0-429c-4649-bb3b-a42b9e9e6c16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058465 Oct 02 01:11:18.367571 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1298/2508] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:18.473681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.488547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.490023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.491258 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-090cb5f9-8107-432a-b2da-f44eb60bbfa9 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 200 len: 1331 microversion: 2.25 time: 0.161335 Oct 02 01:11:18.491372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:18.491817 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1211/2509] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:18 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:18.492020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] [instance: 79e806fe-2261-4f84-a359-763dcf320803] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:18.503561 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:18.505642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.513920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.516842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.517868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.518580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.519256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.554966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] HTTP exception thrown: Instance 79e806fe-2261-4f84-a359-763dcf320803 could not be found. Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Request method failure captured: Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 HTTP/1.1 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOR47M3bKHcaG66Q6GxoumXOE2e7Hl8MRkF92P7msk4zuI2y2v6DO1245hT7TrYDHxhe9Mte14qHM-sDjs1vV9tRMDTTGfimDUuCH_JxEhRVFcgmHjfp3CXR92pzAcL146o5gu9SRo08UTWh7gTPDbd92_K7C1knKxRLR5vWm_ddmDA Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 76dd02a5b3d346168e6dde74ddb4d3e0 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesAdminNegativeTest-1425676500 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/76dd02a5b3d346168e6dde74ddb4d3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76dd02a5b3d346168e6dde74ddb4d3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76dd02a5b3d346168e6dde74ddb4d3e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_76dd02a5b3d346168e6dde74ddb4d3e0"}]}] Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesAdminNegativeTest-1425676500 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 76dd02a5b3d346168e6dde74ddb4d3e0 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1425676500 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesAdminNegativeTest-1425676500-project Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a8ae1a9c7c164923840b20e32c471cf3 Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesAdminNegativeTest-1425676500-project Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 79e806fe-2261-4f84-a359-763dcf320803 could not be found. Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '79e806fe-2261-4f84-a359-763dcf320803'} Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e806fe-2261-4f84-a359-763dcf320803 could not be found. Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e806fe-2261-4f84-a359-763dcf320803 could not be found. Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:18.557587 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e806fe-2261-4f84-a359-763dcf320803 could not be found. Oct 02 01:11:18.562107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:18.563360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Returning 404 to user: Instance 79e806fe-2261-4f84-a359-763dcf320803 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:18.564698 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-846cd92d-86a2-4907-a27b-1183e6ecddf9 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803" status: 404 len: 111 microversion: 2.1 time: 0.082669 Oct 02 01:11:18.565838 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1299/2510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:18 2022] GET /compute/v2.1/servers/79e806fe-2261-4f84-a359-763dcf320803 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:11:18.575077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d986c749-7441-4b33-8c06-3f36cde645f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] Calling method '.version_select at 0x7fb881183e50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:18.615451 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d986c749-7441-4b33-8c06-3f36cde645f7 tempest-VolumesAdminNegativeTest-1425676500 tempest-VolumesAdminNegativeTest-1425676500-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806888045" status: 202 len: 0 microversion: 2.1 time: 0.045155 Oct 02 01:11:18.619601 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1212/2511] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:11:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806888045 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:11:18.719861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:18.720479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:18.728730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.729228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.729670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.730393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.730965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.731365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.840652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:18.841647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:18.859321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.860251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.861008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.861852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.862515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.863170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.911618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.921695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.923496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.929973 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78ab56d7-5c15-46d9-b071-dec2ff30abc6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1447 microversion: 2.75 time: 0.214792 Oct 02 01:11:18.942753 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1300/2512] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:18 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:18.960547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.977416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.979397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:18.987550 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d88b670-da17-422a-8fdb-9dedf18c02ba tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.149648 Oct 02 01:11:18.989169 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1213/2513] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:18 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:19.517072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:19.517993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 5d8d0527-6134-4260-829e-1a3c714713a3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:19.524958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.525452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.525895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.526617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.527087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.527555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.541384 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] HTTP exception thrown: Instance 5d8d0527-6134-4260-829e-1a3c714713a3 could not be found. Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Request method failure captured: Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 HTTP/1.1 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOONTneYK8cEXs-q1fqwq4rWQv8uwLoKp-1PJs1Cxcs4gC81RXlnIxxnnlwDOZArojhkklCGUtk1klW1ZllgGZvP6wxLybZiOb6nbyr0twToZy42n_Drp-Rq_sX1rQGFWUdjaOjVmstG0ZJ6_lDevp86N7e9XBXq1IwdK8MbFN-IMMNo Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.25 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b8fabf5bc8740b09c77687c9d4e1e77"}]}] Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: d44f8d053e07440699d217cd63c94d0d Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 5d8d0527-6134-4260-829e-1a3c714713a3 could not be found. Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '5d8d0527-6134-4260-829e-1a3c714713a3'} Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8d0527-6134-4260-829e-1a3c714713a3 could not be found. Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8d0527-6134-4260-829e-1a3c714713a3 could not be found. Oct 02 01:11:19.543066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8d0527-6134-4260-829e-1a3c714713a3 could not be found. Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Returning 404 to user: Instance 5d8d0527-6134-4260-829e-1a3c714713a3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9961d6cb-ec7b-4bee-8999-a6b7b3b097bc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3" status: 404 len: 111 microversion: 2.25 time: 0.032116 Oct 02 01:11:19.547432 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1301/2514] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:19 2022] GET /compute/v2.1/servers/5d8d0527-6134-4260-829e-1a3c714713a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:11:19.554246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:19.554779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:19.561704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.562908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.563359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.564072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.564529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.564963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.592021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:19.680676 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1681818b-32e0-4f04-8bae-f13ef26de0db tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "DELETE /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 204 len: 0 microversion: 2.25 time: 0.130028 Oct 02 01:11:19.681429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1214/2515] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:11:19 2022] DELETE /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:11:19.692916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:19.693631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:19.703186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.704271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.705093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.707351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.707822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.708430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.960599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:19.961521 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:19.966814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:19.968139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.968683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.969118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.970185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.970664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.971096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.979915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:19.981570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:19.982829 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c62bd617-727a-49b6-a425-ae51fc290bbc tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1563 microversion: 2.25 time: 0.296821 Oct 02 01:11:19.983584 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1302/2516] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:19 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1563 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:20.017684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:20.018326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:20.024371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:20.024858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:20.025292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:20.026023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:20.026481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:20.026955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:20.065197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:20.075605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:20.077294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:20.083200 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85ea90bf-ab9e-491c-b833-eaae50f494d6 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1453 microversion: 2.75 time: 0.126945 Oct 02 01:11:20.083777 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1215/2517] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:19 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:20.162799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:20.171196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:20.172657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:20.177623 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe05a153-3edd-4f1f-a942-ac3be1039ba4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1535 microversion: 2.91 time: 0.164617 Oct 02 01:11:20.178204 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1303/2518] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:20 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1535 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:21.008763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:21.009381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:21.016928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.017423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.017878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.018581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.019065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.019500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.113525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:21.114174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:21.121151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.121721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.122173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.122908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.123375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.123810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.207729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.210531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.216833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.219068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.221339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.223143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.224554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-649e86a2-817e-4a92-897f-99c2aff6707e tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1563 microversion: 2.25 time: 0.219825 Oct 02 01:11:21.225114 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6996a555-e04e-4a34-8e93-5e12755ccc44 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1453 microversion: 2.75 time: 0.115654 Oct 02 01:11:21.239205 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1216/2519] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:21 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:21.239572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1304/2520] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:21 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:21.250478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:21.251163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:21.257226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.257724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.258169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.258951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.260048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.260492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.333479 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.353342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.356126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:21.362644 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f76c041d-7727-443f-9264-65768a96cfbb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1535 microversion: 2.91 time: 0.121655 Oct 02 01:11:21.363469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1217/2521] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:21 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1535 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:22.257871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:22.258615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:22.261315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:22.261939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:22.276621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.277290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.278715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.279317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.280037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.280494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.280958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.286272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.286985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.287885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.288499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.289114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.440306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.451898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.455114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.463449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b544c5b8-140a-476b-baa9-afde4645e131 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1453 microversion: 2.75 time: 0.211504 Oct 02 01:11:22.464822 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1218/2522] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:22 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:22.473711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:22.474523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:22.483730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.484968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.485894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.487127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.488874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.489543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.542834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.566652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.568800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.574096 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-29b05e61-42c1-4087-abc2-268043b6ba24 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1563 microversion: 2.25 time: 0.323438 Oct 02 01:11:22.590526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1305/2523] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:22 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1563 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:22.620974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.636318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.638457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:22.646551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ea83d97-1673-4c97-b83e-976cba451a5b tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1538 microversion: 2.91 time: 0.179339 Oct 02 01:11:22.648481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1219/2524] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:22 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1538 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:22.677971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:22.680423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:22.705684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.706219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.706704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.707461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.707935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.708394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.829807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=122355) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:11:22.946293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b32f65fd-3e9e-41ad-82c5-60113252809b tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action" status: 202 len: 0 microversion: 2.91 time: 0.268102 Oct 02 01:11:22.948570 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1306/2525] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:11:22 2022] POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:11:22.958538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:22.960057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:22.987272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.987835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.988280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.991241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.992265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.992714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.403911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.425920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.432717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.448062 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a18cfdd-5855-4fb6-beda-8581c0f638aa tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1546 microversion: 2.91 time: 0.493998 Oct 02 01:11:23.454124 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1220/2526] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:22 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1546 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:23.500724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:23.501418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:23.521505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.522225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.522842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.524572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.525153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.525709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.555787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3323a060-26db-413f-845f-8101737ef8c5 req-a698a88c-09d8-4c90-956e-0a3db691e471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c5f8c-5276-47e4-a319-754d03b65941", "name": "network-vif-deleted", "tag": "49cd68b5-8534-47fa-9f97-121682028281"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:23.567587 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:23.570238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3323a060-26db-413f-845f-8101737ef8c5 req-a698a88c-09d8-4c90-956e-0a3db691e471 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.571059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3323a060-26db-413f-845f-8101737ef8c5 req-a698a88c-09d8-4c90-956e-0a3db691e471 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.571760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3323a060-26db-413f-845f-8101737ef8c5 req-a698a88c-09d8-4c90-956e-0a3db691e471 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.585855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3323a060-26db-413f-845f-8101737ef8c5 req-a698a88c-09d8-4c90-956e-0a3db691e471 service nova] Creating event network-vif-deleted:49cd68b5-8534-47fa-9f97-121682028281 for instance 471c5f8c-5276-47e4-a319-754d03b65941 on n-h2-master-1 Oct 02 01:11:23.592899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3323a060-26db-413f-845f-8101737ef8c5 req-a698a88c-09d8-4c90-956e-0a3db691e471 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043238 Oct 02 01:11:23.594392 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1221/2527] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:23.608469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:23.610189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:23.618999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.622289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.622779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.623606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.624167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.625351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.713562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.730701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.732521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.739406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aef7807e-e521-4308-a1d1-46d85284c471 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1453 microversion: 2.75 time: 0.243927 Oct 02 01:11:23.740022 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1307/2528] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:23 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1453 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:23.741548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.767133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.770382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd44f8d053e07440699d217cd63c94d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8fabf5bc8740b09c77687c9d4e1e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:23.771613 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd3fe088-3979-41d2-bc6d-a48281aaf5c0 tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 200 len: 1347 microversion: 2.25 time: 0.169298 Oct 02 01:11:23.772190 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1222/2529] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:23 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 1347 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:24.478120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:24.479127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:24.486435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:24.488006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:24.488448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.489158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:24.489614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:24.490813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.602533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:24.612380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:24.613938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:24.621151 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2696712d-00b0-4cb6-948f-8d68a7c2ff16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.147454 Oct 02 01:11:24.622239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1308/2530] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:24 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:24.770294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:24.770965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:24.790138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:24.790542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:24.791005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.791949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:24.792408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:24.792841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.801285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:24.802442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] [instance: 471c5f8c-5276-47e4-a319-754d03b65941] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:24.815316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:24.816187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:24.817177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.818450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:24.819277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:24.820156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.837210 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] HTTP exception thrown: Instance 471c5f8c-5276-47e4-a319-754d03b65941 could not be found. Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Request method failure captured: Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 HTTP/1.1 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOONTneYK8cEXs-q1fqwq4rWQv8uwLoKp-1PJs1Cxcs4gC81RXlnIxxnnlwDOZArojhkklCGUtk1klW1ZllgGZvP6wxLybZiOb6nbyr0twToZy42n_Drp-Rq_sX1rQGFWUdjaOjVmstG0ZJ6_lDevp86N7e9XBXq1IwdK8MbFN-IMMNo Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.25 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b8fabf5bc8740b09c77687c9d4e1e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b8fabf5bc8740b09c77687c9d4e1e77"}]}] Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4b8fabf5bc8740b09c77687c9d4e1e77 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-778705981 Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: d44f8d053e07440699d217cd63c94d0d Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-778705981-project Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 471c5f8c-5276-47e4-a319-754d03b65941 could not be found. Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '471c5f8c-5276-47e4-a319-754d03b65941'} Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471c5f8c-5276-47e4-a319-754d03b65941 could not be found. Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471c5f8c-5276-47e4-a319-754d03b65941 could not be found. Oct 02 01:11:24.839108 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471c5f8c-5276-47e4-a319-754d03b65941 could not be found. Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] Returning 404 to user: Instance 471c5f8c-5276-47e4-a319-754d03b65941 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4dc7a31d-17de-45d1-b7b7-3400b47655ae tempest-LiveAutoBlockMigrationV225Test-778705981 tempest-LiveAutoBlockMigrationV225Test-778705981-project] 10.222.0.23 "GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941" status: 404 len: 111 microversion: 2.25 time: 0.044282 Oct 02 01:11:24.842674 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1309/2531] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:24 2022] GET /compute/v2.1/servers/471c5f8c-5276-47e4-a319-754d03b65941 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:11:24.901294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:24.910233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:24.911702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:24.918052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01451d05-4479-43ed-ad51-7d122dd7f9b3 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1438 microversion: 2.75 time: 0.152505 Oct 02 01:11:24.918666 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1223/2532] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:24 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1438 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:25.010805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:25.013929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:25.021419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.022192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.022895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.023814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.024470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.024898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.109387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:11:25.110635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:11:25.111396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:11:25.111897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:11:25.112395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:11:25.180493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:25.186729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.187976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.188694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.189807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.190904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.191546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.370957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:25.445831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d9bae5a-a216-47a1-bd09-86bd89b5a712 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc/action" status: 202 len: 1942 microversion: 2.75 time: 0.502027 Oct 02 01:11:25.448603 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1310/2533] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:11:24 2022] POST /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc/action => generated 1942 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 02 01:11:25.480039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:25.480906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:25.489413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.490074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.490712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.491569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.492175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.492755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.631743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:25.652974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:25.653593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:25.670466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.673036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.684248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3394fb3a-165a-4ec0-aea5-fae5d59bc1c1 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.208058 Oct 02 01:11:25.687211 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1224/2534] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:25 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:25.694213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.697401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.697905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.698417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.847675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:25.864771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:25.870795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:25.895553 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-395b6921-8d3a-498f-96b8-5d0189d4172d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.248886 Oct 02 01:11:25.898623 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1311/2535] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:25 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:26.720726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:26.721408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:26.744828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:26.745735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:26.746442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:26.747359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:26.749828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:26.750674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:26.904789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:26.932191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:26.932807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:26.943895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4fbc7a3e-e2e1-41c2-8709-39e47eebbd6b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.229815 Oct 02 01:11:26.944081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:26.944776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:26.945283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:26.956263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:26.956783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:26.957208 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1225/2536] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:26 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:26.970015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:26.985947 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:27.100660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:27.114434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:27.117450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:27.127788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be446237-2b07-4ca2-b7ee-7bd9b5f9f69a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.202310 Oct 02 01:11:27.129043 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1312/2537] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:26 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:27.575594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:27.576377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:27.590548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:27.593205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:27.600209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:27.601121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:27.601720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:27.603377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:27.989004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:27.990341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:28.003651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.006793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.007462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.008461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.009235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.010565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.257544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:28.300287 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e297d2c-8ef2-40df-a67a-141d382d3853 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.316996 Oct 02 01:11:28.300890 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1313/2538] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:27 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:28.333842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:28.338971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:28.353652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.354387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.356227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.361163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.362876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.364292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.741537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:28.756835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:28.761555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:28.772128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:28.775451 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:28.789369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62ac3d99-97d8-4eaa-93bb-f727674c7177 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.465009 Oct 02 01:11:28.790774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-357f93ce-1e81-4fca-a692-6e5eff367ea7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 1.220305 Oct 02 01:11:28.809056 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1314/2539] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:28 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:28.810361 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1226/2540] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:27 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:28.839038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:28.840110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:28.857134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.860434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.861914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.865574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.868826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.869483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.336908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:29.337851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:29.351484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.356680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.357435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.358383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.359106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.361415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.731662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:29.753715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:29.763122 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7ea5330-8dc3-489d-a112-edd52fc263c7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.927251 Oct 02 01:11:29.780857 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1315/2541] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:28 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:29.790244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:29.791208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:29.801803 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77e68971-b529-4817-adf2-d50d61e8fa44 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.468642 Oct 02 01:11:29.815990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.816736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.817358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.819217 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1227/2542] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:29 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:29.820931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.821971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.822632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.832590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:29.833533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:29.844049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.844843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.845496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.846693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.847701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.848837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:30.033068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:30.048531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:30.052315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:30.069240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8fc27f71-e503-4094-8e3c-5ada3d9d2c19 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.237650 Oct 02 01:11:30.070619 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1228/2543] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:29 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:30.251070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:30.273004 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02053f76-7e4d-4a01-b585-7f3dffe389b3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.487673 Oct 02 01:11:30.273747 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1316/2544] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:29 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:30.301857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-107656245"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:30.305011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:30.321424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:30.323019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:30.324363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:30.325957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:30.329369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:30.330077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:30.712089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e90c63e4-d6bc-4296-b57d-2fe59cafb00c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.415504 Oct 02 01:11:30.713074 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1229/2545] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:11:30 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 02 01:11:30.845618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:30.847155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:30.903311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:30.904328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:30.905591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:30.917178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:30.928535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:30.931251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:31.104688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:31.119082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:31.120487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:31.134630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:31.136328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:31.138548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:31.140897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:31.143840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:31.145029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:31.210319 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91692ec1-01fc-4557-a397-deb7ad633a42 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.369731 Oct 02 01:11:31.211376 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1317/2546] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:30 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:31.303795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:31.315531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:31.320261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:31.333957 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b387644e-91fa-4b19-9568-848cf69d77d2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.220144 Oct 02 01:11:31.354905 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1230/2547] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:31 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:32.242436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:32.243078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:32.251125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:32.251846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:32.252364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:32.253149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:32.253681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:32.254178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:32.380584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:32.387741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:32.391789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:32.424193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:32.428548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:32.428548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:32.432904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:32.435870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:32.436048 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9aa49921-ef05-4a4b-88ac-70a89cbb942b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.190026 Oct 02 01:11:32.436692 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1318/2548] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:32 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:32.436964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:32.619462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:32.631134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:32.638508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:32.652331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b96d2442-a572-42cd-ac46-c69b96cca986 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.285738 Oct 02 01:11:32.657356 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1231/2549] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:32 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:33.481657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:33.482584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:33.497335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:33.497991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:33.498564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:33.500093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:33.501931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:33.502578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:33.665958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:33.689906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:33.691316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:33.704485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:33.705120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:33.705828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:33.708858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:33.709622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:33.710264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:33.716078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d6ea5cf5-ea7c-416a-a0ba-3a1e755f9f3b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.239181 Oct 02 01:11:33.726981 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1319/2550] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:33 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:34.338230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:34.352352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:34.353789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:34.368122 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0842eef-a9d8-4402-a4ff-975133a57677 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.682757 Oct 02 01:11:34.371810 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1232/2551] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:33 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:34.747085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:34.748356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:34.761454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:34.764319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:34.766505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:34.769483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:34.770162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:34.775227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:34.975003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:34.999073 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83246aa9-2d26-4785-9614-19cde84b7c1c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.255681 Oct 02 01:11:35.000714 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1320/2552] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:34 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:35.405267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:35.407726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:35.420679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:35.421497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:35.422051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:35.422998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:35.423622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:35.424056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:35.551141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:35.561981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:35.563737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:35.570892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1dba1725-2677-48ba-add2-b261a42c3dbe tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.169466 Oct 02 01:11:35.575739 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1233/2553] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:35 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:36.031732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:36.032745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:36.040518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.041086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.041751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.042528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.043088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.043590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.210243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:36.237368 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-516840c7-41c8-4e57-bf41-1db996b7b53c tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.204931 Oct 02 01:11:36.252316 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1321/2554] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:36 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:36.465514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d56a3eed-68be-45f3-a125-a52339493159 req-556e744c-3b37-4808-ba70-82633d3cb69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-plugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:36.477899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d56a3eed-68be-45f3-a125-a52339493159 req-556e744c-3b37-4808-ba70-82633d3cb69c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.478774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d56a3eed-68be-45f3-a125-a52339493159 req-556e744c-3b37-4808-ba70-82633d3cb69c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.479576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d56a3eed-68be-45f3-a125-a52339493159 req-556e744c-3b37-4808-ba70-82633d3cb69c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.494530 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d56a3eed-68be-45f3-a125-a52339493159 req-556e744c-3b37-4808-ba70-82633d3cb69c service nova] Creating event network-vif-plugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:11:36.500959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d56a3eed-68be-45f3-a125-a52339493159 req-556e744c-3b37-4808-ba70-82633d3cb69c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038284 Oct 02 01:11:36.502648 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1234/2555] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:36.604412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:36.605198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:36.614546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.615517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.616220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.617217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.617913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.618586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.897038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:36.908479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:36.910759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:36.917007 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-976db2c2-06c9-469c-816d-1683e750c354 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.316605 Oct 02 01:11:36.917726 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1322/2556] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:36 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:37.269153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:37.270020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:37.276343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:37.276831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:37.277477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:37.278170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:37.278637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:37.279326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:37.368412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:37.389009 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c671a2c-b13d-4cc2-adb8-9e072e82ba92 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.124297 Oct 02 01:11:37.390638 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1235/2557] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:37 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:37.948539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:37.951690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:37.961666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:37.962876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:37.964398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:37.965394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:37.965863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:37.966436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:38.142799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:38.154848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:38.157224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:38.163687 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae181ea0-b710-46be-a96e-f4937eb8d25a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.219753 Oct 02 01:11:38.164304 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1323/2558] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:37 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:38.419176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:38.420800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:38.429410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:38.430234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:38.430892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:38.431811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:38.432958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:38.433579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:38.563036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:38.600594 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9ce9da4-ad9e-48c3-be37-78fce5b4568e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.185696 Oct 02 01:11:38.621563 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1236/2559] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:38 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:39.194155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:39.195698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:39.212420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:39.214190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:39.214899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:39.217086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:39.217851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:39.221877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:39.337414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:39.346759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:39.355697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:39.368876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c491d052-088e-42d7-9006-95d70377510f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.179756 Oct 02 01:11:39.370690 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1324/2560] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:39 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:39.634178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:39.635581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:39.649144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:39.649639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:39.650077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:39.650813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:39.659107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:39.666972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:39.794001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:39.837517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49a0d706-7b30-44ef-bb5c-e9a2634638e8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.208988 Oct 02 01:11:39.842118 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1237/2561] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:39 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:40.398982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:40.399593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:40.413677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.414393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.423739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.424891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.427562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.428178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.572107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:40.587440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:40.589969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:40.596147 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:40.600317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c181799-3841-45eb-93d8-0abbe20f2d70 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1531 microversion: 2.91 time: 0.206469 Oct 02 01:11:40.600909 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1325/2562] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:40 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1531 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:40.631108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:40.632357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:40.639036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.639569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.640029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.640874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.645583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.646049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.742747 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:40.746397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lazy-loading 'services' on Instance uuid de3d36f4-2336-489c-80d3-939cc4bee2db {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:40.769155 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fbfd4e3e-292c-4b63-b7b5-41b29b677e38 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1936 microversion: 2.91 time: 0.141976 Oct 02 01:11:40.770287 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1326/2563] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:40 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1936 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:40.804147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:40.805279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:40.813035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.813582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.814177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.815681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.816080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.816520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.846908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lazy-loading 'flavor' on Instance uuid de3d36f4-2336-489c-80d3-939cc4bee2db {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:40.908302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2029158696", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "52e9d38c-d322-45f0-aba7-d15109b53e80"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:41.025446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] validate_networks() for [('52e9d38c-d322-45f0-aba7-d15109b53e80', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:11:41.302936 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e370142-649f-416d-9b45-7fa33466ece8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action" status: 202 len: 0 microversion: 2.91 time: 0.502327 Oct 02 01:11:41.306051 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1327/2564] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:11:40 2022] POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:11:41.313995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:41.315132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:41.328577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.329554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.330206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.332189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.332913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.333880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.465315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:41.512023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3001ae21-fd8e-4e60-be06-56b8f515e337 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.203521 Oct 02 01:11:41.528053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1328/2565] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:41 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:41.543613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:41.544854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:41.563392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.566033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.566877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.569017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.570244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.571866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.698130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:41.720933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:41.722723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:41.738286 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bced3d09-ddb3-407a-a6f1-7f88b3310e4a tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.197822 Oct 02 01:11:41.739290 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1329/2566] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:41 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:41.909149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:11:41.909688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:11:41.910311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:11:41.910756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:11:41.911174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:11:41.926183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.926766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.927567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.929220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.932085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.932969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.962428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:11:41.969593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for user 8cd2ad37e9b844ac8b7632fd9291023a and project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:11:41.985253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:11:41.988086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:11:42.044915 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ece8122d-bbba-4758-8b48-74dfcb6f6664 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.628474 Oct 02 01:11:42.046299 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1238/2567] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:11:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:11:42.058281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71da000d-4960-4b84-85e1-a44397e74067 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:42.058926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71da000d-4960-4b84-85e1-a44397e74067 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:42.156099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71da000d-4960-4b84-85e1-a44397e74067 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:42.164926 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71da000d-4960-4b84-85e1-a44397e74067 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1208 microversion: 2.1 time: 0.111102 Oct 02 01:11:42.178631 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1330/2568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:42 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1208 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:42.472060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1636821095", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:42.551513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:42.553021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:42.572502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:42.573402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:42.574288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:42.575293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:42.576038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:42.577309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:42.590487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:11:42.784710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:42.851039 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c148e24-37b7-46f9-815f-8e0ae2ef84d6 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.303374 Oct 02 01:11:42.877501 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1331/2569] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:42 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:42.886508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:42.887696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:42.896063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:42.896612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:42.897052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:42.898421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:42.898924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:42.899358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.022700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:11:43.023166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:11:43.023506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:11:43.023957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:11:43.024369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:11:43.035917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.036381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.039254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.040612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.041165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.041671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.057098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:43.079439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:43.081670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:43.096336 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6bccd08b-e81f-476a-accc-f671c64da6b4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.212251 Oct 02 01:11:43.121878 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1332/2570] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:42 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:43.131869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Getting quotas for project d565120ddfb84f22ad17d8dd0f9c35fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:11:43.142643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Getting quotas for user daade8c46ae44a4b81bafa442b6037f4 and project d565120ddfb84f22ad17d8dd0f9c35fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:11:43.158499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:11:43.161127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:11:43.194739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:43.195934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:43.212312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.212805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.213343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.214588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.215327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.215761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.246977 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-228b83d2-8f64-45bd-9081-67d596244cf6 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961996 Oct 02 01:11:43.249687 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1239/2571] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:11:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:11:43.262725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6784c0a-68cb-4a7c-9185-67a1f9a57d9a tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:43.268936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6784c0a-68cb-4a7c-9185-67a1f9a57d9a tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:43.413347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:43.425665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6784c0a-68cb-4a7c-9185-67a1f9a57d9a tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:43.433881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6784c0a-68cb-4a7c-9185-67a1f9a57d9a tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1219 microversion: 2.1 time: 0.174995 Oct 02 01:11:43.436044 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1240/2572] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:43 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:43.438961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82a8b80f-7ad1-458d-8cfb-fa9143efaaa5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1260 microversion: 2.1 time: 0.252826 Oct 02 01:11:43.439584 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1333/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:43 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:43.888384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:43.889144 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:43.903220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.907489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.908279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.911857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.913245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.913245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.095624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:44.131034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09cf51fc-ac89-4a32-90c1-17dfdf18db68 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.246345 Oct 02 01:11:44.131889 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1241/2574] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:43 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:44.151586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:44.151586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:44.152160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:44.152434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:44.153114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.155002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:44.156296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:44.158409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.394252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:44.426196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:44.431150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:44.452220 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23d2fca5-94f4-44c0-9738-5235c81660b2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.324258 Oct 02 01:11:44.457485 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1334/2575] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:44 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:44.462640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:44.463420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:44.470425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:44.471139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:44.471320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:44.471884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:44.472018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.472843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:44.473425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:44.473981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.497038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:44.497821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:44.498413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.499387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:44.500861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:44.501448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.630107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:44.634240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:44.643693 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57278a9d-901d-4b31-8e66-f635a280f3ba tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1215 microversion: 2.1 time: 0.186064 Oct 02 01:11:44.652375 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ead02eaa-2cba-4558-b728-5d347e873ff7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1266 microversion: 2.1 time: 0.193461 Oct 02 01:11:44.660051 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1242/2576] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:44 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:44.667684 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1335/2577] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:44 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:45.165978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:45.167292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:45.181296 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:45.191744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.192572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.193773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.194779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.195717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.196517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.228890 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:45.418352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:45.490355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:45.491986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:45.510417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.513355 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d64844d1-db89-450c-bae5-2b7f0e767b9e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.353315 Oct 02 01:11:45.528645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.532455 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1243/2578] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:45 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:45.533449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.534475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.535310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.536174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.686750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:45.689400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:45.707681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.708631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.709472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.710586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.711301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.711991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.862680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:45.872117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:45.888924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:45.919638 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6809031b-ad7b-4d35-a4b3-6613c067ccda tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.429618 Oct 02 01:11:45.945218 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1336/2579] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:45 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:45.974966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:45.975825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:45.992230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.992746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.993198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.998988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.999541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.000022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:46.116500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:46.127819 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-33327b86-5f1c-438d-a986-d2b40141e0cb tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1308 microversion: 2.1 time: 0.448832 Oct 02 01:11:46.129828 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1244/2580] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:45 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:46.177437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:46.191793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8138da29-85dd-4ff1-9cff-7c11494d0a5d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1277 microversion: 2.1 time: 0.245982 Oct 02 01:11:46.193292 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1337/2581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:45 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:46.557678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:46.558878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:46.573990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:46.575344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.578721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:46.580352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:46.582102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.583269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:46.720138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:46.753828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-978200e5-1c2f-4a75-a35b-35d3ef0e16a8 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.200272 Oct 02 01:11:46.772608 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1245/2582] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:46 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:46.952677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:46.954526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:46.981854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:46.987031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.987699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:46.989948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4e6945fb-9e68-4a75-967b-1e08f8b54623 req-225f730b-050a-430f-9a74-5128089bb7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5159e837-6076-465b-9383-601745d7acb3", "tag": "b91bce40-0ff7-4121-8b5d-41e3a6fd12e7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:46.992341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:46.995318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.997223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.013946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4e6945fb-9e68-4a75-967b-1e08f8b54623 req-225f730b-050a-430f-9a74-5128089bb7f0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.017925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4e6945fb-9e68-4a75-967b-1e08f8b54623 req-225f730b-050a-430f-9a74-5128089bb7f0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.018691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4e6945fb-9e68-4a75-967b-1e08f8b54623 req-225f730b-050a-430f-9a74-5128089bb7f0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.036206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4e6945fb-9e68-4a75-967b-1e08f8b54623 req-225f730b-050a-430f-9a74-5128089bb7f0 service nova] Creating event network-changed:b91bce40-0ff7-4121-8b5d-41e3a6fd12e7 for instance 5159e837-6076-465b-9383-601745d7acb3 on n-h2-master-1 Oct 02 01:11:47.044748 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4e6945fb-9e68-4a75-967b-1e08f8b54623 req-225f730b-050a-430f-9a74-5128089bb7f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059515 Oct 02 01:11:47.045962 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1246/2583] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:47.164818 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:47.167508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:47.167810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:47.177089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:47.178524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:47.179607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.181511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.182755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.183645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.194076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d8429e3-950b-4631-a5a2-773d814cc6da tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.245264 Oct 02 01:11:47.206694 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1338/2584] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:46 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:47.209183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.219416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.224094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:47.224717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:47.244225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.246246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.246810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.247563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.248055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.248516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.573794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:47.584115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:47.596200 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3622e672-8176-49f7-a43c-bab0e1b751b8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1308 microversion: 2.1 time: 0.442524 Oct 02 01:11:47.596795 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1247/2585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:47 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:47.597586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fbb4ecd-0ff9-4cd2-b6ff-bde35725d3f1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.377793 Oct 02 01:11:47.610622 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1339/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:47 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:47.785881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:47.786520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:47.795326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.795859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.796313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.797074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.797543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.803961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.913293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:47.935192 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe4ec171-bf20-4945-a3d6-d477fc9f0152 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.152509 Oct 02 01:11:47.936494 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1248/2587] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:47 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:47.975484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-53b968f6-97bc-4f1c-acad-ee70637a8be3 req-63fd49b0-5159-441d-844c-23212b7253ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2febfa-f50f-4a0e-9af7-f538ac10c2d1", "tag": "c924a27e-7d51-4918-98ab-125e09734ef4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:47.997994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-53b968f6-97bc-4f1c-acad-ee70637a8be3 req-63fd49b0-5159-441d-844c-23212b7253ec service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.998501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-53b968f6-97bc-4f1c-acad-ee70637a8be3 req-63fd49b0-5159-441d-844c-23212b7253ec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.998990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-53b968f6-97bc-4f1c-acad-ee70637a8be3 req-63fd49b0-5159-441d-844c-23212b7253ec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.013714 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-53b968f6-97bc-4f1c-acad-ee70637a8be3 req-63fd49b0-5159-441d-844c-23212b7253ec service nova] Creating event network-changed:c924a27e-7d51-4918-98ab-125e09734ef4 for instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 on n-h1-master-1 Oct 02 01:11:48.020859 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-53b968f6-97bc-4f1c-acad-ee70637a8be3 req-63fd49b0-5159-441d-844c-23212b7253ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048464 Oct 02 01:11:48.022058 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1340/2588] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:48.226189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:48.228805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:48.233937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.235341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.236071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.237024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.237637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.238164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.315433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:48.327134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:48.329207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:48.335029 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85847b98-352a-4b1d-8bb3-3c93a983b360 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.113303 Oct 02 01:11:48.336043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1249/2589] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:48 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:48.622762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:48.623033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:48.623650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:48.623929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:48.630881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.631580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.632226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.632502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.633086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.633518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.633664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.634266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.634750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.634870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.635478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.636073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.876978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:48.883271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:48.890002 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec01b3f1-1245-4abe-b1d6-40162b2bdea2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1308 microversion: 2.1 time: 0.270533 Oct 02 01:11:48.903905 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1250/2590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:48 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:48.904997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87357261-7098-49ad-ae8d-647e697fb57b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.279584 Oct 02 01:11:48.913375 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1341/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:48 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:48.919520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0413a29-556c-4578-8f60-e0d7d4fba505"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:48.923125 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:48.934256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.934908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.935434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.936392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.937010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.938502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.968638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:48.970089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:48.988862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.989452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.990074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.990915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.991498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.992026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.996010 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:49.132775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:49.158169 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70af0555-ca99-4412-9c00-b49245c19e8f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.195725 Oct 02 01:11:49.175305 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1342/2592] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:48 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:49.351749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-98c0de6d-ca70-4d95-999c-8281aee51d1f tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437307 Oct 02 01:11:49.361018 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1251/2593] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:11:48 2022] POST /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:49.364401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:49.365335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:49.377884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.378666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.379314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.380483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.383154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.383873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.539836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:49.551598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:49.553505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:49.561668 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-42b56822-dd03-476c-8b81-85d7ac5941f8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.201044 Oct 02 01:11:49.570389 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1343/2594] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:49 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:49.917186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:49.917993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:49.920038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:49.920676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:49.929154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.930639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.931106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.931562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.932266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.932736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.933159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.933439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.936219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.937078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.940100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.946123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.302906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:50.321352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0b47033-9cd1-4109-80fd-89dc6421d48e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.404957 Oct 02 01:11:50.336291 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1344/2595] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:49 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:50.344662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:50.345625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:50.354111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:50.354861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:50.355523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.357103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:50.357733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:50.358327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.360635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:50.371920 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36c98144-f4d7-44ef-bcdf-7fe3d4ebd90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1308 microversion: 2.1 time: 0.458952 Oct 02 01:11:50.395751 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1252/2596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:49 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:50.493122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:50.543874 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0078e885-a9fe-43f4-8cdd-1fdcd7f2c697 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.205498 Oct 02 01:11:50.544485 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1345/2597] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:50 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:50.592347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:50.593242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:50.609815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:50.611675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:50.613244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.614158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:50.617117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:50.617662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.734629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:50.748792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:50.751985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:50.771830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af8728d1-f061-4006-9ef7-af2bae4d0e76 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.184194 Oct 02 01:11:50.772651 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1253/2598] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:50 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:51.352141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:51.353700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:51.370762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.371536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.376207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.377685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.383351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.384427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.400507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:51.402331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:51.410173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.411182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.412216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.413568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.414272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.415105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.643887 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:51.658320 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-828569d2-f018-433f-9e35-6ade6106c4ad tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.312610 Oct 02 01:11:51.667233 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1346/2599] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:51 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:51.673733 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:51.674355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:51.698923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.699431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.700154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.700882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.701372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.701780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.870094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:51.883989 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c51633a-f5a6-4cee-a148-5b673ae316d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1308 microversion: 2.1 time: 0.487255 Oct 02 01:11:51.896966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:51.900358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1254/2600] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:51 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:51.908957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:51.910462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:51.917121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.918137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.918609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.919326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.920810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.921242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.938227 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87c28722-96f7-4f5f-ae97-d35ca1d12f8e tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.269218 Oct 02 01:11:51.938877 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1347/2601] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:51 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:52.010337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:52.023709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:52.038746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:52.045546 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9ac120a-94f4-450e-87f4-ab5a49fa3f08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.143919 Oct 02 01:11:52.046056 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1255/2602] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:51 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:52.418503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0fc9c4d8-563c-4752-9f99-54d0eb09bc67 req-06a85b56-3803-4db2-a98d-5e0464573f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5159e837-6076-465b-9383-601745d7acb3", "name": "network-vif-plugged", "status": "completed", "tag": "b91bce40-0ff7-4121-8b5d-41e3a6fd12e7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:52.423963 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:52.433545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0fc9c4d8-563c-4752-9f99-54d0eb09bc67 req-06a85b56-3803-4db2-a98d-5e0464573f03 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.434063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0fc9c4d8-563c-4752-9f99-54d0eb09bc67 req-06a85b56-3803-4db2-a98d-5e0464573f03 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.434506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0fc9c4d8-563c-4752-9f99-54d0eb09bc67 req-06a85b56-3803-4db2-a98d-5e0464573f03 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.450419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0fc9c4d8-563c-4752-9f99-54d0eb09bc67 req-06a85b56-3803-4db2-a98d-5e0464573f03 service nova] Creating event network-vif-plugged:b91bce40-0ff7-4121-8b5d-41e3a6fd12e7 for instance 5159e837-6076-465b-9383-601745d7acb3 on n-h2-master-1 Oct 02 01:11:52.460119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0fc9c4d8-563c-4752-9f99-54d0eb09bc67 req-06a85b56-3803-4db2-a98d-5e0464573f03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044127 Oct 02 01:11:52.460821 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1348/2603] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:52.614020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:52.614823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:52.633837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.635050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.636119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.642241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.643280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.645781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.709722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:52.723141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:52.724858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:52.736847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.738058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.739618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.741206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.742891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.744098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.820748 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:52.861129 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-961bee50-3cd6-412e-b9c3-5c270d660e39 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 204 len: 0 microversion: 2.1 time: 0.251165 Oct 02 01:11:52.861865 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1256/2604] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:11:52 2022] DELETE /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:11:52.870939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:52.871748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:52.878755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.879331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.879837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.880608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.884918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.884918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.039200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:53.050197 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-547a9584-123e-4a4d-83ca-537bc3c03155 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.332623 Oct 02 01:11:53.061420 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1349/2605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:52 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:53.074546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:53.075197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:53.089448 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:53.095090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.095769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.096213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.100053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.100585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.101026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.129039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:53.141221 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0c639734-4fb2-4eb0-8045-9d8b02914606 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1666 microversion: 2.1 time: 0.274490 Oct 02 01:11:53.144986 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1257/2606] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:52 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1666 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:53.155746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:53.157398 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:53.172643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.173542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.175406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.178742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.179476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.180390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.302030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:53.302294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:53.312643 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc4c51d6-6287-49de-8fd8-d6f55c922344 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1308 microversion: 2.1 time: 0.249958 Oct 02 01:11:53.323481 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1350/2607] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:53 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:53.330059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:53.330698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:53.337243 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f920cf9e-5eb4-4319-8e5b-2621bb02c135 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.190814 Oct 02 01:11:53.338165 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1258/2608] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:53 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:53.348075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.348567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.348997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.349704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.350156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.350582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.454524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:53.468170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:53.471217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:53.480477 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d1f9ef8f-08eb-422d-9810-ef3b39a41098 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.155682 Oct 02 01:11:53.491564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1351/2609] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:53 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:54.076517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.077345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.089241 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=14 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:54.096362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.097641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.099147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.100745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.101923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.102584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.348478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:54.357508 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1eb6ba45-c286-4083-a806-7d3604b5d792 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.285474 Oct 02 01:11:54.358717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1259/2610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:54.365642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.366315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.373414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.373913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.374349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.375693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.376144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.376619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.398557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.399083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.408731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.409219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.409654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.414023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.414793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.415373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.471007 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:11:54.615327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:54.627695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-746652f4-58bd-4cd5-adb0-e5e8373a8a15 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1666 microversion: 2.1 time: 0.265988 Oct 02 01:11:54.628902 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1260/2611] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1666 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:54.631062 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd9a7849-8d0e-4f76-8387-1b408b9771fb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 204 len: 0 microversion: 2.42 time: 0.513400 Oct 02 01:11:54.632161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1352/2612] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:11:54 2022] DELETE /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:11:54.637668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.638290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.641675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.643155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.646793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.647296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.647743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.648653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.649268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.649711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.660189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.660937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.663047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.664186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.664809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.666162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.841487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:54.888981 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d2ae3ac-0b3b-4735-88e6-82b02a015f4f tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.255435 Oct 02 01:11:54.889729 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1353/2613] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:54.899213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.902016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.912334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.912836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.913280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.913996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.919474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.919951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.939581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:54.954570 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28d48e88-7da0-4ddd-9e48-3653098adec9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1488 microversion: 2.1 time: 0.324244 Oct 02 01:11:54.970663 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1261/2614] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1488 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:54.980401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.982730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.992351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.992928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.993294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.993995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.994449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.994898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.030200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.039968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.041410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.047307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-320920d8-66fe-44b6-9270-46d561c6a481 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.156672 Oct 02 01:11:55.048084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1354/2615] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:55.052631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:55.053320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:55.081382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.081877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.082324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.087031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.087557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.088068 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.200269 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:55.247661 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d570988a-b754-4309-ad42-7e00b9257a8d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3/action" status: 202 len: 0 microversion: 2.1 time: 0.198313 Oct 02 01:11:55.248544 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1355/2616] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:11:55 2022] POST /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:11:55.261110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:55.261801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:55.288408 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:55.306295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.306808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.307667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.307968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.308460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.308859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.512120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.522394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.528643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.534180 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70e63183-d718-44a8-bdf8-0531cecab95b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2952 microversion: 2.42 time: 0.575737 Oct 02 01:11:55.543679 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1262/2617] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2952 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:55.551198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:55.552224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:55.568335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.569117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.571474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.572475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.574240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.575842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.876480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.885391 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dde4cd66-91d4-487d-bd13-df43133339ec tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1493 microversion: 2.1 time: 0.628212 Oct 02 01:11:55.895289 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1356/2618] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:55 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1493 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:55.895289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-20647e21-df26-4066-a4bf-cd311d7e04de req-212140b5-3647-45fb-bd0a-e7f9316a1cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2febfa-f50f-4a0e-9af7-f538ac10c2d1", "name": "network-vif-plugged", "status": "completed", "tag": "c924a27e-7d51-4918-98ab-125e09734ef4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:55.916606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-20647e21-df26-4066-a4bf-cd311d7e04de req-212140b5-3647-45fb-bd0a-e7f9316a1cef service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.919804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-20647e21-df26-4066-a4bf-cd311d7e04de req-212140b5-3647-45fb-bd0a-e7f9316a1cef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.920294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-20647e21-df26-4066-a4bf-cd311d7e04de req-212140b5-3647-45fb-bd0a-e7f9316a1cef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.962253 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-20647e21-df26-4066-a4bf-cd311d7e04de req-212140b5-3647-45fb-bd0a-e7f9316a1cef service nova] Creating event network-vif-plugged:c924a27e-7d51-4918-98ab-125e09734ef4 for instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 on n-h1-master-1 Oct 02 01:11:55.973964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:55.982463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-66fbadaa-8229-41d7-997f-9534dbf295be tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.437338 Oct 02 01:11:55.985343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-20647e21-df26-4066-a4bf-cd311d7e04de req-212140b5-3647-45fb-bd0a-e7f9316a1cef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097017 Oct 02 01:11:55.985977 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1357/2619] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:56.002632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1263/2620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:55 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:56.008452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.009555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.013241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.013864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.033580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.035065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.036051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.037035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.037724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.038359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.052636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.053144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.057666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.058531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.059052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.067859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.195426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.208396 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ffb224c-a4dd-4912-881e-387d55230e7a tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1598 microversion: 2.1 time: 0.221134 Oct 02 01:11:56.211412 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1358/2621] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:55 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1598 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:56.223402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.225512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.244834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.244834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.245141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.245739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.247417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.247417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.281192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:56.332355 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aebaff3a-04f0-4264-8eec-565f1fae25bc tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.342180 Oct 02 01:11:56.336918 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1264/2622] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:55 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:56.341731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.342350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.373083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.373788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.374330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.386104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.386632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.387086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.520155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.539084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.547478 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70c9c45a-ea14-456d-bce2-aeca0fbb655a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.334481 Oct 02 01:11:56.548082 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1359/2623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:56 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:56.548612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.550071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.554579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d154fc3d-505e-4187-a11a-0a8c69f1c69c req-8f9c2aad-e333-4726-96ff-93c9bbfb76f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218e500e-43b6-4c99-af78-3607ae5f9b23", "name": "network-vif-deleted", "tag": "9b2a702c-7189-4a97-ab39-ae072c6da628"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:56.555461 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-705c90d9-3623-47fd-8d2e-32c1b7e5052c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.217509 Oct 02 01:11:56.556033 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1265/2624] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:56 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:56.572439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d154fc3d-505e-4187-a11a-0a8c69f1c69c req-8f9c2aad-e333-4726-96ff-93c9bbfb76f8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.572975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d154fc3d-505e-4187-a11a-0a8c69f1c69c req-8f9c2aad-e333-4726-96ff-93c9bbfb76f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.573419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d154fc3d-505e-4187-a11a-0a8c69f1c69c req-8f9c2aad-e333-4726-96ff-93c9bbfb76f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.585731 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d154fc3d-505e-4187-a11a-0a8c69f1c69c req-8f9c2aad-e333-4726-96ff-93c9bbfb76f8 service nova] Creating event network-vif-deleted:9b2a702c-7189-4a97-ab39-ae072c6da628 for instance 218e500e-43b6-4c99-af78-3607ae5f9b23 on n-h1-master-1 Oct 02 01:11:56.590544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d154fc3d-505e-4187-a11a-0a8c69f1c69c req-8f9c2aad-e333-4726-96ff-93c9bbfb76f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041354 Oct 02 01:11:56.591180 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1360/2625] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:56.654176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.654819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.660941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.661431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.661867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.662568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.663059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.663484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.863369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.872557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.873994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:56.876071 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ca2f6da-367d-4a66-ab6a-49ba2ca3a050 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2952 microversion: 2.42 time: 0.225016 Oct 02 01:11:56.876646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1266/2626] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:56 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2952 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:56.909985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.910756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.916858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.917332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.917770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.918549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.919021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.919449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.012105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.012727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.019371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.019864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.020298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.021002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.021457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.021883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.056235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.065922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8b52e260-29f1-4af4-893f-46b21abf1c14 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 200 len: 1473 microversion: 2.1 time: 0.160768 Oct 02 01:11:57.066523 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1361/2627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:56 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 1473 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:57.089188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1876022172"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:57.091752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.099512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.100007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.100446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.101168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.101627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.102053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.170634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.179849 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f890875-8185-4582-8bfd-5e1534b36dc9 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.171304 Oct 02 01:11:57.180436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1267/2628] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:57.244716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.245489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.252180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.252870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.253374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.254146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.254721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.255191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.331652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.345209 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0cadf205-515d-4387-882e-962b77277a03 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1311 microversion: 2.1 time: 0.113577 Oct 02 01:11:57.363620 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1268/2629] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:57.363933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.364648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.368722 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d692d4a0-7fb3-491c-8522-7b79287be064 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3/action" status: 202 len: 0 microversion: 2.1 time: 0.283415 Oct 02 01:11:57.369497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1362/2630] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:11:57 2022] POST /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 02 01:11:57.378412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.379046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.379574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.380344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.381005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.381611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.382585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa3f1b2b-6f12-4ce9-9e96-0173d493476b tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880893a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.462046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa3f1b2b-6f12-4ce9-9e96-0173d493476b tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1414 microversion: 2.1 time: 0.085295 Oct 02 01:11:57.462978 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1363/2631] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:57.497704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:57.517081 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f835a48c-8eb7-49b3-a291-c738da7ed652 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1929 microversion: 2.75 time: 0.159778 Oct 02 01:11:57.517955 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1269/2632] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1929 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:57.572861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.573964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.582492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.583143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.584090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.584840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.585297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.585724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.586535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.587976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.597396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.600494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.601044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.601862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.606320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.606934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.712733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.722108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.724028 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.729486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9aeab70c-c729-4969-a7d2-daff99b0e5c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.148667 Oct 02 01:11:57.730138 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1270/2633] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:57.772652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:57.780442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46ec66a6-3d36-4211-9c0b-df64a0059a50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.212711 Oct 02 01:11:57.781017 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1364/2634] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:57.804605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-547123098"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:11:57.807343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.813719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.814216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.814680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.815395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.815863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.816287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.904191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.904917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.911922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.912471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.912855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.913546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.913996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.914638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.994840 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:58.029793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-32957a3b-58ee-4ace-97b0-7eb1621e1b2f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.229121 Oct 02 01:11:58.034251 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1271/2635] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:11:57 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 02 01:11:58.117438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.127249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.128639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.129876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c6447f8-a9bc-471e-97bc-f82a0f2770aa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2952 microversion: 2.42 time: 0.229641 Oct 02 01:11:58.130450 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1365/2636] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2952 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:11:58.204100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:58.204829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:58.211213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.211705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.212140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.212838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.213300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.213788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.369487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.370580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:58.371227 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:58.379031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.379461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.379746 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-db19c26b-016f-4423-b212-9eb2e71654fb tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.180438 Oct 02 01:11:58.379898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.380337 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1272/2637] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:58 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:58.380793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.381245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.381680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.461265 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.471704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43426364-94e4-4d2d-86de-f547424766bd tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1311 microversion: 2.1 time: 0.104781 Oct 02 01:11:58.474885 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1366/2638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:58 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:11:58.480078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b28422c3-d953-46ed-848b-c1600b5f09bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881678670>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:58.536479 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b28422c3-d953-46ed-848b-c1600b5f09bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1414 microversion: 2.1 time: 0.062487 Oct 02 01:11:58.537046 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1273/2639] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:58 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:58.545109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:58.545757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:58.552948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.553437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.553878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.554569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.555056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.555490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.628866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:58.646720 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-edd336f1-ffd0-4631-acac-c62e216cd4ba tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1935 microversion: 2.75 time: 0.105127 Oct 02 01:11:58.647366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1367/2640] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:58 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1935 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:58.757259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:58.757871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:58.763926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.764405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.764837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.765611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.766615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.767202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.833996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.842034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.843485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:58.848221 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f26b675-2ea2-4382-b559-c33370e58a88 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.094834 Oct 02 01:11:58.848784 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1274/2641] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:58 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:59.157242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.158429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:59.164950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.165444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.165888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.166585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.167069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.167496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.357744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.367523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.369203 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.370738 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7de6298-9e72-497e-9e9a-793e3c68bb52 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2952 microversion: 2.42 time: 0.217372 Oct 02 01:11:59.371299 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1368/2642] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2952 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:59.402444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.403098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:59.410009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.410572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.410960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.411648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.412105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.412537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.495887 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.496501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:59.502686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.503173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.503603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.504295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.504745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.505165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.542485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.543000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.543114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.543442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.543887 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lazy-loading 'fault' on Instance uuid 218e500e-43b6-4c99-af78-3607ae5f9b23 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:59.552222 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6246514-e989-4986-bc8b-6c9cab26ae50 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1319 microversion: 2.1 time: 0.153504 Oct 02 01:11:59.552944 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1275/2643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:59.572420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad84c04e-0f61-4d52-b572-c2ba74cae779 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88119bf70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.590709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214ad89f7fde4314a25b19d1e3479e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918bcae48ada42b48ffd801791f5df22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.599142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cce423bd-7216-4c6d-a6e7-7e3d26e00cc2 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 200 len: 1316 microversion: 2.1 time: 0.107062 Oct 02 01:11:59.610170 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1369/2644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:59.618559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad84c04e-0f61-4d52-b572-c2ba74cae779 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1414 microversion: 2.1 time: 0.054311 Oct 02 01:11:59.619212 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1276/2645] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:11:59.677004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.677618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:59.683553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.684044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.684480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.685165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.685620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.686045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.759681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:11:59.777133 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-297b6cf5-5ccb-4d67-9a8f-e4d519117414 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1935 microversion: 2.75 time: 0.104299 Oct 02 01:11:59.777725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1370/2646] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1935 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:11:59.875747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.876981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:59.883127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.883613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.884062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.884756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.885219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.885648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.954043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.963023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.964465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:11:59.969561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1794513-13a4-46f8-b066-2f05c1f3bfb9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.097757 Oct 02 01:11:59.970931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1277/2647] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:00.400200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.401800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:00.409590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.410094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.410539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.411279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.411739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.412171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.470969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-95902c14-d113-42ae-b3ca-381b1795a37f req-87750bb9-c42a-42aa-bccd-2ce96e807f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-unplugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:00.489826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-95902c14-d113-42ae-b3ca-381b1795a37f req-87750bb9-c42a-42aa-bccd-2ce96e807f37 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.493252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-95902c14-d113-42ae-b3ca-381b1795a37f req-87750bb9-c42a-42aa-bccd-2ce96e807f37 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.493926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-95902c14-d113-42ae-b3ca-381b1795a37f req-87750bb9-c42a-42aa-bccd-2ce96e807f37 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.513875 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-95902c14-d113-42ae-b3ca-381b1795a37f req-87750bb9-c42a-42aa-bccd-2ce96e807f37 service nova] Creating event network-vif-unplugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:12:00.519749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-95902c14-d113-42ae-b3ca-381b1795a37f req-87750bb9-c42a-42aa-bccd-2ce96e807f37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056886 Oct 02 01:12:00.520987 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1278/2648] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:12:00.586957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.587901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:00.593899 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:00.595889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.596353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.596790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.597498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.597955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.598384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.693975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:00.704864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:00.706791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:00.707939 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf7b128b-8685-4320-9f93-2660308098d3 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2952 microversion: 2.42 time: 0.311888 Oct 02 01:12:00.711597 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1371/2649] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2952 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:00.717241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.717970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] [instance: 218e500e-43b6-4c99-af78-3607ae5f9b23] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:00.724966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.725799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.726319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.727236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.728111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.728795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.734183 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:00.747074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] HTTP exception thrown: Instance 218e500e-43b6-4c99-af78-3607ae5f9b23 could not be found. Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Request method failure captured: Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 HTTP/1.1 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOTtYI4ln-ZC4TapAh7ZD2AOLH5ERAYG3tgO-hIUtxKuW2EyP9Km8Nb4qi-jYvam2cPev2Z0MP1RLagwDMvoyvoecfysxaashDn07HmU1CeumoAUpI2SY73ukX8xJZaBzH77JMzswDATaOSOsuqzeI3tcVRTwtg7YFjw3G4PZh_1dtY Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 918bcae48ada42b48ffd801791f5df22 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestFqdnHostnames-706060024 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/918bcae48ada42b48ffd801791f5df22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/918bcae48ada42b48ffd801791f5df22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/918bcae48ada42b48ffd801791f5df22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_918bcae48ada42b48ffd801791f5df22"}]}] Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestFqdnHostnames-706060024 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 918bcae48ada42b48ffd801791f5df22 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-706060024 Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestFqdnHostnames-706060024-project Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 214ad89f7fde4314a25b19d1e3479e9f Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestFqdnHostnames-706060024-project Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 218e500e-43b6-4c99-af78-3607ae5f9b23 could not be found. Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '218e500e-43b6-4c99-af78-3607ae5f9b23'} Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218e500e-43b6-4c99-af78-3607ae5f9b23 could not be found. Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218e500e-43b6-4c99-af78-3607ae5f9b23 could not be found. Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:00.748785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218e500e-43b6-4c99-af78-3607ae5f9b23 could not be found. Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Returning 404 to user: Instance 218e500e-43b6-4c99-af78-3607ae5f9b23 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea7e7747-c10c-4717-aa6a-012817a483b8 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23" status: 404 len: 111 microversion: 2.1 time: 0.037382 Oct 02 01:12:00.753541 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1372/2650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/servers/218e500e-43b6-4c99-af78-3607ae5f9b23 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:00.758029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f36d0b03-ada1-460d-a715-88a364441240 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881215670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.771224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:00.779453 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b4e0f06c-896a-4995-a121-0c029ec43be1 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1468 microversion: 2.1 time: 0.196743 Oct 02 01:12:00.794641 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1279/2651] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:00.794641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b93c8a4-db4e-4bdf-9117-ec7655a9b8e0 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] Calling method '.version_select at 0x7fb88119b8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.807322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f36d0b03-ada1-460d-a715-88a364441240 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1414 microversion: 2.1 time: 0.054612 Oct 02 01:12:00.808370 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1373/2652] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:00.826145 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b93c8a4-db4e-4bdf-9117-ec7655a9b8e0 tempest-ServersTestFqdnHostnames-706060024 tempest-ServersTestFqdnHostnames-706060024-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044879790" status: 202 len: 0 microversion: 2.1 time: 0.043056 Oct 02 01:12:00.829845 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1280/2653] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044879790 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:12:00.838262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.840061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:00.855152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.855847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.856415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.857607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.859082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.860334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.874160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-602906860", "block_migration": true, "disk_over_commit": false}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:00.879029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:00.889247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.890147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.890731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.892057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.893254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.893800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.927463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lazy-loading 'flavor' on Instance uuid 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:00.943054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Going to try to live migrate instance to tempest-host-602906860 {{(pid=122355) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:12:00.951158 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] HTTP exception thrown: Compute host tempest-host-602906860 could not be found. Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Request method failure captured: Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1/action HTTP/1.1 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 106 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVN5PL_G8n9wV6z0H1TK1Wws2pLM44fbaNFGWOQbA7yIlK7CAnKCfc-rSQdGkyrQ2CzaXzpR-8a8_erYnG-wCyLdmUMIKDWHPBpeAtT-dxMSvrIwjI_eHmGBMOwRMtSnif4eKnfbXCyef7UPuu6vnMCuLSvTIz79uFJ_iyKPCF2bVE Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: eb9a0ffa5fc74000836f096c478319eb Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveMigrationNegativeTest-1085183416 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9a0ffa5fc74000836f096c478319eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9a0ffa5fc74000836f096c478319eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9a0ffa5fc74000836f096c478319eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9a0ffa5fc74000836f096c478319eb"}]}] Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveMigrationNegativeTest-1085183416 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: eb9a0ffa5fc74000836f096c478319eb Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1085183416 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveMigrationNegativeTest-1085183416-project-admin Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: f175c7c95670489281ab0368dec8b016 Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveMigrationNegativeTest-1085183416-project-admin Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: {"os-migrateLive": {"host": "tempest-host-602906860", "block_migration": true, "disk_over_commit": false}} Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: exception: Compute host tempest-host-602906860 could not be found. Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7e2febfa-f50f-4a0e-9af7-f538ac10c2d1', 'body': {'os-migrateLive': {'host': 'tempest-host-602906860', 'block_migration': True, 'disk_over_commit': False}}} Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 02 01:12:00.966511 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-602906860 could not be found. Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-602906860 could not be found. Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-602906860 could not be found. Oct 02 01:12:00.971380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:00.975133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Returning 400 to user: Compute host tempest-host-602906860 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:00.976411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d16252d-afdd-413e-af3c-b9c1001d1419 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1/action" status: 400 len: 99 microversion: 2.1 time: 0.166806 Oct 02 01:12:00.976968 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1374/2654] 10.222.0.23 () {60 vars in 1279 bytes} [Sun Oct 2 01:12:00 2022] POST /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1/action => generated 99 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:00.984481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:00.987383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.989998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:01.000282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.000882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.001953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.002826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.003640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.004308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.005424 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ef564ff-0cec-4573-ab28-da9c3666f706 tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1935 microversion: 2.75 time: 0.173423 Oct 02 01:12:01.006183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1281/2655] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1935 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:01.016918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:01.017938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:01.031202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.031616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.032053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.033671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.034331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.034828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.138287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.146579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.148183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.153339 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0beaeb3f-0750-4b09-a933-27e18eae9cc8 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.146003 Oct 02 01:12:01.153901 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1282/2656] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:01 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:01.197874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.206156 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3cfcc91a-6739-432a-9134-e1e09778754e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1468 microversion: 2.1 time: 0.224103 Oct 02 01:12:01.206779 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1375/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:01.271654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1313561126", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:01.327058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:12:01.572361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:12:01.572793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:12:01.573276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:12:01.573689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:12:01.574129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:12:01.584148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.584634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.585076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.585809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.586265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.586736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.605187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Getting quotas for project d565120ddfb84f22ad17d8dd0f9c35fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:12:01.610481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Getting quotas for user daade8c46ae44a4b81bafa442b6037f4 and project d565120ddfb84f22ad17d8dd0f9c35fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:12:01.623476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:12:01.625779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:12:01.673069 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df056774-441c-4e11-8a5c-b236e16cc612 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.405976 Oct 02 01:12:01.673892 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1283/2658] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:12:01.684561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e55e9562-eb1a-4328-90cf-a54331f8a723 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:01.685174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e55e9562-eb1a-4328-90cf-a54331f8a723 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:01.746483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:01.747707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:01.750493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e55e9562-eb1a-4328-90cf-a54331f8a723 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.758106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.759059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.759779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.760575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.760754 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e55e9562-eb1a-4328-90cf-a54331f8a723 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1219 microversion: 2.1 time: 0.079933 Oct 02 01:12:01.761344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.761993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.763601 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1376/2659] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:01 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:01.823712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1f8e88f-4abe-4e3e-9e29-f374dabda90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8807c8a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:01.881592 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1f8e88f-4abe-4e3e-9e29-f374dabda90f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1414 microversion: 2.1 time: 0.061802 Oct 02 01:12:01.889492 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1377/2660] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:01 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:12:01.966943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.978898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.980364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:01.981620 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b4d47e4f-f538-4e7c-a62c-a1b06c071f8d tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2931 microversion: 2.42 time: 0.247163 Oct 02 01:12:01.982685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1284/2661] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:01 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2931 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:12:02.034757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:02.035415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:02.041806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.042199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.042672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.043730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.044356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.044783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.125083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:02.145541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f9acba53-51e4-40a9-aeba-9a1b896cc8ce tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1935 microversion: 2.75 time: 0.116011 Oct 02 01:12:02.146173 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1378/2662] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:02 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1935 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:02.185281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:02.187299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:02.194138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.194767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.195219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.196827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.196827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.197229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.324472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:02.337446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:02.338823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:02.348650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c9f2f60-d8f6-4377-b35b-cd99d205878f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.167639 Oct 02 01:12:02.349604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1285/2663] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:02 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:02.601328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e87cf275-8909-44f9-b7b2-b3bba2c3816f req-01dbec1f-56d9-486b-8bf1-46a5cfc5331e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5159e837-6076-465b-9383-601745d7acb3", "name": "network-vif-plugged", "status": "completed", "tag": "b91bce40-0ff7-4121-8b5d-41e3a6fd12e7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:02.634564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e87cf275-8909-44f9-b7b2-b3bba2c3816f req-01dbec1f-56d9-486b-8bf1-46a5cfc5331e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.635337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e87cf275-8909-44f9-b7b2-b3bba2c3816f req-01dbec1f-56d9-486b-8bf1-46a5cfc5331e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.644932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e87cf275-8909-44f9-b7b2-b3bba2c3816f req-01dbec1f-56d9-486b-8bf1-46a5cfc5331e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.664173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e87cf275-8909-44f9-b7b2-b3bba2c3816f req-01dbec1f-56d9-486b-8bf1-46a5cfc5331e service nova] Creating event network-vif-plugged:b91bce40-0ff7-4121-8b5d-41e3a6fd12e7 for instance 5159e837-6076-465b-9383-601745d7acb3 on n-h2-master-1 Oct 02 01:12:02.694298 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e87cf275-8909-44f9-b7b2-b3bba2c3816f req-01dbec1f-56d9-486b-8bf1-46a5cfc5331e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099735 Oct 02 01:12:02.697443 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1379/2664] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:02.785990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:02.786626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:02.802926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.803433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.803873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.816825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.817462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.817964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.852113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:02.856559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:02.899607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.901188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.904799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.908295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:02.909485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:02.912931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.997225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:03.020950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'flavor' on Instance uuid 481845ee-ce3d-4b19-95a4-4eeda0435f4d {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:03.036468 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae414764-ad3a-48e4-a4e5-e9e2ac4b0263 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1271 microversion: 2.1 time: 0.253442 Oct 02 01:12:03.043006 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1286/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:02 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:03.067750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bd52b8d-b6ce-4381-a043-cd837bf1d683 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880b0b9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:03.276227 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d0549011-54db-45cb-8a60-ffa07762c321 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/action" status: 200 len: 32 microversion: 2.1 time: 0.431324 Oct 02 01:12:03.281598 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1380/2666] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:12:02 2022] POST /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:12:03.287772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:03.295602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:03.309941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:03.310126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:03.310567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:03.312234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:03.312588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:03.313029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:03.868346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:03.881104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:03.891229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:03.893880 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-acf68edb-100a-4827-8162-225348e2e955 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2910 microversion: 2.42 time: 0.615402 Oct 02 01:12:03.895393 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1381/2667] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:03 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2910 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:03.900262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:03.927034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:03.943642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:03.944500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:03.947720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:03.950296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:03.954821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:03.960000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:04.212832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:04.244244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2cd3a523-1468-41b3-b4bf-3754f5e92f9b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1935 microversion: 2.75 time: 0.346670 Oct 02 01:12:04.255231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1382/2668] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:03 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1935 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:04.275945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:04.276832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:04.283767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:04.285910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:04.286633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:04.293979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:04.294776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:04.295463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:04.986637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:05.008090 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d7db170-7f5c-4cb1-8920-a237a6a49d19 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.750858 Oct 02 01:12:05.015426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1383/2669] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:04 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:05.035952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:05.039838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:05.056775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:05.059369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:05.061023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:05.063122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:05.065801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:05.067486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:05.242781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:05.260444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:05.262426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:05.280759 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f39942a5-f9d3-489e-9573-125377cf4512 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.256716 Oct 02 01:12:05.299197 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1384/2670] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:05 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:05.320797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:05.320797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:05.332319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:05.336833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:05.336833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:05.337748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:05.338345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:05.338882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.051537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:06.077353 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0b0441b3-aac5-44df-97e8-7777a8997755 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1319 microversion: 2.1 time: 0.778797 Oct 02 01:12:06.094636 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1385/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:05 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1319 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:06.094636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-unplugged", "status": "completed", "tag": "25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-unplugged", "status": "completed", "tag": "f5e3966a-d368-487e-b5a2-ec22b74ff1da"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-unplugged", "status": "completed", "tag": "b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:06.138348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.144492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.155613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.205832 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Creating event network-vif-unplugged:25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:06.206347 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Creating event network-vif-unplugged:f5e3966a-d368-487e-b5a2-ec22b74ff1da for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:06.206926 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] Creating event network-vif-unplugged:b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:06.231838 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a27c7ebb-27df-4559-9fb5-945875cb2fe2 req-89623579-deb1-458e-a659-b78ee09d0a2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.142135 Oct 02 01:12:06.232419 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1386/2672] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:06.239622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:06.240331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:06.268633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.269079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.269516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.270230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.270705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.271132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.873144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:06.886238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:06.891535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:06.900359 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-431ef85d-b98e-44f8-bff9-e8c41c210519 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2864 microversion: 2.42 time: 0.666551 Oct 02 01:12:06.904993 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1387/2673] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:06 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2864 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:06.918731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:06.919944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:06.949371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.950903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.951580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.952529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.953199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.953857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:07.202279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] Lazy-loading 'services' on Instance uuid ef0310ab-16d8-45c0-92e2-7ce83ef131dc {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:07.270468 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20fcb189-bcf9-4010-ac8b-4fe12d27c31b tempest-ServersAdmin275Test-993347328 tempest-ServersAdmin275Test-993347328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1920 microversion: 2.75 time: 0.364014 Oct 02 01:12:07.283106 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1388/2674] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:06 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1920 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:07.311937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:07.311937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:07.325519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:07.326169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:07.326773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:07.327591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:07.333075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:07.333075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.124397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:09.143504 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13b7fcbd-aece-4362-993c-02b1416e6fa6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 1.858641 Oct 02 01:12:09.145431 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1389/2675] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:07 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:09.231979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:09.246054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:09.278057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.278712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.284197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.285260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.288489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.291456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.432354 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:09.609502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:09.636601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:09.638509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:09.668690 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-737de02c-855a-43d5-8b09-96aee089e917 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.517939 Oct 02 01:12:09.671458 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1390/2676] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:09 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:09.803754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-717595ce-e899-4c4c-810e-957e962245d6 req-da963f7d-34b6-40ce-86a4-1dea232b0764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-deleted", "tag": "25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:09.834666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-717595ce-e899-4c4c-810e-957e962245d6 req-da963f7d-34b6-40ce-86a4-1dea232b0764 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.841520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-717595ce-e899-4c4c-810e-957e962245d6 req-da963f7d-34b6-40ce-86a4-1dea232b0764 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.842107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-717595ce-e899-4c4c-810e-957e962245d6 req-da963f7d-34b6-40ce-86a4-1dea232b0764 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.889548 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-717595ce-e899-4c4c-810e-957e962245d6 req-da963f7d-34b6-40ce-86a4-1dea232b0764 service nova] Creating event network-vif-deleted:25cdfd7d-5caf-4451-b2cc-a6246fc1f3c6 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:09.928628 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-717595ce-e899-4c4c-810e-957e962245d6 req-da963f7d-34b6-40ce-86a4-1dea232b0764 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252371 Oct 02 01:12:09.929694 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1391/2677] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:09.950466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:09.951383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:09.968741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.969397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.970769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.971597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.972223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.972758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:10.539842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:10.567621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20511e01-baf5-4955-b5b6-147aa91dc798 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1319 microversion: 2.1 time: 0.627846 Oct 02 01:12:10.569413 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1392/2678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:09 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:10.588339 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:10.589129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:10.604323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:10.605111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:10.605735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:10.606637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:10.607276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:10.608016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:10.685117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:12:10.817355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4ec4dbe4-84d2-451b-97ce-84c6e134b0b1 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 204 len: 0 microversion: 2.75 time: 0.246422 Oct 02 01:12:10.820902 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1393/2679] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:12:10 2022] DELETE /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:12:10.832934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:10.833744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:10.861216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:10.861879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:10.862320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:10.863072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:10.866002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:10.866002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.420310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:11.433282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:11.435134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:11.436470 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0021413f-9964-4bf4-9d10-58abddc1240a tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2658 microversion: 2.42 time: 0.617138 Oct 02 01:12:11.437520 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1394/2680] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:10 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2658 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:11.443254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-unplugged", "status": "completed", "tag": "59e8f14e-0229-48db-bae6-a559e24b69a8"}, {"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-plugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-unplugged", "status": "completed", "tag": "d0d278c0-2d7f-4560-8593-274b58492b90"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:11.456972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:11.457455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:11.457896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.487857 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Creating event network-vif-unplugged:59e8f14e-0229-48db-bae6-a559e24b69a8 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:11.488658 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Creating event network-vif-plugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:12:11.489182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] Creating event network-vif-unplugged:d0d278c0-2d7f-4560-8593-274b58492b90 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:11.524136 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-888ef068-00f4-4e0a-be7a-a6f7b6e0ddfa req-4f1f9ea6-9fa6-4744-8042-fef405c4257c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.082216 Oct 02 01:12:11.525445 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1395/2681] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:11.542215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9cb71978-7915-4e98-8a00-c7a7d2c7eadc req-551f2c34-6074-43fd-9ad0-09e71d4c94f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739", "tag": "2af810b5-2883-4052-a338-bf77d878110f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:11.568850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9cb71978-7915-4e98-8a00-c7a7d2c7eadc req-551f2c34-6074-43fd-9ad0-09e71d4c94f8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:11.570308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9cb71978-7915-4e98-8a00-c7a7d2c7eadc req-551f2c34-6074-43fd-9ad0-09e71d4c94f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:11.570841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9cb71978-7915-4e98-8a00-c7a7d2c7eadc req-551f2c34-6074-43fd-9ad0-09e71d4c94f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.587185 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9cb71978-7915-4e98-8a00-c7a7d2c7eadc req-551f2c34-6074-43fd-9ad0-09e71d4c94f8 service nova] Creating event network-changed:2af810b5-2883-4052-a338-bf77d878110f for instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 on n-h2-master-1 Oct 02 01:12:11.593643 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9cb71978-7915-4e98-8a00-c7a7d2c7eadc req-551f2c34-6074-43fd-9ad0-09e71d4c94f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065836 Oct 02 01:12:11.596166 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1396/2682] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:11.599183 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:11.614731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:11.615455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:11.617317 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:11.634038 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:11.639799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:11.642733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:11.643212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.643960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:11.644434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:11.648705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.770762 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:12.253240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.269631 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5af63267-df9f-44c3-837a-2934592868d9 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.667049 Oct 02 01:12:12.271263 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1397/2683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:11 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:12.280844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:12.281470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:12.302699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.303205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.303640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.304353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.304808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.305229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.432114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.440837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.450495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.469296 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1cd1bb3c-9d08-46ae-8d33-cb09458f24de tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1558 microversion: 2.91 time: 0.196443 Oct 02 01:12:12.488782 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1398/2684] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:12 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:12.506904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:12.506904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:12.522544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.523075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.523509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.524251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.524693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.525119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.738870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.770798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.777119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49da406fdd2e4aa980c1a7343af9a321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1893a97eaf94d85b113cb3d03c3ef85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:12.788414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70a0dff7-9420-4c5a-96f3-4e0c75ef9760 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 200 len: 1444 microversion: 2.75 time: 0.298121 Oct 02 01:12:12.789676 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1399/2685] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:12 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 1444 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:12.795880 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:12.813454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:12.816455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:12.846506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.847041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.847494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.854025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.854641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.855086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.002102 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:13.288650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:13.301116 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-167f3735-56ce-4cb7-a514-f35a793ede0d tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1319 microversion: 2.1 time: 0.510115 Oct 02 01:12:13.304686 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1400/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:12 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:13.317018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-deleted", "tag": "f5e3966a-d368-487e-b5a2-ec22b74ff1da"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-deleted", "tag": "b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:13.358454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.363369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.368090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.426583 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] Creating event network-vif-deleted:f5e3966a-d368-487e-b5a2-ec22b74ff1da for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:13.426583 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] Creating event network-vif-deleted:b6e2f1c5-a1a8-4cd7-acb0-87dd4f07e7fe for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:13.451291 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c4dba206-1bac-435d-a40e-11d22ca9cd7e req-ea9a752b-fe70-4c49-a213-805717fc7caa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.143587 Oct 02 01:12:13.455661 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1401/2687] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:13.465292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:13.472361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:13.492180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.492879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.500788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.502180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.502696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.511846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.788315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:13.801628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:13.805201 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:13.807039 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90869e5a-0a06-4596-a828-15f1c489d9c2 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 2498 microversion: 2.42 time: 0.350064 Oct 02 01:12:13.809614 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1402/2688] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:13 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 2498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:13.813467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:13.814867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:13.824375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.824868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.825353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.825992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.826576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.827314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.061801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:14.075282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6266812a-69bf-462a-8773-37846015d910 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.265487 Oct 02 01:12:14.076982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1403/2689] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:13 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:14.087873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:14.089309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:14.099684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.100974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.101993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.103576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.104662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.105458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.228692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:14.244074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:14.246810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:14.260855 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d2f774c-2ec1-4865-ae5d-20884b4b4314 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1558 microversion: 2.91 time: 0.177813 Oct 02 01:12:14.281350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1404/2690] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:14 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:14.298746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:14.301338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] [instance: ef0310ab-16d8-45c0-92e2-7ce83ef131dc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:14.324854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.331893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.332497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.334039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.342127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.343864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.409644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] HTTP exception thrown: Instance ef0310ab-16d8-45c0-92e2-7ce83ef131dc could not be found. Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Request method failure captured: Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc HTTP/1.1 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOUMDeaTmgC8SlvbzZ_rUBToIwFhG9-PLd-ZEIMehn5IOxm8n_mlX_A0R7t0cBYstcN2WyWFugG0Gh67OnfxbPqfne-6E7JXERkmQbNjVef5kpoIJdoaEn4scprGRwdpDnTmU4_OUiWkpWF6kDG0VdE-xKrmWu4_U4TA6qtjPUoITwA Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.75 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: c1893a97eaf94d85b113cb3d03c3ef85 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersAdmin275Test-3805213 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1893a97eaf94d85b113cb3d03c3ef85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1893a97eaf94d85b113cb3d03c3ef85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1893a97eaf94d85b113cb3d03c3ef85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1893a97eaf94d85b113cb3d03c3ef85"}]}] Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersAdmin275Test-3805213 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: c1893a97eaf94d85b113cb3d03c3ef85 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersAdmin275Test-3805213 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersAdmin275Test-3805213-project Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 49da406fdd2e4aa980c1a7343af9a321 Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersAdmin275Test-3805213-project Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: exception: Instance ef0310ab-16d8-45c0-92e2-7ce83ef131dc could not be found. Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'ef0310ab-16d8-45c0-92e2-7ce83ef131dc'} Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0310ab-16d8-45c0-92e2-7ce83ef131dc could not be found. Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0310ab-16d8-45c0-92e2-7ce83ef131dc could not be found. Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:14.412380 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0310ab-16d8-45c0-92e2-7ce83ef131dc could not be found. Oct 02 01:12:14.417255 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:14.425666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] Returning 404 to user: Instance ef0310ab-16d8-45c0-92e2-7ce83ef131dc could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:14.431888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2455043-f89d-4546-b163-d08211d09f55 tempest-ServersAdmin275Test-3805213 tempest-ServersAdmin275Test-3805213-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc" status: 404 len: 111 microversion: 2.75 time: 0.144541 Oct 02 01:12:14.433762 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1405/2691] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:14 2022] GET /compute/v2.1/servers/ef0310ab-16d8-45c0-92e2-7ce83ef131dc => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:12:14.463491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:14.463491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:14.468279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.468279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.468279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.468279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.489094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.489094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:15.132233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:15.143753 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e99cec39-5713-4a0d-8a34-573d14096125 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1319 microversion: 2.1 time: 0.703353 Oct 02 01:12:15.151087 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1406/2692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:14 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:15.168279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:15.172257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:15.192518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:15.196032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:15.198548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:15.199520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:15.203256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:15.203702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:15.712304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:15.740385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:15.745202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:15.746439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d08ba00-ef41-4b2b-976d-bfaabe956528 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.590981 Oct 02 01:12:15.747258 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1407/2693] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:15 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:15.781877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:15.793925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:15.829173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:15.833294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:15.838506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:15.841773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:15.843145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:15.849612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:16.562498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:16.569274 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:16.580161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d28e525-3707-4f66-b2da-fa380ebc8450 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.828756 Oct 02 01:12:16.581063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1408/2694] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:15 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:16.591489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:16.592291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:16.606207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:16.607294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:16.607920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:16.615084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:16.616173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:16.616840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:16.921202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:16.956970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:16.962242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:16.979163 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2cf6a981-878a-4fd2-bae3-d160127afeb7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.391959 Oct 02 01:12:16.982258 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1409/2695] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:16 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:17.006136 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-deleted", "tag": "d0d278c0-2d7f-4560-8593-274b58492b90"}, {"server_uuid": "0e6528b7-91d7-4dde-b95a-5520c5cd6c26", "name": "network-vif-deleted", "tag": "59e8f14e-0229-48db-bae6-a559e24b69a8"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:17.035845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.036654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.037336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.059625 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] Creating event network-vif-deleted:d0d278c0-2d7f-4560-8593-274b58492b90 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:17.060450 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] Creating event network-vif-deleted:59e8f14e-0229-48db-bae6-a559e24b69a8 for instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 on n-h1-master-1 Oct 02 01:12:17.072069 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a257f8f6-f4e2-47f5-b847-02b7f75b86e6 req-63137fa8-8007-4128-bc9c-4f4eacd14a3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087639 Oct 02 01:12:17.080345 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1410/2696] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:17.101590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:17.107376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:17.135114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.136912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.137498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.144503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.145358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.146051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.511817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:17.529707 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2225d38f-90e3-4a01-9459-e1a03d3c5218 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1319 microversion: 2.1 time: 0.446902 Oct 02 01:12:17.530567 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1411/2697] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:17 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:17.547724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:17.548903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:17.569998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.573975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.574746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.577813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.582975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.583783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.791741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:17.810530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:17.813553 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:17.816484 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02dd76db-54da-4d98-9885-d4583c98adcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.279741 Oct 02 01:12:17.831863 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1412/2698] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:17 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:17.848352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f7c5ddfd-a932-4fd0-ad39-deeed414a944 req-5d94ed6f-bdfe-4758-bf62-caa6cfa686ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739", "name": "network-vif-plugged", "status": "completed", "tag": "2af810b5-2883-4052-a338-bf77d878110f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:17.879540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f7c5ddfd-a932-4fd0-ad39-deeed414a944 req-5d94ed6f-bdfe-4758-bf62-caa6cfa686ac service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.880169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f7c5ddfd-a932-4fd0-ad39-deeed414a944 req-5d94ed6f-bdfe-4758-bf62-caa6cfa686ac service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.880730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f7c5ddfd-a932-4fd0-ad39-deeed414a944 req-5d94ed6f-bdfe-4758-bf62-caa6cfa686ac service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.896606 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f7c5ddfd-a932-4fd0-ad39-deeed414a944 req-5d94ed6f-bdfe-4758-bf62-caa6cfa686ac service nova] Creating event network-vif-plugged:2af810b5-2883-4052-a338-bf77d878110f for instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 on n-h2-master-1 Oct 02 01:12:17.901966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f7c5ddfd-a932-4fd0-ad39-deeed414a944 req-5d94ed6f-bdfe-4758-bf62-caa6cfa686ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068471 Oct 02 01:12:17.920037 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1413/2699] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:17.935141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:17.944614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:17.959385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.967273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.978448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.978798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.979523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.980118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.335648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:18.343959 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8d9bf3cb-3036-44ed-8ce9-0dbcbb39925e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.422495 Oct 02 01:12:18.344746 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1414/2700] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:17 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:18.367443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:18.368055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:18.391659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.392198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.392637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.393342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.393796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.394219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.547004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:18.559997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:18.561427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:18.578016 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0419771a-6e59-4af3-b8ea-96ffe53fc0c1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.231841 Oct 02 01:12:18.593811 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1415/2701] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:18 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:18.604928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:18.605559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:18.618169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.618691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.619134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.619843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.620290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.620717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.903256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:18.913388 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eb0eca2a-d6c2-4a72-aa58-3559648f1272 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1319 microversion: 2.1 time: 0.320996 Oct 02 01:12:18.915460 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1416/2702] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:18 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:18.920603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:18.921515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:18.928311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.929057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.929665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.930542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.931177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.931759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:19.030786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:19.046882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:19.055608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:19.065461 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4cde5918-b3f5-4405-85cc-e13391560812 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.148690 Oct 02 01:12:19.072913 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1417/2703] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:18 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:19.372359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:19.372987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:19.405503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:19.406103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:19.406569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:19.415736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:19.416355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:19.418956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:19.765324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:19.775289 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5b59c45-cafa-4ce9-8563-54ccd530496e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.407376 Oct 02 01:12:19.793655 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1418/2704] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:19 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:19.804423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:19.807466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:19.819921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:19.823636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:19.824418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:19.828796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:19.831595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:19.835299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.046721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.057130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.062393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.076670 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8767a5a3-ad4e-4730-be22-67f2c8ab0758 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.281126 Oct 02 01:12:20.093805 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1419/2705] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:19 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:20.114585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:20.115609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:20.125034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.126183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.127512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.128557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.129278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.129936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.484677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.516732 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-624f45bf-bc3d-4f8a-acb8-89782e89ef83 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1469 microversion: 2.1 time: 0.412086 Oct 02 01:12:20.530916 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1420/2706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:20 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:20.539677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:20.540543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:20.547763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.548780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.549454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.550392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.551113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.551903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.709409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.729069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.733624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:20.736868 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6bb6f0ac-cd41-43b0-a605-fd63c1622751 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.205456 Oct 02 01:12:20.737637 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1421/2707] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:20 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:20.769218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:20.772634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:20.899030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.917012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.937428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.939622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.944556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.945217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:21.066807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lazy-loading 'flavor' on Instance uuid 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:21.279677 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ebaf548-c92a-458b-9bff-32591c693445 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739/action" status: 202 len: 0 microversion: 2.1 time: 0.518609 Oct 02 01:12:21.303865 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1422/2708] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:12:20 2022] POST /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:12:21.327118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:21.331638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:21.348927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:21.351079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:21.353830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:21.355410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:21.366489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:21.367716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:21.966023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:21.984512 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a6a0ac2-7319-483e-b3e7-4c80e7f45934 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.673911 Oct 02 01:12:21.994942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1423/2709] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:21 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:22.000742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:22.006703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:22.043565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:22.045992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:22.053090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.057042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:22.057863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:22.060299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.167534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.181488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.185851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.205649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf3c31a5-232f-42af-82ca-5fef28b4df39 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.206856 Oct 02 01:12:22.207392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1424/2710] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:21 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:22.219523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:22.221378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:22.248009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:22.248835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:22.250473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.251600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:22.254391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:22.256740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.292418 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:22.546191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.556862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bcae7a63-0d18-494c-8ef7-d458133cb8d8 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1460 microversion: 2.1 time: 0.346936 Oct 02 01:12:22.558206 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1425/2711] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:22 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1460 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:22.569145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:22.569781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:22.588155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:22.588645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:22.603321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.604105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:22.604584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:22.605021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.827672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.904302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.904302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:22.904302 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fed49da4-e156-43f4-bceb-36ceac038f8c tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.351320 Oct 02 01:12:22.904302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1426/2712] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:22 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:23.438077 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4bac13f5-a5a1-4458-98ae-ad2f6fcaa053 tempest-TenantUsagesNegativeTestJSON-241281153 tempest-TenantUsagesNegativeTestJSON-241281153-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-01T01%3A12%3A22.578210&end=2022-10-03T01%3A12%3A22.578210" status: 404 len: 112 microversion: - time: 0.518391 Oct 02 01:12:23.438823 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1427/2713] 10.222.0.23 () {58 vars in 1316 bytes} [Sun Oct 2 01:12:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-01T01%3A12%3A22.578210&end=2022-10-03T01%3A12%3A22.578210 => generated 112 bytes in 520 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 01:12:23.457081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:23.457752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:23.480373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:23.480872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:23.481316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:23.482032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:23.482801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:23.491278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.063142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b4ad8c1-1b6d-4346-afb2-1a5549e642ed tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1611 microversion: 2.1 time: 0.617326 Oct 02 01:12:24.064117 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1428/2714] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:23 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1611 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:24.087923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:24.088539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:24.097212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.098783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.099550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.100356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.100836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.101264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.357085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.380793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-943252e1-ef1a-42f4-80ca-8e30de41a4fc tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.296582 Oct 02 01:12:24.399100 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1429/2715] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:24.414301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:24.414954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:24.427834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.428329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.430185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.431133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.432777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.433379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.581816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.597864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.599421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.608763 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-35689416-f75b-4124-9c90-5c10a2b458ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.208951 Oct 02 01:12:24.609558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1430/2716] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:24.627154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b838764a-3811-441e-82a1-bc701ea27aa8 tempest-TenantUsagesNegativeTestJSON-241281153 tempest-TenantUsagesNegativeTestJSON-241281153-project-admin] Calling method '.version_select at 0x7fb881297040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:24.635991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b838764a-3811-441e-82a1-bc701ea27aa8 tempest-TenantUsagesNegativeTestJSON-241281153 tempest-TenantUsagesNegativeTestJSON-241281153-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b838764a-3811-441e-82a1-bc701ea27aa8 tempest-TenantUsagesNegativeTestJSON-241281153 tempest-TenantUsagesNegativeTestJSON-241281153-project-admin] Request method failure captured: Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-simple-tenant-usage/5718ec2e31884cf4aa08f61348463aa1?start=2022-10-03T01%3A12%3A22.578210&end=2022-10-01T01%3A12%3A22.578210 HTTP/1.1 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOV2WiheMiYTv8lrIf1mtwlDSsXnldYXU2UHj7kvArKYeu3xArQSLiPqdmKOAslOS1qxKZXo-AGy44mGWYsSw3c8HTOk0wJLVMHatwIlauMfsosTE7Oq9ny_SUSGpWSESkkaqivO5yHFi6-ZvWNLaJngzGAWpnfAMRtn8swqd6CwCgw Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: c3e42a55d5a24780aeeefd075120c1ef Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-241281153 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c3e42a55d5a24780aeeefd075120c1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c3e42a55d5a24780aeeefd075120c1ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c3e42a55d5a24780aeeefd075120c1ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c3e42a55d5a24780aeeefd075120c1ef"}]}] Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-241281153 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: c3e42a55d5a24780aeeefd075120c1ef Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-241281153 Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TenantUsagesNegativeTestJSON-241281153-project-admin Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a89041e621f643389b328f8b8e177c9b Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-241281153-project-admin Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid start time. The start time cannot occur after the end time. Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '5718ec2e31884cf4aa08f61348463aa1'} Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 02 01:12:24.647382 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:24.652550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b838764a-3811-441e-82a1-bc701ea27aa8 tempest-TenantUsagesNegativeTestJSON-241281153 tempest-TenantUsagesNegativeTestJSON-241281153-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:24.652550 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b838764a-3811-441e-82a1-bc701ea27aa8 tempest-TenantUsagesNegativeTestJSON-241281153 tempest-TenantUsagesNegativeTestJSON-241281153-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/5718ec2e31884cf4aa08f61348463aa1?start=2022-10-03T01%3A12%3A22.578210&end=2022-10-01T01%3A12%3A22.578210" status: 400 len: 111 microversion: 2.1 time: 0.040432 Oct 02 01:12:24.653363 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1431/2717] 10.222.0.23 () {58 vars in 1412 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/os-simple-tenant-usage/5718ec2e31884cf4aa08f61348463aa1?start=2022-10-03T01%3A12%3A22.578210&end=2022-10-01T01%3A12%3A22.578210 => generated 111 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:12:24.667324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:24.673774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:24.703518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.709879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.712122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.713105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.715671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.716209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.819866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.834387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.836541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:24.838084 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5cd037c3-6c13-455c-8380-c4e502c034d9 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.176674 Oct 02 01:12:24.855944 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1432/2718] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:24.867243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:24.871804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.872551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.873161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.874257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.875044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.875652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.936675 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bd8998ce-3855-490a-a5de-82bf1e5a51ef tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079228 Oct 02 01:12:24.938009 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1433/2719] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:25.168839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0bcb582-5632-434f-bfde-5bc28f5be299 tempest-TenantUsagesNegativeTestJSON-43675040 tempest-TenantUsagesNegativeTestJSON-43675040-project] Calling method '.version_select at 0x7fb8807c5ca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:25.184249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0bcb582-5632-434f-bfde-5bc28f5be299 tempest-TenantUsagesNegativeTestJSON-43675040 tempest-TenantUsagesNegativeTestJSON-43675040-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '6101c2fe10bb4064a119057c1d17adae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718ec2e31884cf4aa08f61348463aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0bcb582-5632-434f-bfde-5bc28f5be299 tempest-TenantUsagesNegativeTestJSON-43675040 tempest-TenantUsagesNegativeTestJSON-43675040-project] Request method failure captured: Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-01T01%3A12%3A22.578210&end=2022-10-03T01%3A12%3A22.578210&detailed=1 HTTP/1.1 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOV0nj6KKkNEQ0LitJxV_UDnc8mklja7ImaCduZIFA8Tj6qt-BdTT2T-FISa7QbavkAx1KjsBIECCikCvAsCgv3oNALf6REByJ5UoOCoEeJpL2MxBakXYAJGwcgJSIZcwFOhf-vKJI7Ks3e1EsSquCnQ1AU_IrzmzbW9EOIV2K2YPGw Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 5718ec2e31884cf4aa08f61348463aa1 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-43675040 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5718ec2e31884cf4aa08f61348463aa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5718ec2e31884cf4aa08f61348463aa1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5718ec2e31884cf4aa08f61348463aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5718ec2e31884cf4aa08f61348463aa1"}]}] Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-43675040 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 5718ec2e31884cf4aa08f61348463aa1 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-43675040 Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TenantUsagesNegativeTestJSON-43675040-project Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6101c2fe10bb4064a119057c1d17adae Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-43675040-project Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:12:25.199239 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0bcb582-5632-434f-bfde-5bc28f5be299 tempest-TenantUsagesNegativeTestJSON-43675040 tempest-TenantUsagesNegativeTestJSON-43675040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:25.205972 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0bcb582-5632-434f-bfde-5bc28f5be299 tempest-TenantUsagesNegativeTestJSON-43675040 tempest-TenantUsagesNegativeTestJSON-43675040-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-01T01%3A12%3A22.578210&end=2022-10-03T01%3A12%3A22.578210&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.260752 Oct 02 01:12:25.208512 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1434/2720] 10.222.0.23 () {58 vars in 1335 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-01T01%3A12%3A22.578210&end=2022-10-03T01%3A12%3A22.578210&detailed=1 => generated 123 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:25.248514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:25.262227 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:25.276437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.276941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.281332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.287275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.292831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.293577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.303684 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bd52b8d-b6ce-4381-a043-cd837bf1d683 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1414 microversion: 2.1 time: 22.256745 Oct 02 01:12:25.312864 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1287/2721] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:03 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1414 bytes in 22267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:25.385397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Lazy-loading 'flavor' on Instance uuid 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:12:25.401706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:25.402156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:25.414856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.415488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.415796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.416804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.416968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.417370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.466281 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 while it is in vm_state suspended Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Request method failure captured: Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739/action HTTP/1.1 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 97 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVN5PL_G8n9wV6z0H1TK1Wws2pLM44fbaNFGWOQbA7yIlK7CAnKCfc-rSQdGkyrQ2CzaXzpR-8a8_erYnG-wCyLdmUMIKDWHPBpeAtT-dxMSvrIwjI_eHmGBMOwRMtSnif4eKnfbXCyef7UPuu6vnMCuLSvTIz79uFJ_iyKPCF2bVE Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: eb9a0ffa5fc74000836f096c478319eb Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveMigrationNegativeTest-1085183416 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader,admin Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader,admin Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9a0ffa5fc74000836f096c478319eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9a0ffa5fc74000836f096c478319eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9a0ffa5fc74000836f096c478319eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9a0ffa5fc74000836f096c478319eb"}]}] Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveMigrationNegativeTest-1085183416 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: eb9a0ffa5fc74000836f096c478319eb Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1085183416 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveMigrationNegativeTest-1085183416-project-admin Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: f175c7c95670489281ab0368dec8b016 Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveMigrationNegativeTest-1085183416-project-admin Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'os-migrateLive' instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 while it is in vm_state suspended Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739', 'body': {'os-migrateLive': {'host': 'n-h1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:25.488675 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 while it is in vm_state suspended Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 while it is in vm_state suspended Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:25.492494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 while it is in vm_state suspended {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:25.498032 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9bdbf13-549a-40bd-bda1-a2dd67b57bf2 tempest-LiveMigrationNegativeTest-1085183416 tempest-LiveMigrationNegativeTest-1085183416-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739/action" status: 409 len: 155 microversion: 2.1 time: 0.272295 Oct 02 01:12:25.504750 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1435/2722] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:12:25 2022] POST /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739/action => generated 155 bytes in 295 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:12:25.526109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:25.528661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:25.555650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.556805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.557195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.557918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.558379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.558840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.825165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:25.839062 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4f4504a0-34d7-44b5-8969-b173df9eeeae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.443166 Oct 02 01:12:25.842534 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1288/2723] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:25 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:25.854290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:25.855072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:25.862389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.867307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.872044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.873038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.874192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.874859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.917234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:12:26.002775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.021406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d08a73db-85bf-49ed-8169-92a494ba33fd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.514324 Oct 02 01:12:26.024532 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1436/2724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:25 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:26.037636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.039586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:26.044429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50a53280-8481-4b21-9755-2951987e8cae tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 204 len: 0 microversion: 2.1 time: 0.199512 Oct 02 01:12:26.044429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1289/2725] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:12:25 2022] DELETE /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:12:26.056345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.057083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:26.066032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.066840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.070219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.071608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.072279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.074254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.077268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.077697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.078195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.078768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.081315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.081736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.180514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.194935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.203518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.215912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-448deb79-4051-4238-b59a-cb13bb1cef08 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.188720 Oct 02 01:12:26.217487 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1437/2726] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:26.234033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.234850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:26.245352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.245930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.246369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.248605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.258424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.259157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.291402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.303915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.305361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.306668 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d36f5cf-71ec-45cc-ac0e-bbc7b6c3ce13 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.255083 Oct 02 01:12:26.307204 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1290/2727] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:26.331110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7865f145-e362-4ab1-91bf-3823d74c2dc0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880b0b430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.400690 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7865f145-e362-4ab1-91bf-3823d74c2dc0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1423 microversion: 2.1 time: 0.084826 Oct 02 01:12:26.403970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1291/2728] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:26.417887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edb5cae9-6e6d-46eb-80a5-8e4cffda80f1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880aa7670>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.517779 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-edb5cae9-6e6d-46eb-80a5-8e4cffda80f1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 200 len: 1423 microversion: 2.1 time: 0.103972 Oct 02 01:12:26.518762 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1292/2729] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:26.533649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a47810c8-76c6-486d-aef5-3e3a5751cbc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880b0be50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.545706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:26.565842 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da527ef2-1ab5-4372-9f99-16cdf97f23a7 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1466 microversion: 2.1 time: 0.346959 Oct 02 01:12:26.566446 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1438/2730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1466 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:26.867060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.869284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:26.907208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.907986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.911329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.912387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.915478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.921408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.309758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:27.338513 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6bd887ac-d409-4c31-b0b1-0361a3b28753 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.475879 Oct 02 01:12:27.340737 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1439/2731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:27.348273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:27.349229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:27.355679 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:27.358244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.359206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.360137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.362336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.364810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.365520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.669338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:27.705860 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-290a6b53-eec2-428a-b19e-3458c6cf8d98 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.358930 Oct 02 01:12:27.709088 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1440/2732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:27 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:27.723307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:27.724380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:27.733035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.733842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.734537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.735499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.737595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.737595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.804036 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a47810c8-76c6-486d-aef5-3e3a5751cbc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 204 len: 0 microversion: 2.1 time: 1.274676 Oct 02 01:12:27.809118 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1293/2733] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:26 2022] DELETE /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 0 bytes in 1280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:12:27.824391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:27.825448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:27.853429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.857466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.859719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.860768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.861514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.862252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.021539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:28.035826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:28.038150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:28.045979 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8dfbb393-3c3b-4671-af46-01752bc6d20c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.335468 Oct 02 01:12:28.047327 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1441/2734] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:27 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:28.054570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-575546620"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:28.057801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:28.069296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.070945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.071629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.073102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.074088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.074812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.257500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:28.292119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:28.294212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:28.312034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2eca0a6-d43e-440d-909f-050601066f02 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.498468 Oct 02 01:12:28.323079 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1294/2735] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:27 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:28.332167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:28.333089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:28.356675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.357174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.357610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.358345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.362304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.362849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.482901 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b0e49f2-573d-48dd-b7b0-1b976aeae91d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.433856 Oct 02 01:12:28.484310 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1442/2736] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:12:28 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 02 01:12:28.495919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:28.496783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:28.514592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.515469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.516133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.517344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.518222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.520397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.579281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:12:28.620624 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:28.775900 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26ac84cc-10fc-4a17-92c7-b569170f25b9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 204 len: 0 microversion: 2.1 time: 0.289757 Oct 02 01:12:28.777612 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1443/2737] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:12:28 2022] DELETE /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:12:28.795619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:28.804128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:28.820973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.821887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.823464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.824421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.825093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.826930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:29.645912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:29.662955 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5011d2ac-d60d-40dd-ad2c-f355878e2c0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.877762 Oct 02 01:12:29.691650 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1444/2738] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:28 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:29.696735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:29.697360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:29.737654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:29.740437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:29.748758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:29.753100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:29.753853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:29.762548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.076660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.091456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d328c892-c62a-40ca-9ee4-ccf109eb4410 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 200 len: 1466 microversion: 2.1 time: 1.772327 Oct 02 01:12:30.117982 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1295/2739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:28 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 1466 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:30.137489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1559185404", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "52e9d38c-d322-45f0-aba7-d15109b53e80"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:30.221995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.223261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] validate_networks() for [('52e9d38c-d322-45f0-aba7-d15109b53e80', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:12:30.236970 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a5101df-8861-46d6-aa8a-c93dd05ff550 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.544054 Oct 02 01:12:30.257247 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1445/2740] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:29 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:30.265772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:30.273772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:30.291929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:30.314641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:30.317819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.322121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:30.331934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:30.332771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.561589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.576468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.580943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.592668 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c889899-314f-46f8-8e67-4a757f980fdb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.333905 Oct 02 01:12:30.612984 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1446/2741] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:30 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:30.621496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:30.622808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:30.640261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:30.642118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:30.643628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.647690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:30.649059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:30.650661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.924833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.953622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.983697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:30.996311 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b374e143-3202-4a9d-9559-9a5bcfc740c1 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.380408 Oct 02 01:12:31.002728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1447/2742] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:30 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:31.015275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-006a1898-61de-40ac-8ca9-805b45f7ac2c req-afa39b7b-c4f1-4984-8be4-969b363c361d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739", "name": "network-vif-deleted", "tag": "2af810b5-2883-4052-a338-bf77d878110f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:31.042727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-006a1898-61de-40ac-8ca9-805b45f7ac2c req-afa39b7b-c4f1-4984-8be4-969b363c361d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:31.045096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-006a1898-61de-40ac-8ca9-805b45f7ac2c req-afa39b7b-c4f1-4984-8be4-969b363c361d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:31.046772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-006a1898-61de-40ac-8ca9-805b45f7ac2c req-afa39b7b-c4f1-4984-8be4-969b363c361d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:31.083343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-006a1898-61de-40ac-8ca9-805b45f7ac2c req-afa39b7b-c4f1-4984-8be4-969b363c361d service nova] Creating event network-vif-deleted:2af810b5-2883-4052-a338-bf77d878110f for instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 on n-h2-master-1 Oct 02 01:12:31.103542 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-006a1898-61de-40ac-8ca9-805b45f7ac2c req-afa39b7b-c4f1-4984-8be4-969b363c361d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093851 Oct 02 01:12:31.104881 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1448/2743] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:31.110739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:31.115720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:31.130274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:31.136220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:31.139330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:31.140678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:31.144489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:31.147468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.313521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:32.328164 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bd558856-39a6-4442-8264-61fe803d1b41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1685 microversion: 2.1 time: 1.221603 Oct 02 01:12:32.348886 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1449/2744] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:31 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1685 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:32.376292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:12:32.377767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:12:32.378677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:12:32.380468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:12:32.381318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:12:32.405952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.415815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.419266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.421353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.424585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.425199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.497474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:12:32.512982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for user 8cd2ad37e9b844ac8b7632fd9291023a and project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:12:32.529172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:12:32.531921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:12:32.632052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f372065f-9a47-4024-94ea-7744799412aa tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:32.632904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9489529-2375-4850-a82f-3b1e34af6925 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.510905 Oct 02 01:12:32.633819 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1296/2745] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:12:32.648090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:32.653171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:32.661505 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f372065f-9a47-4024-94ea-7744799412aa tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.311013 Oct 02 01:12:32.674523 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1450/2746] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:32.680113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.690835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.691613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.692523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.693472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.693625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:32.694172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.700835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:32.739804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.743703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.744244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.750627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.752680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.755039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] HTTP exception thrown: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 could not be found. Oct 02 01:12:32.757093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Request method failure captured: Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 HTTP/1.1 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOVM7Evt0o7TUAoDUZbnRH-QuNsanmWjwOqqGGtabDL6v7LQPnX1s66xCvX1gTY8EhDm5SHPdT0FqeOR4FvlyflEALS1Nsly5PPcd2cjmqw-fhy48YSYIk7Fjms5yppz1PSn9AAEz05jYG0etao5oZGNWcEj3V7ORT74_iEiAQacdiE Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: d565120ddfb84f22ad17d8dd0f9c35fa Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-LiveMigrationNegativeTest-534466989 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d565120ddfb84f22ad17d8dd0f9c35fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d565120ddfb84f22ad17d8dd0f9c35fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d565120ddfb84f22ad17d8dd0f9c35fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d565120ddfb84f22ad17d8dd0f9c35fa"}]}] Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-LiveMigrationNegativeTest-534466989 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: d565120ddfb84f22ad17d8dd0f9c35fa Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-534466989 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-LiveMigrationNegativeTest-534466989-project Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: daade8c46ae44a4b81bafa442b6037f4 Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-LiveMigrationNegativeTest-534466989-project Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 could not be found. Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739'} Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 could not be found. Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 could not be found. Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:32.763065 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 could not be found. Oct 02 01:12:32.768322 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:32.780258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Returning 404 to user: Instance 0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:32.781625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e197b60a-f145-4f31-8d69-89292619f13e tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739" status: 404 len: 111 microversion: 2.1 time: 0.137505 Oct 02 01:12:32.782970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1297/2747] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:32 2022] GET /compute/v2.1/servers/0477ffd6-2ff7-4a6b-a95a-7f3b90c5b739 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:32.789901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:32.802449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:32.820441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.821348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.823702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.824707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.827407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.828100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.155349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.171467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.176207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.196278 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10775b8d-bf72-46b6-bca8-b8c8fe66c96c tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.409082 Oct 02 01:12:33.199120 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1298/2748] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:32 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:33.216925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b04a6ca0-ff4d-4a54-980a-042964114580 req-3eb0b491-9b50-43d7-8ba0-eaefa81d5f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-unplugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:33.252516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b04a6ca0-ff4d-4a54-980a-042964114580 req-3eb0b491-9b50-43d7-8ba0-eaefa81d5f65 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.253810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b04a6ca0-ff4d-4a54-980a-042964114580 req-3eb0b491-9b50-43d7-8ba0-eaefa81d5f65 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.259017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b04a6ca0-ff4d-4a54-980a-042964114580 req-3eb0b491-9b50-43d7-8ba0-eaefa81d5f65 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.294440 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b04a6ca0-ff4d-4a54-980a-042964114580 req-3eb0b491-9b50-43d7-8ba0-eaefa81d5f65 service nova] Creating event network-vif-unplugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:12:33.307581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b04a6ca0-ff4d-4a54-980a-042964114580 req-3eb0b491-9b50-43d7-8ba0-eaefa81d5f65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100287 Oct 02 01:12:33.310288 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1299/2749] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:33.323892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:33.329414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:33.344905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.345809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.348324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.355286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.358260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.358875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.450558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.468371 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81bb5432-6606-4586-84cb-21b01cc57ada tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.792589 Oct 02 01:12:33.474184 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1451/2750] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:32 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:33.490685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-171c8290-1694-443f-89f0-645e3a210c55 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:33.491305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-171c8290-1694-443f-89f0-645e3a210c55 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:33.533980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.552664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.560734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.573861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63063206-1558-4971-b38d-d91972079bcf tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.261966 Oct 02 01:12:33.577227 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1300/2751] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:33 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:33.600017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-707eb51e-18f1-482c-882e-22fb72d03005 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:33.641514 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-707eb51e-18f1-482c-882e-22fb72d03005 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.054104 Oct 02 01:12:33.642524 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1301/2752] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:12:33 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:33.657179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:33.659892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:33.677293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.678757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.679434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.680378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.681050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.681737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.692866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-171c8290-1694-443f-89f0-645e3a210c55 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:33.704544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-171c8290-1694-443f-89f0-645e3a210c55 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1208 microversion: 2.1 time: 0.228418 Oct 02 01:12:33.706134 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1452/2753] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:33 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1208 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:33.749471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0f6ee11e-06a5-4886-bbcd-2c0f1fa4e410 req-dc070416-1152-4880-9833-46b3a6f9441a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5159e837-6076-465b-9383-601745d7acb3", "name": "network-vif-deleted", "tag": "b91bce40-0ff7-4121-8b5d-41e3a6fd12e7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:33.754227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:12:33.784048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0f6ee11e-06a5-4886-bbcd-2c0f1fa4e410 req-dc070416-1152-4880-9833-46b3a6f9441a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.784570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0f6ee11e-06a5-4886-bbcd-2c0f1fa4e410 req-dc070416-1152-4880-9833-46b3a6f9441a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.785192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0f6ee11e-06a5-4886-bbcd-2c0f1fa4e410 req-dc070416-1152-4880-9833-46b3a6f9441a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.817783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0f6ee11e-06a5-4886-bbcd-2c0f1fa4e410 req-dc070416-1152-4880-9833-46b3a6f9441a service nova] Creating event network-vif-deleted:b91bce40-0ff7-4121-8b5d-41e3a6fd12e7 for instance 5159e837-6076-465b-9383-601745d7acb3 on n-h2-master-1 Oct 02 01:12:33.828389 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0f6ee11e-06a5-4886-bbcd-2c0f1fa4e410 req-dc070416-1152-4880-9833-46b3a6f9441a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120965 Oct 02 01:12:33.832017 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1453/2754] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:33.843005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:33.844387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:33.864100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.864737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.865351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.866785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.869062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.869512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.938486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-74feae1b-fc60-4a7e-ab1c-7f61cf5f1013 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 204 len: 0 microversion: 2.1 time: 0.294195 Oct 02 01:12:33.939963 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1302/2755] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:12:33 2022] DELETE /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:12:33.958006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-731d9494-84ba-4102-82ba-964a5994f6f8 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.007054 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-731d9494-84ba-4102-82ba-964a5994f6f8 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.063366 Oct 02 01:12:34.008584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1303/2756] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:34.023691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.031745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:34.054679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.057006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.059152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.060139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.061410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.064756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.291774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.301259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58394697-275e-4628-99a7-341aa296305e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1685 microversion: 2.1 time: 0.467838 Oct 02 01:12:34.305646 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1454/2757] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:33 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1685 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:34.310653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4aa53e56-51a5-4052-b026-ca8f98362645 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.330567 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4aa53e56-51a5-4052-b026-ca8f98362645 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023072 Oct 02 01:12:34.335877 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1455/2758] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:34.345116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.350256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:34.353572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.358143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.359038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.361977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.362946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.363572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.364154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.369485 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6519add-d526-4a2e-bd02-e69a2bd6918b tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1474 microversion: 2.1 time: 0.359347 Oct 02 01:12:34.375716 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1304/2759] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:34.390184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e8f182c-9f04-4bb4-b3a1-f1a92b633cc3 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.463517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e8f182c-9f04-4bb4-b3a1-f1a92b633cc3 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.085419 Oct 02 01:12:34.471921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1305/2760] 10.222.0.23 () {58 vars in 1165 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:34.484586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.495454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0fbff90-3f35-434a-9a9a-d64d77ce449c tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.508440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.512289 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0fbff90-3f35-434a-9a9a-d64d77ce449c tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021833 Oct 02 01:12:34.514302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.520178 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1306/2761] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:34.527109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.529257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3512458d-3b21-409f-b353-8b81dfed4101 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.192083 Oct 02 01:12:34.530181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:34.534650 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1456/2762] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:34.547045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a44b3b5-8f8f-445a-a4a4-565378bdfcad tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.547277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.548354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.549582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.552746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.553460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.554297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.613255 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a44b3b5-8f8f-445a-a4a4-565378bdfcad tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.076410 Oct 02 01:12:34.618046 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1457/2763] 10.222.0.23 () {58 vars in 1169 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:34.629120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.631295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:34.643711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.644640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.645296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.646379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.647097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.648430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.873856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.895012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.906169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:34.910285 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3aac91d8-7ab4-47f8-b36e-5b21d337b057 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.290567 Oct 02 01:12:34.911716 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1458/2764] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:34.916146 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:34.928549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6f4af5d6-940f-4bc9-8744-0f8a36083fd3 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.997734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6f4af5d6-940f-4bc9-8744-0f8a36083fd3 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.074436 Oct 02 01:12:34.999194 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1459/2765] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:35.024388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:35.030002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:35.087777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.088288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.088721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.102298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.149057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.152001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.156246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:35.169868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d19adce-03ba-40ba-abee-f4e0b4522a69 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 0.648207 Oct 02 01:12:35.178553 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1307/2766] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:35.200146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03f15331-607a-4de6-ae8d-57cbad107e39 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:35.262332 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03f15331-607a-4de6-ae8d-57cbad107e39 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.078828 Oct 02 01:12:35.268479 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1308/2767] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:35.299124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-964f33ec-1eaf-4abf-bf5d-ca9d6d59e539 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:35.370625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:35.400643 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f27aca05-574b-4a71-963f-13341c20042d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1204 microversion: 2.1 time: 0.386716 Oct 02 01:12:35.420098 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1460/2768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1204 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:35.441358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:35.443125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:35.490897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.492065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.497455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.499304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.504312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.505019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.531734 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-964f33ec-1eaf-4abf-bf5d-ca9d6d59e539 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.254195 Oct 02 01:12:35.538422 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1309/2769] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:12:35 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:35.551432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:35.566542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:35.594757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.597253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.599206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.606752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.607768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.608414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.379060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:36.388937 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf1922ea-a567-4510-a91f-bb800f821214 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1474 microversion: 2.1 time: 0.849145 Oct 02 01:12:36.414415 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1310/2770] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:35 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1474 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:36.421807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d9701cd-d5b5-4f42-81f5-0af5aaf13a3a tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:36.448754 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d9701cd-d5b5-4f42-81f5-0af5aaf13a3a tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032763 Oct 02 01:12:36.471960 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1311/2771] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:36.486877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:36.496715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:36.519062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.535950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.536577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.537457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.538040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.538578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.659728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:36.690272 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9999b1a4-49e1-49c9-bb0c-be570bc9e9ea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 1.266886 Oct 02 01:12:36.698935 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1461/2772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:35 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:36.713799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4af5b069-2323-4e97-8c8c-acc1d9162af1 req-4743367f-c7d1-45c4-965e-2939ddd72507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5159e837-6076-465b-9383-601745d7acb3", "name": "network-vif-unplugged", "status": "completed", "tag": "b91bce40-0ff7-4121-8b5d-41e3a6fd12e7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:36.743292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4af5b069-2323-4e97-8c8c-acc1d9162af1 req-4743367f-c7d1-45c4-965e-2939ddd72507 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.748590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4af5b069-2323-4e97-8c8c-acc1d9162af1 req-4743367f-c7d1-45c4-965e-2939ddd72507 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.749183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4af5b069-2323-4e97-8c8c-acc1d9162af1 req-4743367f-c7d1-45c4-965e-2939ddd72507 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.787613 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4af5b069-2323-4e97-8c8c-acc1d9162af1 req-4743367f-c7d1-45c4-965e-2939ddd72507 service nova] Creating event network-vif-unplugged:b91bce40-0ff7-4121-8b5d-41e3a6fd12e7 for instance 5159e837-6076-465b-9383-601745d7acb3 on n-h2-master-1 Oct 02 01:12:36.812750 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4af5b069-2323-4e97-8c8c-acc1d9162af1 req-4743367f-c7d1-45c4-965e-2939ddd72507 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112140 Oct 02 01:12:36.814898 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1462/2773] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:36.835341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:36.847281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:36.851804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:36.852827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:36.858675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:36.869650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.876248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.877464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.881553 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-128e2fbf-1c82-41e0-b26e-adbeddc0362f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.408234 Oct 02 01:12:36.882885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.883521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.899813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.902674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1312/2774] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:36 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:36.925667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:36.940094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:36.953035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.953859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.957644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.964200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.965078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.969606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.981740 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:37.211407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:37.221975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:37.223473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:37.233713 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6074409e-5936-4189-8e7b-1fd109d44440 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.405797 Oct 02 01:12:37.253983 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1463/2775] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:36 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:37.264590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:37.266791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:37.308560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:37.309355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:37.309953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:37.310865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:37.315336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:37.316144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:37.762058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:37.774721 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5bf96533-4be9-4804-be11-2f9ff5d00f03 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1266 microversion: 2.1 time: 0.519395 Oct 02 01:12:37.775740 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1464/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:37 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1266 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:37.801194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4442ec7c-640b-48df-bae5-5ec314a64b9d tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:37.892630 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4442ec7c-640b-48df-bae5-5ec314a64b9d tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.107681 Oct 02 01:12:37.904219 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1465/2777] 10.222.0.23 () {58 vars in 1144 bytes} [Sun Oct 2 01:12:37 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:37.931674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:37.936919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:37.976927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:37.977914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:37.979743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:37.980739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:37.983332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:37.988301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:38.199207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:38.231257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87a0a139-a7d4-47e5-a5de-7fa4da0d60e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1735 microversion: 2.1 time: 1.312195 Oct 02 01:12:38.232790 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1313/2778] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:36 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1735 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:38.260251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:38.269481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:38.284032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:38.287468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:38.290965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:38.292062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:38.292724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:38.293442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:38.802014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daade8c46ae44a4b81bafa442b6037f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:38.819876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a41cc9c5-0266-4d1a-a64f-9ad4cb18c686 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 200 len: 1474 microversion: 2.1 time: 0.909904 Oct 02 01:12:38.820504 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1466/2779] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:37 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 1474 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:38.846144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6053ae68-690f-4003-8181-c6443d07fb69 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:38.892615 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6053ae68-690f-4003-8181-c6443d07fb69 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062228 Oct 02 01:12:38.911526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1467/2780] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:38.929708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:38.930699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:38.985515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:38.986842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:38.988762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:38.995162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:38.995871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:39.004387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:39.027104 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:39.495459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:39.507041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab2ba1e2-f52a-4c2e-a4d2-228797624596 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 1.258507 Oct 02 01:12:39.515960 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1314/2781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:38 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:39.521409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:39.522036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:39.568865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:39.574835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:39.576049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:39.583439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:39.584219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:39.584905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:40.442427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:40.470097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:40.473987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:40.495983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-74a068b7-ed58-474e-afdb-fa4681dc48cd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 1.578329 Oct 02 01:12:40.520300 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1468/2782] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:38 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:40.542249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:40.547411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:40.574987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:40.575676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:40.576124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:40.576836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:40.577303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:40.577716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:40.676976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:40.697934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:40.704016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:40.715198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee216645-dd4c-4130-b9bf-5213d029c735 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 1.197947 Oct 02 01:12:40.736575 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1315/2783] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:39 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:40.769024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-52877100-3135-4775-b79c-c597bc7165ab req-5087058f-3332-41f7-ac3b-6c1aed9c6822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2febfa-f50f-4a0e-9af7-f538ac10c2d1", "name": "network-vif-deleted", "tag": "c924a27e-7d51-4918-98ab-125e09734ef4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:40.821841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-52877100-3135-4775-b79c-c597bc7165ab req-5087058f-3332-41f7-ac3b-6c1aed9c6822 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:40.824262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-52877100-3135-4775-b79c-c597bc7165ab req-5087058f-3332-41f7-ac3b-6c1aed9c6822 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:40.824836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-52877100-3135-4775-b79c-c597bc7165ab req-5087058f-3332-41f7-ac3b-6c1aed9c6822 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:40.894379 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-52877100-3135-4775-b79c-c597bc7165ab req-5087058f-3332-41f7-ac3b-6c1aed9c6822 service nova] Creating event network-vif-deleted:c924a27e-7d51-4918-98ab-125e09734ef4 for instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 on n-h1-master-1 Oct 02 01:12:40.924709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-52877100-3135-4775-b79c-c597bc7165ab req-5087058f-3332-41f7-ac3b-6c1aed9c6822 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181874 Oct 02 01:12:40.948096 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1316/2784] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:40.979345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4588d056-e6ec-4a0d-8290-3b98f23817a2 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:41.081173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4588d056-e6ec-4a0d-8290-3b98f23817a2 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.131183 Oct 02 01:12:41.091757 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1317/2785] 10.222.0.23 () {58 vars in 1148 bytes} [Sun Oct 2 01:12:40 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:41.107366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:41.109145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:41.134969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.135739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.136349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.137259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.143473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.144260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.201120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:41.210366 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a0bc557-b808-49a4-b1ee-10e3ba85ad94 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.687392 Oct 02 01:12:41.210996 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1469/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:40 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:41.233811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:41.249974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] [instance: 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:41.279634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.281640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.283536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.284479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.285813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.287147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.341269 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] HTTP exception thrown: Instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 could not be found. Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Request method failure captured: Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 HTTP/1.1 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVM7Evt0o7TUAoDUZbnRH-QuNsanmWjwOqqGGtabDL6v7LQPnX1s66xCvX1gTY8EhDm5SHPdT0FqeOR4FvlyflEALS1Nsly5PPcd2cjmqw-fhy48YSYIk7Fjms5yppz1PSn9AAEz05jYG0etao5oZGNWcEj3V7ORT74_iEiAQacdiE Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d565120ddfb84f22ad17d8dd0f9c35fa Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-LiveMigrationNegativeTest-534466989 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d565120ddfb84f22ad17d8dd0f9c35fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d565120ddfb84f22ad17d8dd0f9c35fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d565120ddfb84f22ad17d8dd0f9c35fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d565120ddfb84f22ad17d8dd0f9c35fa"}]}] Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-LiveMigrationNegativeTest-534466989 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d565120ddfb84f22ad17d8dd0f9c35fa Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-534466989 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-LiveMigrationNegativeTest-534466989-project Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: daade8c46ae44a4b81bafa442b6037f4 Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-LiveMigrationNegativeTest-534466989-project Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 could not be found. Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7e2febfa-f50f-4a0e-9af7-f538ac10c2d1'} Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 could not be found. Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 could not be found. Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:41.347721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 could not be found. Oct 02 01:12:41.353374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:12:41.355535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] Returning 404 to user: Instance 7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:41.359652 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed1fdb29-8852-44c8-a0a3-d9a970bb1193 tempest-LiveMigrationNegativeTest-534466989 tempest-LiveMigrationNegativeTest-534466989-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1" status: 404 len: 111 microversion: 2.1 time: 0.132230 Oct 02 01:12:41.372318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1470/2787] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:41 2022] GET /compute/v2.1/servers/7e2febfa-f50f-4a0e-9af7-f538ac10c2d1 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:41.385296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8e123af2-91a1-4629-9eb2-57befd186c6b req-8449c804-f546-40fa-a3de-4be5e3e166f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-plugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:41.412846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e123af2-91a1-4629-9eb2-57befd186c6b req-8449c804-f546-40fa-a3de-4be5e3e166f4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.415010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e123af2-91a1-4629-9eb2-57befd186c6b req-8449c804-f546-40fa-a3de-4be5e3e166f4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.421636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e123af2-91a1-4629-9eb2-57befd186c6b req-8449c804-f546-40fa-a3de-4be5e3e166f4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.454933 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8e123af2-91a1-4629-9eb2-57befd186c6b req-8449c804-f546-40fa-a3de-4be5e3e166f4 service nova] Creating event network-vif-plugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:12:41.471775 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8e123af2-91a1-4629-9eb2-57befd186c6b req-8449c804-f546-40fa-a3de-4be5e3e166f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096759 Oct 02 01:12:41.478327 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1471/2788] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:41.495915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:41.497766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:41.511122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.513032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.513674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.514726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.515367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.515951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:42.472065 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:42.523933 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:42.567828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:42.586998 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-98b0dc88-28ae-47ef-bd01-0e7696104a46 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 1.103217 Oct 02 01:12:42.588021 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1472/2789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:41 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:42.588939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:42.596698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b4814b8-d10b-4f38-8913-a50cb4a0452b tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:42.598840 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bec19e73-8f10-4718-bbcb-9e861e45b48a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1715 microversion: 2.1 time: 1.505726 Oct 02 01:12:42.599426 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1318/2790] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:41 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1715 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:42.640894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:42.647418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:42.659569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b4814b8-d10b-4f38-8913-a50cb4a0452b tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.064970 Oct 02 01:12:42.662345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:42.663824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:42.665681 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1473/2791] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 2 01:12:42 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:42.666375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:42.669337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:42.669902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:42.670408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:42.676491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:42.677996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:42.689002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:42.690438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:42.691068 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:42.691989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:42.692596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:42.693174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:42.977035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:42.988558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:42.989031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:42.990715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:43.004158 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bb66d42-ac6f-477a-a6f7-7f310463cb1e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.390703 Oct 02 01:12:43.015793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:43.022407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:43.025824 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2bf0613b-5908-4563-977e-e3510296bb0b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.358197 Oct 02 01:12:43.030548 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1474/2792] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:42 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:43.033018 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1319/2793] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:42 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:43.048141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:43.050204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-692cedc8-23dc-41ad-9d8d-113b7dfa167e tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:43.053745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:43.072196 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-692cedc8-23dc-41ad-9d8d-113b7dfa167e tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036836 Oct 02 01:12:43.075934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.077398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.082342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.086001 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1320/2794] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:43.088284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.088793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.090399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.106233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:43.108165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:43.129498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.138367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.138846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.139815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.140441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.141035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.695100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:43.700397 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:43.724038 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da4d95ef-9700-4631-bb0a-635551ba96f0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.688698 Oct 02 01:12:43.743602 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1475/2795] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:43 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:43.755838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42d4f804-cd34-4762-9e86-f278834b27f9 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:43.909718 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-42d4f804-cd34-4762-9e86-f278834b27f9 tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.163251 Oct 02 01:12:43.919838 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1476/2796] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:12:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:43.932284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:43.935132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:43.961879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.962458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.962929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.963667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.964131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.964564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:44.425669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:44.441276 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-214e8052-1ad5-439c-8e5c-51f20712527a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.523961 Oct 02 01:12:44.442236 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1477/2797] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:43 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:44.453709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-33b57720-ade9-4b42-811a-75875ce6d2cd tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:44.519168 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-33b57720-ade9-4b42-811a-75875ce6d2cd tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069867 Oct 02 01:12:44.531979 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1478/2798] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:12:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:44.541465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:44.542469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:44.549895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:44.550670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:44.551751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:44.553482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:44.554323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:44.555058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:44.760049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:44.770553 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:44.777180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:44.790265 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a89898bd-0a55-44bd-8014-2b47e835c52d tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.256534 Oct 02 01:12:44.807237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1479/2799] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:44 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:44.818156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:44.819076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:44.826725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:44.827725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:44.828330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:44.829213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:44.829862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:44.831166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:45.141608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:45.141608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:45.141608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:45.141608 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fdca16a9-b782-4d4c-af31-a9902b27e2ad tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.317401 Oct 02 01:12:45.141608 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1480/2800] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:44 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:45.159358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e6eb59ac-b2fd-4f04-aac3-63885536a34d tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:45.169579 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e6eb59ac-b2fd-4f04-aac3-63885536a34d tempest-FlavorsV2TestJSON-1255529886 tempest-FlavorsV2TestJSON-1255529886-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040906 Oct 02 01:12:45.170868 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1481/2801] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:12:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:45.176641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:45.178984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:45.185881 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:45.189900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:45.190770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:45.191483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:45.192429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:45.193161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:45.193824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:45.871003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:45.881704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa2a281e-363c-4b14-b50c-a646d43b5d7d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.709432 Oct 02 01:12:45.895337 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1482/2802] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:45 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:45.895337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9a0251a6-ccf9-42d3-9338-674f87e5a156 req-98ff5b5c-6832-4348-a0dd-f16195ff1f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4164649-d919-44dd-8130-9f16db3e4dd2", "tag": "bda80aba-707d-4dbd-b83e-c0c24b3fa477"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:45.932201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9a0251a6-ccf9-42d3-9338-674f87e5a156 req-98ff5b5c-6832-4348-a0dd-f16195ff1f42 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:45.932691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9a0251a6-ccf9-42d3-9338-674f87e5a156 req-98ff5b5c-6832-4348-a0dd-f16195ff1f42 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:45.933130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9a0251a6-ccf9-42d3-9338-674f87e5a156 req-98ff5b5c-6832-4348-a0dd-f16195ff1f42 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:46.549716 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9a0251a6-ccf9-42d3-9338-674f87e5a156 req-98ff5b5c-6832-4348-a0dd-f16195ff1f42 service nova] Creating event network-changed:bda80aba-707d-4dbd-b83e-c0c24b3fa477 for instance b4164649-d919-44dd-8130-9f16db3e4dd2 on n-h1-master-1 Oct 02 01:12:46.555301 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9a0251a6-ccf9-42d3-9338-674f87e5a156 req-98ff5b5c-6832-4348-a0dd-f16195ff1f42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.667039 Oct 02 01:12:46.556087 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1483/2803] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:46.587169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:46.589975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:46.606450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:46.610461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:46.613377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:46.614186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:46.614731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:46.615175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.017777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.062349 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eb4e7d21-ffa6-4c99-8782-f709ec0f5fd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.498514 Oct 02 01:12:47.063201 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1484/2804] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:46 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:47.091892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:47.096975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:47.116183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.119257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.119925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.123563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.127584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.129617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.305108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.324365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.334640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.367800 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-630d1b30-dd8c-4f53-b158-9324188847c4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.285180 Oct 02 01:12:47.369035 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1485/2805] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:47 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:47.392835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:47.397547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:47.419096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.428601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.431254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.433549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.434039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.434486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.721843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.732267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.752588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:47.768109 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bd63ee72-3f4b-413c-a26c-8d98fe94b8fa tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.396344 Oct 02 01:12:47.773861 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1486/2806] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:47 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:47.795088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:47.804558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:47.829364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.831383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.833134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.841290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.841811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.842407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:48.303148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:48.319328 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d8f714b-155d-4c1f-828e-578712e2274d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.544232 Oct 02 01:12:48.319944 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1487/2807] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:47 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:48.336912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:48.337473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:48.354114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:48.354642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:48.355098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:48.355823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:48.356282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:48.356715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:49.905838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:49.925505 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e99243b3-3497-4ad8-9bef-dedb065def0f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 1.602754 Oct 02 01:12:49.927307 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1488/2808] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:48 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:49.945740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:49.946386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:49.970113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:49.975418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:49.976620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:49.977803 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:49.978552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:49.979372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:50.175097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:50.190034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:50.191574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:50.218827 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2212d8a-aff0-44eb-a0dd-48802cc980b7 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.290350 Oct 02 01:12:50.219949 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1489/2809] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:49 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:50.248542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:50.253321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:50.277844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:50.286102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:50.287047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:50.287972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:50.288787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:50.289371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:50.671937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:50.675106 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:50.694558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:50.698412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c8a46a0556407f9956cbd1ffd75c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6dd9c628eb4be5b48c28a1192e16c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:50.702199 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46261972-a7c8-47b4-805e-8c76658ebf4b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 200 len: 1603 microversion: 2.42 time: 0.473775 Oct 02 01:12:50.735664 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1490/2810] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:50 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 1603 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:50.754584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:50.757469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:50.781752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:50.782215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:50.782693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:50.789487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:50.790658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:50.791460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.202063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:51.219618 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2224537a-ed92-4b88-90c6-158e055a450f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.480217 Oct 02 01:12:51.220757 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1491/2811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:50 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:51.405951 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Cannot 'detach_volume' instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d while it is in vm_state rescued Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments/c0413a29-556c-4578-8f60-e0d7d4fba505 HTTP/1.1 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'detach_volume' instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d while it is in vm_state rescued Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '481845ee-ce3d-4b19-95a4-4eeda0435f4d', 'id': 'c0413a29-556c-4578-8f60-e0d7d4fba505'} Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d while it is in vm_state rescued Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:51.411341 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:51.416872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:51.416872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:51.416872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:51.416872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:51.416872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d while it is in vm_state rescued Oct 02 01:12:51.416872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:51.424215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 409 to user: Cannot 'detach_volume' instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d while it is in vm_state rescued {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:51.425559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3f334f4-ec12-4319-8aec-cf7b3312ac15 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments/c0413a29-556c-4578-8f60-e0d7d4fba505" status: 409 len: 152 microversion: 2.1 time: 8.338298 Oct 02 01:12:51.432198 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1321/2812] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:12:43 2022] DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments/c0413a29-556c-4578-8f60-e0d7d4fba505 => generated 152 bytes in 8345 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:12:51.438100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:51.438985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:51.447519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.448255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.448843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.449975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.450581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.451182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.544572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c14f8d6-55a8-4586-a385-5d934f262f80 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '.version_select at 0x7fb880798af0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:51.719231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:51.737404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c14f8d6-55a8-4586-a385-5d934f262f80 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af" status: 200 len: 371 microversion: 2.1 time: 0.494502 Oct 02 01:12:51.747187 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-425fd338-c2ea-4ec5-9760-6293c87c7a4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.304895 Oct 02 01:12:51.748372 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1492/2813] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:12:51 2022] GET /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af => generated 371 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:51.750200 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1322/2814] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:51 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:51.755468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:51.756353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:51.763249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:51.764092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:51.776520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.791284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.792122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.798402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.799203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.803612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.807543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.808197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.809054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.809974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.811054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.811962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.984603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:52.051829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2fc376c9-4d9f-4c05-96c0-e9e33e8b0ba3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/action" status: 202 len: 0 microversion: 2.1 time: 0.300052 Oct 02 01:12:52.052718 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1323/2815] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:12:51 2022] POST /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:12:52.058692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.060433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:52.068398 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:52.078185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:52.081494 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:52.083780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.086000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.086776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.091229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.092086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.092917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.123101 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8083aa9a-46ee-4ecb-9245-6b6ea5ac5d7e tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.364614 Oct 02 01:12:52.128446 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1493/2816] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:51 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:52.149262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Action: 'update', calling method: .version_select at 0x7fb880798160>, body: {"quota_set": {"ram": "5120"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:52.181747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] HTTP exception thrown: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Request method failure captured: Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 HTTP/1.1 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOPvx7JGuN3aYKDOJt6gciNSJt0a5CcS89Epdo1SfJAXq5_tq8dk2Wz2l8-n0zh99i2Kv9cbkpKGpCcK07nz7Ng_mI0h4uP2PVKFhxL-6gBvMvRg-Eq0h8lJLxhu1JMsizBrfL1UcTdBty22CK_H0-WqKoutJzAG0RnNXSwTDOW4FH4 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.42 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b6dd9c628eb4be5b48c28a1192e16c1 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b6dd9c628eb4be5b48c28a1192e16c1"}]}] Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b6dd9c628eb4be5b48c28a1192e16c1 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TaggedBootDevicesTest_v242-1023674894-project Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c4c8a46a0556407f9956cbd1ffd75c7e Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1023674894-project Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0e6528b7-91d7-4dde-b95a-5520c5cd6c26'} Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:52.186039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:12:52.193120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Returning 404 to user: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:12:52.194232 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97de318c-ebb4-4742-aad6-5f3c594c0537 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 404 len: 111 microversion: 2.42 time: 0.139061 Oct 02 01:12:52.198312 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1324/2817] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:52 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:12:52.215228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.218071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:52.233871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.234370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.234834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.238827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.240442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.241458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.325312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.327336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.328343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.329370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.330639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.331303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.461733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ccd98ce-9b5c-493f-a78f-d33981e65328 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af" status: 200 len: 328 microversion: 2.1 time: 0.330192 Oct 02 01:12:52.465597 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1494/2818] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:12:52 2022] PUT /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af => generated 328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:52.479905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2bc1998-6b77-4124-9ecd-41f8b39c894b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '.version_select at 0x7fb8807603a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.523642 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2bc1998-6b77-4124-9ecd-41f8b39c894b tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85429138" status: 204 len: 0 microversion: 2.42 time: 0.056789 Oct 02 01:12:52.527616 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1495/2819] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85429138 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:12:52.531732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.531732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:52.546455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.547187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.550157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.551917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.553027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.557839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.775998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:52.790012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-499660f6-ea8b-4044-957e-6e9d854fe28a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1723 microversion: 2.1 time: 0.587918 Oct 02 01:12:52.795768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1325/2820] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:52 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:52.809619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56abaef5-256f-4ed1-b7ab-37570fc4ead0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.856615 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56abaef5-256f-4ed1-b7ab-37570fc4ead0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af" status: 202 len: 0 microversion: 2.1 time: 0.059289 Oct 02 01:12:52.857821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1326/2821] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:12:52 2022] DELETE /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:12:52.869400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.872876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:52.899602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.900503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.901214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.902342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.904102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.908828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:53.202752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:53.211644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-676af54c-d3a7-4d0e-b891-f30835435536 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.686014 Oct 02 01:12:53.214959 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1496/2822] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:52 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:53.227966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8657ae43-9f3d-4dc0-a931-f0df0d4784f2 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '.version_select at 0x7fb8807583a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:53.402711 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8657ae43-9f3d-4dc0-a931-f0df0d4784f2 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af" status: 200 len: 371 microversion: 2.1 time: 0.186522 Oct 02 01:12:53.405164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1497/2823] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:12:53 2022] GET /compute/v2.1/os-quota-sets/a813c098daec4a96a86d76386e0b81af => generated 371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:53.439172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:53.441019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:53.450223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:53.457267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:53.463053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:53.472876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:53.473562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:53.474207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:53.761768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:53.781873 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-98abdb9b-ec03-4af6-a712-f3e506c956c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.922493 Oct 02 01:12:53.788146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1327/2824] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:52 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:53.815176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-180a107f-4811-4b42-b2fa-82d1d84d0403 req-28115ff8-0152-4e7c-bd6b-cbe74501f29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4164649-d919-44dd-8130-9f16db3e4dd2", "name": "network-vif-plugged", "status": "completed", "tag": "bda80aba-707d-4dbd-b83e-c0c24b3fa477"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:53.880937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-180a107f-4811-4b42-b2fa-82d1d84d0403 req-28115ff8-0152-4e7c-bd6b-cbe74501f29f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:53.881724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-180a107f-4811-4b42-b2fa-82d1d84d0403 req-28115ff8-0152-4e7c-bd6b-cbe74501f29f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:53.882323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-180a107f-4811-4b42-b2fa-82d1d84d0403 req-28115ff8-0152-4e7c-bd6b-cbe74501f29f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:53.917888 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-180a107f-4811-4b42-b2fa-82d1d84d0403 req-28115ff8-0152-4e7c-bd6b-cbe74501f29f service nova] Creating event network-vif-plugged:bda80aba-707d-4dbd-b83e-c0c24b3fa477 for instance b4164649-d919-44dd-8130-9f16db3e4dd2 on n-h1-master-1 Oct 02 01:12:53.934850 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-180a107f-4811-4b42-b2fa-82d1d84d0403 req-28115ff8-0152-4e7c-bd6b-cbe74501f29f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132121 Oct 02 01:12:53.936629 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1328/2825] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:53.954470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-433c8ae9-68a7-433c-a40f-44f7ae494f50 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '.version_select at 0x7fb880b0e8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:54.201995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:54.229681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:54.234611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:54.255058 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-51fb3cc1-c100-48ca-95ab-eaf7609f0a45 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.841401 Oct 02 01:12:54.256504 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1498/2826] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:53 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:54.273659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:54.275934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:54.289931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:54.292105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:54.294747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:54.295764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:54.296974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:54.301093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:54.570520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-433c8ae9-68a7-433c-a40f-44f7ae494f50 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe/defaults" status: 200 len: 371 microversion: 2.1 time: 0.632408 Oct 02 01:12:54.574400 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1329/2827] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:12:53 2022] GET /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe/defaults => generated 371 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:54.597053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:54.601579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:54.618275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:54.620998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:54.629781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:54.632103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:54.634423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:54.635051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:55.317707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:55.328572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-602bad89-e6c4-4b52-a036-854ff10e8d70 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.752788 Oct 02 01:12:55.346803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1330/2828] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:54 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:55.369220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:55.389136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:55.391718 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5db57ae8-3be4-452d-987f-7a7fd2a38d56 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1723 microversion: 2.1 time: 1.133650 Oct 02 01:12:55.429783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:55.457324 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1499/2829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:54 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1723 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:55.496717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Action: 'update', calling method: .version_select at 0x7fb880711940>, body: {"quota_set": {"ram": "5120"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:55.504137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:55.510171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:55.510829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:55.511884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:55.519603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:55.527165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:55.877116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:55.882720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:55.883492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:55.885317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:55.885873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:55.886425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.010800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:56.022447 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ff96e5d-239a-4f84-a443-bd617f4a3ee2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.659035 Oct 02 01:12:56.024308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1331/2830] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:55 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:56.030815 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-01f1f585-364b-43dd-83bf-34f36b21deeb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33" status: 200 len: 328 microversion: 2.1 time: 0.571818 Oct 02 01:12:56.034045 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1500/2831] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:12:55 2022] PUT /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33 => generated 328 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:56.043853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:56.047458 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '.version_select at 0x7fb88072dca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:56.053424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:56.086660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.088584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.089751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.092832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.098162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.102640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.225788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.226307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.227934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.231874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.247108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.249840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.328616 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-acad389d-dfad-4d4f-a56e-7c77bdbb614c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33/detail" status: 200 len: 916 microversion: 2.1 time: 0.280849 Oct 02 01:12:56.329221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1501/2832] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:12:56 2022] GET /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33/detail => generated 916 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:56.335881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:56.344915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:56.353604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:56.365287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:56.365928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:56.369500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f62790c-f6c7-4da7-b32c-64457c9ae565 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.342054 Oct 02 01:12:56.376446 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1332/2833] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:56 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:56.418153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.442755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.443403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.444175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.444655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.445086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.459608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:56.460231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:56.473974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.477639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.480654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.481588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.482217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.486745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.160701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:57.176991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13cbe8c2-a736-4bda-8b3c-c4906f63f56a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1308 microversion: 2.1 time: 0.819877 Oct 02 01:12:57.178174 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1502/2834] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:56 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:12:57.193745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Action: 'update', calling method: .version_select at 0x7fb88077e430>, body: {"quota_set": {"ram": "2048"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:57.310408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:57.322884 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-973e257c-08d3-4a6d-b1a2-65f07d11e385 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1723 microversion: 2.1 time: 0.867709 Oct 02 01:12:57.341364 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1333/2835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:56 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1723 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:12:57.352482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:57.352708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:57.377886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.378429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.379154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.380028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.380484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.380828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.381238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.381703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.382127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.382455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.384496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.385124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.520652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.521224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.521553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.532549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.533721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.540604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.647953 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:57.713282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:57.717700 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:57.727885 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03cc507e-b59c-47bb-b15b-ead2f3a586c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.385351 Oct 02 01:12:57.742623 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1334/2836] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:57 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:57.750830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:57.751462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:57.759953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.761985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.762583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.763858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.764436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.765626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.785097 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-19676f7a-81e4-49d7-990e-63446a6a34c8 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33?user_id=64d757fc80fe46fb829870edabeed2cc" status: 200 len: 328 microversion: 2.1 time: 0.605501 Oct 02 01:12:57.785878 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1503/2837] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:12:57 2022] PUT /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33?user_id=64d757fc80fe46fb829870edabeed2cc => generated 328 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:57.798135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae2f6aa8-0680-4721-8568-80b21e6e3657 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '.version_select at 0x7fb880711160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:57.868110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:57.882246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:57.884373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:57.897133 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3fc1e26c-6e3f-4750-ade3-9969ecbac033 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1553 microversion: 2.91 time: 0.161230 Oct 02 01:12:57.912568 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1335/2838] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:57 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:57.937575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae2f6aa8-0680-4721-8568-80b21e6e3657 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33?user_id=64d757fc80fe46fb829870edabeed2cc" status: 200 len: 370 microversion: 2.1 time: 0.143054 Oct 02 01:12:57.938837 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1504/2839] 10.222.0.23 () {58 vars in 1323 bytes} [Sun Oct 2 01:12:57 2022] GET /compute/v2.1/os-quota-sets/c4de1add8ea74350b8c11b9e50d29a33?user_id=64d757fc80fe46fb829870edabeed2cc => generated 370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:58.206841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:58.207762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:58.226305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:58.226843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:58.236196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:58.241116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:58.246408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:58.247989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:58.350759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:58.352270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:58.380814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:58.383037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:58.383855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:58.388696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:58.390827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:58.393866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.220555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:59.230424 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab6f7cfd-27e4-4500-952b-d09f56ef3a7c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1488 microversion: 2.1 time: 1.029560 Oct 02 01:12:59.237827 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1336/2840] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:58 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1488 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:59.242937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77ccf373-e550-4f15-9ff0-986d2036cbd2 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Calling method '.version_select at 0x7fb880b0e820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:59.323089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:59.332634 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-731339fa-f63d-4860-9afb-d9a4a30bda8d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1729 microversion: 2.1 time: 0.987843 Oct 02 01:12:59.336256 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1505/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:58 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1729 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:59.341047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:59.341703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:59.355482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.356017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.361909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.362830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.363319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.363766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.650654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:59.666980 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-422bd769-cb52-42cb-9b86-f06e97151912 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.329156 Oct 02 01:12:59.669103 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1506/2842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:12:59 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:12:59.676199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:59.677073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:59.684179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.685472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.693526 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77ccf373-e550-4f15-9ff0-986d2036cbd2 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe/defaults" status: 200 len: 371 microversion: 2.1 time: 0.454240 Oct 02 01:12:59.695277 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1337/2843] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:12:59 2022] GET /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe/defaults => generated 371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:59.695739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.698679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.701397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.702053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.721926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85ca4bb6-9c53-4e74-bf42-93f6857ac636 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:12:59.742154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ca4bb6-9c53-4e74-bf42-93f6857ac636 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.745611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ca4bb6-9c53-4e74-bf42-93f6857ac636 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.746286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ca4bb6-9c53-4e74-bf42-93f6857ac636 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.879898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:59.894532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:59.897840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:12:59.912779 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-08f271cb-2268-4941-a149-07f906529b24 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1535 microversion: 2.91 time: 0.242371 Oct 02 01:12:59.931668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1507/2844] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:12:59 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1535 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:12:59.951906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:59.952560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:59.967518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.970686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85ca4bb6-9c53-4e74-bf42-93f6857ac636 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Going to try to stop instance {{(pid=122354) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:12:59.972116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.972851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.975659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.976368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.979459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.113721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85ca4bb6-9c53-4e74-bf42-93f6857ac636 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.416513 Oct 02 01:13:00.114700 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1338/2845] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:12:59 2022] POST /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:13:00.126172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Action: 'update', calling method: .version_select at 0x7fb88119b160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:00.206031 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c397c6a4-c9bf-41d0-b426-e462a8030539 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272862 Oct 02 01:13:00.207798 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1508/2846] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:12:59 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:00.213619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:00.215133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:00.232869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.233445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.233805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.234576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.235361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.235986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.303822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.317134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.326528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.329691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.329691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.343128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.624081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:00.640938 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72343ad9-353c-4028-869a-d8de3b4b2f30 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.431668 Oct 02 01:13:00.648757 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1509/2847] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:00 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:00.697197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:00.698142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:00.718564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.718946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.719601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.725169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.727309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.728981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.083562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-818d9c1b-b6db-4304-9573-4e4d50df00c0 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe" status: 200 len: 329 microversion: 2.1 time: 0.966974 Oct 02 01:13:01.085231 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1339/2848] 10.222.0.23 () {60 vars in 1263 bytes} [Sun Oct 2 01:13:00 2022] PUT /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe => generated 329 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:01.122591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:01.125475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:01.153347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:01.153847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:01.154294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.155304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:01.155774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:01.156208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.450647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:01.468593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:01.469896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:01.506036 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-568392fc-8f8d-45c9-bb15-58174f91c650 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1538 microversion: 2.91 time: 0.390842 Oct 02 01:13:01.550775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1340/2849] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:01 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1538 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:01.559904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Action: 'update', calling method: .version_select at 0x7fb881284b80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:01.738513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:01.763564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:01.767088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:01.767700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7add5e70-1c6c-4077-8155-d0514dcb3f24 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 1.074364 Oct 02 01:13:01.769278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.771895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:01.775164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1510/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:00 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:01.776365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:01.777372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.792099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:01.813228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:01.826715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:01.828704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:01.829168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.829918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:01.831322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:01.831772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:01.921916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=122355) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:13:02.070481 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-319d7eb0-8c57-4634-9050-8cf7ef12a397 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action" status: 202 len: 0 microversion: 2.91 time: 0.293549 Oct 02 01:13:02.073607 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1511/2851] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:13:01 2022] POST /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:13:02.088349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:02.091658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:02.091906 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:INSERT=18,nova_api:UPDATE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:02.107832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:02.108989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:02.111111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:02.113305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:02.114088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:02.114712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:02.146068 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:02.562847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0f1a6c9-0a8c-4c32-b76c-d1ba707a8f7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe" status: 200 len: 329 microversion: 2.1 time: 1.009647 Oct 02 01:13:02.571621 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1341/2852] 10.222.0.23 () {60 vars in 1263 bytes} [Sun Oct 2 01:13:01 2022] PUT /compute/v2.1/os-quota-sets/e90c45c027914ec6bdb0aafec3d30fbe => generated 329 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:02.579003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:02.584776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:02.602543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:02.605630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:02.605630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:02.605630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:02.605630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:02.605630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:03.106836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:03.127038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:03.141632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:03.162825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-526bb0ed-911b-481c-a6bd-66f0515f2d32 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1486 microversion: 2.91 time: 0.589205 Oct 02 01:13:03.163690 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1342/2853] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:02 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1486 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:03.170294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:03.175493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:03.189138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:03.190914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:03.198959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:03.201628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:03.207275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:03.208202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:03.404966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:03.414558 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46ca4673-9a7e-4ae8-ac15-c25fb3e3a2e8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 1.338964 Oct 02 01:13:03.415533 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1512/2854] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:02 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:03.710009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:03.718262 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9384af17-11af-4495-8f80-536060aa461d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.553318 Oct 02 01:13:03.737984 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1343/2855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:03 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:04.198703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:04.199310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:04.210899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.211439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.211890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.212608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.213069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.213495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.286667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4560627f-10e0-4eb3-8610-010e674a56e3 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Calling method '.version_select at 0x7fb880711550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:04.538897 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4560627f-10e0-4eb3-8610-010e674a56e3 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.527133 Oct 02 01:13:04.539773 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1513/2856] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:13:04 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:13:04.544711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:04.545424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:04.548588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:04.570878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:04.573175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:04.584023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.584772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.585480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.588754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.590273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.593095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.601900 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b0b31de-34d6-43bc-84cd-151f78177aa2 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1486 microversion: 2.91 time: 0.406294 Oct 02 01:13:04.614982 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1344/2857] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:04 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1486 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:04.623012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3897fdae-0de3-46ad-a319-63c827f2db70 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Action: 'create', calling method: .version_select at 0x7fb880a43ca0>, body: {"pool": "non_exist_pool"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:04.740040 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3897fdae-0de3-46ad-a319-63c827f2db70 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] HTTP exception thrown: Floating IP pool not found. Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3897fdae-0de3-46ad-a319-63c827f2db70 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Request method failure captured: Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 26 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOWf-nelhAVAdPv2qeSOVWPlnHHrOrvjWF8PvJoObIrpsgpKYkrIKEv5eyHpjejsbgtiNF1E52cKYK3nX3grIHuwyrSRNoFAEOH0vjfHlo8P-Z1NhGZv2sNvKJsJssP0yxyh7d_Td5hK2aooiHZez25UnZZNJsEASmbuA4URgcilRHI Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 84d961145cab4eeaac0e4da70bbe6ac4 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-45401653 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/84d961145cab4eeaac0e4da70bbe6ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84d961145cab4eeaac0e4da70bbe6ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84d961145cab4eeaac0e4da70bbe6ac4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_84d961145cab4eeaac0e4da70bbe6ac4"}]}] Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-45401653 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 84d961145cab4eeaac0e4da70bbe6ac4 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-45401653 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsNegativeTestJSON-45401653-project Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 12255be27c014647bdda3a2b8c654816 Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-45401653-project Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: {"pool": "non_exist_pool"} Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: exception: Floating IP pool not found. Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:04.741733 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:04.746058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 02 01:13:04.746058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:04.746058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3897fdae-0de3-46ad-a319-63c827f2db70 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Returning 404 to user: Floating IP pool not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:04.746058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3897fdae-0de3-46ad-a319-63c827f2db70 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.126160 Oct 02 01:13:04.746058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1345/2858] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:13:04 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:04.753433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:04.754264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:04.774882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.775389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.775833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.776546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.777335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.777773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:05.156237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:05.174494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c994f192-603b-4722-be55-4bfc14ba1fa0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.628082 Oct 02 01:13:05.175488 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1514/2859] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:04 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:05.198341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7059ad1f-d9fc-4fdc-a7c3-5599e385a714 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Calling method '.version_select at 0x7fb8807db670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:05.307703 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-7059ad1f-d9fc-4fdc-a7c3-5599e385a714 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2e40b5d4-824f-4d4f-b787-bd77717846bc could not be found", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:13:05.308577 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7059ad1f-d9fc-4fdc-a7c3-5599e385a714 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] HTTP exception thrown: Floating IP not found for ID 2e40b5d4-824f-4d4f-b787-bd77717846bc Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7059ad1f-d9fc-4fdc-a7c3-5599e385a714 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Request method failure captured: Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-floating-ips/2e40b5d4-824f-4d4f-b787-bd77717846bc HTTP/1.1 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOWf-nelhAVAdPv2qeSOVWPlnHHrOrvjWF8PvJoObIrpsgpKYkrIKEv5eyHpjejsbgtiNF1E52cKYK3nX3grIHuwyrSRNoFAEOH0vjfHlo8P-Z1NhGZv2sNvKJsJssP0yxyh7d_Td5hK2aooiHZez25UnZZNJsEASmbuA4URgcilRHI Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 84d961145cab4eeaac0e4da70bbe6ac4 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-45401653 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/84d961145cab4eeaac0e4da70bbe6ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84d961145cab4eeaac0e4da70bbe6ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84d961145cab4eeaac0e4da70bbe6ac4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_84d961145cab4eeaac0e4da70bbe6ac4"}]}] Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-45401653 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 84d961145cab4eeaac0e4da70bbe6ac4 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-45401653 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FloatingIPsNegativeTestJSON-45401653-project Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12255be27c014647bdda3a2b8c654816 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-45401653-project Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: exception: Floating IP not found for ID 2e40b5d4-824f-4d4f-b787-bd77717846bc Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '2e40b5d4-824f-4d4f-b787-bd77717846bc'} Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2e40b5d4-824f-4d4f-b787-bd77717846bc could not be found Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f09b150-a609-4c2f-8628-23fb818e8c46'] Oct 02 01:13:05.313452 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2e40b5d4-824f-4d4f-b787-bd77717846bc. Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2e40b5d4-824f-4d4f-b787-bd77717846bc Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2e40b5d4-824f-4d4f-b787-bd77717846bc Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:05.319073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7059ad1f-d9fc-4fdc-a7c3-5599e385a714 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] Returning 404 to user: Floating IP not found for ID 2e40b5d4-824f-4d4f-b787-bd77717846bc {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:05.326449 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7059ad1f-d9fc-4fdc-a7c3-5599e385a714 tempest-FloatingIPsNegativeTestJSON-45401653 tempest-FloatingIPsNegativeTestJSON-45401653-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/2e40b5d4-824f-4d4f-b787-bd77717846bc" status: 404 len: 111 microversion: 2.1 time: 0.132787 Oct 02 01:13:05.328533 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1515/2860] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:13:05 2022] DELETE /compute/v2.1/os-floating-ips/2e40b5d4-824f-4d4f-b787-bd77717846bc => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:05.338940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e49854c8-2f3f-420b-82d3-86400ad55d83 req-a34e674e-f1be-4acc-9d22-fa8da1b15541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481845ee-ce3d-4b19-95a4-4eeda0435f4d", "tag": "225eff9c-49dd-4284-907a-878dd594d1bf"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:05.378591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e49854c8-2f3f-420b-82d3-86400ad55d83 req-a34e674e-f1be-4acc-9d22-fa8da1b15541 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:05.379198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e49854c8-2f3f-420b-82d3-86400ad55d83 req-a34e674e-f1be-4acc-9d22-fa8da1b15541 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:05.379538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e49854c8-2f3f-420b-82d3-86400ad55d83 req-a34e674e-f1be-4acc-9d22-fa8da1b15541 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:05.405823 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e49854c8-2f3f-420b-82d3-86400ad55d83 req-a34e674e-f1be-4acc-9d22-fa8da1b15541 service nova] Creating event network-changed:225eff9c-49dd-4284-907a-878dd594d1bf for instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d on n-h2-master-1 Oct 02 01:13:05.420194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e49854c8-2f3f-420b-82d3-86400ad55d83 req-a34e674e-f1be-4acc-9d22-fa8da1b15541 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085963 Oct 02 01:13:05.422114 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1516/2861] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:05.635318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:05.636269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:05.649044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:05.649560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:05.650062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:05.650821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:05.651287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:05.675699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:05.726714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:05.741320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-078c9489-107a-4aaa-a083-572965762332 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1680 microversion: 2.1 time: 0.992904 Oct 02 01:13:05.743901 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1346/2862] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:04 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1680 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:06.106262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:06.117748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:06.133118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:06.156521 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a13f7f31-15bf-4ed6-a83d-53bd22425747 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1486 microversion: 2.91 time: 0.520177 Oct 02 01:13:06.171188 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1517/2863] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:05 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1486 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:13:06.203713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:06.205076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:06.214627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:06.221164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:06.221976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:06.222993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:06.223677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:06.224606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:06.774105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:06.775421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:06.786471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:06.793846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:06.795034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:06.800531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:06.801413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:06.802362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.545785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:07.562564 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e4d4455-b3c8-435c-ad24-b7a6cdaf64a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 1.363480 Oct 02 01:13:07.573864 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1347/2864] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:06 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:07.582310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:07.582970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:07.594272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.594799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.595475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.596999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.597698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.598342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.598893 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=11 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:07.820398 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:07.836011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:07.838094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:07.845677 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-934bd1c4-1f8d-4dc6-b17e-3aaf49a3bd50 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.270386 Oct 02 01:13:07.846921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1348/2865] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:07 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:07.852799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:07.853526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:07.860696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.862533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.863188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.864542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.865388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.866058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.891362 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] HTTP exception thrown: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Request method failure captured: Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 HTTP/1.1 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOPvx7JGuN3aYKDOJt6gciNSJt0a5CcS89Epdo1SfJAXq5_tq8dk2Wz2l8-n0zh99i2Kv9cbkpKGpCcK07nz7Ng_mI0h4uP2PVKFhxL-6gBvMvRg-Eq0h8lJLxhu1JMsizBrfL1UcTdBty22CK_H0-WqKoutJzAG0RnNXSwTDOW4FH4 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.42 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b6dd9c628eb4be5b48c28a1192e16c1 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b6dd9c628eb4be5b48c28a1192e16c1"}]}] Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b6dd9c628eb4be5b48c28a1192e16c1 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TaggedBootDevicesTest_v242-1023674894-project Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c4c8a46a0556407f9956cbd1ffd75c7e Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1023674894-project Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0e6528b7-91d7-4dde-b95a-5520c5cd6c26'} Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:13:07.893917 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Returning 404 to user: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc4b8678-a2e9-4ae9-8489-6e2d7411e8bb tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 404 len: 111 microversion: 2.42 time: 0.049050 Oct 02 01:13:07.898192 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1349/2866] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:13:07 2022] DELETE /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:13:07.910131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-37ae9cf3-b27f-40bc-be76-00eb14a8dba2 req-b3cc11ad-4040-4e9e-8a4b-ac4fac97b057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481845ee-ce3d-4b19-95a4-4eeda0435f4d", "tag": "225eff9c-49dd-4284-907a-878dd594d1bf"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:07.924698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-37ae9cf3-b27f-40bc-be76-00eb14a8dba2 req-b3cc11ad-4040-4e9e-8a4b-ac4fac97b057 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.925188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-37ae9cf3-b27f-40bc-be76-00eb14a8dba2 req-b3cc11ad-4040-4e9e-8a4b-ac4fac97b057 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.925619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-37ae9cf3-b27f-40bc-be76-00eb14a8dba2 req-b3cc11ad-4040-4e9e-8a4b-ac4fac97b057 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.927583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:07.932043 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=38 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:07.946085 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-11e97968-16c5-40cb-9c57-1e63ff70cb67 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 1.179876 Oct 02 01:13:07.947498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-37ae9cf3-b27f-40bc-be76-00eb14a8dba2 req-b3cc11ad-4040-4e9e-8a4b-ac4fac97b057 service nova] Creating event network-changed:225eff9c-49dd-4284-907a-878dd594d1bf for instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d on n-h2-master-1 Oct 02 01:13:07.965960 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1518/2867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:06 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:07.967506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-37ae9cf3-b27f-40bc-be76-00eb14a8dba2 req-b3cc11ad-4040-4e9e-8a4b-ac4fac97b057 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062068 Oct 02 01:13:07.975556 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1350/2868] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:07.988944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:07.991440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] [instance: 0e6528b7-91d7-4dde-b95a-5520c5cd6c26] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:08.030893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.032424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.034649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.036048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.039820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.040531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.067975 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] HTTP exception thrown: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Request method failure captured: Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 HTTP/1.1 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOPvx7JGuN3aYKDOJt6gciNSJt0a5CcS89Epdo1SfJAXq5_tq8dk2Wz2l8-n0zh99i2Kv9cbkpKGpCcK07nz7Ng_mI0h4uP2PVKFhxL-6gBvMvRg-Eq0h8lJLxhu1JMsizBrfL1UcTdBty22CK_H0-WqKoutJzAG0RnNXSwTDOW4FH4 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.42 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2b6dd9c628eb4be5b48c28a1192e16c1 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b6dd9c628eb4be5b48c28a1192e16c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b6dd9c628eb4be5b48c28a1192e16c1"}]}] Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2b6dd9c628eb4be5b48c28a1192e16c1 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1023674894 Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TaggedBootDevicesTest_v242-1023674894-project Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c4c8a46a0556407f9956cbd1ffd75c7e Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1023674894-project Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0e6528b7-91d7-4dde-b95a-5520c5cd6c26'} Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:08.070330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] Returning 404 to user: Instance 0e6528b7-91d7-4dde-b95a-5520c5cd6c26 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23450927-f597-447c-9c77-6bf45e251c37 tempest-TaggedBootDevicesTest_v242-1023674894 tempest-TaggedBootDevicesTest_v242-1023674894-project] 10.222.0.23 "GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26" status: 404 len: 111 microversion: 2.42 time: 0.104377 Oct 02 01:13:08.074251 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1519/2869] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:07 2022] GET /compute/v2.1/servers/0e6528b7-91d7-4dde-b95a-5520c5cd6c26 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:13:08.116396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:08.117098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:08.130420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.130943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.131624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.132077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.132648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.133074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.590501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:08.591371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:08.601911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.602261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.602734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.603445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.603900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.604329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.725276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:08.735389 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f6d8f77-b520-4ee2-b2cd-42e057169345 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.624169 Oct 02 01:13:08.745451 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1351/2870] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:08 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:08.878097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:08.878881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:08.908246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.909593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.911141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.915408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.916203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.917005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:09.782518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:09.792513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:09.820762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:09.837280 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9f48c2c-1707-40b3-b15b-ddc45ab9df09 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.963872 Oct 02 01:13:09.838849 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1352/2871] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:08 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:13:09.855162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ce1c8b8e-932b-451b-a6ac-b604bf833cfb req-e8e160e8-1139-4cdf-b89d-5d1de5dc721f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-unplugged", "status": "completed", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:09.887441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ce1c8b8e-932b-451b-a6ac-b604bf833cfb req-e8e160e8-1139-4cdf-b89d-5d1de5dc721f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:09.887998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ce1c8b8e-932b-451b-a6ac-b604bf833cfb req-e8e160e8-1139-4cdf-b89d-5d1de5dc721f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:09.888526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ce1c8b8e-932b-451b-a6ac-b604bf833cfb req-e8e160e8-1139-4cdf-b89d-5d1de5dc721f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:09.928915 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ce1c8b8e-932b-451b-a6ac-b604bf833cfb req-e8e160e8-1139-4cdf-b89d-5d1de5dc721f service nova] Creating event network-vif-unplugged:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:13:09.949506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ce1c8b8e-932b-451b-a6ac-b604bf833cfb req-e8e160e8-1139-4cdf-b89d-5d1de5dc721f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109168 Oct 02 01:13:09.953284 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1353/2872] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:10.294549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:10.306731 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-55509dc0-3276-4154-9a12-fa57fd4179ed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 1.719473 Oct 02 01:13:10.307334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1520/2873] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:08 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:10.876833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:10.878137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:10.906290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:10.910037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:10.914208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:10.916535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:10.918524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:10.920824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:11.125835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:11.139746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:11.141185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:11.159928 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b10ca4bc-4321-4c38-bbaa-dbf63b327aa3 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.290282 Oct 02 01:13:11.162032 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1354/2874] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:10 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:11.338018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:11.339167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:11.355979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:11.356473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:11.366546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:11.369022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:11.369560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:11.369981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:11.801941 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:11.868536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e2e5434-dfcc-4060-b2af-366eed0e96c0 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Calling method '.version_select at 0x7fb880a7c820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:12.026566 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e2e5434-dfcc-4060-b2af-366eed0e96c0 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 371 microversion: 2.1 time: 0.517381 Oct 02 01:13:12.028867 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1355/2875] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:13:11 2022] GET /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 371 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:13:12.047040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:12.060542 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-55abe6e1-1b91-4737-b5d6-5771e2db6ea0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.726381 Oct 02 01:13:12.073759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Action: 'update', calling method: .version_select at 0x7fb8809fb5e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:12.086158 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1521/2876] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:11 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:12.187123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:12.192974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:12.193795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:12.194800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:12.195442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:12.196123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:12.202095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:12.203242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:12.211478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:12.212586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:12.213203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:12.214081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:12.215210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:12.215885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:12.336830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b71afb9-2be8-4851-951a-30627fee9c77 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 328 microversion: 2.1 time: 0.296185 Oct 02 01:13:12.340216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1356/2877] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:12 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 328 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:12.385882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:12.401596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:12.407985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:12.420292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-131b0324-333f-4396-bd5f-2ff39363c316 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.224455 Oct 02 01:13:12.421800 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1522/2878] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:12 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:12.683534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1636738222", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:12.723850 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=11,nova_api:INSERT=11 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:13.094889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:13.096488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:13.110935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:13.112237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:13.112872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:13.117030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:13.117824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:13.118460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:13.514831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:13.522942 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5cc7ea2-28d6-4c0b-aa95-9cf04bd8cd6d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.433860 Oct 02 01:13:13.523538 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1523/2879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:13 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:13.566502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:13.570010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:13.589603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:13.597462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:13.598355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:13.599317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:13.603365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:13.606326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:13.769913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:13.784512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:13.791246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:13.802846 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a12bffaa-2e27-46dd-9a51-fb64511fbdd1 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.254827 Oct 02 01:13:13.813857 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1524/2880] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:13 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:14.549509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:14.551419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:14.574652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:14.575402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:14.575856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:14.589556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:14.592318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:14.593417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:15.264012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:15.286968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31ab0108-a2e4-46c1-ba90-ff4b29c020b6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.731316 Oct 02 01:13:15.287965 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1525/2881] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:14 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:15.292890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:15.293504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:15.330345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:15.341645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:15.342197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:15.343008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:15.343489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:15.344969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:15.639877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:15.651584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:15.653066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:15.680146 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f5a78db2-2c27-49ed-b6aa-e1111c909b71 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.390938 Oct 02 01:13:15.705159 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1526/2882] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:15 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:16.318783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:16.320143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:16.334489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:16.342183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:16.343513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:16.344452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:16.345094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:16.345709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:16.636704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:16.646156 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2edd9f9b-1cbc-47af-8d6f-38adc80fa3c3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.334311 Oct 02 01:13:16.669188 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1527/2883] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:16 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:16.716220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:16.716847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:16.730228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:16.732125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:16.732125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:16.740464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:16.741287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:16.741864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:16.915800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:16.925936 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:16.927415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:16.945181 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8b8db48-18cd-4236-b9ce-f3896ceb1579 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.232663 Oct 02 01:13:16.954111 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1528/2884] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:16 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:17.677690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:17.678414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:17.691133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:17.691618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:17.692113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:17.692912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:17.693380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:17.693827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:18.281791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:18.342144 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e8b74ec1-7d25-4be9-bc06-143bec75406e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.666438 Oct 02 01:13:18.351868 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1529/2885] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:17 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:18.369418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:18.370379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:18.395174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:18.400423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:18.401408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:18.421600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:18.423800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:18.430635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:18.566221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:18.583399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:18.588332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:18.599256 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b62bea4-14b2-4e21-917e-faa843861b12 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.246056 Oct 02 01:13:18.599858 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1530/2886] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:18 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:19.377966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:19.379519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:19.400099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:19.404841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:19.405399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:19.407933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:19.412545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:19.413176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:19.770162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:19.807443 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27d65e77-0b01-4b97-b75e-4e7a674d23b7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.434407 Oct 02 01:13:19.820385 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1531/2887] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:19 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:19.856566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:19.864885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:19.895085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:19.900249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:19.903026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:19.903994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:19.908272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:19.917062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:20.045471 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:20.142420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:20.160733 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:20.160733 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:20.193602 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c7c66f88-ed74-4012-9598-3d7d6f5588fb tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.369815 Oct 02 01:13:20.194221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1532/2888] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:19 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:20.837298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:20.844133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:20.857791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:20.859434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:20.862512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:20.863610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:20.865012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:20.865508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:21.132068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:21.147866 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-39199c0f-98d1-4ccc-a147-03705c5932bc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.314327 Oct 02 01:13:21.149232 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1533/2889] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:20 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:21.234017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:21.234667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:21.243842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:21.245361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:21.245828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:21.246549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:21.248052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:21.248967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:21.394780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:21.404214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:21.412477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:21.422408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56e65c74-621f-4702-9fbd-b888f695085f tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.192998 Oct 02 01:13:21.427693 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1534/2890] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:21 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:13:22.177412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:22.178813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:22.194887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:22.197007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:22.197605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:22.199513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:22.200233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:22.201801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:22.217336 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:22.219356 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:22.301554 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=78 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:22.378323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:13:22.884503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:22.899917 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8e91155-d998-44ef-89bc-a60ec0346782 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.727354 Oct 02 01:13:22.903343 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1535/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:22 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:22.922506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:22.923710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:22.946302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:22.948277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:22.948748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:22.951562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:22.954486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:22.955128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:22.962184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:13:22.962674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:13:22.963230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:13:22.963861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:13:22.964479 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:13:22.999592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.001445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.003681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.007771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.008554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.009276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.060949 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Getting quotas for project 9001930303b447988a8c81589f00f57b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:13:23.067976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Getting quotas for user 02ae887cc9d3447193a64c784ba4b855 and project 9001930303b447988a8c81589f00f57b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:13:23.086789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.utils [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] cores quota exceeded for 9001930303b447988a8c81589f00f57b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122354) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 02 01:13:23.088056 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Request method failure captured: Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 145 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOWlzKQFvvOfg-Jx4uipwYKLOUl-i38SR5z-20oQyeWjQYqpNcHI6ohuUAvkWRreo6E5Ot3FIvk28kaU6z90ZRc7Mq2vQaTbLD4q4M9Q47r45LhQMQpv8-iZZx1WlSNbKwzwI3VcBM_4YNj3qYc3blc5Hq_iaCEbEakbQHFGA6nSLuE Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9001930303b447988a8c81589f00f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9001930303b447988a8c81589f00f57b"}]}] Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 02ae887cc9d3447193a64c784ba4b855 Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1636738222", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1636738222', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452'}}} Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:13:23.100156 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 02 01:13:23.105016 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:23.110633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:23.112496 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70f14e8e-a8c2-4862-a72d-907cdb28b245 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 10.531833 Oct 02 01:13:23.113662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1357/2892] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:13:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 10535 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:23.126836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Action: 'update', calling method: .version_select at 0x7fb880a0e550>, body: {"quota_set": {"cores": 20}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:23.146719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:23.178910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:23.189169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:23.204458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-844b1914-8bc0-4825-bd10-56d036ed2275 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.298425 Oct 02 01:13:23.206837 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1536/2893] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:22 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:23.223847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:23.226639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:23.240315 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:23.243506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.244683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.247187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.248190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.249968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.250788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.458767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:23.469962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-599c1bd5-bf1d-4eb9-87b7-891feed5be15 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.258720 Oct 02 01:13:23.471348 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1537/2894] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:23 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:23.495480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:23.496457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:23.505186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.507108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.507662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.510381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.511274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.513214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.653338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.657764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.667650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.668923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.669676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.670353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.804975 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f27213f-e3fa-4c8b-b8a2-0656d15b7bab tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 329 microversion: 2.1 time: 0.684227 Oct 02 01:13:23.813734 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1358/2895] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:23 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 329 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:23.819482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-787bcef4-f00e-4ac9-8371-eff7fb3e6ee1 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Calling method '.version_select at 0x7fb880a93040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:23.856001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:23.867765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70c47957-6578-4451-93e3-8d7c0cb3e79d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.375999 Oct 02 01:13:23.869624 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1538/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:23 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:23.896920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:23.897920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:23.908581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.910963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.911937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.915462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.916029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.916545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.945062 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-787bcef4-f00e-4ac9-8371-eff7fb3e6ee1 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 371 microversion: 2.1 time: 0.130836 Oct 02 01:13:23.945658 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1359/2897] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:13:23 2022] GET /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:23.956535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:23.970744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:23.985120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.985534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.985972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.987242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.987986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.988417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.094923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:24.105531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0fc79925-d7ed-4be7-91df-022ef895ea81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.214420 Oct 02 01:13:24.106890 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1539/2898] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:23 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:24.134371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Action: 'update', calling method: .version_select at 0x7fb8811fe280>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:24.278870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.280291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.280969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.286097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.287051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.287656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.312154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:24.325618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e61055f-60da-48bd-a055-2f977ff4f317 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.375782 Oct 02 01:13:24.326456 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1360/2899] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:23 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:24.354470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:24.359313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:24.385432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.388874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.389779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.394095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.396282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.397552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.483894 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2285c33-9f87-432c-aaf5-c3d40f84d4f6 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 328 microversion: 2.1 time: 0.375626 Oct 02 01:13:24.488426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1540/2900] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:24 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 328 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:24.496369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:24.499893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:24.536755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.537546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.538151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.539059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.539682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.540115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.596928 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c4870af5-c8a2-4f67-b681-ca09c38e544f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.262240 Oct 02 01:13:24.597621 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1361/2901] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:13:24 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:13:24.605976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:24.606713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:24.634483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.635006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.635443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.637913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.638446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.638864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.683536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:24.702840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:24.708127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:24.715696 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6828cde8-5b67-4f81-91d9-ecdfc395bed9 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.225746 Oct 02 01:13:24.730538 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1541/2902] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:24 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:24.747400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1644174837", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:24.881379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:13:25.568609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:25.578017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:13:25.578656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:13:25.579146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:13:25.579559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:13:25.579988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:13:25.582712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d6785d6-6cee-43cf-a4fd-d9a366bb8998 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1669 microversion: 2.1 time: 0.980725 Oct 02 01:13:25.588487 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1362/2903] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:24 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1669 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:25.609093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.614045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.616098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:25.616635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.617460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.620272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:25.622690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.623284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.637029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.637892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.638572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.639534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.640256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.644488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.688613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Getting quotas for project 9001930303b447988a8c81589f00f57b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:13:25.712099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Getting quotas for user 02ae887cc9d3447193a64c784ba4b855 and project 9001930303b447988a8c81589f00f57b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:13:25.782963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.utils [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] instances quota exceeded for 9001930303b447988a8c81589f00f57b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122355) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 02 01:13:25.784385 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Request method failure captured: Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 145 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOWlzKQFvvOfg-Jx4uipwYKLOUl-i38SR5z-20oQyeWjQYqpNcHI6ohuUAvkWRreo6E5Ot3FIvk28kaU6z90ZRc7Mq2vQaTbLD4q4M9Q47r45LhQMQpv8-iZZx1WlSNbKwzwI3VcBM_4YNj3qYc3blc5Hq_iaCEbEakbQHFGA6nSLuE Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9001930303b447988a8c81589f00f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9001930303b447988a8c81589f00f57b"}]}] Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 02ae887cc9d3447193a64c784ba4b855 Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1644174837", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1644174837', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452'}}} Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:13:25.790198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 02 01:13:25.794726 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:25.802881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:25.804035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-064d92b0-32d1-4e34-a7f8-35c6227546d9 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.072170 Oct 02 01:13:25.806278 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1542/2904] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:13:24 2022] POST /compute/v2.1/servers => generated 119 bytes in 1075 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:25.819559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:25.822502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:25.834946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.837352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.839526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.842325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.844932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.845552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.990761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:26.004127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:26.005858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:26.022798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ea419c5-ab0f-4225-b146-b49e4c9ceea4 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.214893 Oct 02 01:13:26.024822 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1543/2905] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:25 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:26.042920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Action: 'update', calling method: .version_select at 0x7fb880849670>, body: {"quota_set": {"instances": 10}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:26.159741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:26.168930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.170556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.171106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.171975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.172326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.173190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.176477 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8e31e20-f73a-4ec2-98d6-33cffad13851 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1498 microversion: 2.1 time: 0.566150 Oct 02 01:13:26.179240 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1363/2906] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:25 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1498 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:26.293201 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b405436f-576b-4d5a-8c0e-2a84352687e7 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 329 microversion: 2.1 time: 0.266834 Oct 02 01:13:26.293816 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1544/2907] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:26 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 329 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:26.307474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f730929f-2951-45d2-83ff-4a59532582f4 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Calling method '.version_select at 0x7fb880a93af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:26.451149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f730929f-2951-45d2-83ff-4a59532582f4 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 371 microversion: 2.1 time: 0.146807 Oct 02 01:13:26.452732 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1364/2908] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:13:26 2022] GET /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:26.465505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Action: 'update', calling method: .version_select at 0x7fb8811ad820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:26.600319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.600319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.600319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.601075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.606356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.606838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.616255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:26.617033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:26.624832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.631277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.632334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.633489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.634213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.636010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.713068 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23eac3ca-495d-49be-bf45-dde5dc766c66 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 325 microversion: 2.1 time: 0.248886 Oct 02 01:13:26.713068 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1545/2909] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:26 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:26.805371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-594332274", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:26.954795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:13:26.963760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:26.986574 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfb916e6-b839-4840-8767-ee4bf956d90e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1669 microversion: 2.1 time: 0.372998 Oct 02 01:13:26.993512 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1365/2910] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:26 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:27.063484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:27.064729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:27.073905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:27.074697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:27.075312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:27.076499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:27.077126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:27.077710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.015423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:28.031884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:28.033500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:28.047059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0f95147-7d70-4e09-a8cf-7f4bbb73f5ce tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.993169 Oct 02 01:13:28.066062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1366/2911] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:27 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:28.086077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:28.087164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:28.093681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.094439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.095208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.096802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.097643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.104302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.275352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:13:28.276582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:13:28.278054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:13:28.278769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:13:28.279429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:13:28.298933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.300629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.301353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.302384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.303126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.303781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.328030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Getting quotas for project 9001930303b447988a8c81589f00f57b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:13:28.334591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Getting quotas for user 02ae887cc9d3447193a64c784ba4b855 and project 9001930303b447988a8c81589f00f57b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:13:28.369000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.utils [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] ram quota exceeded for 9001930303b447988a8c81589f00f57b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122355) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 02 01:13:28.373589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Request method failure captured: Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 144 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOWlzKQFvvOfg-Jx4uipwYKLOUl-i38SR5z-20oQyeWjQYqpNcHI6ohuUAvkWRreo6E5Ot3FIvk28kaU6z90ZRc7Mq2vQaTbLD4q4M9Q47r45LhQMQpv8-iZZx1WlSNbKwzwI3VcBM_4YNj3qYc3blc5Hq_iaCEbEakbQHFGA6nSLuE Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9001930303b447988a8c81589f00f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9001930303b447988a8c81589f00f57b"}]}] Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 02ae887cc9d3447193a64c784ba4b855 Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-594332274", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-594332274', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452'}}} Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:13:28.377085 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-af7fc3d3-105e-4283-a85b-68584a3ccac6 tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.584588 Oct 02 01:13:28.382649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1546/2912] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:13:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 1586 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:13:28.397630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:28.399766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:28.414229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.414773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.415233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.416028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.416436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.416867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.779939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:28.788958 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f74d39e-125b-4385-b4f2-a7d3b062528e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 200 len: 1475 microversion: 2.1 time: 0.720831 Oct 02 01:13:28.796385 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1367/2913] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:28 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 1475 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:28.805056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:28.806980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:28.827268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.828020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.828620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.829491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.830098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.831442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.038485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'services' on Instance uuid 481845ee-ce3d-4b19-95a4-4eeda0435f4d {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:13:29.156151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:29.180383 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5f41401c-68a1-4990-befc-42a03607d7fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.792882 Oct 02 01:13:29.180994 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1547/2914] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:28 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:29.190773 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-37232edb-7009-4f3d-a7bd-4e9a025962ed tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments/c0413a29-556c-4578-8f60-e0d7d4fba505" status: 202 len: 0 microversion: 2.1 time: 0.389702 Oct 02 01:13:29.190773 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1368/2915] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:13:28 2022] DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments/c0413a29-556c-4578-8f60-e0d7d4fba505 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:13:29.209903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Action: 'update', calling method: .version_select at 0x7fb8809f6dc0>, body: {"quota_set": {"ram": 51200}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:29.230793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1028873626"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:29.247155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:29.274099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.287812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.291362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.293867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.294865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.296435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.458510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.459034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.459587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.466842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.467835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.468325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.601017 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90697ca3-6785-4952-b82d-5a46738be29a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 200 len: 329 microversion: 2.1 time: 0.411095 Oct 02 01:13:29.610975 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1369/2916] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:29 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 329 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:29.621574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:29.622368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:29.630889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.632685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.632685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.633306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.634005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.634431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.776464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:29.793732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:29.799044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:29.814195 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-78a6ce06-70f9-48de-b787-8cf4964c8a81 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1544 microversion: 2.91 time: 0.201972 Oct 02 01:13:29.818353 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1370/2917] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:29 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1544 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:29.830381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:29.837887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:29.845491 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff1b0c5f-a96f-4b44-81ce-ea63194bcbda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.645111 Oct 02 01:13:29.857015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.858317 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1548/2918] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:13:29 2022] POST /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:13:29.859945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.860687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.861944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.862895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.863786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.870136 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:29.873634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:29.881491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.882292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.882939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.883819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.884474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.889700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.939454 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1838b4ed-84ea-4420-8806-2cf569b25f89 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117949 Oct 02 01:13:29.942885 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1371/2919] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:29 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:29.982851 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96f9f3a6-4878-4a60-afce-5e1a609242f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 200 len: 322 microversion: 2.1 time: 0.120333 Oct 02 01:13:29.984084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1549/2920] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:13:29 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:29.992011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82f92cd6-ddf4-4af0-beeb-4ab66d0cf81e tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Action: 'update', calling method: .version_select at 0x7fb8811feaf0>, body: {"quota_set": {"ram": 0}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:30.001409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-82f92cd6-ddf4-4af0-beeb-4ab66d0cf81e tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '02ae887cc9d3447193a64c784ba4b855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9001930303b447988a8c81589f00f57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82f92cd6-ddf4-4af0-beeb-4ab66d0cf81e tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Request method failure captured: Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b HTTP/1.1 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 25 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOWlzKQFvvOfg-Jx4uipwYKLOUl-i38SR5z-20oQyeWjQYqpNcHI6ohuUAvkWRreo6E5Ot3FIvk28kaU6z90ZRc7Mq2vQaTbLD4q4M9Q47r45LhQMQpv8-iZZx1WlSNbKwzwI3VcBM_4YNj3qYc3blc5Hq_iaCEbEakbQHFGA6nSLuE Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9001930303b447988a8c81589f00f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9001930303b447988a8c81589f00f57b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9001930303b447988a8c81589f00f57b"}]}] Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9001930303b447988a8c81589f00f57b Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-808838841 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 02ae887cc9d3447193a64c784ba4b855 Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-QuotasAdminNegativeTest-808838841-project Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: {"quota_set": {"ram": 0}} Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9001930303b447988a8c81589f00f57b', 'body': {'quota_set': {'ram': 0}}} Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:13:30.013154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82f92cd6-ddf4-4af0-beeb-4ab66d0cf81e tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82f92cd6-ddf4-4af0-beeb-4ab66d0cf81e tempest-QuotasAdminNegativeTest-808838841 tempest-QuotasAdminNegativeTest-808838841-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b" status: 403 len: 116 microversion: 2.1 time: 0.030763 Oct 02 01:13:30.019877 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1550/2921] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:13:29 2022] PUT /compute/v2.1/os-quota-sets/9001930303b447988a8c81589f00f57b => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:30.055254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-215198c0-a206-4781-80fb-3803905db275 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88166b670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:30.082127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-210028769", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "867d699a-34bd-4b9c-a0d1-2f2c4b297862"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:30.150956 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-215198c0-a206-4781-80fb-3803905db275 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.103078 Oct 02 01:13:30.151539 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1551/2922] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:30 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:30.168462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:30.170469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:30.194966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:30.196008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:30.199023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:30.199957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:30.200438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:30.202556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:30.219451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] validate_networks() for [('867d699a-34bd-4b9c-a0d1-2f2c4b297862', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:13:31.056296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:31.069485 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a20f852e-1755-41cb-9cae-f1bf553c79c6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.912929 Oct 02 01:13:31.071660 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1552/2923] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:30 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:31.081992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:31.082698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:31.103197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.104799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.105255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.105989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.106450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.106923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.180901 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:31.493702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:31.515119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:31.517978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:31.545761 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c784916-36b1-49d5-a14f-457e4fb11ddf tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1531 microversion: 2.91 time: 0.466827 Oct 02 01:13:31.547862 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1553/2924] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:31 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1531 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:31.564815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:31.567277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:31.589707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.594251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.594790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.595540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.596007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.596923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.649202 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5d708b4-e767-4e1a-aa23-5dad12805776 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097406 Oct 02 01:13:31.655010 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1554/2925] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:31 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:31.660498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:31.661336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:31.667945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.668701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.669298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.670345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.671050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.671714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.996548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:32.013116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:13:32.013733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:13:32.014170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:13:32.014699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:13:32.015276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:13:32.021888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d10fdc10-4ce1-45ce-84d4-36f5ad79897d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.350231 Oct 02 01:13:32.025613 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1555/2926] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:31 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:32.040320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.042384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.044133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c5a6ac8-53fb-4646-8112-9ebe447c6dcd tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88560ea60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:32.044840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.049122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.051011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.052491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.106187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:13:32.118353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for user eb1045d1468b4a2f814930f5ace5c2ef and project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:13:32.121630 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c5a6ac8-53fb-4646-8112-9ebe447c6dcd tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.094753 Oct 02 01:13:32.122214 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1556/2927] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:32 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:32.138531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:32.139194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:32.155476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.155968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.156406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.157126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.157573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.157998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.160825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:13:32.168645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:13:32.314008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] Lazy-loading 'services' on Instance uuid de3d36f4-2336-489c-80d3-939cc4bee2db {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:13:32.323587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65ef4f2f-2828-4fdd-aa05-e05a826f977a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375630 Oct 02 01:13:32.324446 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1372/2928] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:13:32.336446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:32.342734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:32.349301 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:32.354243 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45b3fa60-9408-4681-9c98-918c18c202a7 tempest-UnshelveToHostMultiNodesTest-997940302 tempest-UnshelveToHostMultiNodesTest-997940302-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1936 microversion: 2.91 time: 0.230673 Oct 02 01:13:32.355130 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1557/2929] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:32 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1936 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:32.368067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.368067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.368067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.368067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.368067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.368067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.396018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d23886f-d90c-4df4-8768-6232159e1434 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:32.396823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d23886f-d90c-4df4-8768-6232159e1434 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:32.876656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9d23886f-d90c-4df4-8768-6232159e1434 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:32.892244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d23886f-d90c-4df4-8768-6232159e1434 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1224 microversion: 2.1 time: 0.505857 Oct 02 01:13:32.893013 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1558/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:32 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1224 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:32.908520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:32.909345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:32.923791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.926043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.933912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.935078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.936004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.936834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.038377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:13:33.085837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:33.105618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc04d568-0297-4f79-8e41-69cadc6ce71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.768929 Oct 02 01:13:33.106298 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1373/2931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:32 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:33.114827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:33.131461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:33.157628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.158127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.158585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.159525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.160123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.160575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.328102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04cf290f-4196-468d-9f0d-dda3bae78411 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220565 Oct 02 01:13:33.334836 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1374/2932] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:33 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:33.355850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:33.356516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:33.379999 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87bec319-fd7e-472d-b867-ae7579387b86 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 204 len: 0 microversion: 2.91 time: 0.484603 Oct 02 01:13:33.389756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.390344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.391059 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1559/2933] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:13:32 2022] DELETE /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:13:33.394425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.396162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.399739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.401506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.408149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32d5490b-1e00-498c-aeba-0ddb9b0286c0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8811fe160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:33.576448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32d5490b-1e00-498c-aeba-0ddb9b0286c0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.183028 Oct 02 01:13:33.578828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1560/2934] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:33 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:33.595234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:33.596691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:33.614307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.614887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.615285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.616008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.621759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.622326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.829233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:33.845657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:33.849366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:33.874635 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-653edc79-e288-4fee-b1ec-8fa6d05306bc tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.293549 Oct 02 01:13:33.884191 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1561/2935] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:33 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:33.926246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:33.927418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:33.931136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:33.941429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1a0a6ed7-bc19-460f-b59e-31f554ce845b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.604615 Oct 02 01:13:33.949221 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1375/2936] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:33 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:33.949817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.950334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.950819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.951797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.952261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.952694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:34.280298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-473613391", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:34.369472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] validate_networks() for [('ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:13:34.691433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:34.700860 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2eb23300-f004-4e86-9db7-87b6615a3640 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1220 microversion: 2.1 time: 0.784113 Oct 02 01:13:34.703447 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1562/2937] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:33 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1220 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:34.710277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:34.713047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:34.724488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:34.724919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:34.725365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:34.726086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:34.726543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:34.727079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:34.804655 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1cef34b-612c-4129-86c1-172ca7399f9a tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099252 Oct 02 01:13:34.810656 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1563/2938] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:34 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:34.816835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d463426f-f71f-441a-a15b-20831572971f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88144b3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:34.887680 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d463426f-f71f-441a-a15b-20831572971f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.075503 Oct 02 01:13:34.890174 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1564/2939] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:34 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:35.190635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86e8f2e0-1795-4548-9e0b-d6c0a51fb077 tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:35.217612 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-86e8f2e0-1795-4548-9e0b-d6c0a51fb077 tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.315403 Oct 02 01:13:35.219230 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1565/2940] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:13:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:35.230423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:35.232874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:35.259314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.259835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.260285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.261016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.261481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.268742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.428237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:35.441068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:35.442846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:35.457609 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0a4f587-fe50-4cc1-a824-0ba7e1eccfcd tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.235231 Oct 02 01:13:35.458216 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1566/2941] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:35 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:35.730589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:35.731935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:35.740426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.740933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.741385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.742134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.742633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.743409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.800551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:13:35.802031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:13:35.803004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:13:35.803638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:13:35.804464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:13:35.809005 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:35.830330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.832546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.833246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.834212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.835046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.835903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.857492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:13:35.871674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for user 66a9d6a142d444be90b2101f23603522 and project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:13:35.893719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:13:35.897495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:13:35.917326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:35.928587 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa2e0cfa-53af-47a4-84fd-47c63c411a23 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1282 microversion: 2.1 time: 0.201829 Oct 02 01:13:35.931125 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1567/2942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:35 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:35.941616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:35.949111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:35.969349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.969900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.970355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.971128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.978073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.978737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:36.023242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cae5bf16-83eb-4e19-934a-dc3a0ed7a214 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746412 Oct 02 01:13:36.024045 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1376/2943] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:13:36.041966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3344498-5d45-43ef-bb03-e9bce2f520f8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880a43e50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:36.072488 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd6350c1-c3b9-4c1b-839d-8f9cb8cccff6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139041 Oct 02 01:13:36.073099 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1568/2944] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:35 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:36.084358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-778a2f08-9882-4c3d-a3ab-2d83bb4a78ee tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-930615035", "imageRef": "0b755045-122d-48f2-a421-cf489a1efc38", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:36.120598 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3344498-5d45-43ef-bb03-e9bce2f520f8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.093619 Oct 02 01:13:36.121516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1377/2945] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:36 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:36.133794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-35f2cb71-1d08-4488-8e49-3485064d1976 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:36.134658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-35f2cb71-1d08-4488-8e49-3485064d1976 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:36.194745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-778a2f08-9882-4c3d-a3ab-2d83bb4a78ee tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:13:36.787379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-35f2cb71-1d08-4488-8e49-3485064d1976 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:36.802673 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-35f2cb71-1d08-4488-8e49-3485064d1976 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1214 microversion: 2.1 time: 0.677211 Oct 02 01:13:36.804996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1378/2946] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:36 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1214 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:36.820769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:36.823407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:36.857738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:36.860353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:36.861005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:36.862818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:36.863821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:36.864476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:36.871394 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:37.071518 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-778a2f08-9882-4c3d-a3ab-2d83bb4a78ee tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-778a2f08-9882-4c3d-a3ab-2d83bb4a78ee tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] Request method failure captured: Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 142 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW-6NnWjwQ_9z3aIqGzTchEEz-aPH_nsV9Xj1sUe1R7LUX4dgHpNWunn-jLSlwOMroybRWHsWcEWbkbyPQlH97l2x9vahlMBqmFKK3NJifRU44SIMztofEenu8CaeyLnoK8nwzywlPqVCvMTWwb_zp7S_xXbMpRgsWb7KhpM5218E4 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1fdfc6203c4d44dd9a3098f7b6b56f9c Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FlavorsV2NegativeTest-875072812 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fdfc6203c4d44dd9a3098f7b6b56f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fdfc6203c4d44dd9a3098f7b6b56f9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fdfc6203c4d44dd9a3098f7b6b56f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fdfc6203c4d44dd9a3098f7b6b56f9c"}]}] Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FlavorsV2NegativeTest-875072812 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1fdfc6203c4d44dd9a3098f7b6b56f9c Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-875072812 Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FlavorsV2NegativeTest-875072812-project Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7d31213ca7fe463685f86f2d9de6b00b Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FlavorsV2NegativeTest-875072812-project Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-930615035", "imageRef": "0b755045-122d-48f2-a421-cf489a1efc38", "flavorRef": "452"}} Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: exception: Flavor's memory is too small for requested image. Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-930615035', 'imageRef': '0b755045-122d-48f2-a421-cf489a1efc38', 'flavorRef': '452'}}} Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:37.073709 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-778a2f08-9882-4c3d-a3ab-2d83bb4a78ee tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:37.078105 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-778a2f08-9882-4c3d-a3ab-2d83bb4a78ee tempest-FlavorsV2NegativeTest-875072812 tempest-FlavorsV2NegativeTest-875072812-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.002285 Oct 02 01:13:37.089116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1569/2947] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:13:36 2022] POST /compute/v2.1/servers => generated 93 bytes in 1015 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:37.127379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-55e60df9-7ab9-497b-9f2c-4478f72c873f req-79a1d9d3-d807-479a-ae04-ab07244fb7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4164649-d919-44dd-8130-9f16db3e4dd2", "name": "network-vif-plugged", "status": "completed", "tag": "bda80aba-707d-4dbd-b83e-c0c24b3fa477"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:37.198313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-55e60df9-7ab9-497b-9f2c-4478f72c873f req-79a1d9d3-d807-479a-ae04-ab07244fb7c1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.198738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-55e60df9-7ab9-497b-9f2c-4478f72c873f req-79a1d9d3-d807-479a-ae04-ab07244fb7c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.200065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-55e60df9-7ab9-497b-9f2c-4478f72c873f req-79a1d9d3-d807-479a-ae04-ab07244fb7c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.245474 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-55e60df9-7ab9-497b-9f2c-4478f72c873f req-79a1d9d3-d807-479a-ae04-ab07244fb7c1 service nova] Creating event network-vif-plugged:bda80aba-707d-4dbd-b83e-c0c24b3fa477 for instance b4164649-d919-44dd-8130-9f16db3e4dd2 on n-h1-master-1 Oct 02 01:13:37.263491 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-55e60df9-7ab9-497b-9f2c-4478f72c873f req-79a1d9d3-d807-479a-ae04-ab07244fb7c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170355 Oct 02 01:13:37.264996 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1570/2948] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:37.274344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:37.286546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:37.288724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:37.294234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:37.300893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bc89a846ec4240bd21f1052b90be8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccfc72930a48ed8a9578968a8e0ee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:37.317898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.318404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.318913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.319642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.335864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.336475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.338631 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b8b257e-9a14-41cd-a700-fcdee75aba16 tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 200 len: 1537 microversion: 2.91 time: 0.529417 Oct 02 01:13:37.339590 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1379/2949] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:36 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 1537 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:37.357446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:37.387751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:37.413386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.415100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.415583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.418876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.419382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.423272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.571405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d01c2d3-c5d1-4ca4-9272-8afa1df27d82 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225135 Oct 02 01:13:37.574393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1380/2950] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:37 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:37.621240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfecede4-506b-4fa1-a234-7d8c016fc368 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880997310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:37.651503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:37.663644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f642c44f-eba6-4253-bd34-0cd8d40ddd14 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1282 microversion: 2.1 time: 0.397066 Oct 02 01:13:37.671149 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1571/2951] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:37 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1282 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:37.719921 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfecede4-506b-4fa1-a234-7d8c016fc368 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.143109 Oct 02 01:13:37.721103 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1381/2952] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:37 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:37.836055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:37.836682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:37.849793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.850307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.850784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.859274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.861381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.864143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.155672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:38.171482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5591c14a-a701-4bfe-8a11-a14b0797ddea tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1210 microversion: 2.1 time: 0.341888 Oct 02 01:13:38.178825 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1572/2953] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:37 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1210 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:38.376027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:38.377485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] [instance: de3d36f4-2336-489c-80d3-939cc4bee2db] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:38.390160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.394446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.395233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.396193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.396869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.397561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.461936 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] HTTP exception thrown: Instance de3d36f4-2336-489c-80d3-939cc4bee2db could not be found. Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Request method failure captured: Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db HTTP/1.1 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOT5F9WZdVawfNDuH1fbyaSGJ0uEDkCKbrqajgZHKCFvPFNEKC-nhmnwyeIITcTF1xdhreiTxuakJxet9cwbBxgfXVCXWZH_9zaqU9ZNXyVuiHG2Jmqbns_Ilr4VsLVbBJQEjkO-cuhZl0U1DvNZ3o5S-h7bIRL0ah22Ne01QCc9mQU Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.91 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 43ccfc72930a48ed8a9578968a8e0ee0 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1752604989 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/43ccfc72930a48ed8a9578968a8e0ee0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43ccfc72930a48ed8a9578968a8e0ee0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43ccfc72930a48ed8a9578968a8e0ee0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_43ccfc72930a48ed8a9578968a8e0ee0"}]}] Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1752604989 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 43ccfc72930a48ed8a9578968a8e0ee0 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1752604989 Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-UnshelveToHostMultiNodesTest-1752604989-project Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c6bc89a846ec4240bd21f1052b90be8f Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1752604989-project Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: exception: Instance de3d36f4-2336-489c-80d3-939cc4bee2db could not be found. Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'de3d36f4-2336-489c-80d3-939cc4bee2db'} Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3d36f4-2336-489c-80d3-939cc4bee2db could not be found. Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3d36f4-2336-489c-80d3-939cc4bee2db could not be found. Oct 02 01:13:38.468554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3d36f4-2336-489c-80d3-939cc4bee2db could not be found. Oct 02 01:13:38.472572 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:38.475098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] Returning 404 to user: Instance de3d36f4-2336-489c-80d3-939cc4bee2db could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:38.478418 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f112459-ed10-48b5-a90f-ffd93763e7ab tempest-UnshelveToHostMultiNodesTest-1752604989 tempest-UnshelveToHostMultiNodesTest-1752604989-project] 10.222.0.23 "GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db" status: 404 len: 111 microversion: 2.91 time: 0.107930 Oct 02 01:13:38.486179 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1382/2954] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:13:38 2022] GET /compute/v2.1/servers/de3d36f4-2336-489c-80d3-939cc4bee2db => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:13:38.583457 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=10 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:38.590829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:38.593820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:38.621204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.623556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.626722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.629109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.633139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.638798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.689109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:38.690213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:38.708232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.709964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.713811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.720714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.722267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.723096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.753621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c394b0a9-6352-4f3f-9c2a-96a399a59671 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171168 Oct 02 01:13:38.758788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1573/2955] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:38 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:38.769682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6751eea4-5a5a-4367-b0a0-19704b2a2c44 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881062e50>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:38.926894 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6751eea4-5a5a-4367-b0a0-19704b2a2c44 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.166757 Oct 02 01:13:38.927485 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1574/2956] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:38 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:39.202299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:39.203098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:39.224276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:39.229368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:39.230199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:39.231692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:39.234554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:39.244534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:39.584124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:39.588068 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:39.594419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f98a69df-8a77-4cc2-b3e2-c6593d73aa0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1266 microversion: 2.1 time: 0.396587 Oct 02 01:13:39.595087 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1575/2957] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:39 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:39.771026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:39.773471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:39.797368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:39.807427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:39.809406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:39.810557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:39.812381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:39.814208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:39.902483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-05959493-2fb9-42d3-9f81-9dfd69a89db5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136874 Oct 02 01:13:39.907222 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1576/2958] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:39 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:39.930943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:39.943561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-832842d4-5f48-43f8-ac31-30c6df67851e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8811ad940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:39.970982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13459289-0463-42b9-9f70-671c0603ac34 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 1.285570 Oct 02 01:13:39.988903 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1383/2959] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:38 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:40.068853 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-832842d4-5f48-43f8-ac31-30c6df67851e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.130546 Oct 02 01:13:40.069463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1577/2960] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:39 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:40.623147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:40.626944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:40.652477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:40.653784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:40.654392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:40.655390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:40.656047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:40.662062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:40.916974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:40.919337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:40.937343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:40.943282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:40.944018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:40.944481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:40.945440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:40.946359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:40.947367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:40.953668 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec7a519e-f240-42b5-8b61-00dec6cae8fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1272 microversion: 2.1 time: 0.336098 Oct 02 01:13:40.954274 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1384/2961] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:40 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:40.998925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:40.999696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:41.022924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.023428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.031055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.036562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.037635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.040261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.040448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5f75c756-2155-4459-95a6-b34cc26ba461 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127382 Oct 02 01:13:41.048973 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1578/2962] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:40 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:13:41.086029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7de3d65-ecec-4c6a-a974-b032aaf185a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8811ad940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:41.197037 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7de3d65-ecec-4c6a-a974-b032aaf185a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.116003 Oct 02 01:13:41.202130 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1579/2963] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:41 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:41.289992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:41.292206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:41.304695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.305209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.305658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.319266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.319827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.320314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.409919 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Cannot 'reboot' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action HTTP/1.1 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 28 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: {"reboot": {"type": "HARD"}} Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'reboot' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '01ff56fa-0255-4a23-af32-50537ccd587e', 'body': {'reboot': {'type': 'HARD'}}} Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ff56fa-0255-4a23-af32-50537ccd587e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:13:41.411749 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 409 to user: Cannot 'reboot' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d3eec8c-067c-4263-8a78-5341e012ce7d tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action" status: 409 len: 145 microversion: 2.1 time: 0.130033 Oct 02 01:13:41.421800 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1580/2964] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:13:41 2022] POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action => generated 145 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:13:41.437254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:41.446579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:41.475216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.475730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.479753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.480627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.480988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.481431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.562672 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Cannot 'rebuild' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action HTTP/1.1 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 65 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'rebuild' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '01ff56fa-0255-4a23-af32-50537ccd587e', 'body': {'rebuild': {'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406'}}} Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ff56fa-0255-4a23-af32-50537ccd587e in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:41.571810 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:41.576397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 409 to user: Cannot 'rebuild' instance 01ff56fa-0255-4a23-af32-50537ccd587e while it is in vm_state rescued {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:41.578519 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43f678da-2e7c-4c3c-bc11-bf147ac23352 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action" status: 409 len: 146 microversion: 2.1 time: 0.153471 Oct 02 01:13:41.578519 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1581/2965] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:13:41 2022] POST /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e/action => generated 146 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:41.590339 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:41.591667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:41.601909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.602921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.603539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.604437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:41.605088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:41.605682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.638028 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:13:41.762046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5b5df268-ccb3-4b95-b71f-cebbe0bd6a55 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 204 len: 0 microversion: 2.1 time: 0.176675 Oct 02 01:13:41.764061 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1582/2966] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:13:41 2022] DELETE /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:13:42.289557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-168d8e34-e966-4991-a7b9-e62e5e90e24e tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Calling method '.version_select at 0x7fb88103f700>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:42.322451 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-168d8e34-e966-4991-a7b9-e62e5e90e24e tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] HTTP exception thrown: Image not found. Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-168d8e34-e966-4991-a7b9-e62e5e90e24e tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Request method failure captured: Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/3951a94b-9746-446f-82ed-c0fa8f806acc/metadata/os_distro HTTP/1.1 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXF1OZoF1BWmAeq8z18quvdlgeoiDEr9rPOGOOJ3j1G5Uw_GQaTx2-90G16NAAggTx5A6Vp3k8ZgX9wnfFU0ozlFv89kSF1hPPHuQ2zH-nApzjlYhzYbcalhfBzM9qTgmmZupfvSF631idVpq6I1DHbpyYcYAszJktlJDjgjgJEQAg Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edfd034d62f4496fb72e741c40c86302"}]}] Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c2f85f8748d9445ba1bcfdb1d31c8a2d Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: action_args: {'image_id': '3951a94b-9746-446f-82ed-c0fa8f806acc', 'id': 'os_distro'} Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3951a94b-9746-446f-82ed-c0fa8f806acc Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:13:42.332031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3951a94b-9746-446f-82ed-c0fa8f806acc could not be found. Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:13:42.337018 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:42.342019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-168d8e34-e966-4991-a7b9-e62e5e90e24e tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:42.343151 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-168d8e34-e966-4991-a7b9-e62e5e90e24e tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] 10.222.0.23 "DELETE /compute/v2.1/images/3951a94b-9746-446f-82ed-c0fa8f806acc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.577011 Oct 02 01:13:42.344112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1583/2967] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:13:41 2022] DELETE /compute/v2.1/images/3951a94b-9746-446f-82ed-c0fa8f806acc/metadata/os_distro => generated 62 bytes in 579 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:42.355449 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:42.359505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:42.376346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:42.381101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:42.382394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:42.384759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:42.385391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:42.388126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:42.782440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:42.808594 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-049d0cce-3c27-44bb-8898-d84b7afb4105 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 1.814233 Oct 02 01:13:42.809854 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1385/2968] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:40 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:42.818123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:42.824480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:42.837924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:42.838829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:42.840516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:42.841551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:42.844743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:42.845621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:42.884256 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=38 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:43.111321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:43.126337 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-46667219-5d7c-4e87-abc2-55d9ed16ef42 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1272 microversion: 2.1 time: 0.312769 Oct 02 01:13:43.127517 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1386/2969] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:42 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:43.146515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40e4d3b2-2872-4192-8553-caca61126a5e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8809fb430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:43.188035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:43.196918 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-af6c6f87-f2d9-4886-8217-0fb3e46f0f81 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1689 microversion: 2.1 time: 0.847005 Oct 02 01:13:43.197516 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1584/2970] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:42 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1689 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:43.219372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-063bc902-a08b-4211-bfc2-d6cddeaabbaf tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Calling method '.version_select at 0x7fb8811294c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:43.248581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40e4d3b2-2872-4192-8553-caca61126a5e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.117238 Oct 02 01:13:43.250946 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1387/2971] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:43 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:43.267893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-063bc902-a08b-4211-bfc2-d6cddeaabbaf tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] HTTP exception thrown: Image not found. Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-063bc902-a08b-4211-bfc2-d6cddeaabbaf tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Request method failure captured: Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/images/9c4fdb24-18ed-48b3-80bb-dd62f9fc1fad/metadata/os_version HTTP/1.1 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXF1OZoF1BWmAeq8z18quvdlgeoiDEr9rPOGOOJ3j1G5Uw_GQaTx2-90G16NAAggTx5A6Vp3k8ZgX9wnfFU0ozlFv89kSF1hPPHuQ2zH-nApzjlYhzYbcalhfBzM9qTgmmZupfvSF631idVpq6I1DHbpyYcYAszJktlJDjgjgJEQAg Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edfd034d62f4496fb72e741c40c86302"}]}] Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c2f85f8748d9445ba1bcfdb1d31c8a2d Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: action_args: {'image_id': '9c4fdb24-18ed-48b3-80bb-dd62f9fc1fad', 'id': 'os_version'} Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9c4fdb24-18ed-48b3-80bb-dd62f9fc1fad Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:13:43.270722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9c4fdb24-18ed-48b3-80bb-dd62f9fc1fad could not be found. Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:13:43.275298 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.280912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-063bc902-a08b-4211-bfc2-d6cddeaabbaf tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:43.282148 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-063bc902-a08b-4211-bfc2-d6cddeaabbaf tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] 10.222.0.23 "GET /compute/v2.1/images/9c4fdb24-18ed-48b3-80bb-dd62f9fc1fad/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.068767 Oct 02 01:13:43.283242 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1585/2972] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:13:43 2022] GET /compute/v2.1/images/9c4fdb24-18ed-48b3-80bb-dd62f9fc1fad/metadata/os_version => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:43.293811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0536dc6-de4f-4e98-a010-ca2e250c5da2 tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Calling method '.version_select at 0x7fb880a7c820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:43.321143 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f0536dc6-de4f-4e98-a010-ca2e250c5da2 tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] HTTP exception thrown: Image not found. Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0536dc6-de4f-4e98-a010-ca2e250c5da2 tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Request method failure captured: Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/images/fbb94084-25f2-453a-85e0-0726c828ec60/metadata HTTP/1.1 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXF1OZoF1BWmAeq8z18quvdlgeoiDEr9rPOGOOJ3j1G5Uw_GQaTx2-90G16NAAggTx5A6Vp3k8ZgX9wnfFU0ozlFv89kSF1hPPHuQ2zH-nApzjlYhzYbcalhfBzM9qTgmmZupfvSF631idVpq6I1DHbpyYcYAszJktlJDjgjgJEQAg Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edfd034d62f4496fb72e741c40c86302"}]}] Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c2f85f8748d9445ba1bcfdb1d31c8a2d Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: action_args: {'image_id': 'fbb94084-25f2-453a-85e0-0726c828ec60'} Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fbb94084-25f2-453a-85e0-0726c828ec60 Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:13:43.323430 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fbb94084-25f2-453a-85e0-0726c828ec60 could not be found. Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0536dc6-de4f-4e98-a010-ca2e250c5da2 tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:43.328197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0536dc6-de4f-4e98-a010-ca2e250c5da2 tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] 10.222.0.23 "GET /compute/v2.1/images/fbb94084-25f2-453a-85e0-0726c828ec60/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035954 Oct 02 01:13:43.336362 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1388/2973] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:13:43 2022] GET /compute/v2.1/images/fbb94084-25f2-453a-85e0-0726c828ec60/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:43.339254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e35d533f-0c08-4c7c-ba6d-62e36f059c8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Action: 'update_all', calling method: .version_select at 0x7fb8816ce790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:43.372687 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e35d533f-0c08-4c7c-ba6d-62e36f059c8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] HTTP exception thrown: Image not found. Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e35d533f-0c08-4c7c-ba6d-62e36f059c8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Request method failure captured: Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/images/f48edea8-0700-4bad-a6f8-2ece94d6fe5d/metadata HTTP/1.1 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 57 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXF1OZoF1BWmAeq8z18quvdlgeoiDEr9rPOGOOJ3j1G5Uw_GQaTx2-90G16NAAggTx5A6Vp3k8ZgX9wnfFU0ozlFv89kSF1hPPHuQ2zH-nApzjlYhzYbcalhfBzM9qTgmmZupfvSF631idVpq6I1DHbpyYcYAszJktlJDjgjgJEQAg Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edfd034d62f4496fb72e741c40c86302"}]}] Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c2f85f8748d9445ba1bcfdb1d31c8a2d Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: action_args: {'image_id': 'f48edea8-0700-4bad-a6f8-2ece94d6fe5d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f48edea8-0700-4bad-a6f8-2ece94d6fe5d Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:13:43.376498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f48edea8-0700-4bad-a6f8-2ece94d6fe5d could not be found. Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e35d533f-0c08-4c7c-ba6d-62e36f059c8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e35d533f-0c08-4c7c-ba6d-62e36f059c8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] 10.222.0.23 "PUT /compute/v2.1/images/f48edea8-0700-4bad-a6f8-2ece94d6fe5d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044028 Oct 02 01:13:43.385647 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1586/2974] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:13:43 2022] PUT /compute/v2.1/images/f48edea8-0700-4bad-a6f8-2ece94d6fe5d/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:43.390650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf5067ee-7763-4f7e-aae0-222bb0ca6a8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Action: 'update', calling method: .version_select at 0x7fb880b0eaf0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:43.427106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-cf5067ee-7763-4f7e-aae0-222bb0ca6a8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] HTTP exception thrown: Image not found. Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf5067ee-7763-4f7e-aae0-222bb0ca6a8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Request method failure captured: Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/images/0c6534a0-c2fd-4e31-902f-71bd13806e94/metadata/os_distro HTTP/1.1 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 30 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXF1OZoF1BWmAeq8z18quvdlgeoiDEr9rPOGOOJ3j1G5Uw_GQaTx2-90G16NAAggTx5A6Vp3k8ZgX9wnfFU0ozlFv89kSF1hPPHuQ2zH-nApzjlYhzYbcalhfBzM9qTgmmZupfvSF631idVpq6I1DHbpyYcYAszJktlJDjgjgJEQAg Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edfd034d62f4496fb72e741c40c86302"}]}] Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c2f85f8748d9445ba1bcfdb1d31c8a2d Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: {"meta": {"os_distro": "alt"}} Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: action_args: {'image_id': '0c6534a0-c2fd-4e31-902f-71bd13806e94', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c6534a0-c2fd-4e31-902f-71bd13806e94 Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:13:43.429182 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c6534a0-c2fd-4e31-902f-71bd13806e94 could not be found. Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf5067ee-7763-4f7e-aae0-222bb0ca6a8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf5067ee-7763-4f7e-aae0-222bb0ca6a8c tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] 10.222.0.23 "PUT /compute/v2.1/images/0c6534a0-c2fd-4e31-902f-71bd13806e94/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.045943 Oct 02 01:13:43.433204 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1389/2975] 10.222.0.23 () {60 vars in 1310 bytes} [Sun Oct 2 01:13:43 2022] PUT /compute/v2.1/images/0c6534a0-c2fd-4e31-902f-71bd13806e94/metadata/os_distro => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 02 01:13:43.442949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8f61aab-76d3-4be7-89bd-ab8bf667c5ca tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Action: 'create', calling method: .version_select at 0x7fb8811b80d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:43.478300 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e8f61aab-76d3-4be7-89bd-ab8bf667c5ca tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] HTTP exception thrown: Image not found. Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8f61aab-76d3-4be7-89bd-ab8bf667c5ca tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Request method failure captured: Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/images/6fc70b9c-65aa-427e-9545-fb031a5644f8/metadata HTTP/1.1 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 57 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXF1OZoF1BWmAeq8z18quvdlgeoiDEr9rPOGOOJ3j1G5Uw_GQaTx2-90G16NAAggTx5A6Vp3k8ZgX9wnfFU0ozlFv89kSF1hPPHuQ2zH-nApzjlYhzYbcalhfBzM9qTgmmZupfvSF631idVpq6I1DHbpyYcYAszJktlJDjgjgJEQAg Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edfd034d62f4496fb72e741c40c86302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edfd034d62f4496fb72e741c40c86302"}]}] Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: edfd034d62f4496fb72e741c40c86302 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c2f85f8748d9445ba1bcfdb1d31c8a2d Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1040082886-project Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: action_args: {'image_id': '6fc70b9c-65aa-427e-9545-fb031a5644f8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6fc70b9c-65aa-427e-9545-fb031a5644f8 Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:13:43.481572 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fc70b9c-65aa-427e-9545-fb031a5644f8 could not be found. Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8f61aab-76d3-4be7-89bd-ab8bf667c5ca tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:43.486275 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e8f61aab-76d3-4be7-89bd-ab8bf667c5ca tempest-ImagesMetadataNegativeTestJSON-1040082886 tempest-ImagesMetadataNegativeTestJSON-1040082886-project] 10.222.0.23 "POST /compute/v2.1/images/6fc70b9c-65aa-427e-9545-fb031a5644f8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.045875 Oct 02 01:13:43.497336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1587/2976] 10.222.0.23 () {60 vars in 1281 bytes} [Sun Oct 2 01:13:43 2022] POST /compute/v2.1/images/6fc70b9c-65aa-427e-9545-fb031a5644f8/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:13:43.677124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c04cca07-6195-49b1-aa40-a3e573a5545a req-c5d038bb-ace5-4fd7-8fdf-7e6145effe3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56bb3075-cb62-451e-99ff-27487026bce3", "tag": "1afbb3fb-f49d-429e-aba6-9062a035e604"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:43.689896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c04cca07-6195-49b1-aa40-a3e573a5545a req-c5d038bb-ace5-4fd7-8fdf-7e6145effe3d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:43.692168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c04cca07-6195-49b1-aa40-a3e573a5545a req-c5d038bb-ace5-4fd7-8fdf-7e6145effe3d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:43.692829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c04cca07-6195-49b1-aa40-a3e573a5545a req-c5d038bb-ace5-4fd7-8fdf-7e6145effe3d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:43.706586 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c04cca07-6195-49b1-aa40-a3e573a5545a req-c5d038bb-ace5-4fd7-8fdf-7e6145effe3d service nova] Creating event network-changed:1afbb3fb-f49d-429e-aba6-9062a035e604 for instance 56bb3075-cb62-451e-99ff-27487026bce3 on n-h2-master-1 Oct 02 01:13:43.713327 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c04cca07-6195-49b1-aa40-a3e573a5545a req-c5d038bb-ace5-4fd7-8fdf-7e6145effe3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049161 Oct 02 01:13:43.714572 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1390/2977] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:43.836360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:43.837483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:43.852284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:43.856431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:43.857786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:43.859719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:43.860442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:43.861255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.156316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:44.157575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:44.173129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:44.177166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:44.177787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.178707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:44.179425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:44.195886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.593990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:44.609528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9cfd725e-fc0c-412b-a576-b1f6a4292b35 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 0.459352 Oct 02 01:13:44.626978 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1391/2978] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:44 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:44.628413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:44.629029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:44.652904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:44.654525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:44.655166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.655908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:44.658193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:44.660061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.769558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:44.779859 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9680589-ad29-496c-9f0d-918681b43235 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 0.949961 Oct 02 01:13:44.780836 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1588/2979] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:43 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:44.786005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b56aa54-9339-4845-a74a-c89f692ab866 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8813421f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:44.863120 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b56aa54-9339-4845-a74a-c89f692ab866 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.080401 Oct 02 01:13:44.866807 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1589/2980] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:44 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:45.004186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:45.013528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c1e6de6-7136-477e-b8f8-13dad718f598 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1689 microversion: 2.1 time: 0.396432 Oct 02 01:13:45.018207 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1392/2981] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:44 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1689 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:45.640198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:45.641078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:45.656534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:45.659801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:45.660185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:45.660990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:45.663048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:45.663502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:45.821573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:45.823081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:45.834168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:45.835266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:45.835856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:45.839268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:45.840112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:45.841176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:45.847834 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:46.797728 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=40 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:47.368708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:47.391035 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-59759cbb-5428-43ac-b759-a35a2e629d88 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 1.588058 Oct 02 01:13:47.391554 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1393/2982] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:45 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:47.656460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:47.685927 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1d67a89a-a736-4c1e-9769-75540aef8b9c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 2.044455 Oct 02 01:13:47.687062 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1590/2983] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:45 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:47.708060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1120a0c1-e73b-457f-b655-7d699d2d97a3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881353160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:47.768067 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1120a0c1-e73b-457f-b655-7d699d2d97a3 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.079199 Oct 02 01:13:47.769421 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1591/2984] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:47 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:47.776168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:47.777137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:47.796959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:47.797956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:47.798576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:47.800373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:47.801076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:47.801698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:47.861731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Action: 'update', calling method: .version_select at 0x7fb8809f7430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:47.872374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:47.873096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:47.873907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:47.901350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:47.902367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:47.903083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:47.972427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] HTTP exception thrown: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Request method failure captured: Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35 HTTP/1.1 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 56 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXJdYcLCy-yuSmgwZ8w-mra0VtyYXDNXNqVBi3Sl-9e0PayCbPrTUtDBcX26lS9Lfk2km5MpPmozmhcW_ind6Pr2bh0TfzN01-633retu80zYVPWzA720fhG_G4Owr2dh5Ur8wbcgNX-tr60MelWGoqu0zDaXp0vXC7vyGtuJbtLj8 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.53 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 74a5db96ff50409aa7d82bbcec32b9ee Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74a5db96ff50409aa7d82bbcec32b9ee"}]}] Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 74a5db96ff50409aa7d82bbcec32b9ee Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 338a2b7cdd8c4d23a53588de01c8b2f5 Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: exception: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '76025181-fb68-455c-a853-61b900abed35', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:47.986246 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:47.992761 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:47.994780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Returning 404 to user: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:47.997253 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b1748c3-3c83-4ec4-a020-2c0ea8d8e9e6 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35" status: 404 len: 110 microversion: 2.53 time: 0.583650 Oct 02 01:13:47.999777 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1394/2985] 10.222.0.23 () {62 vars in 1309 bytes} [Sun Oct 2 01:13:47 2022] PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35 => generated 110 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:13:48.009738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Action: 'update', calling method: .version_select at 0x7fb880997700>, body: {"status": "disabled"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:48.025141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.026258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.031633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.047666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.051078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.051763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.064822 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] HTTP exception thrown: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Request method failure captured: Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35 HTTP/1.1 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 22 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXJdYcLCy-yuSmgwZ8w-mra0VtyYXDNXNqVBi3Sl-9e0PayCbPrTUtDBcX26lS9Lfk2km5MpPmozmhcW_ind6Pr2bh0TfzN01-633retu80zYVPWzA720fhG_G4Owr2dh5Ur8wbcgNX-tr60MelWGoqu0zDaXp0vXC7vyGtuJbtLj8 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.53 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 74a5db96ff50409aa7d82bbcec32b9ee Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74a5db96ff50409aa7d82bbcec32b9ee"}]}] Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 74a5db96ff50409aa7d82bbcec32b9ee Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 338a2b7cdd8c4d23a53588de01c8b2f5 Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: {"status": "disabled"} Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: exception: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '76025181-fb68-455c-a853-61b900abed35', 'body': {'status': 'disabled'}} Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:48.069152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.073560 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.076079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Returning 404 to user: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:48.077674 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1f35232-491f-4c38-b955-b18a2a28e5fb tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35" status: 404 len: 110 microversion: 2.53 time: 0.072296 Oct 02 01:13:48.082836 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1395/2986] 10.222.0.23 () {62 vars in 1309 bytes} [Sun Oct 2 01:13:48 2022] PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:13:48.098460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Action: 'update', calling method: .version_select at 0x7fb880a6bc10>, body: {"status": "enabled"} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:48.106919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.108920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.109621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.126131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.128530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.129348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.142847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] HTTP exception thrown: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Request method failure captured: Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35 HTTP/1.1 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 21 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXJdYcLCy-yuSmgwZ8w-mra0VtyYXDNXNqVBi3Sl-9e0PayCbPrTUtDBcX26lS9Lfk2km5MpPmozmhcW_ind6Pr2bh0TfzN01-633retu80zYVPWzA720fhG_G4Owr2dh5Ur8wbcgNX-tr60MelWGoqu0zDaXp0vXC7vyGtuJbtLj8 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.53 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 74a5db96ff50409aa7d82bbcec32b9ee Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74a5db96ff50409aa7d82bbcec32b9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74a5db96ff50409aa7d82bbcec32b9ee"}]}] Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 74a5db96ff50409aa7d82bbcec32b9ee Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 338a2b7cdd8c4d23a53588de01c8b2f5 Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: {"status": "enabled"} Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: exception: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '76025181-fb68-455c-a853-61b900abed35', 'body': {'status': 'enabled'}} Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:13:48.157130 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. Oct 02 01:13:48.170220 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:13:48.181509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Returning 404 to user: Service 76025181-fb68-455c-a853-61b900abed35 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:48.181509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-769ee45f-70b3-4744-9476-b4406942cb99 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35" status: 404 len: 110 microversion: 2.53 time: 0.081441 Oct 02 01:13:48.182683 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1396/2987] 10.222.0.23 () {62 vars in 1309 bytes} [Sun Oct 2 01:13:48 2022] PUT /compute/v2.1/os-services/76025181-fb68-455c-a853-61b900abed35 => generated 110 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:13:48.187903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.192023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.195782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.198704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.201264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.201846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.203082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.247520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7fc411d-8e80-43eb-baa8-28407cee1cdc tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063460 Oct 02 01:13:48.259154 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1397/2988] 10.222.0.23 () {60 vars in 1178 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:48.274549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.284423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.286857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.290046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.291411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.292379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.293047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.375771 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a53c73f2-5847-4c94-8c86-0e925d91c85b tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.114821 Oct 02 01:13:48.394812 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1398/2989] 10.222.0.23 () {60 vars in 1211 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:48.407050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.413630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.414670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.415280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.416953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.417665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.418509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.452835 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ca41d52-248b-4720-bea8-f4cac986f254 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.052903 Oct 02 01:13:48.454072 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1399/2990] 10.222.0.23 () {60 vars in 1178 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:13:48.459350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.460237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:48.476198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.478442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.479167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.482163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.483063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.483810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.682371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:48.699783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f5f0637a-030c-4740-b9cc-9930f83c12ab tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1689 microversion: 2.1 time: 0.928885 Oct 02 01:13:48.700876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1592/2991] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:47 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1689 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:48.726172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.732200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.733088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.733704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.734848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.735476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.736248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.771951 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dda86b7c-4151-40ac-9449-f8465b078723 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.055070 Oct 02 01:13:48.774942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1593/2992] 10.222.0.23 () {60 vars in 1235 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:48.791258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.792846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:48.806739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.810109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.813342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.814364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.818021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.819029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:49.762407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:49.781422 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78200a70-3f4d-4ec0-9308-1be4ea333b47 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 1.004088 Oct 02 01:13:49.784868 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1594/2993] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:49.794579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d31b4136-57f1-493b-9c0a-bd68ac3fc359 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881342af0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:49.831414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:49.840008 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e14e16df-5c0c-49bd-b386-32a94b116ac6 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 1.384387 Oct 02 01:13:49.844936 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1400/2994] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:49.850959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:49.859581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:49.867489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:49.875883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:49.877121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:49.877847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:49.883348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:49.916573 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d31b4136-57f1-493b-9c0a-bd68ac3fc359 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.130377 Oct 02 01:13:49.919137 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1595/2995] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:49 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:49.941776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b8b3f858-0563-46f4-88d9-30428510eb58 req-85fba500-624c-4748-86aa-e0cb612675bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19dbd236-4878-4e8f-876b-4bb16c9b85b0", "tag": "05552769-9647-44a3-b4b1-cc20d94caa6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:49.977093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5402957-51a5-4115-a6f5-ae08d4640b9f tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.128042 Oct 02 01:13:49.988044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b8b3f858-0563-46f4-88d9-30428510eb58 req-85fba500-624c-4748-86aa-e0cb612675bd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:49.988631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b8b3f858-0563-46f4-88d9-30428510eb58 req-85fba500-624c-4748-86aa-e0cb612675bd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:49.989149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b8b3f858-0563-46f4-88d9-30428510eb58 req-85fba500-624c-4748-86aa-e0cb612675bd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:49.993686 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1401/2996] 10.222.0.23 () {60 vars in 1178 bytes} [Sun Oct 2 01:13:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:13:50.016894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:50.019353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:50.024442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b8b3f858-0563-46f4-88d9-30428510eb58 req-85fba500-624c-4748-86aa-e0cb612675bd service nova] Creating event network-changed:05552769-9647-44a3-b4b1-cc20d94caa6a for instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 on n-h1-master-1 Oct 02 01:13:50.037432 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b8b3f858-0563-46f4-88d9-30428510eb58 req-85fba500-624c-4748-86aa-e0cb612675bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104951 Oct 02 01:13:50.038492 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1596/2997] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:50.040627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.041127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.045211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:50.045375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.046001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.046471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.046929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.062450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.063252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.063969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.064971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.066824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.069702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.137664 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-894da8a1-832c-4327-98f2-1f78f20bea68 tempest-ServicesAdminNegativeV253TestJSON-1134804707 tempest-ServicesAdminNegativeV253TestJSON-1134804707-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.095438 Oct 02 01:13:50.140047 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1597/2998] 10.222.0.23 () {60 vars in 1239 bytes} [Sun Oct 2 01:13:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:50.513323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a64aa0e5-b2cc-4b6d-b4fb-1cbfd999034c tempest-ServicesAdminNegativeV253TestJSON-426029936 tempest-ServicesAdminNegativeV253TestJSON-426029936-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:50.516701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a64aa0e5-b2cc-4b6d-b4fb-1cbfd999034c tempest-ServicesAdminNegativeV253TestJSON-426029936 tempest-ServicesAdminNegativeV253TestJSON-426029936-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1d3f50ccb8c94d639e25978096ceadde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6d15d072944a39d152df7786d4c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a64aa0e5-b2cc-4b6d-b4fb-1cbfd999034c tempest-ServicesAdminNegativeV253TestJSON-426029936 tempest-ServicesAdminNegativeV253TestJSON-426029936-project] Request method failure captured: Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXIGUvsRoPc-yyaRCB4DzhptY_TI8ZDV-gGM4ecaAYBPM2gIW0P4sLe__nAWdtl020u8_fGMUnWgdY5iobGX482B3ggVvsTqV1ywBSIY7vj4lkbTw2XcvzM04GNsBVjRdDvqUIukCaFUvuV9sZUOBRtAnp984I7DYBXXNZpk0u5Ego Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.53 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2ca6d15d072944a39d152df7786d4c71 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-426029936 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ca6d15d072944a39d152df7786d4c71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ca6d15d072944a39d152df7786d4c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ca6d15d072944a39d152df7786d4c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ca6d15d072944a39d152df7786d4c71"}]}] Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-426029936 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2ca6d15d072944a39d152df7786d4c71 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-426029936 Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServicesAdminNegativeV253TestJSON-426029936-project Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 1d3f50ccb8c94d639e25978096ceadde Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-426029936-project Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise self.value Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 02 01:13:50.529616 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:50.533593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a64aa0e5-b2cc-4b6d-b4fb-1cbfd999034c tempest-ServicesAdminNegativeV253TestJSON-426029936 tempest-ServicesAdminNegativeV253TestJSON-426029936-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:50.540682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a64aa0e5-b2cc-4b6d-b4fb-1cbfd999034c tempest-ServicesAdminNegativeV253TestJSON-426029936 tempest-ServicesAdminNegativeV253TestJSON-426029936-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.380794 Oct 02 01:13:50.541534 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1598/2999] 10.222.0.23 () {60 vars in 1178 bytes} [Sun Oct 2 01:13:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:13:50.544236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:50.556647 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffe16cc3-f6bc-4c88-8bf6-ed9872225ee6 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1621 microversion: 2.1 time: 0.560693 Oct 02 01:13:50.581627 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1402/3000] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:49 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1621 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:50.814552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:50.820605 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:50.853533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.854368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.860614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.868102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.869963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.871160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.877611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:50.879897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:50.895544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.896417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.897268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.898278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.903224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.904032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:51.359362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:51.371911 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e698be82-0633-444f-b1b2-f0ab0061d9d4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 0.566502 Oct 02 01:13:51.380594 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1599/3001] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:50 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:51.390209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-824b340e-4e2c-4688-a46c-db0d68166400 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8807115e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:51.521119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-824b340e-4e2c-4688-a46c-db0d68166400 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.139120 Oct 02 01:13:51.521850 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1600/3002] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:51 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:51.594821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:51.595694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:51.608079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:51.610802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:51.611637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:51.617958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:51.618954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:51.621111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:51.653993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:51.666419 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03e287a9-5897-48ac-aeba-5f03dedb1ece tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 0.793379 Oct 02 01:13:51.671436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1403/3003] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:50 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:51.957228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:51.979537 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13d8a019-bbb2-41f0-bdea-62a028d2f8c3 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1621 microversion: 2.1 time: 0.382588 Oct 02 01:13:51.980541 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1601/3004] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:51 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1621 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:52.401554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:52.402903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:52.412012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:52.412506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:52.412938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:52.413648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:52.414096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:52.414519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:52.537934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d846713-2a27-44b1-80ef-2be7aa090d7f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88144b3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:52.647053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d846713-2a27-44b1-80ef-2be7aa090d7f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.114494 Oct 02 01:13:52.655057 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1602/3005] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:52 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:52.692217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:52.692841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:52.703930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:52.704429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:52.704868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:52.705581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:52.706654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:52.716708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.333809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:54.342085 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3059ef5-bef9-4071-8c32-52b4632c4ff2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 1.944510 Oct 02 01:13:54.342708 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1404/3006] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:52 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:54.363672 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:54.364450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:54.385226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:54.385730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:54.386174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.386925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:54.387384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:54.387814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.433530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:54.452056 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95a82cb4-6f84-4f7f-a364-4edb80945663 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 1.763796 Oct 02 01:13:54.461303 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1603/3007] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:52 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:54.480859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-78f0d091-6496-430e-bd35-9a7569cac04a req-e992b958-1404-49a9-be2b-c6872200e170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481845ee-ce3d-4b19-95a4-4eeda0435f4d", "name": "network-vif-deleted", "tag": "225eff9c-49dd-4284-907a-878dd594d1bf"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:13:54.545215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-78f0d091-6496-430e-bd35-9a7569cac04a req-e992b958-1404-49a9-be2b-c6872200e170 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:54.545814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-78f0d091-6496-430e-bd35-9a7569cac04a req-e992b958-1404-49a9-be2b-c6872200e170 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:54.546269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-78f0d091-6496-430e-bd35-9a7569cac04a req-e992b958-1404-49a9-be2b-c6872200e170 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.547912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:54.551066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:54.552801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.554648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'fault' on Instance uuid 481845ee-ce3d-4b19-95a4-4eeda0435f4d {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:13:54.563558 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:54.633372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-78f0d091-6496-430e-bd35-9a7569cac04a req-e992b958-1404-49a9-be2b-c6872200e170 service nova] Creating event network-vif-deleted:225eff9c-49dd-4284-907a-878dd594d1bf for instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d on n-h2-master-1 Oct 02 01:13:54.661162 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-78f0d091-6496-430e-bd35-9a7569cac04a req-e992b958-1404-49a9-be2b-c6872200e170 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198500 Oct 02 01:13:54.661796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1604/3008] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:54.691924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bdd5e900-2cd1-4815-af6d-f82180aa4620 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88157c9d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:54.708484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:54.745788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a43013d8-1da0-46fc-a5b1-b84117cb746e tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 200 len: 1336 microversion: 2.1 time: 0.400511 Oct 02 01:13:54.749036 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1405/3009] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:54 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 1336 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:54.819909 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bdd5e900-2cd1-4815-af6d-f82180aa4620 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.156821 Oct 02 01:13:54.828331 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1605/3010] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:54 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:55.366417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:55.367309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:55.386537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:55.403133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:55.403622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:55.408697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:55.409259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:55.417497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:55.490543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:55.491319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:55.508304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:55.508811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:55.509254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:55.510000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:55.510457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:55.524248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:56.623129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:56.636260 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1acc01b-60f0-4f1d-ba2d-a159d5fbe13a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 1.150956 Oct 02 01:13:56.637135 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1606/3011] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:55 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:56.645908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:56.646816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 481845ee-ce3d-4b19-95a4-4eeda0435f4d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:56.655196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:56.664854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:56.665496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:56.666563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:56.667339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:56.667783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:56.722331 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:56.732455 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d could not be found. Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d HTTP/1.1 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d could not be found. Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '481845ee-ce3d-4b19-95a4-4eeda0435f4d'} Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d could not be found. Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d could not be found. Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:56.746141 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d could not be found. Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:13:56.751143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 404 to user: Instance 481845ee-ce3d-4b19-95a4-4eeda0435f4d could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:13:56.756523 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ffaeae3-b9d3-4e5c-abfb-78fb8225ab34 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d" status: 404 len: 111 microversion: 2.1 time: 0.115630 Oct 02 01:13:56.764792 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1607/3012] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:56 2022] GET /compute/v2.1/servers/481845ee-ce3d-4b19-95a4-4eeda0435f4d => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:56.773997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3d25fc3-4fad-4b9f-a071-137f2fc82f36 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8811ade50>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:56.798413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:56.813867 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df56cb56-01fd-402e-b7c7-96b50feb4ceb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 1.452855 Oct 02 01:13:56.838624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1406/3013] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:55 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:56.864778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c18f808-4f0c-4aa4-a9de-0e58f6d5a7cb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '.version_select at 0x7fb880a43a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:56.913701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3d25fc3-4fad-4b9f-a071-137f2fc82f36 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.148061 Oct 02 01:13:56.914713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1608/3014] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:56 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:56.939087 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4c18f808-4f0c-4aa4-a9de-0e58f6d5a7cb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205326892" status: 202 len: 0 microversion: 2.1 time: 0.111108 Oct 02 01:13:56.940179 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1407/3015] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205326892 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:13:57.660142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:57.662058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:57.677206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:57.679597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:57.680378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:57.683179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:57.685690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:57.687873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:57.858061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:57.859792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:57.878375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:57.881712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:57.884320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:57.889497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:57.891348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:57.891838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:59.793697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:59.806739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:13:59.821163 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c92b5003-f7c0-4992-9c31-f5abdbc218bf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 1.969551 Oct 02 01:13:59.825144 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47f142e0-7c91-49e0-990e-9ff766fbc8fa tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 2.169474 Oct 02 01:13:59.825745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1609/3016] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:57 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:13:59.845028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1408/3017] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:13:57 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:13:59.885350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-21af5988-3ab4-4951-80bd-bfa5b8e03d26 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88560ed30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:00.012113 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-21af5988-3ab4-4951-80bd-bfa5b8e03d26 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.172337 Oct 02 01:14:00.012710 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1610/3018] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:59 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:00.851364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:00.852039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:00.867687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:00.868424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:00.870755 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:00.880438 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=14 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:00.895397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:00.897697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:00.902827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:00.905733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:00.911440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:00.911856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:00.913339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:00.916398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:00.916892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:00.917656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:00.918181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:00.937562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:01.810835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:01.820040 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e799c4b1-4d4f-423d-8e8b-7f9072b2c058 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 0.974144 Oct 02 01:14:01.820633 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1409/3019] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:00 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:01.857016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0493deaf-6752-4138-8ce9-8a37be8c32a4 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88098f700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:01.990072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:02.004336 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0493deaf-6752-4138-8ce9-8a37be8c32a4 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.171414 Oct 02 01:14:02.012636 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e6103e34-decc-485b-9158-d1c18eb83ae4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 1.149283 Oct 02 01:14:02.014064 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1410/3020] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:01 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:02.024463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1611/3021] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:00 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:02.028340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-53ddb903-7699-45cc-a972-c4aa21b6970a req-6c485c63-e808-42c2-ad40-f853aba7b22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bb3075-cb62-451e-99ff-27487026bce3", "name": "network-vif-plugged", "status": "completed", "tag": "1afbb3fb-f49d-429e-aba6-9062a035e604"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:02.103270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-53ddb903-7699-45cc-a972-c4aa21b6970a req-6c485c63-e808-42c2-ad40-f853aba7b22c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:02.104726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-53ddb903-7699-45cc-a972-c4aa21b6970a req-6c485c63-e808-42c2-ad40-f853aba7b22c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:02.107127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-53ddb903-7699-45cc-a972-c4aa21b6970a req-6c485c63-e808-42c2-ad40-f853aba7b22c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:02.123572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-53ddb903-7699-45cc-a972-c4aa21b6970a req-6c485c63-e808-42c2-ad40-f853aba7b22c service nova] Creating event network-vif-plugged:1afbb3fb-f49d-429e-aba6-9062a035e604 for instance 56bb3075-cb62-451e-99ff-27487026bce3 on n-h2-master-1 Oct 02 01:14:02.134334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-53ddb903-7699-45cc-a972-c4aa21b6970a req-6c485c63-e808-42c2-ad40-f853aba7b22c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118186 Oct 02 01:14:02.135724 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1411/3022] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:02.848545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:02.849369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:02.861985 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:02.865555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:02.868302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:02.868756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:02.869509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:02.870617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:02.871067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:03.032338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ddf76ea-51e3-4eab-a455-17b1a04999a0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8809374c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:03.140628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ddf76ea-51e3-4eab-a455-17b1a04999a0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.114772 Oct 02 01:14:03.141574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1412/3023] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:03 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:14:03.154965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:03.161147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:03.183506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:03.184404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:03.184972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:03.188752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:03.189362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:03.190415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:03.710834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:03.736088 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8b22b0f-4a1e-428d-8224-400d15be3b28 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1324 microversion: 2.1 time: 0.891848 Oct 02 01:14:03.740052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1612/3024] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:02 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1324 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:03.777567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57b1e8a1-5da5-4159-b824-20bd1d1718cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Action: 'create', calling method: .version_select at 0x7fb8812045e0>, body: {"keypair": {"name": "tempest-keypair-1545194574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzf5QSFFOPq414gAtiAdrt271+53LPdXcSdT3K5x2hSGPkLL9uquOyRsSFzxfB17VAtfUlK5aECTnzc9QkD7Xe7zGLSjN917Gzt7F1+A6LLmXaDFyTVXPdYfv/dx4Yq6Q=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:03.825334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-57b1e8a1-5da5-4159-b824-20bd1d1718cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Getting quotas for project 447cbc915a47450c8bc98a83e919310a. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:03.840534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:03.853803 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05bbdcda-e2ac-4d85-b3f9-56e6eb5cbd0b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 0.707350 Oct 02 01:14:03.855969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-57b1e8a1-5da5-4159-b824-20bd1d1718cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Getting quotas for user ef737c7d2aa247388c88fc2ad7ea5748 and project 447cbc915a47450c8bc98a83e919310a. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:03.860971 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1413/3025] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:03 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:03.898048 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-57b1e8a1-5da5-4159-b824-20bd1d1718cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.154925 Oct 02 01:14:03.900295 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1613/3026] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:14:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:14:04.157712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f89e7d3-e4c6-420e-9ef4-b3afebc573a9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880926790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:04.257135 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f89e7d3-e4c6-420e-9ef4-b3afebc573a9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.103318 Oct 02 01:14:04.257901 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1414/3027] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:04 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:04.762077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:04.763557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:04.782847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:04.785193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:04.787132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:04.804818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:04.809053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:04.811646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:04.885134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:04.886794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:04.899596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:04.900895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:04.901975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:04.906735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:04.908248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:04.910379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:05.688977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:05.710658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1375e9e4-5252-46a1-9f32-3144f80378eb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 0.826491 Oct 02 01:14:05.720555 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1415/3028] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:04 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:14:05.737252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:05.748961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-334bf0c9-d513-4868-88c5-3209a7fc6cef tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 0.990033 Oct 02 01:14:05.751390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bf65780b-7537-419b-abf6-0189de7fa828 req-4decf5ea-94e6-4305-9bb1-4f00903fcc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19dbd236-4878-4e8f-876b-4bb16c9b85b0", "name": "network-vif-plugged", "status": "completed", "tag": "05552769-9647-44a3-b4b1-cc20d94caa6a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:05.755603 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1614/3029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:04 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:05.768336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-274492fa-6fe5-4bca-9d25-5c4b4d2a3837 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88150e430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:05.818752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bf65780b-7537-419b-abf6-0189de7fa828 req-4decf5ea-94e6-4305-9bb1-4f00903fcc33 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:05.820380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bf65780b-7537-419b-abf6-0189de7fa828 req-4decf5ea-94e6-4305-9bb1-4f00903fcc33 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:05.822902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bf65780b-7537-419b-abf6-0189de7fa828 req-4decf5ea-94e6-4305-9bb1-4f00903fcc33 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:05.903689 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bf65780b-7537-419b-abf6-0189de7fa828 req-4decf5ea-94e6-4305-9bb1-4f00903fcc33 service nova] Creating event network-vif-plugged:05552769-9647-44a3-b4b1-cc20d94caa6a for instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 on n-h1-master-1 Oct 02 01:14:05.950710 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-274492fa-6fe5-4bca-9d25-5c4b4d2a3837 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.182649 Oct 02 01:14:05.978024 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1615/3030] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:05 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:05.991489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bf65780b-7537-419b-abf6-0189de7fa828 req-4decf5ea-94e6-4305-9bb1-4f00903fcc33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263356 Oct 02 01:14:06.003803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1416/3031] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:06.019469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:06.031581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:06.075939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:06.085161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:06.087400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:06.096487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:06.099617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:06.100399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:06.763385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:06.765242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:06.791439 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:06.795860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:06.796633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:06.797066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:06.797814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:06.800595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:06.804641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:07.345714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:07.380537 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e568f536-6e9f-4eb8-b15b-4437b4918910 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 1.395645 Oct 02 01:14:07.384056 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1616/3032] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:05 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:07.405740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e960ea3-9318-44a1-8a77-b72ac3d56c00 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88161c3a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:07.564597 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1e960ea3-9318-44a1-8a77-b72ac3d56c00 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1414 microversion: 2.1 time: 0.177187 Oct 02 01:14:07.565430 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1617/3033] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:07 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:07.592019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-28883950", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "30932a8d-2c64-4a77-bbf3-82ca6328967c"}, {"uuid": "eb9543f1-455b-46ed-93b2-8f3a24b1ea71"}, {"uuid": "30932a8d-2c64-4a77-bbf3-82ca6328967c"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:07.683396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:07.691516 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4eeb7c9a-a370-4fab-8a21-f4d5b1d74bb0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1314 microversion: 2.1 time: 0.949220 Oct 02 01:14:07.692097 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1417/3034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:06 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:14:07.718489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1bdc6a31-2d5f-4b52-bc54-87dd1b5d06d5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-567014631", "metadata": {"": ""}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1bdc6a31-2d5f-4b52-bc54-87dd1b5d06d5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action HTTP/1.1 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 106 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-567014631", "metadata": {"": ""}}} Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-567014631', 'metadata': {'': ''}}}} Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'': ''} Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:14:07.723418 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:07.727697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:07.731930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1bdc6a31-2d5f-4b52-bc54-87dd1b5d06d5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:07.742589 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1bdc6a31-2d5f-4b52-bc54-87dd1b5d06d5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action" status: 400 len: 170 microversion: 2.1 time: 0.040533 Oct 02 01:14:07.743465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1418/3035] 10.222.0.23 () {60 vars in 1279 bytes} [Sun Oct 2 01:14:07 2022] POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action => generated 170 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:14:07.758647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:07.767414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:07.769718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] validate_networks() for [('30932a8d-2c64-4a77-bbf3-82ca6328967c', None, None, None, None, None), ('eb9543f1-455b-46ed-93b2-8f3a24b1ea71', None, None, None, None, None), ('30932a8d-2c64-4a77-bbf3-82ca6328967c', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:07.793727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:07.794463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:07.795097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:07.796161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:07.796870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:07.798730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:08.481096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:08.492282 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb6b1b4a-35db-4ada-b691-7535dc0c92fd tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 0.742789 Oct 02 01:14:08.493563 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1419/3036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:07 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:08.517466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:08.521964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:08.531172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:08.536375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:08.537072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:08.538590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:08.544521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:08.545216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:09.745206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:09.756689 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-734a48f4-06c4-4795-977d-65c0168ec31b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 1.243134 Oct 02 01:14:09.768152 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1420/3037] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:08 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:14:09.785485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28efe7d6-6ce9-4652-911a-c93f79cb3929 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880a43dc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:09.856429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28efe7d6-6ce9-4652-911a-c93f79cb3929 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1423 microversion: 2.1 time: 0.086115 Oct 02 01:14:09.857003 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1421/3038] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:09 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:09.875864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:09.876481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:09.891447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:09.891999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:09.892442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:09.893155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:09.895221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:09.895855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:10.322625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:10.338625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e8bd72a8-10e5-4adb-b285-1e272b4df2ba tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1500 microversion: 2.1 time: 0.478653 Oct 02 01:14:10.341036 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1422/3039] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:09 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1500 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:10.359871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1095436933", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3905b6d4-1633-471e-9f4e-9547c8270f9f"}, {"port": "1eacffaa-d469-4d5d-8028-a6edca0baa66", "tag": "port-1"}, {"port": "4a47e1ce-0f9e-4ca0-a5e1-dc5927d7fb75", "tag": "port-2"}, {"uuid": "b97253ef-face-4cad-8160-90d62873262e", "tag": "net-1"}, {"uuid": "b97253ef-face-4cad-8160-90d62873262e"}, {"uuid": "9181e1d0-bd5b-4518-9ffc-602e3e3d2200", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9181e1d0-bd5b-4518-9ffc-602e3e3d2200", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a839b275-bae1-420a-9f4d-d52b86e9c51f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1e5700cb-3001-4919-970d-2bfe910902bc", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "68377c0f-04a2-4cde-ac9b-9f01fd996723", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--736113930"}], "key_name": "tempest-keypair-1545194574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:10.899942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] validate_networks() for [('3905b6d4-1633-471e-9f4e-9547c8270f9f', None, None, None, None, None), (None, None, '1eacffaa-d469-4d5d-8028-a6edca0baa66', None, None, None), (None, None, '4a47e1ce-0f9e-4ca0-a5e1-dc5927d7fb75', None, None, None), ('b97253ef-face-4cad-8160-90d62873262e', None, None, None, None, None), ('b97253ef-face-4cad-8160-90d62873262e', None, None, None, None, None), ('9181e1d0-bd5b-4518-9ffc-602e3e3d2200', '10.2.2.100', None, None, None, None), ('9181e1d0-bd5b-4518-9ffc-602e3e3d2200', '10.2.2.200', None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:12.345830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:12.345830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:12.346476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:12.354240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:12.359124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:12.394742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:12.395451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:12.396079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:12.397030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:12.398140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:12.401835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:12.458278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Getting quotas for project bf661665ac114503b71ac751f84bfdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:12.481745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Getting quotas for user 852e8ab225d64f40a4dc9ce54fe509fd and project bf661665ac114503b71ac751f84bfdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:12.543088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:12.548371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:12.692094 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4bd72cae-128f-4405-b15e-40c81fb034f3 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.118433 Oct 02 01:14:12.693886 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1618/3040] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 5127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:14:12.704400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be7a6649-14a5-4f3f-8933-e1fa992d0c99 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-733593807", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be7a6649-14a5-4f3f-8933-e1fa992d0c99 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action HTTP/1.1 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 618 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-733593807", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-733593807', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:14:12.722568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:14:12.725785 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:12.731002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be7a6649-14a5-4f3f-8933-e1fa992d0c99 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:12.733826 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be7a6649-14a5-4f3f-8933-e1fa992d0c99 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action" status: 400 len: 938 microversion: 2.1 time: 0.038784 Oct 02 01:14:12.737055 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1619/3041] 10.222.0.23 () {60 vars in 1279 bytes} [Sun Oct 2 01:14:12 2022] POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action => generated 938 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:14:12.752697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9eba0ab-decf-4d63-a660-7df5581d7251 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8815e54c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:12.831173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9eba0ab-decf-4d63-a660-7df5581d7251 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 200 len: 1423 microversion: 2.1 time: 0.091916 Oct 02 01:14:12.832640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1620/3042] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:12 2022] GET /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:12.848598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-321f3745-3ab1-4b0b-97b0-3bf1226cba81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:12.880737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-321f3745-3ab1-4b0b-97b0-3bf1226cba81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:12.881248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-321f3745-3ab1-4b0b-97b0-3bf1226cba81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:12.888808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-321f3745-3ab1-4b0b-97b0-3bf1226cba81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:13.110478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-321f3745-3ab1-4b0b-97b0-3bf1226cba81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Going to try to stop instance {{(pid=122355) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:14:13.244287 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-321f3745-3ab1-4b0b-97b0-3bf1226cba81 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0/action" status: 202 len: 0 microversion: 2.1 time: 0.406555 Oct 02 01:14:13.245645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1621/3043] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:12 2022] POST /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:14:13.255498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-242fd526-973d-450f-b4ae-bb95f43e56ba req-bc695b68-d093-4904-8025-06e3fe7a3e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4164649-d919-44dd-8130-9f16db3e4dd2", "name": "network-vif-unplugged", "status": "completed", "tag": "bda80aba-707d-4dbd-b83e-c0c24b3fa477"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:13.291974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-242fd526-973d-450f-b4ae-bb95f43e56ba req-bc695b68-d093-4904-8025-06e3fe7a3e6d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:13.292809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-242fd526-973d-450f-b4ae-bb95f43e56ba req-bc695b68-d093-4904-8025-06e3fe7a3e6d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:13.294542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-242fd526-973d-450f-b4ae-bb95f43e56ba req-bc695b68-d093-4904-8025-06e3fe7a3e6d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:13.326178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-242fd526-973d-450f-b4ae-bb95f43e56ba req-bc695b68-d093-4904-8025-06e3fe7a3e6d service nova] Creating event network-vif-unplugged:bda80aba-707d-4dbd-b83e-c0c24b3fa477 for instance b4164649-d919-44dd-8130-9f16db3e4dd2 on n-h1-master-1 Oct 02 01:14:13.336833 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-242fd526-973d-450f-b4ae-bb95f43e56ba req-bc695b68-d093-4904-8025-06e3fe7a3e6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089780 Oct 02 01:14:13.340224 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1622/3044] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:13.350176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9abb44b1-cdd6-44d2-a24a-9d384a0e670f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:13.359293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9abb44b1-cdd6-44d2-a24a-9d384a0e670f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:13.476867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9abb44b1-cdd6-44d2-a24a-9d384a0e670f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:13.488259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9abb44b1-cdd6-44d2-a24a-9d384a0e670f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1211 microversion: 2.1 time: 0.142661 Oct 02 01:14:13.489606 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1623/3045] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:13 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:13.501226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:13.501870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:13.533645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:13.534157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:13.539121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:13.540041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:13.540537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:13.541162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:14.622000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:14.634109 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eaecffae-6580-4e88-ab30-6863d2fd4972 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 1.142219 Oct 02 01:14:14.654833 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1624/3046] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:13 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:14.662049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4fcc5f89-0f12-4169-937a-bfeb28148af4 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8807db550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:16.089642 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4fcc5f89-0f12-4169-937a-bfeb28148af4 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 204 len: 0 microversion: 2.1 time: 1.433551 Oct 02 01:14:16.090245 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1625/3047] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:14 2022] DELETE /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 0 bytes in 1435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:14:16.097948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:16.098653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:16.120596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:16.121100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:16.121549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:16.122273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:16.122776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:16.136447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:17.150403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:17.159437 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58853e47-2f51-4c7b-b65d-58b7904e3034 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 1.068100 Oct 02 01:14:17.160103 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1626/3048] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:16 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:17.523738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-901246513", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "5c5d890d-9575-4bd1-92a2-9257ae3243d4"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:17.604183 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] validate_networks() for [('5c5d890d-9575-4bd1-92a2-9257ae3243d4', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:18.996484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:18.997138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:18.997373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:18.998024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:18.998649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:19.010884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:19.011665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:19.012247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:19.013152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:19.013763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:19.014419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:19.039751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Getting quotas for project 53272886aeac4313b1e8ad37b6f9ff12. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:19.045481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Getting quotas for user 7f2fd89c34d84d77b2c0ad9d5ad45390 and project 53272886aeac4313b1e8ad37b6f9ff12. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:19.059181 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:19.061505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:19.125233 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81b56571-735c-4edd-9b99-0520b09bc0e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941374 Oct 02 01:14:19.139797 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1627/3049] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:14:19.145328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:19.145872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:19.158247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:19.158950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:19.160061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:19.161050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:19.161507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:19.161932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:19.982559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:19.999610 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ce1c648-aa4e-45d1-9b2c-b522f9b1bc36 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1332 microversion: 2.1 time: 0.858380 Oct 02 01:14:20.007102 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1628/3050] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:19 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1332 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:20.011259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:20.012346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:20.028570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.029074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.029517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.030232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.030716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.031320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.099698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:20.100246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:20.100667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:20.101074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:20.101549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:20.122292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.123992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.125806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.126769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.129258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.130909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.174117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Getting quotas for project 447cbc915a47450c8bc98a83e919310a. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:20.185458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Getting quotas for user ef737c7d2aa247388c88fc2ad7ea5748 and project 447cbc915a47450c8bc98a83e919310a. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:20.393583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:20.413246 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ac02ab3-5a8b-4746-b106-5e891bb1df1a tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 0.406920 Oct 02 01:14:20.414283 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1629/3051] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:20 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:20.469842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:20.474632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a839b275-bae1-420a-9f4d-d52b86e9c51f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1e5700cb-3001-4919-970d-2bfe910902bc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68377c0f-04a2-4cde-ac9b-9f01fd996723',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:20.592065 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:20.592568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:20.608887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.609496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.609976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.610961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.611523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.611964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.696385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:14:20.866261 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f05ba3c-28cc-4bf6-940d-5c0f54a068cd tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 204 len: 0 microversion: 2.1 time: 0.448071 Oct 02 01:14:20.866982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1630/3052] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:14:20 2022] DELETE /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:14:20.889806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:20.891025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:20.905685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.908546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.909606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:20.910887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:20.911605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:20.912286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.002567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:14:21.072398 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad435dcf-ac5d-4542-8190-bcaac2c71cfd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 10.730002 Oct 02 01:14:21.073438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1423/3053] 10.222.0.23 () {62 vars in 1189 bytes} [Sun Oct 2 01:14:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 10732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:14:21.084972 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:21.086675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:21.087669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:21.096934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.098658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.099405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.101007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.102650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.103314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.194091 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-14dddce7-e9bd-404c-ab0f-e416c0d084d0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 204 len: 0 microversion: 2.1 time: 0.320243 Oct 02 01:14:21.195500 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1631/3054] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:14:20 2022] DELETE /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:14:21.300080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1476724012", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ebdcb03-5ad3-4f1b-8896-dc5e5893c329"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:21.402580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] validate_networks() for [('1ebdcb03-5ad3-4f1b-8896-dc5e5893c329', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:21.552366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:21.561799 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7bb1a100-c339-46e2-9f31-3107c2dfa134 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.480422 Oct 02 01:14:21.563054 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1424/3055] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:21 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:21.569146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:21.570302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:21.576620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.577118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.577826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.578542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.579288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.579770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.683143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:21.693909 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4763f250-8098-4a08-b85c-8f9debc47e34 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1277 microversion: 2.1 time: 0.129555 Oct 02 01:14:21.703598 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1425/3056] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:21 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:21.703598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f3ecf4f-bf2b-4d47-a089-e92c8fcbeca7 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f3ecf4f-bf2b-4d47-a089-e92c8fcbeca7 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action HTTP/1.1 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 285 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.705967 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:21.709898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f3ecf4f-bf2b-4d47-a089-e92c8fcbeca7 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:21.711526 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f3ecf4f-bf2b-4d47-a089-e92c8fcbeca7 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action" status: 400 len: 619 microversion: 2.1 time: 0.011554 Oct 02 01:14:21.719015 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1426/3057] 10.222.0.23 () {60 vars in 1279 bytes} [Sun Oct 2 01:14:21 2022] POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:14:21.748151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:21.748786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:21.756946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.757440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.757875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.758575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.759050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.759475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.027456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.042439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:22.042972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:22.043381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:22.043795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:22.044202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:22.049287 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7d42e71d-9384-44cd-9abf-056c51ce9093 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1507 microversion: 2.1 time: 0.326804 Oct 02 01:14:22.054046 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1427/3058] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:21 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:22.055174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.055937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.056376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.057116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.057554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.058097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.071495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:22.072599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:22.077675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Getting quotas for project e3f2bd52c8d347679396891f8f163197. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:22.084163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Getting quotas for user 1e5ba26f19334afa95c2df9b1655626e and project e3f2bd52c8d347679396891f8f163197. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:22.094293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.096319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.097839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.098718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.099152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.099589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.110492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:22.114469 n-d-master-1 devstack@n-api.service[122355]: WARNING nova.utils [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1476724012 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-147672401 Oct 02 01:14:22.118145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:22.171950 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97baddac-0726-42df-9cb7-3285994b7869 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974788 Oct 02 01:14:22.179315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1632/3059] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:14:22.183180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:22.183816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:22.191810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.192305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.193044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.193575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.194034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.194468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.276944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.292981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.294475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.295678 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1e2327bb-ffa1-44ce-936b-798528718d09 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1528 microversion: 2.32 time: 0.116708 Oct 02 01:14:22.296258 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1633/3060] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:22 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1528 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:22.305343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1797889674", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "52e9d38c-d322-45f0-aba7-d15109b53e80"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:22.317871 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:22.322580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.336238 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88fd7498-991e-49fb-a172-13c67a6163c2 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.273440 Oct 02 01:14:22.337119 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1428/3061] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:22 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:22.346485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:22.347232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:22.359786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.360279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.360716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.361419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.362364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.362364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.380591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] validate_networks() for [('52e9d38c-d322-45f0-aba7-d15109b53e80', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:22.619564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.631184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfb9288d-daa8-4253-a0c5-15fd45b6ddd0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 0.292428 Oct 02 01:14:22.643401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1429/3062] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:22 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:22.655985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5885448-e19e-42a0-9de0-b8266e74a66f tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:22.658706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b5885448-e19e-42a0-9de0-b8266e74a66f tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:22.786801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b5885448-e19e-42a0-9de0-b8266e74a66f tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:22.807699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5885448-e19e-42a0-9de0-b8266e74a66f tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1232 microversion: 2.1 time: 0.162972 Oct 02 01:14:22.833689 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1430/3063] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:22 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1232 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:22.846386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:22.851467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:22.867206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.868016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.868456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.869882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.869882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.870075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.544029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:23.574242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b32699f4-156a-4380-bd9a-e6088280b0f4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.736181 Oct 02 01:14:23.575562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1431/3064] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:22 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:23.588850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:23.589636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:23.603487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:23.604095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:23.604373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:23.604779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:23.605186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:23.610435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.610974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.611418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.612633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.613313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.613750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.621030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.621629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.621759 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:23.622384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.623469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.623936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.624362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.665967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:23.679754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for user 8cd2ad37e9b844ac8b7632fd9291023a and project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:23.700592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:23.717856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:23.825507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7659dc31-d3a5-45de-86dc-418442570ea7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528175 Oct 02 01:14:23.827887 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1634/3065] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:14:23.837908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:23.838839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:23.850506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.851539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.852348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.853237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.854002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.854621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.090431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:24.109581 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c862619-faa6-4198-804e-5a4af151ede4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1275 microversion: 2.1 time: 0.277046 Oct 02 01:14:24.127725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1635/3066] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:23 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:24.139486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:24.140116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:24.164513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.165119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.165331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.166316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.168456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.168785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.477048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:24.484993 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e064b69c-bb5b-4b71-b022-1973be29a48c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 0.908047 Oct 02 01:14:24.485574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1432/3067] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:23 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:24.501242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:24.505583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:24.515926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.516705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.517631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.519969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.520668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.522334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.742241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:24.755527 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2bc0630-a61d-44c7-b7dc-e2eba2f35b79 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1507 microversion: 2.1 time: 0.626551 Oct 02 01:14:24.756131 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1636/3068] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:24 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1507 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:24.764455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:24.767293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:24.780275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.780835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:24.787440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.788383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.789689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.790308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.790933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.801202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:24.805420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:24.809943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0c83ea04-34c8-445d-b3b2-c29c1b789982 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1594 microversion: 2.32 time: 0.321326 Oct 02 01:14:24.822712 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1433/3069] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:24 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1594 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:24.822712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4728793d-7aaf-448f-ae16-fdb98945eda3 req-6c933be7-b9d9-45e3-acfd-6c5cd8c43441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4164649-d919-44dd-8130-9f16db3e4dd2", "name": "network-vif-deleted", "tag": "bda80aba-707d-4dbd-b83e-c0c24b3fa477"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:24.865878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4728793d-7aaf-448f-ae16-fdb98945eda3 req-6c933be7-b9d9-45e3-acfd-6c5cd8c43441 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.868445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4728793d-7aaf-448f-ae16-fdb98945eda3 req-6c933be7-b9d9-45e3-acfd-6c5cd8c43441 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.869012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4728793d-7aaf-448f-ae16-fdb98945eda3 req-6c933be7-b9d9-45e3-acfd-6c5cd8c43441 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.889155 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4728793d-7aaf-448f-ae16-fdb98945eda3 req-6c933be7-b9d9-45e3-acfd-6c5cd8c43441 service nova] Creating event network-vif-deleted:bda80aba-707d-4dbd-b83e-c0c24b3fa477 for instance b4164649-d919-44dd-8130-9f16db3e4dd2 on n-h1-master-1 Oct 02 01:14:24.910798 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4728793d-7aaf-448f-ae16-fdb98945eda3 req-6c933be7-b9d9-45e3-acfd-6c5cd8c43441 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097347 Oct 02 01:14:24.914836 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1434/3070] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:24.948546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:24.949417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:24.977884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.978656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.979284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.982707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.983549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.985324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.305524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:25.313650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06515db0-b6d2-411b-b218-b28ab6eb2505 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1204 microversion: 2.1 time: 0.385038 Oct 02 01:14:25.324504 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1435/3071] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:24 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1204 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:25.333921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:25.334360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:25.364341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.364841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.365284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.365998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.366456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.366911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.594718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:25.608587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e293cd2-7b2b-4966-ab1a-92c0c120755e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1290 microversion: 2.1 time: 0.282498 Oct 02 01:14:25.610100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1436/3072] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:25 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:25.619418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-155768205"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:25.637958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:25.648245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:25.657740 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-addfc9ed-e95d-42cc-b40f-a664728586fd tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.900305 Oct 02 01:14:25.663174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.663715 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1637/3073] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:24 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:25.664953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.665408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.673117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.674716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.675651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:25.676527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:25.676657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.692369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.693211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.693878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.695023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.695687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.697078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:26.086936 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e17026a6-6d21-4a69-ab70-0685788482c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action" status: 202 len: 0 microversion: 2.1 time: 0.473658 Oct 02 01:14:26.088331 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1437/3074] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:25 2022] POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:14:26.105793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:26.106781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:26.119839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:26.120346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:26.120793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:26.121518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:26.132412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:26.132920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.227698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:27.259651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:27.266971 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3d8ccb0-72b1-4352-a279-0af5b2b70b74 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 1.601614 Oct 02 01:14:27.268539 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1638/3075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:25 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:27.275013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:27.277086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:27.302400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.305225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.311281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.312519 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-51eb2d18-b311-4881-90da-14ca77e6b27d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 1.221471 Oct 02 01:14:27.315698 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1438/3076] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:26 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:27.317838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.319519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.322449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.337332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:27.356846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:27.374580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.377521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.381393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.382899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.385560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.388751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.458840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.460337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.460801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.463567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'fault' on Instance uuid 01ff56fa-0255-4a23-af32-50537ccd587e {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:14:27.779659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:27.788838 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-86b68023-712d-4f54-8410-8e8de7c8e3e5 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 200 len: 1311 microversion: 2.1 time: 0.518595 Oct 02 01:14:27.807984 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1639/3077] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:27 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 1311 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:27.817452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-901225282"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:27.822020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:27.833182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.833975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.834573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.850349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.851697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.852360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.981345 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Cannot 'createImage' instance 56bb3075-cb62-451e-99ff-27487026bce3 while it is in task_state image_pending_upload Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action HTTP/1.1 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 84 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-901225282"}} Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'createImage' instance 56bb3075-cb62-451e-99ff-27487026bce3 while it is in task_state image_pending_upload Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-901225282'}}} Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56bb3075-cb62-451e-99ff-27487026bce3 in task_state image_pending_upload. Cannot snapshot while the instance is in this state. Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:14:27.985171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 56bb3075-cb62-451e-99ff-27487026bce3 while it is in task_state image_pending_upload Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 56bb3075-cb62-451e-99ff-27487026bce3 while it is in task_state image_pending_upload Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:27.990724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 409 to user: Cannot 'createImage' instance 56bb3075-cb62-451e-99ff-27487026bce3 while it is in task_state image_pending_upload {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:27.992078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b6a7088c-ced6-41a4-ab82-3fa376a65185 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action" status: 409 len: 165 microversion: 2.1 time: 0.177305 Oct 02 01:14:27.992286 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1640/3078] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:27 2022] POST /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3/action => generated 165 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:14:27.997415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:27.998087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:28.012697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.012697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.013040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.013984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.014761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.015451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.198781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:28.210099 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0551482c-bdf5-476f-938f-2056fcc57129 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1266 microversion: 2.1 time: 0.216591 Oct 02 01:14:28.218227 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1641/3079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:27 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:28.235128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:28.236611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:28.250207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.251571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.272663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.273775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.274800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.276676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.281220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:28.291901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:28.293339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:28.294504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de79d5cf-b220-442f-b921-e20ec5a257c2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1661 microversion: 2.32 time: 0.971242 Oct 02 01:14:28.295104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1439/3080] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:27 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1661 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:28.335569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:28.337781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:28.344800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.345487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.346370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.347370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.359371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.360176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:29.071213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:29.087752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c095eb87-5738-4a10-840a-2c4aeddc2627 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.866488 Oct 02 01:14:29.092933 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1642/3081] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:28 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:29.109718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-75d2c8dd-aa9f-4d5c-be17-5175ef9d3301 req-42992d77-ba72-4c67-9bc2-b7986ae4a8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ff56fa-0255-4a23-af32-50537ccd587e", "name": "network-vif-deleted", "tag": "2de8cfb8-b5be-4fc0-9d78-52af73579fb0"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:29.148456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-75d2c8dd-aa9f-4d5c-be17-5175ef9d3301 req-42992d77-ba72-4c67-9bc2-b7986ae4a8ec service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:29.156453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-75d2c8dd-aa9f-4d5c-be17-5175ef9d3301 req-42992d77-ba72-4c67-9bc2-b7986ae4a8ec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:29.165138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-75d2c8dd-aa9f-4d5c-be17-5175ef9d3301 req-42992d77-ba72-4c67-9bc2-b7986ae4a8ec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:29.199175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-75d2c8dd-aa9f-4d5c-be17-5175ef9d3301 req-42992d77-ba72-4c67-9bc2-b7986ae4a8ec service nova] Creating event network-vif-deleted:2de8cfb8-b5be-4fc0-9d78-52af73579fb0 for instance 01ff56fa-0255-4a23-af32-50537ccd587e on n-h2-master-1 Oct 02 01:14:29.217050 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-75d2c8dd-aa9f-4d5c-be17-5175ef9d3301 req-42992d77-ba72-4c67-9bc2-b7986ae4a8ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122398 Oct 02 01:14:29.219747 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1643/3082] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:29.236430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4d52663-2e59-41a6-a5bd-7bed6c9f8f62 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '.version_select at 0x7fb88184d790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:29.500837 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4d52663-2e59-41a6-a5bd-7bed6c9f8f62 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/images/4044ef71-d03b-414b-9d83-6915d03b8664" status: 204 len: 0 microversion: 2.1 time: 0.278968 Oct 02 01:14:29.501421 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1644/3083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:29 2022] DELETE /compute/v2.1/images/4044ef71-d03b-414b-9d83-6915d03b8664 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:14:29.508796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:29.509779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:29.523255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:29.523942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:29.527392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:29.528442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:29.536414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:29.537128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:29.950424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:29.985246 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f253a9e1-5454-40de-9e47-a4f132f41c4f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.480212 Oct 02 01:14:29.985872 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1645/3084] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:29 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:29.999762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:30.002157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:30.010357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.012493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.013108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.013968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.014615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.015215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.052506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:30.078163 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c93c7f5a-c75a-43a0-9d97-08e188cadae4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 1.740499 Oct 02 01:14:30.086079 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1440/3085] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:28 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:30.106025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:30.110637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 01ff56fa-0255-4a23-af32-50537ccd587e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:30.127711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.132600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.133068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.133855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.134256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.134701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.161182 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:30.162624 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Instance 01ff56fa-0255-4a23-af32-50537ccd587e could not be found. Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e HTTP/1.1 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 01ff56fa-0255-4a23-af32-50537ccd587e could not be found. Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '01ff56fa-0255-4a23-af32-50537ccd587e'} Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ff56fa-0255-4a23-af32-50537ccd587e could not be found. Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ff56fa-0255-4a23-af32-50537ccd587e could not be found. Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:30.164442 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ff56fa-0255-4a23-af32-50537ccd587e could not be found. Oct 02 01:14:30.168800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:30.170908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 404 to user: Instance 01ff56fa-0255-4a23-af32-50537ccd587e could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:30.178551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96da391b-82e5-4916-9722-091ca3649219 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e" status: 404 len: 111 microversion: 2.1 time: 0.089566 Oct 02 01:14:30.179479 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1441/3086] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:30 2022] GET /compute/v2.1/servers/01ff56fa-0255-4a23-af32-50537ccd587e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:14:30.185078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:30.185499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:30.207866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.208472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.208998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.209938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.210624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.211287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.044714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:31.064461 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-374c738a-7daf-4c01-a528-ebf14a2046b0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.882935 Oct 02 01:14:31.068139 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1442/3087] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:30 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:31.079365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:31.081018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:31.094769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.099239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.099792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.100680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.101239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.101934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.225243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:31.242996 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-efa1a56b-1ae5-4ffc-bea6-dad58422c440 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 1.255620 Oct 02 01:14:31.259198 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1646/3088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:29 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:31.274744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:31.275707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:31.292098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.292975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.293656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.294631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.297348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.298059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.703461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:31.724886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:31.727673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:31.733599 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4514e9f-9896-4882-961d-6003c1bb780f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1753 microversion: 2.32 time: 0.663239 Oct 02 01:14:31.746791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1443/3089] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:31 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1753 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:31.752458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:31.753435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:31.769667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.772295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.772843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.773659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.776131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.776890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.849283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:31.864616 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0ab576c-26bd-4153-b1e2-b95ded8b94bf tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1521 microversion: 2.1 time: 0.600408 Oct 02 01:14:31.866375 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1647/3090] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:31 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:31.879241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:31.880319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:31.897651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.903741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.904667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.905794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.906521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.912280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.984329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:14:32.060696 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:32.126111 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b374f5d-dd10-4bd5-9dcf-3861e8807855 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 204 len: 0 microversion: 2.1 time: 0.257603 Oct 02 01:14:32.128350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1648/3091] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:14:31 2022] DELETE /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:14:32.136790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:32.138147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:32.150409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.151325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.152856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.154077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.154957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.155793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.193647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:32.206393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ba14f36-e1a1-4017-8b48-99a6659385ab tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.458061 Oct 02 01:14:32.219191 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1444/3092] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:31 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:32.225700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:32.227342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:32.235971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.236872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.237609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.239408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.240111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.240751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.715545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:32.727089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-702dbcd7-f368-4090-af8b-fed14f776c01 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.506376 Oct 02 01:14:32.732009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:32.744684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1445/3093] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:32 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:32.749826 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7917c0da-1f8c-4252-bf89-d41009549ee5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.618818 Oct 02 01:14:32.750858 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1649/3094] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:32 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:32.759153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-108cc891-1d0d-4a86-b1ea-f6c26bc7873b req-9ca628cb-6231-414a-b407-cc16f1f1808d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bb3075-cb62-451e-99ff-27487026bce3", "name": "network-vif-plugged", "status": "completed", "tag": "1afbb3fb-f49d-429e-aba6-9062a035e604"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:32.765025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-59e8fd93-31f1-4372-8f56-d52bc71177f2 req-ce0d4f64-8ffa-4da6-bfd4-d9af0c5c9233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0", "tag": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:32.781610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-108cc891-1d0d-4a86-b1ea-f6c26bc7873b req-9ca628cb-6231-414a-b407-cc16f1f1808d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.782905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-108cc891-1d0d-4a86-b1ea-f6c26bc7873b req-9ca628cb-6231-414a-b407-cc16f1f1808d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.783516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-59e8fd93-31f1-4372-8f56-d52bc71177f2 req-ce0d4f64-8ffa-4da6-bfd4-d9af0c5c9233 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.784216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-108cc891-1d0d-4a86-b1ea-f6c26bc7873b req-9ca628cb-6231-414a-b407-cc16f1f1808d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.784460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-59e8fd93-31f1-4372-8f56-d52bc71177f2 req-ce0d4f64-8ffa-4da6-bfd4-d9af0c5c9233 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.785422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-59e8fd93-31f1-4372-8f56-d52bc71177f2 req-ce0d4f64-8ffa-4da6-bfd4-d9af0c5c9233 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.800685 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:32.803910 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-59e8fd93-31f1-4372-8f56-d52bc71177f2 req-ce0d4f64-8ffa-4da6-bfd4-d9af0c5c9233 service nova] Creating event network-changed:5e6a0047-75ea-4c38-9f37-d1ecfe28fecf for instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 on n-h1-master-1 Oct 02 01:14:32.805278 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-108cc891-1d0d-4a86-b1ea-f6c26bc7873b req-9ca628cb-6231-414a-b407-cc16f1f1808d service nova] Creating event network-vif-plugged:1afbb3fb-f49d-429e-aba6-9062a035e604 for instance 56bb3075-cb62-451e-99ff-27487026bce3 on n-h2-master-1 Oct 02 01:14:32.811204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-59e8fd93-31f1-4372-8f56-d52bc71177f2 req-ce0d4f64-8ffa-4da6-bfd4-d9af0c5c9233 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064885 Oct 02 01:14:32.812078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-108cc891-1d0d-4a86-b1ea-f6c26bc7873b req-9ca628cb-6231-414a-b407-cc16f1f1808d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059477 Oct 02 01:14:32.812743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1446/3095] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:32.820662 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1650/3096] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:32.823636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-250d05c4-ed3c-469d-8c78-c7786dedffc2 req-2c8922dc-efcc-4f54-8539-6a62ba4c51cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "tag": "00c082ad-e0e2-43e3-8d4e-b5dc883f1405"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:32.827385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:32.828889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:32.838339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-250d05c4-ed3c-469d-8c78-c7786dedffc2 req-2c8922dc-efcc-4f54-8539-6a62ba4c51cc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.839338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.839797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-250d05c4-ed3c-469d-8c78-c7786dedffc2 req-2c8922dc-efcc-4f54-8539-6a62ba4c51cc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.839914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.840343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.841030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-250d05c4-ed3c-469d-8c78-c7786dedffc2 req-2c8922dc-efcc-4f54-8539-6a62ba4c51cc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.841446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.842147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.843057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.860500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-250d05c4-ed3c-469d-8c78-c7786dedffc2 req-2c8922dc-efcc-4f54-8539-6a62ba4c51cc service nova] Creating event network-changed:00c082ad-e0e2-43e3-8d4e-b5dc883f1405 for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:14:32.873039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-250d05c4-ed3c-469d-8c78-c7786dedffc2 req-2c8922dc-efcc-4f54-8539-6a62ba4c51cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058093 Oct 02 01:14:32.873924 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1447/3097] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:32.886632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:14:32.905562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:32.906366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:32.916817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.917314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.917754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.918465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.918973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.919466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.035968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56993563-8c07-4f26-87fb-9028cfee2285 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 204 len: 0 microversion: 2.1 time: 0.212578 Oct 02 01:14:33.041477 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1651/3098] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:14:32 2022] DELETE /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:14:33.049143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.051031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.058850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.059389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.059872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.061098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.062238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.062801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.367573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.377395 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7739acf8-7992-4a6e-9abf-81d46a7c4eca tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.502052 Oct 02 01:14:33.378477 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1448/3099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:32 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:33.384874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.385792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.393747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.394734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.395412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.396363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.396926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.397448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.416042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.423848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f91ad425-3626-486f-afb3-99aefb071676 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.381028 Oct 02 01:14:33.424613 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1652/3100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:33.447272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.447898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.453935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.454503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.455295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.456067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.456659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.457257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.633880 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:33.691147 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=30 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:33.691904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.701518 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84758357-11e9-41b9-8799-2477d993fc70 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 0.320603 Oct 02 01:14:33.702227 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1449/3101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:33.708060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.708604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.714970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.715673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.716118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.716818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.717273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.717712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.721931 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:33.744353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.754795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.756247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.757420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1948fb11-6b95-4569-ba1d-d2b6e9310a90 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1799 microversion: 2.32 time: 0.315042 Oct 02 01:14:33.757992 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1653/3102] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1799 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:33.762697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.763503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.770204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.770878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.771408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.772111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.772627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.773059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.930796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.938544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-efede24d-5c33-470a-818c-4749e15f7a1c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1527 microversion: 2.1 time: 0.235315 Oct 02 01:14:33.939149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1450/3103] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:33.944347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.944952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.950725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.951203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.951635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.952316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.952764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.953179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.976797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:33.984350 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a93f7de7-ae28-4ed1-9565-fc9fef990c38 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.225183 Oct 02 01:14:33.985019 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1654/3104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:33.990366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.991088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.997235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.997804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.998336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.999134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.999666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.000165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.148113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:34.155729 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be30e17f-6928-486b-9840-0ff7674731a5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.215452 Oct 02 01:14:34.156516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1451/3105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:34.177817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:34.185634 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f18cbc51-a4f5-4327-bdf8-6cae116293c4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.199497 Oct 02 01:14:34.186214 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1655/3106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:34.402085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:34.402733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:34.408935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.409415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.410133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.410620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.411148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.411576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.448463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:34.449085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:34.457138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.457985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.458438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.459566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.459698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.460074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.721927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:34.727228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:34.730948 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-30baf265-6e30-4941-9637-f502a386ea07 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.333507 Oct 02 01:14:34.731560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1452/3107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:34 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:34.736648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:34.737148 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed74950e-635a-4341-98dc-d5ea69f1229c tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.292333 Oct 02 01:14:34.737708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:34.738793 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1656/3108] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:34 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:34.745351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.745841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.746279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.747008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.747586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.748382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.786296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:34.786935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:34.793274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.793774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.794244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.795200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.795844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.796277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.970335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:34.987648 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e9eda5d-4502-4349-896f-b686497a3945 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 0.253535 Oct 02 01:14:34.991802 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1453/3109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:34 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:34.998445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:34.998657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-979708a3-d3d3-4906-a087-88bd3faafbab req-7acdfadf-1b0e-45ba-a7ca-caed60654d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bb3075-cb62-451e-99ff-27487026bce3", "name": "network-vif-unplugged", "status": "completed", "tag": "1afbb3fb-f49d-429e-aba6-9062a035e604"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:35.008750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.009735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.010963 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83d19561-6d1d-4cbc-9237-42283a1f292d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1799 microversion: 2.32 time: 0.229551 Oct 02 01:14:35.011537 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1657/3110] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:34 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1799 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:14:35.016495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-757cb759-841f-48b0-b3f9-ccc238fd3cee req-e9651b42-b7ff-40e7-93d9-3a00642b6482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c277426b-e31d-455e-a9ed-17a3b7a7746c", "tag": "f0040594-ca37-4c7d-ae42-44a3581c717f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:35.026797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-979708a3-d3d3-4906-a087-88bd3faafbab req-7acdfadf-1b0e-45ba-a7ca-caed60654d5e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.027584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-979708a3-d3d3-4906-a087-88bd3faafbab req-7acdfadf-1b0e-45ba-a7ca-caed60654d5e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.028183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-979708a3-d3d3-4906-a087-88bd3faafbab req-7acdfadf-1b0e-45ba-a7ca-caed60654d5e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.028679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-757cb759-841f-48b0-b3f9-ccc238fd3cee req-e9651b42-b7ff-40e7-93d9-3a00642b6482 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.029171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-757cb759-841f-48b0-b3f9-ccc238fd3cee req-e9651b42-b7ff-40e7-93d9-3a00642b6482 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.029607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-757cb759-841f-48b0-b3f9-ccc238fd3cee req-e9651b42-b7ff-40e7-93d9-3a00642b6482 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.043342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-979708a3-d3d3-4906-a087-88bd3faafbab req-7acdfadf-1b0e-45ba-a7ca-caed60654d5e service nova] Creating event network-vif-unplugged:1afbb3fb-f49d-429e-aba6-9062a035e604 for instance 56bb3075-cb62-451e-99ff-27487026bce3 on n-h2-master-1 Oct 02 01:14:35.046189 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-757cb759-841f-48b0-b3f9-ccc238fd3cee req-e9651b42-b7ff-40e7-93d9-3a00642b6482 service nova] Creating event network-changed:f0040594-ca37-4c7d-ae42-44a3581c717f for instance c277426b-e31d-455e-a9ed-17a3b7a7746c on n-h2-master-1 Oct 02 01:14:35.049297 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-979708a3-d3d3-4906-a087-88bd3faafbab req-7acdfadf-1b0e-45ba-a7ca-caed60654d5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055494 Oct 02 01:14:35.054879 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-757cb759-841f-48b0-b3f9-ccc238fd3cee req-e9651b42-b7ff-40e7-93d9-3a00642b6482 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041785 Oct 02 01:14:35.055508 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1658/3111] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:35.063994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1454/3112] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:35.067423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "tag": "4e8a0f53-86ec-4570-b3f1-797e10f5eb2f"}, {"name": "network-changed", "server_uuid": "8ad765cc-a5f7-4748-922a-b6a7086787cc", "tag": "77ad6923-4e68-4c74-b282-d1b5390b5f23"}, {"name": "network-changed", "server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "tag": "24a43f83-dbac-4108-b318-bc4b49e5ac8c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:35.070578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.071821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.078237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.078771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.078899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.079381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.080045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.080162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.080766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.081227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.082198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.095809 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Creating event network-changed:4e8a0f53-86ec-4570-b3f1-797e10f5eb2f for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:14:35.096367 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Creating event network-changed:77ad6923-4e68-4c74-b282-d1b5390b5f23 for instance 8ad765cc-a5f7-4748-922a-b6a7086787cc on n-h2-master-1 Oct 02 01:14:35.096882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] Creating event network-changed:24a43f83-dbac-4108-b318-bc4b49e5ac8c for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:14:35.108531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-330d6147-2dcb-4c65-ac30-196e330f5bbf req-6fd0bfc1-c2a3-4ba6-b679-42e05e15c657 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.046147 Oct 02 01:14:35.109758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1659/3113] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:35.117556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.118274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.125552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.126031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.126688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.127408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.127870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.128302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.283543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.291646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-601fd8f7-6209-4eb0-91f1-025df36d4993 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1527 microversion: 2.1 time: 0.226125 Oct 02 01:14:35.292685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1455/3114] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1527 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:35.298699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.299481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.307874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.309111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.309325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.310262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.310948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.311535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.317785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.325644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5f09d7f9-eb7b-4ec8-a1f7-1e3827e83504 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.214309 Oct 02 01:14:35.326219 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1660/3115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:35.330915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.331732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.337985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.338466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.338932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.339624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.340078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.340502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.528118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.536280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.538699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc6e70db-32ee-418e-94e2-70d593785ddc tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.244780 Oct 02 01:14:35.539686 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1456/3116] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:35.544158 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-423aa626-0770-4185-be01-5ab72c77b96c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.216945 Oct 02 01:14:35.544728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1661/3117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:35.755527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.756151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.762288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.762820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.763258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.763934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.764079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.764450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.764582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.764874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.771925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.772424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.772895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.773586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.774058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.774494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.964071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.967921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:35.972128 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2e8dd69-754e-4f9f-91ff-80cd7512dcef tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.212130 Oct 02 01:14:35.972739 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1662/3118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:14:35.976307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfbdd5a0-e154-4a20-8d17-b8ea3908c2f2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.225411 Oct 02 01:14:35.977028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1457/3119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:36.015467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:36.016014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:36.022029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.022508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.022980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.023804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.024280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.024716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.039334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:36.039961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:36.045932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.046425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.046900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.047601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.048069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.048522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.680093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:36.689213 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-678e05f6-9a58-4c88-83c2-98da4676effd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 0.677531 Oct 02 01:14:36.689806 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1663/3120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:36 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:36.695191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:36.696024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:36.702274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.702964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.703582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.704462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.705319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.705914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.735287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:36.749521 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:36.751346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:36.752927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c667672-9a1a-41ea-9f8b-4840f72778f0 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1845 microversion: 2.32 time: 0.717808 Oct 02 01:14:36.766643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1458/3121] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:36 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1845 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:14:36.766643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:36.766643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:36.774237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.774237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.774237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.774237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.774237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.774237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:37.277852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:37.290744 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f9e9ca3b-5508-4ba2-9a0d-6328f0eca59e tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1527 microversion: 2.1 time: 0.596044 Oct 02 01:14:37.291950 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1664/3122] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:36 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1527 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:37.296900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:37.307339 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:37.321306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:37.323436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:37.324221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:37.325584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:37.326226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:37.326841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:37.615574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:37.643304 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b0be9aa0-3c48-4449-8817-3b9b8e79ef32 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.886039 Oct 02 01:14:37.658511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1459/3123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:36 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:37.664688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:37.665342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:37.679305 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:37.680817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:37.681308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:37.681743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:37.682464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:37.691378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:37.692075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.100536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:38.104487 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:38.113236 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bedc9968-61d1-41ae-ae34-ef94da3aeeaa tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.819188 Oct 02 01:14:38.127446 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1665/3124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:37 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:38.136449 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:38.137951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:38.146505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.148616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.149347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.150445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.151240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.151994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.333856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:38.351692 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b247ddc0-efb5-4796-8487-6eda47472176 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1510 microversion: 2.1 time: 0.706631 Oct 02 01:14:38.368506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1460/3125] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:37 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1510 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:38.377899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:38.380109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:38.387491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.388273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.388966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.390089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.390793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.391496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.771494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:38.782324 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47d2e2c8-783d-40be-9262-65b98abdbcc8 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1520 microversion: 2.1 time: 0.653386 Oct 02 01:14:38.788159 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1666/3126] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:38 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:38.793431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:38.806640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:38.813224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.813967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.814564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.815492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.816105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.816718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:39.421892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:39.458321 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5ca338c-52f6-4494-8d77-6028edb4416a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 1.087513 Oct 02 01:14:39.459562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1461/3127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:38 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:39.470058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:39.471578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:39.498031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:39.500430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:39.503301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:39.505974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:39.507749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:39.508789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:39.878986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:39.893528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a947736-b9d5-40a6-8e9d-a127a2b53e99 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 1.103721 Oct 02 01:14:39.895592 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1667/3128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:38 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:39.914419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:39.918916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:39.937372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:39.940988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:39.942230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:39.944362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:39.946249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:39.948044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.108623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.109324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.109957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.110589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lazy-loading 'fault' on Instance uuid 56bb3075-cb62-451e-99ff-27487026bce3 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:14:40.227744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:40.236430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:40.264844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c2d1ae5-c641-4314-bee1-91add80c9c2f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 200 len: 1314 microversion: 2.1 time: 0.367326 Oct 02 01:14:40.267207 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1668/3129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:39 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:40.270825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:40.276495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:40.280441 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-164021fd-f013-470f-97df-0a0939cefb92 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1845 microversion: 2.32 time: 0.818910 Oct 02 01:14:40.282301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1462/3130] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:39 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1845 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:40.282937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:40.286774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:40.295561 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a263929e-53cf-4786-80fc-52ea6cb9df9c req-153af79c-dea5-468f-bee4-1f126f999f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "905b6b15-1615-469e-b334-8a1fb6e075a5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:40.304693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.307280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.308008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.309239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.311070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.313048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.324453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a263929e-53cf-4786-80fc-52ea6cb9df9c req-153af79c-dea5-468f-bee4-1f126f999f24 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.328219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a263929e-53cf-4786-80fc-52ea6cb9df9c req-153af79c-dea5-468f-bee4-1f126f999f24 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.331205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a263929e-53cf-4786-80fc-52ea6cb9df9c req-153af79c-dea5-468f-bee4-1f126f999f24 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.359630 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a263929e-53cf-4786-80fc-52ea6cb9df9c req-153af79c-dea5-468f-bee4-1f126f999f24 service nova] Creating event network-changed:905b6b15-1615-469e-b334-8a1fb6e075a5 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:40.372570 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a263929e-53cf-4786-80fc-52ea6cb9df9c req-153af79c-dea5-468f-bee4-1f126f999f24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087033 Oct 02 01:14:40.376095 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1463/3131] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:40.391012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:40.393739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:40.406324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.407264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.407985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.408982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.409649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.410373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.717277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:40.730389 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a186417-2fbd-48be-be66-fc86e326fdec tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.459972 Oct 02 01:14:40.742624 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1669/3132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:40 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:40.742851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:40.743287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:40.743287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:40.743528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca8743ed-b6b3-42e0-999c-8015a0860353 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.365977 Oct 02 01:14:40.745910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1464/3133] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:40 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:40.746213 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:40.755600 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-60bb9e48-70cc-4cfc-bc32-e564c7c8fa3b req-ea2f44e0-a5e7-470f-9fbb-d9687438b25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bb3075-cb62-451e-99ff-27487026bce3", "name": "network-vif-deleted", "tag": "1afbb3fb-f49d-429e-aba6-9062a035e604"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:40.760859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.761290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.761741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.762463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.768130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.768684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.778564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60bb9e48-70cc-4cfc-bc32-e564c7c8fa3b req-ea2f44e0-a5e7-470f-9fbb-d9687438b25a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.781413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60bb9e48-70cc-4cfc-bc32-e564c7c8fa3b req-ea2f44e0-a5e7-470f-9fbb-d9687438b25a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.782097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60bb9e48-70cc-4cfc-bc32-e564c7c8fa3b req-ea2f44e0-a5e7-470f-9fbb-d9687438b25a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.811897 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-60bb9e48-70cc-4cfc-bc32-e564c7c8fa3b req-ea2f44e0-a5e7-470f-9fbb-d9687438b25a service nova] Creating event network-vif-deleted:1afbb3fb-f49d-429e-aba6-9062a035e604 for instance 56bb3075-cb62-451e-99ff-27487026bce3 on n-h2-master-1 Oct 02 01:14:40.823409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-60bb9e48-70cc-4cfc-bc32-e564c7c8fa3b req-ea2f44e0-a5e7-470f-9fbb-d9687438b25a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075710 Oct 02 01:14:40.824449 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1465/3134] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:40.837076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-eedc1f27-f816-4353-969d-d17beb2d8fd2 req-5b645d24-0317-4c67-9ed1-5b3b9c4ed092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0", "name": "network-vif-plugged", "status": "completed", "tag": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:40.857919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-eedc1f27-f816-4353-969d-d17beb2d8fd2 req-5b645d24-0317-4c67-9ed1-5b3b9c4ed092 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.870959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-eedc1f27-f816-4353-969d-d17beb2d8fd2 req-5b645d24-0317-4c67-9ed1-5b3b9c4ed092 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.871571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-eedc1f27-f816-4353-969d-d17beb2d8fd2 req-5b645d24-0317-4c67-9ed1-5b3b9c4ed092 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.888942 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-eedc1f27-f816-4353-969d-d17beb2d8fd2 req-5b645d24-0317-4c67-9ed1-5b3b9c4ed092 service nova] Creating event network-vif-plugged:5e6a0047-75ea-4c38-9f37-d1ecfe28fecf for instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 on n-h1-master-1 Oct 02 01:14:40.897073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-eedc1f27-f816-4353-969d-d17beb2d8fd2 req-5b645d24-0317-4c67-9ed1-5b3b9c4ed092 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070488 Oct 02 01:14:40.902978 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1466/3135] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:40.909285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:40.910770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:40.918222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.919020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.919690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.920886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.921497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.922082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.977303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:40.977855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:40.978435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:40.979081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'fault' on Instance uuid 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:14:41.051133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.061588 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-31fb4865-cf68-4c02-8d4f-eab2c9ff70fb tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1311 microversion: 2.1 time: 0.156735 Oct 02 01:14:41.062532 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1467/3136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:40 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1311 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:41.068051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.068658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.075973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.076462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.076897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.077599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.078053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.078478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.121583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.132715 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-af8464cf-1a12-4054-acda-843fe71e03c8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1487 microversion: 2.1 time: 0.400275 Oct 02 01:14:41.133723 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1670/3137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:40 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1487 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:41.150923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.152248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.160635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.161367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.161850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.162881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.163560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.164002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.309634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.318257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a69bb2f7-ef16-48de-9acf-f72402acbbfc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 0.177473 Oct 02 01:14:41.326212 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1671/3138] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:41.333361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:41.336139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.342295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.342948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.343387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.344087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.344540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.345140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.414284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f36e7a6-e96e-48a1-9717-6de2eed58239 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 200 len: 143 microversion: 2.1 time: 0.085700 Oct 02 01:14:41.419434 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1672/3139] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:41 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:41.420654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.421613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.429370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.429864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.430306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.431201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.431672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.432120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.447251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.447645 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 HTTP/1.1 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3'} Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:41.449348 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c6f0c073-38dd-4d25-b37f-bb500bd2e55f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 404 len: 111 microversion: 2.1 time: 0.034633 Oct 02 01:14:41.453331 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1673/3140] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:14:41.456557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.457729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.464476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.464974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.465127 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a9fed05f-c127-4dd8-acb5-9083f45badc5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.401124 Oct 02 01:14:41.465421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.466136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.466623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.467056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.467365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1468/3141] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:41.472251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.473739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.481358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.482263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.482986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.483712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.484177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.484628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.490540 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:41.720809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.727391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.729501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d467fca-29e7-4c74-94b3-c3581778894a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.260833 Oct 02 01:14:41.730260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1469/3142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:41.734780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd2a3a7d-286d-4622-b9c4-fd5434330724 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'create', calling method: .version_select at 0x7fb880997280>, body: {"keypair": {"name": "tempest-keypair-922689143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrNAlrBkCBb+ub4F1jZbABag96bCQUCuHsKgdX27gTG3/C1IVctMn44lBOMqa90wSGXcdOt0YSsFe1GIK1viDxLZM72vOWmEj9Tjf4q+6jJQCQlXV8RYhar8R+DyEh5sA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:41.740153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.741871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.743481 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8e8ad9b-6164-46e0-96a5-8dedfb4f0b99 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1866 microversion: 2.32 time: 0.290790 Oct 02 01:14:41.744731 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1674/3143] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1866 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:41.754882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-dd2a3a7d-286d-4622-b9c4-fd5434330724 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:41.760150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-dd2a3a7d-286d-4622-b9c4-fd5434330724 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for user eb1045d1468b4a2f814930f5ace5c2ef and project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:41.764074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.764660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.771434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.771930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.772368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.773101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.773560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.773993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.785740 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd2a3a7d-286d-4622-b9c4-fd5434330724 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053972 Oct 02 01:14:41.786341 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1470/3144] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:14:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:41.797166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.797772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.805182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.805859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.806304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.807026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.807475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.807898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.992315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:41.994868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.004872 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d1a205e7-25d3-4e0d-8ba7-c3e0af9ec24e tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.252636 Oct 02 01:14:42.010053 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14b4a783-7752-464a-846c-48532221c118 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.216584 Oct 02 01:14:42.014768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1471/3145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.021990 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1675/3146] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.023148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.023148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.030279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.031448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.032146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.032893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.033416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.033902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.041859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.043327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.050223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.051817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.052503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.054212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.054941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.055634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.298769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.303018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.307025 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be543fdf-49ee-4b8d-9ca8-7391525519fb tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.290437 Oct 02 01:14:42.307605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1472/3147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.312059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.312704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.319561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.320940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.321655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.324115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.324701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.325464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.329061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eb00860e-4ada-43f8-9c7d-03b4ba9743d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.296448 Oct 02 01:14:42.342043 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1676/3148] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.349373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.350350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.358314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.359362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.361495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.362493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.363174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.364843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.377376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.377936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.378385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.379406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lazy-loading 'fault' on Instance uuid 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:14:42.433119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df46881c91e8419e84b8679ad474ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.444374 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6245fa7-6a61-4296-897d-63ee17b7b616 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 200 len: 1311 microversion: 2.1 time: 0.135635 Oct 02 01:14:42.445347 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1473/3149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.450753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.451442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.458363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.459441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.460216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.461217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.461845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.462427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.605138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.617064 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-55eb2ffa-9f5f-4057-b97a-b266047447ba tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 0.273361 Oct 02 01:14:42.630808 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1677/3150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.633036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f0c9b9d2-c491-486d-b5e9-7c55b69be1a5 req-7c1dac27-ff07-40fc-960f-66c216c1cb00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "1eacffaa-d469-4d5d-8028-a6edca0baa66"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:42.645492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0c9b9d2-c491-486d-b5e9-7c55b69be1a5 req-7c1dac27-ff07-40fc-960f-66c216c1cb00 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.646000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0c9b9d2-c491-486d-b5e9-7c55b69be1a5 req-7c1dac27-ff07-40fc-960f-66c216c1cb00 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.646448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0c9b9d2-c491-486d-b5e9-7c55b69be1a5 req-7c1dac27-ff07-40fc-960f-66c216c1cb00 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.660599 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f0c9b9d2-c491-486d-b5e9-7c55b69be1a5 req-7c1dac27-ff07-40fc-960f-66c216c1cb00 service nova] Creating event network-changed:1eacffaa-d469-4d5d-8028-a6edca0baa66 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:42.674873 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f0c9b9d2-c491-486d-b5e9-7c55b69be1a5 req-7c1dac27-ff07-40fc-960f-66c216c1cb00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052036 Oct 02 01:14:42.675330 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1678/3151] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:42.681881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.682902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.689353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.689971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.690518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.691790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.692478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.693131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.696709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.706481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6427742d-fe2a-415f-88e1-f8bd082a15ca tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.259840 Oct 02 01:14:42.708577 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1474/3152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.774149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.774846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.784999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.785738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.786725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.787023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.787445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.787871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.914560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:42.924409 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-712c6f49-62bd-40de-b016-64c0bd9ea114 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.245157 Oct 02 01:14:42.925034 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1679/3153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:42.929991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad765cc-a5f7-4748-922a-b6a7086787cc", "name": "network-vif-plugged", "status": "completed", "tag": "77ad6923-4e68-4c74-b282-d1b5390b5f23"}, {"server_uuid": "c277426b-e31d-455e-a9ed-17a3b7a7746c", "name": "network-vif-plugged", "status": "completed", "tag": "f0040594-ca37-4c7d-ae42-44a3581c717f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:42.949962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.950806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.951545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.967877 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] Creating event network-vif-plugged:77ad6923-4e68-4c74-b282-d1b5390b5f23 for instance 8ad765cc-a5f7-4748-922a-b6a7086787cc on n-h2-master-1 Oct 02 01:14:42.968673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] Creating event network-vif-plugged:f0040594-ca37-4c7d-ae42-44a3581c717f for instance c277426b-e31d-455e-a9ed-17a3b7a7746c on n-h2-master-1 Oct 02 01:14:42.976960 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c154455d-f988-46c8-8734-803256f6b6fb req-40b77aa9-9988-4cba-ba44-abdefe7d48f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050583 Oct 02 01:14:42.978289 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1680/3154] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:42.984956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-966561810", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:43.048870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] validate_networks() for [('ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:43.130441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:43.141510 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:43.152366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:43.153969 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0333f3d8-8d51-48a3-9f7b-5c3dabcf2c9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1866 microversion: 2.32 time: 0.386550 Oct 02 01:14:43.154816 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1475/3155] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1866 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:14:43.165261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-427e341d-cb37-494e-ab2b-c5b6d8237802 req-347bde67-d463-4709-9247-0e1ff25402fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a9d17-5cc3-4882-96fc-08b6bc217ec4", "name": "network-vif-deleted", "tag": "ebf1e937-96c7-4f57-8cda-5b451e0c686f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:43.195416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-427e341d-cb37-494e-ab2b-c5b6d8237802 req-347bde67-d463-4709-9247-0e1ff25402fe service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.195914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-427e341d-cb37-494e-ab2b-c5b6d8237802 req-347bde67-d463-4709-9247-0e1ff25402fe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.196350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-427e341d-cb37-494e-ab2b-c5b6d8237802 req-347bde67-d463-4709-9247-0e1ff25402fe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:43.220736 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-427e341d-cb37-494e-ab2b-c5b6d8237802 req-347bde67-d463-4709-9247-0e1ff25402fe service nova] Creating event network-vif-deleted:ebf1e937-96c7-4f57-8cda-5b451e0c686f for instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 on n-h1-master-1 Oct 02 01:14:43.236093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-427e341d-cb37-494e-ab2b-c5b6d8237802 req-347bde67-d463-4709-9247-0e1ff25402fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079725 Oct 02 01:14:43.237112 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1476/3156] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:43.246478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:43.247374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:43.268368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.269007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.271052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:43.272023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.272560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.281162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:43.813014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:43.835861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ab5168d-7e3a-4e68-a09e-b19e609f0447 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1332 microversion: 2.1 time: 0.597457 Oct 02 01:14:43.836461 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1477/3157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:43 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1332 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:43.855980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:43.857330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:43.875485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.877821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.879609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:43.880387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.884675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.886856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.261819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:44.273486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5a7d7d8-72f5-48cc-947f-707a823de925 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.435830 Oct 02 01:14:44.274847 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1478/3158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:43 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:44.281288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:44.282112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] [instance: 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:44.292049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.293220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.294138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.295478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.296369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.297046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.314469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] HTTP exception thrown: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 could not be found. Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Request method failure captured: Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 HTTP/1.1 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOS7ZjZ0TZhJ9N_dA5VSrFke7bWS-KMn327iqkQ1qJikjC4XgQ9NLjRRFRW_cyv11U4JpscnE1uJOtmIMwaUjXURM5Q8JsSrKnDcDGCtZdRgOx0Po9kJckaWC-CXL4DBYZ6in4IxAebs5Iug3qiIzaJQrH_93pvIx0RZDEQgnUEDrsQ Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2d3a5d2c4f4761b3bb73e4967ed345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2d3a5d2c4f4761b3bb73e4967ed345"}]}] Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 2b2d3a5d2c4f4761b3bb73e4967ed345 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315800058 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: df46881c91e8419e84b8679ad474ba44 Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315800058-project Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 could not be found. Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7b0a9d17-5cc3-4882-96fc-08b6bc217ec4'} Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 could not be found. Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 could not be found. Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:44.316816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 could not be found. Oct 02 01:14:44.321295 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:14:44.322843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] Returning 404 to user: Instance 7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:14:44.323901 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a95706c1-fed6-42fa-bb00-71172c435543 tempest-ServerRescueNegativeTestJSON-1315800058 tempest-ServerRescueNegativeTestJSON-1315800058-project] 10.222.0.23 "GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4" status: 404 len: 111 microversion: 2.1 time: 0.047535 Oct 02 01:14:44.329431 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1479/3159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:44 2022] GET /compute/v2.1/servers/7b0a9d17-5cc3-4882-96fc-08b6bc217ec4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:14:44.336832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:44.337673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:44.345636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.346395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.347063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.348280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.348925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.349696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.429207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:44.430169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:44.430864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:44.431643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:44.432485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:44.456736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.458126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.459800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.462771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.463855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.466753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.497032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:44.503492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for user 66a9d6a142d444be90b2101f23603522 and project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:44.520862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:44.523397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:44.550484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:44.561622 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a20bde39-975c-4946-9d56-60dba3fcdb76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1317 microversion: 2.1 time: 0.230117 Oct 02 01:14:44.562910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1480/3160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:44 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:44.568629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:44.569482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:44.577537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.578227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.578853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.580847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.581490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.582455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.598292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1651e12c-a52d-48b7-95fb-528869b44768 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.617940 Oct 02 01:14:44.599327 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1681/3161] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:14:44.604376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1391372699", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:44.677081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] validate_networks() for [('867d699a-34bd-4b9c-a0d1-2f2c4b297862', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:14:44.915249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:44.936343 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-78b5ccec-7a0b-4eaa-a9a8-5b54ed086846 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1308 microversion: 2.1 time: 0.368010 Oct 02 01:14:44.940123 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1481/3162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:44 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:44.952139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:44.955585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:44.969303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.975457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.975990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.978257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.978796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.979242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.421105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:45.438997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:45.440718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:45.443179 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7244a3ee-7f12-481e-8a86-10265a56f65d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1887 microversion: 2.32 time: 0.501594 Oct 02 01:14:45.459034 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1482/3163] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:44 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1887 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:45.467799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:45.468648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:45.476885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.483389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.484124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.485042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.485661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.486284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.543737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:45.544806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:45.545401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:45.546412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:45.546869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:45.571958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.573522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.574318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.577720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.583316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.584050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.633619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:45.651291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b43e4a3-11dd-4722-90bd-da19270bd023 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1218 microversion: 2.1 time: 0.182591 Oct 02 01:14:45.652336 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1483/3164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:45 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:45.654515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:14:45.657236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-03f31312-171f-4442-aea0-94547bdad3f9 req-5a1a434e-581f-4088-8467-8487b9444347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "4a47e1ce-0f9e-4ca0-a5e1-dc5927d7fb75"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:45.673548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for user eb1045d1468b4a2f814930f5ace5c2ef and project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:14:45.680370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03f31312-171f-4442-aea0-94547bdad3f9 req-5a1a434e-581f-4088-8467-8487b9444347 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.681107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03f31312-171f-4442-aea0-94547bdad3f9 req-5a1a434e-581f-4088-8467-8487b9444347 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.681703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03f31312-171f-4442-aea0-94547bdad3f9 req-5a1a434e-581f-4088-8467-8487b9444347 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.695615 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-03f31312-171f-4442-aea0-94547bdad3f9 req-5a1a434e-581f-4088-8467-8487b9444347 service nova] Creating event network-changed:4a47e1ce-0f9e-4ca0-a5e1-dc5927d7fb75 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:45.703118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:14:45.706045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:14:45.720073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-03f31312-171f-4442-aea0-94547bdad3f9 req-5a1a434e-581f-4088-8467-8487b9444347 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066259 Oct 02 01:14:45.720951 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1484/3165] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:45.726567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:45.727594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:45.744348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.745123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.745730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.746979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.747613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.748337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.802110 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12a6e7b3-e05a-4396-9d02-b4be67355732 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.198056 Oct 02 01:14:45.802474 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1682/3166] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:14:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:14:45.817179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:45.817767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:45.844271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.844777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.845219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.849220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.850084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.850199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.324805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:46.337290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-75738552-ccf4-4916-8254-67ab10ce497f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.531857 Oct 02 01:14:46.354224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:46.367092 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1683/3167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:45 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:46.373097 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48ae823f-0c8d-4e21-8677-dd058bcbaedd tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1535 microversion: 2.1 time: 0.650631 Oct 02 01:14:46.378402 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1485/3168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:45 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1535 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:46.388524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f07e2519-09e0-4773-a5d5-fbe0581d9695 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:46.391621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f07e2519-09e0-4773-a5d5-fbe0581d9695 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:46.392502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:46.400062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:46.409283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.410471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.411697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.412803 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.414642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.415438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.592434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f07e2519-09e0-4773-a5d5-fbe0581d9695 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:46.605498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f07e2519-09e0-4773-a5d5-fbe0581d9695 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1225 microversion: 2.1 time: 0.224838 Oct 02 01:14:46.608840 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1486/3169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:46 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1225 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:46.624248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:46.627458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:46.671139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.672480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.677039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.677891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.681472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.681931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.747331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:46.759252 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9ad51e53-2b70-4cd9-a811-b910f0f606af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1504 microversion: 2.1 time: 0.390955 Oct 02 01:14:46.761911 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1684/3170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:46 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:46.768951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1c2cd823-24c3-4a13-8350-1f62fe433c84 req-1015bbbd-dd9e-4a9c-98e0-cd4664c735d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "name": "network-vif-plugged", "status": "completed", "tag": "00c082ad-e0e2-43e3-8d4e-b5dc883f1405"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:46.795635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c2cd823-24c3-4a13-8350-1f62fe433c84 req-1015bbbd-dd9e-4a9c-98e0-cd4664c735d6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.796460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c2cd823-24c3-4a13-8350-1f62fe433c84 req-1015bbbd-dd9e-4a9c-98e0-cd4664c735d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.797215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1c2cd823-24c3-4a13-8350-1f62fe433c84 req-1015bbbd-dd9e-4a9c-98e0-cd4664c735d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.836227 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1c2cd823-24c3-4a13-8350-1f62fe433c84 req-1015bbbd-dd9e-4a9c-98e0-cd4664c735d6 service nova] Creating event network-vif-plugged:00c082ad-e0e2-43e3-8d4e-b5dc883f1405 for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:14:46.844663 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1c2cd823-24c3-4a13-8350-1f62fe433c84 req-1015bbbd-dd9e-4a9c-98e0-cd4664c735d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081210 Oct 02 01:14:46.845702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1685/3171] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:46.856783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83bd1c90-62c9-4d7c-a713-9b71e26c7e40 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'create', calling method: .version_select at 0x7fb885594c10>, body: {"pool": "38cab524-487b-4b38-8872-81306b82592c"} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:48.031998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:48.041589 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08430f7c-5189-4f33-9b47-cedf7f328727 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1488 microversion: 2.1 time: 1.429535 Oct 02 01:14:48.049465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1487/3172] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:46 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1488 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:48.055902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:48.058800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:48.075608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.076477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.077185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.078121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.078844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.079546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.715339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:48.740152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:48.743218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:48.745927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-825e6190-8423-4fdf-be5d-92f8c58ca0ee tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1887 microversion: 2.32 time: 0.694903 Oct 02 01:14:48.746845 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1488/3173] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:48 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1887 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:48.760714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:48.761497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:48.770070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.770868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.771454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.772336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.772988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.773593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.795672 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:48.918207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:48.932949 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82ede8bd-463b-48db-b082-5c9e154e3781 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1272 microversion: 2.1 time: 0.176797 Oct 02 01:14:48.961656 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1489/3174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:48 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:48.970242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:48.971418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:48.980473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.981430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.982122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.983432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.984243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.984819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:49.905761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:49.923266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e803c21-ab53-444b-87c3-870870ba42f1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1504 microversion: 2.1 time: 0.959568 Oct 02 01:14:49.931012 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1490/3175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:48 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1504 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:49.939400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:49.940353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:49.976678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:49.977214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:49.977674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:49.978438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:49.978935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:49.979428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:50.368142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:50.381139 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b76ff7fe-15e5-4a96-a7e6-4fe42cc9837c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.448889 Oct 02 01:14:50.381823 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1491/3176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:49 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:50.391428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:50.392245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:50.408636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:50.409749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:50.412557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:50.413555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:50.414248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:50.425048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.324668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:51.338898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-901abd40-82c6-4d7c-afd9-356fa0cd8953 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1325 microversion: 2.1 time: 0.955789 Oct 02 01:14:51.341718 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1492/3177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:50 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1325 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:51.352007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e3f795e9-1b6e-47b8-8e41-06cef96d3a00 req-3e645678-10c6-4d79-bd79-656f21e98735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "02b6b599-4c10-4fd0-8cd7-c5881f8a4780"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:51.373529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e3f795e9-1b6e-47b8-8e41-06cef96d3a00 req-3e645678-10c6-4d79-bd79-656f21e98735 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.374289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e3f795e9-1b6e-47b8-8e41-06cef96d3a00 req-3e645678-10c6-4d79-bd79-656f21e98735 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.375031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e3f795e9-1b6e-47b8-8e41-06cef96d3a00 req-3e645678-10c6-4d79-bd79-656f21e98735 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.391477 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e3f795e9-1b6e-47b8-8e41-06cef96d3a00 req-3e645678-10c6-4d79-bd79-656f21e98735 service nova] Creating event network-changed:02b6b599-4c10-4fd0-8cd7-c5881f8a4780 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:51.397854 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e3f795e9-1b6e-47b8-8e41-06cef96d3a00 req-3e645678-10c6-4d79-bd79-656f21e98735 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054399 Oct 02 01:14:51.399511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1493/3178] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:51.407955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:51.408996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:51.418512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.419213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.419828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.420774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.421688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.422430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.479446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lazy-loading 'flavor' on Instance uuid c277426b-e31d-455e-a9ed-17a3b7a7746c {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:14:51.579928 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6093120e-86b9-495b-8d86-fd6af182d285 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c/action" status: 202 len: 0 microversion: 2.1 time: 0.178562 Oct 02 01:14:51.581758 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1494/3179] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:51 2022] POST /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:14:51.590005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:51.591049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:51.599344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.600135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.600907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.601947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.602682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.603367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.503346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:52.522646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:52.525779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:52.528091 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f23e25e2-1029-4ed2-8f5c-3a50354de9b9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1887 microversion: 2.32 time: 0.944477 Oct 02 01:14:52.529284 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1495/3180] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:51 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1887 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:52.545497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2a45c53a-8aec-42df-9378-94d39e1ac726 req-1adb18e9-9e2e-4ecc-85e4-376c0e1ddf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "name": "network-vif-plugged", "status": "completed", "tag": "4e8a0f53-86ec-4570-b3f1-797e10f5eb2f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:52.560628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2a45c53a-8aec-42df-9378-94d39e1ac726 req-1adb18e9-9e2e-4ecc-85e4-376c0e1ddf8e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.561540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2a45c53a-8aec-42df-9378-94d39e1ac726 req-1adb18e9-9e2e-4ecc-85e4-376c0e1ddf8e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.562230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2a45c53a-8aec-42df-9378-94d39e1ac726 req-1adb18e9-9e2e-4ecc-85e4-376c0e1ddf8e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.576504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2a45c53a-8aec-42df-9378-94d39e1ac726 req-1adb18e9-9e2e-4ecc-85e4-376c0e1ddf8e service nova] Creating event network-vif-plugged:4e8a0f53-86ec-4570-b3f1-797e10f5eb2f for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:14:52.582659 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2a45c53a-8aec-42df-9378-94d39e1ac726 req-1adb18e9-9e2e-4ecc-85e4-376c0e1ddf8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050894 Oct 02 01:14:52.587340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1496/3181] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:52.593151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:52.596011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:52.603720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.604418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.605028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.605801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.606450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.606969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.698617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:14:52.698890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:14:52.708520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:14:52.709112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:14:52.709726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:14:52.840621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:52.851317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.852879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.852879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.853691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.854402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.854963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.898952 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77e6e196-9ff8-426f-8e93-37f1eaade873 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "POST /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc/action" status: 202 len: 1106 microversion: 2.1 time: 0.309910 Oct 02 01:14:52.910483 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1497/3182] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:52 2022] POST /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc/action => generated 1106 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 02 01:14:52.910483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:52.910483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:52.929727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.930350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.931833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.932973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.933400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.935078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.025103 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83bd1c90-62c9-4d7c-a713-9b71e26c7e40 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.177905 Oct 02 01:14:53.026435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1686/3183] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:14:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:53.039761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:53.040706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:53.055134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.057011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.057915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.060238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.061409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.062950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.106495 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:53.526038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:53.553446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:53.559126 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e114ab4f-2e17-47cd-b8c8-081d32a8e918 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1314 microversion: 2.1 time: 0.656887 Oct 02 01:14:53.566591 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1498/3184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:52 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:53.580306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:53.581532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:53.589460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-092996a1-fe96-491f-84e1-a09c53a806d6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.557558 Oct 02 01:14:53.590115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1687/3185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:53 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:53.608148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.608687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.609449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.612757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.614482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:53.614710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.615422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.631226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:53.645970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.646822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.647994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.649108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.649731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.650318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.112625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:54.138986 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d0ecb2a-618f-4dcc-a773-301da24940e0 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 200 len: 1479 microversion: 2.1 time: 0.571106 Oct 02 01:14:54.139895 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1499/3186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:53 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 1479 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:54.144490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:54.146192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:54.151896 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:54.153667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:54.154199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:54.154651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.155363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:54.157864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:54.158357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.193886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:54.239772 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a6f742a-4ff2-4d9d-8b4a-72996ffeb46b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1325 microversion: 2.1 time: 0.645651 Oct 02 01:14:54.241504 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1688/3187] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:53 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1325 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:54.251381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.149"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:54.258397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:54.265517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:54.266077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:54.266750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.267697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:54.268303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:54.275633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.346267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:14:54.346975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquired lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:14:54.983805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:55.009374 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6729965-9d70-426b-95bc-9f97192ae9de tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.868536 Oct 02 01:14:55.023199 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1500/3188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:54 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:55.036424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4"}, {"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "47217643-f743-4e05-9b81-726cd2a59e92"}, {"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:55.047697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.048345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.049032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.062076 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Creating event network-changed:cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:55.062906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Creating event network-changed:47217643-f743-4e05-9b81-726cd2a59e92 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:55.063417 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] Creating event network-changed:b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:14:55.068782 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1815e991-751c-4eca-b058-d6af3e6029c4 req-c05ca587-e79b-46f1-be36-9a18688149b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.045060 Oct 02 01:14:55.069434 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1501/3189] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:55.074806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:55.075511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:55.082356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.083167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.083850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.084572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.085034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.085464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.589375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:55.601310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:55.603260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:55.604565 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ed3be53-a193-47c7-a01b-23b8ab43c2c6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.533876 Oct 02 01:14:55.605860 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1502/3190] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:55 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:55.610998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-fb526732-b9b6-4973-b2f4-6989f81685f3 req-d08da81c-c574-442c-aba4-0ae3d9ae8757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdd09fc-040e-4612-92f3-b0902284af55", "tag": "5e759d20-d216-432c-b3e1-26ccb1c718df"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:55.619233 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:55.623886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fb526732-b9b6-4973-b2f4-6989f81685f3 req-d08da81c-c574-442c-aba4-0ae3d9ae8757 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.624802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fb526732-b9b6-4973-b2f4-6989f81685f3 req-d08da81c-c574-442c-aba4-0ae3d9ae8757 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.625526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fb526732-b9b6-4973-b2f4-6989f81685f3 req-d08da81c-c574-442c-aba4-0ae3d9ae8757 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.639461 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-fb526732-b9b6-4973-b2f4-6989f81685f3 req-d08da81c-c574-442c-aba4-0ae3d9ae8757 service nova] Creating event network-changed:5e759d20-d216-432c-b3e1-26ccb1c718df for instance 8fdd09fc-040e-4612-92f3-b0902284af55 on n-h2-master-1 Oct 02 01:14:55.645861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-fb526732-b9b6-4973-b2f4-6989f81685f3 req-d08da81c-c574-442c-aba4-0ae3d9ae8757 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037701 Oct 02 01:14:55.647018 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1503/3191] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:55.652521 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-423726327"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:55.655846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:55.663336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.663972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.664505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.665298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.665849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.666427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.691057 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:55.857656 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:55.896761 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6575dad7-db26-4893-b5ed-2419bb083ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c/action" status: 202 len: 0 microversion: 2.1 time: 0.247885 Oct 02 01:14:55.897986 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1504/3192] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:55 2022] POST /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:14:55.903978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:55.905214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:55.913033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.913862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.914538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.915601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.916211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.916887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.145849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:56.155357 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5438f44d-818c-4cd9-acb8-48dabe81e964 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1314 microversion: 2.1 time: 0.255921 Oct 02 01:14:56.156406 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1505/3193] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:55 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:56.163326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6402caa9-92ad-4318-bf93-b2018318b656 req-09ee7c31-d20d-4275-af4f-8bb75feb084e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "name": "network-vif-plugged", "status": "completed", "tag": "24a43f83-dbac-4108-b318-bc4b49e5ac8c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:56.173622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6402caa9-92ad-4318-bf93-b2018318b656 req-09ee7c31-d20d-4275-af4f-8bb75feb084e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.174472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6402caa9-92ad-4318-bf93-b2018318b656 req-09ee7c31-d20d-4275-af4f-8bb75feb084e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.175169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6402caa9-92ad-4318-bf93-b2018318b656 req-09ee7c31-d20d-4275-af4f-8bb75feb084e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.187091 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6402caa9-92ad-4318-bf93-b2018318b656 req-09ee7c31-d20d-4275-af4f-8bb75feb084e service nova] Creating event network-vif-plugged:24a43f83-dbac-4108-b318-bc4b49e5ac8c for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:14:56.192432 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6402caa9-92ad-4318-bf93-b2018318b656 req-09ee7c31-d20d-4275-af4f-8bb75feb084e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033194 Oct 02 01:14:56.193750 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1506/3194] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:56.203294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:56.204089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:56.211435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.212070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.212578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.213353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.213877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.214370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.599739 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:56.652947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:56.663739 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eb9aa73f-1707-4c73-a7cf-64e53562448c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1353 microversion: 2.1 time: 0.466070 Oct 02 01:14:56.664222 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1507/3195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:56 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1353 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:56.703677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:56.705245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:56.719601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.724095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.725237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.728405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.729160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.729597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:57.235042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:57.245280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Building network info cache for instance {{(pid=122355) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:14:57.254941 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-863a67d9-386f-4e79-8150-881fa4ec97a0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1325 microversion: 2.1 time: 0.566812 Oct 02 01:14:57.261366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1508/3196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:56 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:57.278542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9d456ee9-2d9b-447c-a639-d4398ce54f29 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880aad3a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:57.351370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9d456ee9-2d9b-447c-a639-d4398ce54f29 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.088618 Oct 02 01:14:57.352342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1509/3197] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:57 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:57.358042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:57.358684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:57.375335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:57.376256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:57.376873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:57.377955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:57.378582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:57.379790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:58.234813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:58.248989 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d508042b-c7e5-41cb-aaf5-a703e678189e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.895370 Oct 02 01:14:58.249628 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1510/3198] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:57 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:58.260281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:58.260894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:58.278035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:58.278543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:58.279021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:58.279744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:58.280202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:58.280623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:58.949324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:58.975244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:58.978391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:58.980176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cde7ba24-84d2-4739-a0ed-c4fa4a9187de tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.729434 Oct 02 01:14:58.987120 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1511/3199] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:14:58 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:14:58.992837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:58.993480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:58.999789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.000665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.001214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.002159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.002796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.003364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.626341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:14:59.639244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-86bb47bc-9251-4938-b531-e8479988383e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1314 microversion: 2.1 time: 0.647252 Oct 02 01:14:59.647914 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1512/3200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:58 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:14:59.653618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:59.654312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:59.662690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.663235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.663778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.664623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.665192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.665713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.704216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Updating instance_info_cache with network_info: [{"id": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf", "address": "fa:16:3e:75:20:7c", "network": {"id": "1ebdcb03-5ad3-4f1b-8896-dc5e5893c329", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-89942229-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e3f2bd52c8d347679396891f8f163197", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5e6a0047-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:14:59.722015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Releasing lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:14:59.723771 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97e24b02-bfac-4baa-9a16-68ad2566b256 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action" status: 202 len: 0 microversion: 2.1 time: 5.478659 Oct 02 01:14:59.724668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1689/3201] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:14:54 2022] POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action => generated 0 bytes in 5482 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:14:59.732295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2594e2a1-02b5-403c-8989-4dd1f40bc4eb", "tag": "97738f33-8fc1-4251-a80f-e4056133fa4b"}, {"name": "network-changed", "server_uuid": "bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0", "tag": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:14:59.747158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.748034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.748808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.764971 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] Creating event network-changed:97738f33-8fc1-4251-a80f-e4056133fa4b for instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb on n-h2-master-1 Oct 02 01:14:59.765630 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] Creating event network-changed:5e6a0047-75ea-4c38-9f37-d1ecfe28fecf for instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 on n-h1-master-1 Oct 02 01:14:59.779100 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fe8e89c1-60d6-43c2-9a2c-2d004f6bb121 req-62c884e3-483e-4074-8b15-b5d7d7906d15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052186 Oct 02 01:14:59.781412 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1690/3202] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:59.789083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:59.789976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:59.799357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.799962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.801014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.804502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.806181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.806909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:00.123160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:00.136916 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3aad465e-fde7-44e4-b1a0-e248c48f487f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1803 microversion: 2.1 time: 0.487146 Oct 02 01:15:00.159562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1513/3203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:59 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1803 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:00.165851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0bc5afbe-4274-4f18-abf8-ab6b9fcfdab8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880b20040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:00.249262 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0bc5afbe-4274-4f18-abf8-ab6b9fcfdab8 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.088022 Oct 02 01:15:00.250864 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1514/3204] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:00 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:00.257369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:00.258212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:00.267909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:00.268720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:00.269320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:00.270272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:00.271107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:00.272534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:00.750378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:00.766065 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d99d6a2f-8b2f-4739-b45e-17d36e9a2a54 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1325 microversion: 2.1 time: 0.982257 Oct 02 01:15:00.773353 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1691/3205] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:14:59 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1325 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:00.787473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8db3fb52-e887-43d0-8c9a-55a3d92f97b0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'create', calling method: .version_select at 0x7fb881bf2a60>, body: {"pool": "38cab524-487b-4b38-8872-81306b82592c"} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:01.086511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:01.094924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57fe1300-631d-4c35-b332-4bd1dc56b6b2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.842383 Oct 02 01:15:01.107821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1515/3206] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:00 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:01.123465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:01.124364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:01.132536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.143375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.144070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.145024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.145646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.146279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.847389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:01.859575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:01.861363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:01.862859 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffb3bb70-3aea-4f1b-9ef1-e08c4925a21f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.753780 Oct 02 01:15:01.864205 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1516/3207] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:01 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:01.871256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3b8f19e0-41bc-4ad9-a996-fbbe95b29b50 req-f09d59de-26fe-4451-8af7-c640da022ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdd09fc-040e-4612-92f3-b0902284af55", "name": "network-vif-plugged", "status": "completed", "tag": "5e759d20-d216-432c-b3e1-26ccb1c718df"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:01.883589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b8f19e0-41bc-4ad9-a996-fbbe95b29b50 req-f09d59de-26fe-4451-8af7-c640da022ce6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.884354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b8f19e0-41bc-4ad9-a996-fbbe95b29b50 req-f09d59de-26fe-4451-8af7-c640da022ce6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.884941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3b8f19e0-41bc-4ad9-a996-fbbe95b29b50 req-f09d59de-26fe-4451-8af7-c640da022ce6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.900897 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3b8f19e0-41bc-4ad9-a996-fbbe95b29b50 req-f09d59de-26fe-4451-8af7-c640da022ce6 service nova] Creating event network-vif-plugged:5e759d20-d216-432c-b3e1-26ccb1c718df for instance 8fdd09fc-040e-4612-92f3-b0902284af55 on n-h2-master-1 Oct 02 01:15:01.905858 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3b8f19e0-41bc-4ad9-a996-fbbe95b29b50 req-f09d59de-26fe-4451-8af7-c640da022ce6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040143 Oct 02 01:15:01.906459 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1517/3208] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:01.912714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:01.913288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:01.922468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.923250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.923880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.924776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.925392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.926022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.975868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0c24bfd-80d9-4fd2-a454-c6913f5a545e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5/ips" status: 200 len: 218 microversion: 2.1 time: 0.067978 Oct 02 01:15:01.985485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1518/3209] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:15:01 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5/ips => generated 218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:01.992212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:01.993523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:02.001076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:02.001635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:02.002147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:02.002908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:02.003423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:02.003858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:02.717546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:02.732739 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-33fea834-4399-4334-ab4e-4cbec2a39194 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1314 microversion: 2.1 time: 0.745899 Oct 02 01:15:02.735860 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1519/3210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:01 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:02.748442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbee6edf-c6e3-4465-9738-e410013b6f27 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881c251f0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:02.830477 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cbee6edf-c6e3-4465-9738-e410013b6f27 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.093292 Oct 02 01:15:02.831115 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1520/3211] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:02 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:02.843105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:02.845732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:02.859397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:02.859919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:02.860364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:02.866078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:02.867799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:02.870492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.201023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:03.212118 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-befe744f-b650-41ce-bae6-7c1a662c3f74 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1325 microversion: 2.1 time: 0.376788 Oct 02 01:15:03.212632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1521/3212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:02 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1325 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:03.227116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:03.227635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:03.247479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.247988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.248435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.249173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.249609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.250038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.314509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:03.482134 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-80b96fc1-8add-4dbe-891b-60b5d0c47735 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 204 len: 0 microversion: 2.1 time: 0.268082 Oct 02 01:15:03.483144 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1522/3213] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:03 2022] DELETE /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:03.494507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:03.495366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:03.511709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.512307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.512827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.513612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.514138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.514854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.560576 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:03.870726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:03.893744 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-824e9fdf-5e65-459b-aa7c-f55d8353e0ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.408608 Oct 02 01:15:03.896554 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1523/3214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:03 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:03.902007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:03.903317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:03.910676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.912021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.913114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.914112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.914956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.915842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.438959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:04.452710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:04.457021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:04.459215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5857cd4a-4a90-423f-a882-8a095e0d3293 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.561243 Oct 02 01:15:04.460644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1524/3215] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:03 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:04.466579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:04.467444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:04.469374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8db3fb52-e887-43d0-8c9a-55a3d92f97b0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.694044 Oct 02 01:15:04.476033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.476774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.478065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.478418 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1692/3216] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:15:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:04.479348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.480027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.481410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.483495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:04.484312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:04.496760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.499205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.499933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.502252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.502935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.503982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.792081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:04.801015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99439969-77e8-4aea-95d9-29fb96a1473f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1809 microversion: 2.1 time: 0.339006 Oct 02 01:15:04.806592 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1525/3217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:04 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1809 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:04.811595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-34a5cbf3-5533-4826-9aad-f8b56fe67769 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880b04c10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:04.825302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:04.834134 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9335868-bb67-4f0f-8bc9-84361c362fa8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1314 microversion: 2.1 time: 0.354558 Oct 02 01:15:04.840780 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1693/3218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:04 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:04.858833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c277426b-e31d-455e-a9ed-17a3b7a7746c", "name": "network-vif-plugged", "status": "completed", "tag": "f0040594-ca37-4c7d-ae42-44a3581c717f"}, {"server_uuid": "2594e2a1-02b5-403c-8989-4dd1f40bc4eb", "name": "network-vif-plugged", "status": "completed", "tag": "97738f33-8fc1-4251-a80f-e4056133fa4b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:04.874460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.875919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.878045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.917037 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-34a5cbf3-5533-4826-9aad-f8b56fe67769 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.109044 Oct 02 01:15:04.918309 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1526/3219] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:04 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:04.921363 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] Creating event network-vif-plugged:f0040594-ca37-4c7d-ae42-44a3581c717f for instance c277426b-e31d-455e-a9ed-17a3b7a7746c on n-h2-master-1 Oct 02 01:15:04.926826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:04.927785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] Creating event network-vif-plugged:97738f33-8fc1-4251-a80f-e4056133fa4b for instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb on n-h2-master-1 Oct 02 01:15:04.931354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:04.940241 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ed4d7ee1-e48c-4629-809f-18b62fd049a0 req-9e082ef5-448d-432a-b7c6-56bab78a82ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097912 Oct 02 01:15:04.941879 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1694/3220] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:04.945920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.950824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.951518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.953182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.953847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.954498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.961710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.74"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:04.968037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:04.987574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.988340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.988620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.989837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.990402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.990882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:05.083625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:15:05.086209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquired lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:15:05.359118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:05.372103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c6c2699f-7d90-4e71-b1ad-69d775e7dfdc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1521 microversion: 2.1 time: 0.448339 Oct 02 01:15:05.384701 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1527/3221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:04 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:05.463747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:05.464592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:05.481537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:05.482379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:05.482849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:05.483820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:05.484429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:05.485095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:05.776769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:05.785870 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75432da0-a63e-4197-a9b9-2a64bc34577d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.399902 Oct 02 01:15:05.787451 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1528/3222] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:05 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:05.792361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:05.793256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:05.799749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:05.800542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:05.801266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:05.802684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:05.803379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:05.804019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:06.490859 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c.", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:15:06.492237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Releasing lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:15:06.492868 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.492868 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Request method failure captured: Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action HTTP/1.1 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 45 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXq-hflhKtzfumDKwgmRUQ0ODRLhGjKA2ejcP96cadWPGOAlDsIrN7xictm-kFQX3rihOT-2sghRK4SxpmykAppTgLz9Pqn9NHdzDNG250V5PkfKD_jxamN5qAWWdMVrCW75QF0F5-buJ7WZqCxj5g2ii1kz82k_tHFGzqOS83mJT4 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f2bd52c8d347679396891f8f163197"}]}] Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 1e5ba26f19334afa95c2df9b1655626e Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: {"addFloatingIp": {"address": "172.35.4.74"}} Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0', 'body': {'addFloatingIp': {'address': '172.35.4.74'}}} Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:15:06.495140 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] Oct 02 01:15:06.499632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:06.504836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Returning 400 to user: Cannot associate floating IP 172.35.4.74 (c61b4a69-ae8d-44ad-b494-8bd897e4796c) with port 5e6a0047-75ea-4c38-9f37-d1ecfe28fecf using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 38cab524-487b-4b38-8872-81306b82592c. Oct 02 01:15:06.504836 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-2a9a83ed-b6dc-4aca-8682-01879d981a71'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:06.504836 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18525520-8de0-481c-8452-9777c8bfebfa tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action" status: 400 len: 381 microversion: 2.1 time: 1.552072 Oct 02 01:15:06.504836 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1695/3223] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:04 2022] POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action => generated 381 bytes in 1557 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:15:06.512707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:06.513676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:06.522307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:06.523218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:06.523758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:06.524565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:06.525125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:06.525657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:06.569812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:06.580291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e971b4ec-cba5-4b65-9de9-9a9b8f78f2b3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1521 microversion: 2.1 time: 0.791476 Oct 02 01:15:06.581742 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1529/3224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:05 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:06.768340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-554559230", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:06.888307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:06.969170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:06.984012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:06.985103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:06.987749 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ef93711-8485-4300-9341-a5d0a7636f0c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.481200 Oct 02 01:15:06.988884 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1696/3225] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:06 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:06.995074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:06.998563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:07.008897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:07.009806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:07.010695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:07.011824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:07.012757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:07.013440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:07.339194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:07.357031 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4893359-e4c8-4cf0-b949-bd9610770233 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1809 microversion: 2.1 time: 0.366518 Oct 02 01:15:07.371018 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1697/3226] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:06 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1809 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:07.378906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:07.379576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:07.394290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:07.395543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:07.395987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:07.396805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:07.397265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:07.397697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:07.875993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:07.896669 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ce5452f-7125-4ea3-81d5-11be44aeaf5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1501 microversion: 2.1 time: 0.522830 Oct 02 01:15:07.899363 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1698/3227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:07 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1501 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:07.906616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e048bde-8d76-498c-b14c-1cc19eee3e62 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88557f790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:07.963299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e048bde-8d76-498c-b14c-1cc19eee3e62 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.061846 Oct 02 01:15:07.964418 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1699/3228] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:07 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:07.971332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43f6b60a-ee9f-4ea8-8963-ba4136f4d7c3 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '.version_select at 0x7fb8855985e0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:08.221868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:08.222457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:08.222770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:08.223797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:08.224478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:08.241349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:08.241830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:08.242260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:08.251173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:08.251668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:08.252112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:08.284905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:08.304360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:08.333524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:08.336526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:08.422992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53a90314-72af-4ffe-ae3a-bce939f751b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838347 Oct 02 01:15:08.431027 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1530/3229] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:15:08.436589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2118332555"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:08.439570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:08.449982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:08.450546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:08.451269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:08.452251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:08.452726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:08.454877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.038176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ae7e244-fd71-42fa-a1c3-5300c1935cad tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55/action" status: 202 len: 0 microversion: 2.1 time: 0.593577 Oct 02 01:15:09.041468 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1531/3230] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:08 2022] POST /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:15:09.081315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:09.084502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:09.115789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.118526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.119213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.121933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.131452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.133682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.649343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:09.659986 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dbd60293-67af-499f-b7c7-56524552d0e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.615535 Oct 02 01:15:09.663499 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1532/3231] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:09 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:09.677529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a946369a-92b9-4d60-a3c7-9c815eb3b60d req-be4d6335-6781-402d-827d-626450250f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "name": "network-vif-deleted", "tag": "00c082ad-e0e2-43e3-8d4e-b5dc883f1405"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:09.708876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a946369a-92b9-4d60-a3c7-9c815eb3b60d req-be4d6335-6781-402d-827d-626450250f52 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.709604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a946369a-92b9-4d60-a3c7-9c815eb3b60d req-be4d6335-6781-402d-827d-626450250f52 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.710162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a946369a-92b9-4d60-a3c7-9c815eb3b60d req-be4d6335-6781-402d-827d-626450250f52 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.741354 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a946369a-92b9-4d60-a3c7-9c815eb3b60d req-be4d6335-6781-402d-827d-626450250f52 service nova] Creating event network-vif-deleted:00c082ad-e0e2-43e3-8d4e-b5dc883f1405 for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:15:09.746313 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43f6b60a-ee9f-4ea8-8963-ba4136f4d7c3 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/c61b4a69-ae8d-44ad-b494-8bd897e4796c" status: 202 len: 0 microversion: 2.1 time: 1.780690 Oct 02 01:15:09.747491 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1700/3232] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:15:07 2022] DELETE /compute/v2.1/os-floating-ips/c61b4a69-ae8d-44ad-b494-8bd897e4796c => generated 0 bytes in 1782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:09.752626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:09.754033 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a946369a-92b9-4d60-a3c7-9c815eb3b60d req-be4d6335-6781-402d-827d-626450250f52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087224 Oct 02 01:15:09.756654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:09.756945 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1533/3233] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:09.771528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.772030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.772474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.773191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.773654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.777759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:09.778564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.784414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:09.814212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.814462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.824728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.829021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.835491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.835981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.963460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-93640c0a-57d3-467c-88b6-e0d5bfb780ff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 14 microversion: 2.1 time: 0.214517 Oct 02 01:15:09.964443 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1701/3234] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:09 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:15:09.969797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:09.971813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:09.988651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.997593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.998326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.999278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.999894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.000500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.220132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:10.232476 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e02e5b2-5ce2-4acc-9848-a6abaffbd6a0 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1611 microversion: 2.1 time: 0.266631 Oct 02 01:15:10.249845 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1702/3235] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:09 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1611 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:10.256056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:10.257227 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:10.264349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.265190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.265848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.266820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.267487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.268123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.320462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:10.330977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:10.333243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:10.334582 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-427f2ad8-faf0-4845-baaa-8907f8d23b6b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.569371 Oct 02 01:15:10.335932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1534/3236] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:09 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:10.341692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56aee7d0-3975-4676-9889-9f4fb6cba645 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880aad5e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:10.424320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56aee7d0-3975-4676-9889-9f4fb6cba645 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.087102 Oct 02 01:15:10.427646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1535/3237] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:10 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:10.433902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7206ac6e-3f5c-4498-8931-86dff657b726 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '.version_select at 0x7fb880b0e3a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:10.467942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:10.490550 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-378f6a2e-24a6-486b-8860-3e31b8952730 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1244 microversion: 2.1 time: 0.239083 Oct 02 01:15:10.502725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1703/3238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:10 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1244 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:10.520908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'action', calling method: .version_select at 0x7fb883a6f9d0>, body: {"removeFloatingIp": {"address": "172.35.4.149"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:10.686082 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7206ac6e-3f5c-4498-8931-86dff657b726 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902" status: 204 len: 0 microversion: 2.1 time: 0.256539 Oct 02 01:15:10.687254 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1536/3239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:10 2022] DELETE /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:10.707459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:10.709937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:10.726028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.726512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.726979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.727700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.732420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.742241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.795273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:10.806820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.807318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.809998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.810869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.811343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.816024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.607243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:11.621317 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7fc39ace-06b7-4767-8896-c17ac381de76 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.929049 Oct 02 01:15:11.632092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1537/3240] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:10 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:11.632092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8346d5b3-54d2-47a5-b920-8a8d2a2b13de tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '.version_select at 0x7fb880b0b700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:11.658220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:15:11.658786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquired lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:15:11.664281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8346d5b3-54d2-47a5-b920-8a8d2a2b13de tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Image not found. Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8346d5b3-54d2-47a5-b920-8a8d2a2b13de tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902 HTTP/1.1 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '548abde7-b409-4f0a-b1c0-44a2798c6902'} Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 548abde7-b409-4f0a-b1c0-44a2798c6902 Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:15:11.666553 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 548abde7-b409-4f0a-b1c0-44a2798c6902 could not be found. Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8346d5b3-54d2-47a5-b920-8a8d2a2b13de tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:11.670578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8346d5b3-54d2-47a5-b920-8a8d2a2b13de tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902" status: 404 len: 62 microversion: 2.1 time: 0.042594 Oct 02 01:15:11.673655 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1538/3241] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:11 2022] GET /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:11.679390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:11.683713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:11.691172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.691943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.692812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.693637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.694176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.695000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.873205 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c50faaf4-751f-4868-9e51-3d2316e0eeed tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 14 microversion: 2.1 time: 0.196220 Oct 02 01:15:11.875293 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1539/3242] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:11 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:15:11.884878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:11.885592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:11.893133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.893997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.895420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.896999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.897869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.898788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.952351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.966709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.967712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.968468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lazy-loading 'fault' on Instance uuid 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:12.106232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:12.135114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab2e2b73-0e3b-4b11-8627-5ef905d9732e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 200 len: 1301 microversion: 2.1 time: 0.251810 Oct 02 01:15:12.137245 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1540/3243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:11 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 1301 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:12.143241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:12.144175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:12.151170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.152009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.153332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.154263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.155022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.155700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.617259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:12.634445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:12.638830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:12.645862 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-543fc17a-e318-4f54-8d9f-7592cb9183f8 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.507057 Oct 02 01:15:12.647821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1541/3244] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:12 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:12.657959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c7a03b0-e514-4a84-9250-19e3d6f6f3a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88119b820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:12.734811 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c7a03b0-e514-4a84-9250-19e3d6f6f3a6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.085261 Oct 02 01:15:12.735677 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1542/3245] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:12 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:12.743110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:12.749810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:12.789465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.791691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.792336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.793217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.797371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.798147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.924146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:12.933744 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea09a728-31c7-45c1-a85d-156280601f87 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1250 microversion: 2.1 time: 0.195233 Oct 02 01:15:12.959100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1543/3246] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:12 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1250 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:12.977064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:12.977746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:12.986385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.987193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.987856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.988903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.989591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.990228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.295749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:13.295981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Building network info cache for instance {{(pid=122355) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:15:13.310345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3da1688-5f61-46ed-9906-5404c1d73317 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1534 microversion: 2.1 time: 0.349986 Oct 02 01:15:13.311696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1544/3247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:12 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1534 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:13.318000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "name": "network-vif-deleted", "tag": "24a43f83-dbac-4108-b318-bc4b49e5ac8c"}, {"server_uuid": "7b18734f-c4f5-4a75-9e20-38f3d20c04f5", "name": "network-vif-deleted", "tag": "4e8a0f53-86ec-4570-b3f1-797e10f5eb2f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:13.334445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.336014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.336857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.343425 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:13.357346 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] Creating event network-vif-deleted:24a43f83-dbac-4108-b318-bc4b49e5ac8c for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:15:13.358260 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] Creating event network-vif-deleted:4e8a0f53-86ec-4570-b3f1-797e10f5eb2f for instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 on n-h1-master-1 Oct 02 01:15:13.372430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bc9e771a-89d0-4ac8-8a05-f2c858f0de61 req-650250dd-5a9d-48ab-ae05-99e6eb035161 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058794 Oct 02 01:15:13.373472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1545/3248] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:13.384455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:13.386046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:13.394180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.396175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.396848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.397871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.398547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.402271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.721011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:13.735279 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4eda9fe9-f5be-4c52-a451-2565dfe1674d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.360305 Oct 02 01:15:13.737057 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1546/3249] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:13 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:13.742554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:13.747400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:13.754973 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:13.757331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.758104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.758770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.759699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.760427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.761270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.852726 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5b189fc-2950-4c33-b481-afa05cf28a41 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 14 microversion: 2.1 time: 0.113699 Oct 02 01:15:13.857125 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1547/3250] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:13 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:15:13.868288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:13.869977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:13.882231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.884044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.884652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.885702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.893755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.894378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.914834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] HTTP exception thrown: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Request method failure captured: Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 HTTP/1.1 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXal9JWOFiBgV0gCWe9-nI1BFgozf0raZolP_pIsnG2H4Y0hU796_NigYon6lje9OBmAoPJZHj7sCTtiDlGVUZXwYNsLO-YTjFcUqdXqGh8RBxx_m732sGNsDcIBujNbFRlj4z1f-L3xl24yUIm5oM3HMJnL3dZAH3TxOZfqVPk4yw Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf661665ac114503b71ac751f84bfdd7"}]}] Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestMultiNic-1894848516 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 852e8ab225d64f40a4dc9ce54fe509fd Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7b18734f-c4f5-4a75-9e20-38f3d20c04f5'} Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:13.916799 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:15:13.921025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:13.923027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Returning 404 to user: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:13.924394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-913fec73-742b-48f0-9736-83279712083e tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 404 len: 111 microversion: 2.1 time: 0.065581 Oct 02 01:15:13.925437 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1548/3251] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:13 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:13.931026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:13.932001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:13.940095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.940880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.941582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.943666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.944625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.945299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:14.340886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:14.351624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:14.352770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:14.354021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5e1aed2-9858-43e4-acfe-73588f8f6c85 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.427325 Oct 02 01:15:14.354571 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1549/3252] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:13 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:14.374698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7df2b14-4b65-4471-a7a0-0e50bb2d60cf tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880a0eb80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:14.437399 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7df2b14-4b65-4471-a7a0-0e50bb2d60cf tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.081716 Oct 02 01:15:14.439826 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1550/3253] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:14 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:14.445258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:14.446159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:14.453545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:14.454873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:14.455561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:14.456521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:14.458001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:14.459190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:14.797838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:14.807002 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e391dc8-71b3-4cfc-bc40-31e98c3c3188 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.365841 Oct 02 01:15:14.819749 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1551/3254] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:14 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:14.824849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:14.825667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:14.843112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:14.843586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:14.844015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:14.844903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:14.845513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:14.846092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.204638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Updating instance_info_cache with network_info: [{"id": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf", "address": "fa:16:3e:75:20:7c", "network": {"id": "1ebdcb03-5ad3-4f1b-8896-dc5e5893c329", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-89942229-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e3f2bd52c8d347679396891f8f163197", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5e6a0047-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:15:15.228510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Releasing lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:15:15.231393 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec9e6c0f-7ad9-4952-81ea-af79c61a3dac tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action" status: 202 len: 0 microversion: 2.1 time: 4.727491 Oct 02 01:15:15.233581 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1704/3255] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:10 2022] POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action => generated 0 bytes in 4729 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:15:15.243680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a62299c8-3cdf-4cad-a9cc-9dda4ee651d8 req-3ef8bc82-49c2-4234-bf0d-c6639afcfe10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdd09fc-040e-4612-92f3-b0902284af55", "name": "network-vif-plugged", "status": "completed", "tag": "5e759d20-d216-432c-b3e1-26ccb1c718df"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:15.258974 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:15.261900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a62299c8-3cdf-4cad-a9cc-9dda4ee651d8 req-3ef8bc82-49c2-4234-bf0d-c6639afcfe10 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.262729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a62299c8-3cdf-4cad-a9cc-9dda4ee651d8 req-3ef8bc82-49c2-4234-bf0d-c6639afcfe10 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.263872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a62299c8-3cdf-4cad-a9cc-9dda4ee651d8 req-3ef8bc82-49c2-4234-bf0d-c6639afcfe10 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.283306 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a62299c8-3cdf-4cad-a9cc-9dda4ee651d8 req-3ef8bc82-49c2-4234-bf0d-c6639afcfe10 service nova] Creating event network-vif-plugged:5e759d20-d216-432c-b3e1-26ccb1c718df for instance 8fdd09fc-040e-4612-92f3-b0902284af55 on n-h2-master-1 Oct 02 01:15:15.288127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:15.290893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a62299c8-3cdf-4cad-a9cc-9dda4ee651d8 req-3ef8bc82-49c2-4234-bf0d-c6639afcfe10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055640 Oct 02 01:15:15.292053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1705/3256] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:15.297024 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-074dcc61-e4d1-4899-9aed-baa3a8d93447 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1521 microversion: 2.1 time: 0.475875 Oct 02 01:15:15.303154 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1552/3257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:14 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:15.304209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:15.305090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:15.308216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:15.310240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:15.313854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.314541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.333159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.333879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.334771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.335355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.335494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.336009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.346312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.347283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.347833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.348389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.467943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-935ef3aa-200b-4e14-9f44-d38a9ede2284 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 14 microversion: 2.1 time: 0.163469 Oct 02 01:15:15.473009 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1553/3258] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:15 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:15:15.479428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7fde3f13-72f2-44c7-a241-e5398427cc31 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '.version_select at 0x7fb880a0eb80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:16.166795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:16.175480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8b8d9a4-fed3-4edf-a8e4-248e4f00fda2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.882015 Oct 02 01:15:16.176771 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1706/3259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:15 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:16.182668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:16.183489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:16.190424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:16.191220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:16.192617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:16.193741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:16.194443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:16.195119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:16.225797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:16.243471 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:16.347417 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d21cea1e-8c7f-4bbb-bb16-7845e2305443 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 204 len: 0 microversion: 2.1 time: 0.157951 Oct 02 01:15:16.347417 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1707/3260] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:16 2022] DELETE /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:16.347417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:16.347417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:16.351761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:16.352255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:16.352690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:16.353581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:16.354192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:16.354804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:16.938010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:16.948633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:16.950984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:16.954651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa1fc13e-c44d-4e63-a92b-773434327abc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.615984 Oct 02 01:15:16.975869 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1708/3261] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:16 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:16.991304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-dc846cc6-13b3-46ba-8166-668c691a05f8 req-71a2be40-ff0a-4394-8114-42f8a2891808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0", "tag": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:17.019233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dc846cc6-13b3-46ba-8166-668c691a05f8 req-71a2be40-ff0a-4394-8114-42f8a2891808 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.020149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dc846cc6-13b3-46ba-8166-668c691a05f8 req-71a2be40-ff0a-4394-8114-42f8a2891808 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.021154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dc846cc6-13b3-46ba-8166-668c691a05f8 req-71a2be40-ff0a-4394-8114-42f8a2891808 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.046439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dc846cc6-13b3-46ba-8166-668c691a05f8 req-71a2be40-ff0a-4394-8114-42f8a2891808 service nova] Creating event network-changed:5e6a0047-75ea-4c38-9f37-d1ecfe28fecf for instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 on n-h1-master-1 Oct 02 01:15:17.057902 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-dc846cc6-13b3-46ba-8166-668c691a05f8 req-71a2be40-ff0a-4394-8114-42f8a2891808 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078332 Oct 02 01:15:17.079529 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1709/3262] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:17.094826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-60ea6024-1876-46b1-8bca-4adc35a5b4f9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88550f670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:17.185603 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-60ea6024-1876-46b1-8bca-4adc35a5b4f9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1439 microversion: 2.1 time: 0.102585 Oct 02 01:15:17.186690 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1710/3263] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:17 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:17.195708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:17.198137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:17.211594 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.212474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.212915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.213826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.222010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.222931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.522454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:17.542162 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-202e640f-f73d-47bf-bac1-e6de0e4445ff tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.353426 Oct 02 01:15:17.544632 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1711/3264] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:17 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:17.555408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:17.556151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:17.562885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.563674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.564654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.565730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.566220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.566748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.752585 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7fde3f13-72f2-44c7-a241-e5398427cc31 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/af14d44d-3b28-4a29-8ce1-9545da68f114" status: 202 len: 0 microversion: 2.1 time: 2.277646 Oct 02 01:15:17.753177 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1554/3265] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:15:15 2022] DELETE /compute/v2.1/os-floating-ips/af14d44d-3b28-4a29-8ce1-9545da68f114 => generated 0 bytes in 2280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:17.762643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:17.765065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:17.773152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.774011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.774727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.775662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.776369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.777021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.804592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:17.813297 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8d069d2-ad3c-4d57-8eda-a18e4e6eeb22 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1527 microversion: 2.1 time: 0.262969 Oct 02 01:15:17.814185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1712/3266] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:17 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:17.819555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:17.820453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:17.826539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.827341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.828003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.829065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.829767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.830423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.982277 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6dbf38da-5e69-4f6a-9198-59b30d972dac tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 14 microversion: 2.1 time: 0.218626 Oct 02 01:15:17.982434 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1555/3267] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:17 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 14 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:15:18.000695 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2daa435f-8e16-4906-87f5-b374dedab39b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'action', calling method: .version_select at 0x7fb8836493a0>, body: {"addFloatingIp": {"address": ""}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2daa435f-8e16-4906-87f5-b374dedab39b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Request method failure captured: Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action HTTP/1.1 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 34 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXq-hflhKtzfumDKwgmRUQ0ODRLhGjKA2ejcP96cadWPGOAlDsIrN7xictm-kFQX3rihOT-2sghRK4SxpmykAppTgLz9Pqn9NHdzDNG250V5PkfKD_jxamN5qAWWdMVrCW75QF0F5-buJ7WZqCxj5g2ii1kz82k_tHFGzqOS83mJT4 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f2bd52c8d347679396891f8f163197"}]}] Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 1e5ba26f19334afa95c2df9b1655626e Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: {"addFloatingIp": {"address": ""}} Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0', 'body': {'addFloatingIp': {'address': ''}}} Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '' Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:15:18.009067 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.015519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2daa435f-8e16-4906-87f5-b374dedab39b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:18.017327 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2daa435f-8e16-4906-87f5-b374dedab39b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action" status: 400 len: 142 microversion: 2.1 time: 0.030244 Oct 02 01:15:18.018831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:18.027854 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1556/3268] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:17 2022] POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action => generated 142 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:15:18.029708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83ec5139-872c-48c1-81ac-c1332b702a4c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.213468 Oct 02 01:15:18.039541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.040643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:18.047183 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1713/3269] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:17 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:18.050393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.052311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.053009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.053915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.055824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.057081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.060852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:18.063906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:18.094554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.095317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.096443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.097184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.097657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.098104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.137080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:15:18.137487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquired lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:15:18.266528 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:18.311800 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:18.337876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Releasing lock "refresh_cache-bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" {{(pid=122355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:15:18.338443 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] HTTP exception thrown: floating IP not found Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Request method failure captured: Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action HTTP/1.1 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 41 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXq-hflhKtzfumDKwgmRUQ0ODRLhGjKA2ejcP96cadWPGOAlDsIrN7xictm-kFQX3rihOT-2sghRK4SxpmykAppTgLz9Pqn9NHdzDNG250V5PkfKD_jxamN5qAWWdMVrCW75QF0F5-buJ7WZqCxj5g2ii1kz82k_tHFGzqOS83mJT4 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f2bd52c8d347679396891f8f163197"}]}] Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 1e5ba26f19334afa95c2df9b1655626e Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: exception: floating IP not found Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 02 01:15:18.340259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Returning 404 to user: floating IP not found {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5a23f39-c731-40c6-a7cf-2695579eee8b tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action" status: 404 len: 67 microversion: 2.1 time: 0.293391 Oct 02 01:15:18.344982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1714/3270] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:18 2022] POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action => generated 67 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:18.348104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ce2412e0-f8b4-4b3e-9a8f-d586617e2030 req-4dad3176-fa31-42c1-bb95-9c20ebce62e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdd09fc-040e-4612-92f3-b0902284af55", "name": "network-vif-unplugged", "status": "completed", "tag": "5e759d20-d216-432c-b3e1-26ccb1c718df"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:18.363326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce2412e0-f8b4-4b3e-9a8f-d586617e2030 req-4dad3176-fa31-42c1-bb95-9c20ebce62e5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.363907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce2412e0-f8b4-4b3e-9a8f-d586617e2030 req-4dad3176-fa31-42c1-bb95-9c20ebce62e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.364674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce2412e0-f8b4-4b3e-9a8f-d586617e2030 req-4dad3176-fa31-42c1-bb95-9c20ebce62e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.376891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ce2412e0-f8b4-4b3e-9a8f-d586617e2030 req-4dad3176-fa31-42c1-bb95-9c20ebce62e5 service nova] Creating event network-vif-unplugged:5e759d20-d216-432c-b3e1-26ccb1c718df for instance 8fdd09fc-040e-4612-92f3-b0902284af55 on n-h2-master-1 Oct 02 01:15:18.383451 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ce2412e0-f8b4-4b3e-9a8f-d586617e2030 req-4dad3176-fa31-42c1-bb95-9c20ebce62e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039950 Oct 02 01:15:18.384313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1715/3271] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:18.389573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1b8a337-37ad-4e50-b02c-d3ca525dce51 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881051790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.406467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:18.417881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:18.419268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:18.420709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be6ff831-953b-4c3a-8e31-9429c88eaf50 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.391464 Oct 02 01:15:18.421263 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1557/3272] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:18 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:18.426620 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0628c562-5de6-468b-a2aa-47fdff0f32ae tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:18.445319 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1b8a337-37ad-4e50-b02c-d3ca525dce51 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1448 microversion: 2.1 time: 0.059592 Oct 02 01:15:18.445919 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1716/3273] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:18 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1448 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:18.461469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-870c3299-d6da-4022-9483-7e2609d1b72d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88157c280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.514073 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-870c3299-d6da-4022-9483-7e2609d1b72d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 200 len: 1448 microversion: 2.1 time: 0.057382 Oct 02 01:15:18.515076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1717/3274] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:18 2022] GET /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 1448 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:15:18.530710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0b1fb9cb-829f-4981-bc43-24ca50d68343 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88167b4c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.539759 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0628c562-5de6-468b-a2aa-47fdff0f32ae tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0628c562-5de6-468b-a2aa-47fdff0f32ae tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Request method failure captured: Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action HTTP/1.1 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 44 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXq-hflhKtzfumDKwgmRUQ0ODRLhGjKA2ejcP96cadWPGOAlDsIrN7xictm-kFQX3rihOT-2sghRK4SxpmykAppTgLz9Pqn9NHdzDNG250V5PkfKD_jxamN5qAWWdMVrCW75QF0F5-buJ7WZqCxj5g2ii1kz82k_tHFGzqOS83mJT4 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f2bd52c8d347679396891f8f163197"}]}] Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 1e5ba26f19334afa95c2df9b1655626e Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: exception: Floating IP not found for address 0.0.0.0. Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 02 01:15:18.541365 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0628c562-5de6-468b-a2aa-47fdff0f32ae tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0628c562-5de6-468b-a2aa-47fdff0f32ae tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action" status: 404 len: 88 microversion: 2.1 time: 0.120188 Oct 02 01:15:18.547538 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1558/3275] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:18 2022] POST /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0/action => generated 88 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:18.555466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.555982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:18.574929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.575447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.577891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.578838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.579419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.580060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.627832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:18.762005 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54503967-e821-4460-a5b5-c00f89aa8a18 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 204 len: 0 microversion: 2.1 time: 0.212157 Oct 02 01:15:18.763904 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1559/3276] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:18 2022] DELETE /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:18.783119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.784021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:18.791476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.791965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.792665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.793797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.794816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.795466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.113087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:19.121213 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb122548-3e82-4fd5-8c3e-26a8e16a4685 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.353755 Oct 02 01:15:19.135117 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1560/3277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:18 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:19.142847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:19.143835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:19.152052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.152902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.153573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.154503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.155334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.156260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.189644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0b1fb9cb-829f-4981-bc43-24ca50d68343 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 204 len: 0 microversion: 2.1 time: 0.663622 Oct 02 01:15:19.190396 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1718/3278] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:18 2022] DELETE /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:19.196839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:19.197584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:19.204270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.204762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.205200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.206074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.207471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.207794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.493231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:19.508253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:19.513054 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3fe71652-7c64-4e8f-a600-13afb307f501 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1541 microversion: 2.1 time: 0.376599 Oct 02 01:15:19.518332 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1561/3279] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:19 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1541 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:19.540446 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-240aba60-6671-4cf7-b8b1-bdf601a2e88c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1527 microversion: 2.1 time: 0.348653 Oct 02 01:15:19.557305 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1719/3280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:19 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1527 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:19.566059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:19.568880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:19.584412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.585266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.585961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.587394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.588089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.588892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.744964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:19.748656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:19.761510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.774738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.777351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.779197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.779995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.787418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.902568 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e76c04ae-46e4-42f5-90dc-a6790659e51e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 14 microversion: 2.1 time: 0.382103 Oct 02 01:15:19.904030 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1562/3281] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:19 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 14 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:15:19.913993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7e63d49c-e894-419d-8396-642b83486a1b req-9b0d415b-3398-4636-8775-8c5c7dfd4b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f", "tag": "69297fdd-319c-4a70-9879-5ed633c66c9f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:19.944055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7e63d49c-e894-419d-8396-642b83486a1b req-9b0d415b-3398-4636-8775-8c5c7dfd4b5e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.945133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7e63d49c-e894-419d-8396-642b83486a1b req-9b0d415b-3398-4636-8775-8c5c7dfd4b5e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.945888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7e63d49c-e894-419d-8396-642b83486a1b req-9b0d415b-3398-4636-8775-8c5c7dfd4b5e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.966549 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7e63d49c-e894-419d-8396-642b83486a1b req-9b0d415b-3398-4636-8775-8c5c7dfd4b5e service nova] Creating event network-changed:69297fdd-319c-4a70-9879-5ed633c66c9f for instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f on n-h1-master-1 Oct 02 01:15:19.975678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7e63d49c-e894-419d-8396-642b83486a1b req-9b0d415b-3398-4636-8775-8c5c7dfd4b5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069150 Oct 02 01:15:19.977248 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1563/3282] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:19.987981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:19.988931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:19.997786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.001355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.001968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.002950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.003909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.005535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.034649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:20.047706 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5df260c3-9398-4ddf-9e4e-9f1e3b1b18a5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.488876 Oct 02 01:15:20.051158 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1720/3283] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:19 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:20.069464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:20.070803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:20.078671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:20.089281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.091366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.095142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.097250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.097827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.099053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.283436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18773d4a-2d78-47bd-ad43-289e0a7534a1 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 204 len: 0 microversion: 2.1 time: 0.304068 Oct 02 01:15:20.289758 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1564/3284] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:19 2022] DELETE /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:20.302452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:20.303358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:20.327057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.328018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.329887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.330744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.333668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.334384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.432678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:20.442515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:20.444196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:20.445381 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62f06892-118c-4dc3-aae5-860c1d0c4b29 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.391145 Oct 02 01:15:20.445957 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1721/3285] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:20 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:20.485058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1735283331", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "52e9d38c-d322-45f0-aba7-d15109b53e80"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:20.605660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] validate_networks() for [('52e9d38c-d322-45f0-aba7-d15109b53e80', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:20.767711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:20.773132 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:20.780587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a83fe024-3238-4c07-8771-ba0deb82f64d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.489488 Oct 02 01:15:20.781654 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1565/3286] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:20 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:20.787787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:20.788794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:20.796353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.796983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.797543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.798715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:20.799282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:20.799952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.033130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:21.045447 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a281e40-76ab-43a1-9ca8-3a81a9bd62e0 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1541 microversion: 2.1 time: 0.262321 Oct 02 01:15:21.048260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1566/3287] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:20 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1541 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:21.053835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:21.054767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:21.069000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.070544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.071464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.073201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.075349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.076670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.134877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.137039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.138219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.139090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lazy-loading 'fault' on Instance uuid 8fdd09fc-040e-4612-92f3-b0902284af55 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:21.228758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:21.237185 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-15cc33d8-f83c-4860-abef-fdf31a691123 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 200 len: 1315 microversion: 2.1 time: 0.187638 Oct 02 01:15:21.237768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1567/3288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:21 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:21.256047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-124573065", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "4affba85-5ce8-4ca0-a21f-763542981674"}, {"uuid": "9f085079-61e5-4645-af88-c3de1d9806aa"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:21.261348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:21.261994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:21.262630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:21.263384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:21.264054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:21.276099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.276771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.278466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.279881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.280536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.281194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.306389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:21.312474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Getting quotas for user 8cd2ad37e9b844ac8b7632fd9291023a and project 9231cac91fd14f51a4efc95c84202419. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:21.327597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] validate_networks() for [('4affba85-5ce8-4ca0-a21f-763542981674', None, None, None, None, None), ('9f085079-61e5-4645-af88-c3de1d9806aa', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:21.329198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:21.331742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:21.394924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-652c9cc3-5561-44c8-ae9a-3c610cfe8017 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913502 Oct 02 01:15:21.396301 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1722/3289] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:15:21.401317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:21.404082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:21.413777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.414513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.415092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.415999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.420755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.421440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.090440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:22.090989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:22.091375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:22.092235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:22.092649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:22.102725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.103463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.104081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.104973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.105586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.106314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.108480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7972d428-6899-4cb6-bdff-73424d93219d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action" status: 200 len: 8200 microversion: 2.1 time: 0.708740 Oct 02 01:15:22.110161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1723/3290] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:21 2022] POST /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb/action => generated 8200 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:22.122522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:22.124834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:22.139592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Getting quotas for project bf661665ac114503b71ac751f84bfdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:22.140795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.150871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Getting quotas for user 852e8ab225d64f40a4dc9ce54fe509fd and project bf661665ac114503b71ac751f84bfdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:22.156875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.157652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.158922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.159564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.160143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.180891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:22.183329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:22.236834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-376970ea-a7ca-41be-9879-c821513d27f1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997726 Oct 02 01:15:22.237682 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1568/3291] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:15:22.244598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:22.245327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:22.255195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.256443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.256915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.257635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.258093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.258858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.351109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:22.359227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36e7c22e-051d-4bc4-ab76-02eb572f2d83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1212 microversion: 2.1 time: 0.120353 Oct 02 01:15:22.365519 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1569/3292] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:22 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:22.380383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:22.383249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:22.394944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.395934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.396284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.398029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.398522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.402021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.459767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:22.472852 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e96d3d7e-5b28-417b-9a24-9801473792ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.361340 Oct 02 01:15:22.474018 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1724/3293] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:22 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:22.489954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:22.490609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:22.510727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.511668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.512752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.513743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.514373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.514986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:23.871291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:23.884968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:23.886623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:23.895721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e34e2927-5c17-46f4-91a6-7cf09107084a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 1.528089 Oct 02 01:15:23.910680 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1570/3294] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:22 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:23.910680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3a78f078-acd4-4003-bfcc-e9c30015365a req-c1ab62d9-9567-4387-ba86-e71f2d6223a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdd09fc-040e-4612-92f3-b0902284af55", "name": "network-vif-deleted", "tag": "5e759d20-d216-432c-b3e1-26ccb1c718df"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:23.930565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3a78f078-acd4-4003-bfcc-e9c30015365a req-c1ab62d9-9567-4387-ba86-e71f2d6223a2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:23.931474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3a78f078-acd4-4003-bfcc-e9c30015365a req-c1ab62d9-9567-4387-ba86-e71f2d6223a2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:23.932240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3a78f078-acd4-4003-bfcc-e9c30015365a req-c1ab62d9-9567-4387-ba86-e71f2d6223a2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:23.950249 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3a78f078-acd4-4003-bfcc-e9c30015365a req-c1ab62d9-9567-4387-ba86-e71f2d6223a2 service nova] Creating event network-vif-deleted:5e759d20-d216-432c-b3e1-26ccb1c718df for instance 8fdd09fc-040e-4612-92f3-b0902284af55 on n-h2-master-1 Oct 02 01:15:23.955868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3a78f078-acd4-4003-bfcc-e9c30015365a req-c1ab62d9-9567-4387-ba86-e71f2d6223a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057427 Oct 02 01:15:23.957079 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1571/3295] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:23.977057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:23.978048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:23.995077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:23.996318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:23.998438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.001071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.004187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.005826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.098013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:24.101284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.102230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.103077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.103781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lazy-loading 'fault' on Instance uuid bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:24.112670 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0596f1c8-7141-479d-bbb7-db4e80109ae0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 1.637326 Oct 02 01:15:24.113285 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1725/3296] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:22 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:24.148629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:24.149379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:24.176918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.178710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.179171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.181752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.184620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.185429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.341463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5ba26f19334afa95c2df9b1655626e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f2bd52c8d347679396891f8f163197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:24.359597 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cef314be-df21-4244-85cd-b61cd9420cb5 tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 200 len: 1322 microversion: 2.1 time: 0.400337 Oct 02 01:15:24.360274 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1572/3297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:23 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:24.383349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:24.385266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:24.400843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.418242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.420555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.430556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.431102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.431564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.545759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:24.561677 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-19a93d96-0c31-48e9-be4b-14ca2b79aec9 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1264 microversion: 2.1 time: 0.199945 Oct 02 01:15:24.564359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1573/3298] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:24.573570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:24.576716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:24.591415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.591611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:24.592501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.593078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.594356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.595664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.597240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.603863 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a081a864-3375-4fe3-9098-95384788fb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.482863 Oct 02 01:15:24.604476 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1726/3299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:24.624978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0f394fe3-ffde-4674-8161-e979aebd1461 req-0709776b-9533-44fe-b849-498dd4c89931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c277426b-e31d-455e-a9ed-17a3b7a7746c", "name": "network-vif-unplugged", "status": "completed", "tag": "f0040594-ca37-4c7d-ae42-44a3581c717f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:24.640434 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 HTTP/1.1 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '8fdd09fc-040e-4612-92f3-b0902284af55'} Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:24.642938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:24.651441 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:24.654089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:24.655199 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7817819-b5df-4edb-84b1-a0f6ea3f6bc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 404 len: 111 microversion: 2.1 time: 0.088549 Oct 02 01:15:24.657135 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1574/3300] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:24.664743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:24.665629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:24.666466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0f394fe3-ffde-4674-8161-e979aebd1461 req-0709776b-9533-44fe-b849-498dd4c89931 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.667439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0f394fe3-ffde-4674-8161-e979aebd1461 req-0709776b-9533-44fe-b849-498dd4c89931 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.667439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0f394fe3-ffde-4674-8161-e979aebd1461 req-0709776b-9533-44fe-b849-498dd4c89931 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.679948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.680753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.681369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.683962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.686290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.686972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.737100 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0f394fe3-ffde-4674-8161-e979aebd1461 req-0709776b-9533-44fe-b849-498dd4c89931 service nova] Creating event network-vif-unplugged:f0040594-ca37-4c7d-ae42-44a3581c717f for instance c277426b-e31d-455e-a9ed-17a3b7a7746c on n-h2-master-1 Oct 02 01:15:24.758257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0f394fe3-ffde-4674-8161-e979aebd1461 req-0709776b-9533-44fe-b849-498dd4c89931 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150294 Oct 02 01:15:24.765331 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1727/3301] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:24.785278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:24.790871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:24.814911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.821072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.825901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.827107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.827980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.830784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.841682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:24.860396 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54579feb-e0f1-4e4b-a76f-7956a400ad8a tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1266 microversion: 2.1 time: 0.201753 Oct 02 01:15:24.865940 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1575/3302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:24.871036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-70205ffb-c796-467f-8ee9-866255b90143 req-d410ec7b-7f47-437e-b14a-186aaad37977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0", "name": "network-vif-deleted", "tag": "5e6a0047-75ea-4c38-9f37-d1ecfe28fecf"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:24.916835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-70205ffb-c796-467f-8ee9-866255b90143 req-d410ec7b-7f47-437e-b14a-186aaad37977 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.923263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-70205ffb-c796-467f-8ee9-866255b90143 req-d410ec7b-7f47-437e-b14a-186aaad37977 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.923986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-70205ffb-c796-467f-8ee9-866255b90143 req-d410ec7b-7f47-437e-b14a-186aaad37977 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.974646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-70205ffb-c796-467f-8ee9-866255b90143 req-d410ec7b-7f47-437e-b14a-186aaad37977 service nova] Creating event network-vif-deleted:5e6a0047-75ea-4c38-9f37-d1ecfe28fecf for instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 on n-h1-master-1 Oct 02 01:15:24.984208 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-70205ffb-c796-467f-8ee9-866255b90143 req-d410ec7b-7f47-437e-b14a-186aaad37977 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116632 Oct 02 01:15:24.987622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1576/3303] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:24.998494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:25.010824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:25.025472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:25.026280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:25.027009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:25.027983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:25.033827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:25.034343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:25.536743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:25.551190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eae0b365-c316-48f7-a2e3-c4a01d28ee0c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.561713 Oct 02 01:15:25.555942 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1577/3304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:25.571396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-27779455", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:25.621141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:25.637186 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-417a897e-eb0e-4dbd-9bd4-f696fbc28d71 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1511 microversion: 2.1 time: 0.866987 Oct 02 01:15:25.642083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1728/3305] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1511 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:25.666946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:25.671571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:25.679756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] validate_networks() for [('867d699a-34bd-4b9c-a0d1-2f2c4b297862', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:25.683772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:25.684476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:25.685118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:25.686063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:25.686721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:25.687316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.132895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:26.160346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:26.164484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:26.167267 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ef8b3220-000e-4772-afa8-852a39d68c4f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.522819 Oct 02 01:15:26.172509 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1729/3306] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:25 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:26.182377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:26.183727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:26.194342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.195251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.196070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.197229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.197969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.198718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.236901 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:26.487639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:26.497401 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d08e7ee6-9942-4562-a2b7-c3850dbc2af9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.323510 Oct 02 01:15:26.513805 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1730/3307] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:26 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:26.519045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:26.519737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] [instance: bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:26.526586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.527599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.528261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.529054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.529597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.530093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.531207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:26.531698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:26.532204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:26.532967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:26.533803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:26.546370 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] HTTP exception thrown: Instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 could not be found. Oct 02 01:15:26.547207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.547697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.548138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Request method failure captured: Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 HTTP/1.1 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXq-hflhKtzfumDKwgmRUQ0ODRLhGjKA2ejcP96cadWPGOAlDsIrN7xictm-kFQX3rihOT-2sghRK4SxpmykAppTgLz9Pqn9NHdzDNG250V5PkfKD_jxamN5qAWWdMVrCW75QF0F5-buJ7WZqCxj5g2ii1kz82k_tHFGzqOS83mJT4 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3f2bd52c8d347679396891f8f163197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3f2bd52c8d347679396891f8f163197"}]}] Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e3f2bd52c8d347679396891f8f163197 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775 Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 1e5ba26f19334afa95c2df9b1655626e Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: exception: Instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 could not be found. Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0'} Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 could not be found. Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 could not be found. Oct 02 01:15:26.548316 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 could not be found. Oct 02 01:15:26.553228 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:26.553863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.553863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.553863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.555497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] Returning 404 to user: Instance bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:26.557073 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d4559fd1-6218-4c04-a3e1-43bd7245c2de tempest-FloatingIPsAssociationNegativeTestJSON-936904775 tempest-FloatingIPsAssociationNegativeTestJSON-936904775-project] 10.222.0.23 "GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0" status: 404 len: 111 microversion: 2.1 time: 0.041866 Oct 02 01:15:26.558352 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1731/3308] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:26 2022] GET /compute/v2.1/servers/bac0cb8e-c1d6-4947-b8b1-44fd7c7231b0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:26.564330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:26.565342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:26.572443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:26.575399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.576114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.576896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.577764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.578013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Getting quotas for user eb1045d1468b4a2f814930f5ace5c2ef and project 4ac1963b4bf54123b0483de45b6617ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:26.578859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.579599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.592396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:26.594753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:26.699703 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e871ba0-5071-405d-ab94-b933794cdb7c tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.140246 Oct 02 01:15:26.701736 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1578/3309] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:15:26.727888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:26.728548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:26.745986 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:26.748634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.749177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.749623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.751087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.751087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.751336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.941795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:26.956469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b0a0f4f2-c7f9-47ee-acc8-097f15d20e96 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1270 microversion: 2.1 time: 0.246532 Oct 02 01:15:26.960590 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1579/3310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:26 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:26.981420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:26.984105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:26.997944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:26.999440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.999937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.000375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.001080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.006456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.006929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.013250 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a18cb54-b47f-476a-b38b-b560d4c1f431 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.449028 Oct 02 01:15:27.014862 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1732/3311] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:26 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:27.032023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c52612d2-28ce-4b59-87ee-ab445324bace req-8b71670a-7b64-488a-aa07-7cc7dacee74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c277426b-e31d-455e-a9ed-17a3b7a7746c", "name": "network-vif-deleted", "tag": "f0040594-ca37-4c7d-ae42-44a3581c717f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:27.054274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c52612d2-28ce-4b59-87ee-ab445324bace req-8b71670a-7b64-488a-aa07-7cc7dacee74f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.054770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c52612d2-28ce-4b59-87ee-ab445324bace req-8b71670a-7b64-488a-aa07-7cc7dacee74f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.055211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c52612d2-28ce-4b59-87ee-ab445324bace req-8b71670a-7b64-488a-aa07-7cc7dacee74f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.086864 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c52612d2-28ce-4b59-87ee-ab445324bace req-8b71670a-7b64-488a-aa07-7cc7dacee74f service nova] Creating event network-vif-deleted:f0040594-ca37-4c7d-ae42-44a3581c717f for instance c277426b-e31d-455e-a9ed-17a3b7a7746c on n-h2-master-1 Oct 02 01:15:27.100175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c52612d2-28ce-4b59-87ee-ab445324bace req-8b71670a-7b64-488a-aa07-7cc7dacee74f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079872 Oct 02 01:15:27.101497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1733/3312] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:27.107301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:27.108450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:27.123683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.124505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.125207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.126153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.126884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.128072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.525260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:27.550273 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-887e372c-9cf0-4371-a18d-85fcaaff614e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.585799 Oct 02 01:15:27.553216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1580/3313] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:26 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:27.565438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:27.566387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:27.589631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.591971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.593192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.598883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.600291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:27.600829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.601670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.612189 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8873fe75-4447-4940-9543-31fade02b638 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1517 microversion: 2.1 time: 0.509192 Oct 02 01:15:27.619825 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1734/3314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:27 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:27.624843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:27.628296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:27.650733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.651650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.652341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.653284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.654250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.655108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.765720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:27.781507 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d4d6e946-615a-44bd-ba73-e74d69c4cc19 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1227 microversion: 2.1 time: 0.225977 Oct 02 01:15:27.791931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1581/3315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:27 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1227 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:27.797916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:27.798763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:27.812317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.813214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.813805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.814775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.815403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.815989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.032224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:28.043776 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-29ff7a90-b33b-4336-b525-233715609226 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.422618 Oct 02 01:15:28.044677 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1735/3316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:27 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:28.049402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:28.050286 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:28.056979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.057709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.058376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.059336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.060010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.060669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.357530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:28.366350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:28.376498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:28.392464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:28.394486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-72d63d0d-2fcc-4c94-a436-cddea4d33486 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.601311 Oct 02 01:15:28.398688 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1582/3317] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:27 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:28.404165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4637bcde-12f0-4e10-a122-fcf9994faa39 req-8f518b0a-f8c2-4e1d-bde2-6f6dc49d6358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff262c3-fb6b-4ac2-800a-50d89d5ccb69", "tag": "54762fa0-eec8-4c49-847c-9db64395b0d4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:28.414379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64d125a3-9eda-4db7-891f-61ad681dc718 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.368400 Oct 02 01:15:28.415875 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1736/3318] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:28 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:28.421310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:28.422192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:28.428310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4637bcde-12f0-4e10-a122-fcf9994faa39 req-8f518b0a-f8c2-4e1d-bde2-6f6dc49d6358 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.429787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4637bcde-12f0-4e10-a122-fcf9994faa39 req-8f518b0a-f8c2-4e1d-bde2-6f6dc49d6358 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.430246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4637bcde-12f0-4e10-a122-fcf9994faa39 req-8f518b0a-f8c2-4e1d-bde2-6f6dc49d6358 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.434806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.435719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.436383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.437369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.438277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.439380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.450392 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4637bcde-12f0-4e10-a122-fcf9994faa39 req-8f518b0a-f8c2-4e1d-bde2-6f6dc49d6358 service nova] Creating event network-changed:54762fa0-eec8-4c49-847c-9db64395b0d4 for instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 on n-h1-master-1 Oct 02 01:15:28.456944 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4637bcde-12f0-4e10-a122-fcf9994faa39 req-8f518b0a-f8c2-4e1d-bde2-6f6dc49d6358 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056718 Oct 02 01:15:28.458485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1583/3319] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:28.465190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:28.466076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:28.474467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.475457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.476113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.477045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.477781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.478441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.543655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Locking {{(pid=122354) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 02 01:15:28.552695 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:28.612880 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7531b49-2207-4c76-b7db-d0bfcdec9d34 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.151788 Oct 02 01:15:28.617733 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1584/3320] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:28 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:28.622190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:28.623154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:28.633983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.634623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.635178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.636068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.636531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.636961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.964850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:28.986539 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-72a09272-a1bd-4482-8d88-7fe39557dafc tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.368977 Oct 02 01:15:28.989928 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1585/3321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:28 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:29.019854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:29.025360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:29.046391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.047939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.048432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.049640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.050845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.051303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.078056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:29.091858 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d09db6c-fbe5-4d22-a2b9-ccc75229a18d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1312 microversion: 2.1 time: 0.674563 Oct 02 01:15:29.095818 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1737/3322] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:28 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1312 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:29.108523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:29.118938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:29.132187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.134425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.135186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.136062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.136814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.137253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.373254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:29.384964 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7cae7b0c-ed01-46bb-a2bd-1543a10badf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.393611 Oct 02 01:15:29.386588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1586/3323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:28 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:29.394139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:29.400409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:29.413544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.414050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.414511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.418819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.420218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.422936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.640937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:29.649620 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ef109790-81fc-45bf-953e-59beceb12ddb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1517 microversion: 2.1 time: 0.549483 Oct 02 01:15:29.650229 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1738/3324] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:29 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:29.653604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:29.663875 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffbf23be-8c4a-4b09-82d7-ba42af4879b0 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1281 microversion: 2.1 time: 0.276695 Oct 02 01:15:29.669662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-eae7314d-2996-4980-a7e0-d15da569ce8e req-36474141-c512-4216-9496-5bb6e7051977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "47217643-f743-4e05-9b81-726cd2a59e92"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:29.674955 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1587/3325] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:29 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1281 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:29.686705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:29.699340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-eae7314d-2996-4980-a7e0-d15da569ce8e req-36474141-c512-4216-9496-5bb6e7051977 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.700127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-eae7314d-2996-4980-a7e0-d15da569ce8e req-36474141-c512-4216-9496-5bb6e7051977 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.700780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-eae7314d-2996-4980-a7e0-d15da569ce8e req-36474141-c512-4216-9496-5bb6e7051977 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.710308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.710944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.712675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.720049 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-eae7314d-2996-4980-a7e0-d15da569ce8e req-36474141-c512-4216-9496-5bb6e7051977 service nova] Creating event network-vif-plugged:47217643-f743-4e05-9b81-726cd2a59e92 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:29.727447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-eae7314d-2996-4980-a7e0-d15da569ce8e req-36474141-c512-4216-9496-5bb6e7051977 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061286 Oct 02 01:15:29.728960 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1739/3326] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:29.734385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:29.735420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:29.743294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.744106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.744784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.745709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.746398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.747079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.760879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] HTTP exception thrown: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 is locked Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Request method failure captured: Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action HTTP/1.1 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 15 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOT6gW7rlIk-9rX_5-b5ogCPdC94Eyl0z_CXfm7qjUJgyqXdBk9mBUdttaS2TdoFE_maRTEu5RRM8w8xTEQHiUzzNyvele3PYsNuSEFaOQ3TMcDW01hxRS9txDCZGCvJELjw4ZjwbGv5I0UZHc3bk6PZIu6-rfQ2OPZwH17Q5bkhC1U Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c94ca45e7684b3c818871e232e08342"}]}] Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66a9d6a142d444be90b2101f23603522 Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: {"os-stop": {}} Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: exception: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 is locked Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'dd51543d-0b1d-4fad-b37e-d19599b55292', 'body': {'os-stop': {}}} Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 is locked Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 is locked Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 is locked Oct 02 01:15:29.762884 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:29.768162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Returning 409 to user: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 is locked {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:29.768162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-51ece21b-7c46-4fdf-be09-dba019e87f07 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 409 len: 107 microversion: 2.1 time: 0.088311 Oct 02 01:15:29.768162 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1588/3327] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:29 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 107 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:29.771633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:29.773047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:29.780603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.781103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.781543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.782256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.783717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.784166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.424413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:30.438244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ade58109-63df-4fc4-8481-4c04ed55e143 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.672156 Oct 02 01:15:30.443233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:30.456076 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1589/3328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:29 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:30.461376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:30.463368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:30.465562 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88d8693f-4628-4e55-bc81-507d6011a99a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.735254 Oct 02 01:15:30.466735 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1740/3329] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:29 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:30.469679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:30.471598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:30.473302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:30.474763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:30.483002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.484035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.484898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.485935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.486735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.487439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.492610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.494204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.494979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.498109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.500889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.501625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.598860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Unlocking {{(pid=122354) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 02 01:15:30.704474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd880878-f7bb-4403-a96d-e662fdbc0954 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.234015 Oct 02 01:15:30.710916 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1590/3330] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:30 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:30.720984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:30.721615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:30.735150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.735650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.736086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.737108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.737248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.737661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.815641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:30.834292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbb4ff73-3cae-42b1-8097-4a20e56b3a8f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.364067 Oct 02 01:15:30.854548 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1741/3331] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:30 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:30.860257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:30.861432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:30.870138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.870924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.871522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.872398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.873048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.874777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.137490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:31.147397 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-279a5231-0950-49fd-ab5d-ff791f2046b1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.430044 Oct 02 01:15:31.148664 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1591/3332] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:30 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:31.153649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:31.154679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:31.164778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.166018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.166479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.167239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.167712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.168444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.294895 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:31.322156 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:31.374223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:31.384994 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c666097e-9c53-4aa1-b2a2-5e77e4a49279 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1517 microversion: 2.1 time: 0.528756 Oct 02 01:15:31.386267 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1742/3333] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:30 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1517 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:31.402056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2007d241-20f5-41a6-b830-9a8d22176177 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:31.411438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:31.413765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2007d241-20f5-41a6-b830-9a8d22176177 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.416523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2007d241-20f5-41a6-b830-9a8d22176177 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.417081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2007d241-20f5-41a6-b830-9a8d22176177 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.424145 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c59e4de5-d43e-4d24-ad82-19437e9c3aea tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1323 microversion: 2.1 time: 0.274216 Oct 02 01:15:31.428055 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1592/3334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:31 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:31.462569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2007d241-20f5-41a6-b830-9a8d22176177 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Going to try to stop instance {{(pid=122355) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:15:31.465738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:31.466729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:31.485021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.486037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.488744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.491083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.492595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.493763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.553017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2007d241-20f5-41a6-b830-9a8d22176177 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.164578 Oct 02 01:15:31.554355 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1743/3335] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:31 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:31.575132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:31.575873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:31.586509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.586509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.586509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.588707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.589834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.590458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.898215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:31.909559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54d36a87-1eb5-46ce-8d96-9dc39f8def6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.448510 Oct 02 01:15:31.923659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1593/3336] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:31 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:31.931627 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:31.932299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:31.938729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.939300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.939852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.940661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.941232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.941772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.990569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.011284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.013409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.014955 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7983176-9338-47aa-b19c-dc5e437e2721 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.451120 Oct 02 01:15:32.016111 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1744/3337] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:31 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:32.021598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "905b6b15-1615-469e-b334-8a1fb6e075a5"}, {"server_uuid": "8ad765cc-a5f7-4748-922a-b6a7086787cc", "name": "network-vif-plugged", "status": "completed", "tag": "77ad6923-4e68-4c74-b282-d1b5390b5f23"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:32.034131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.035309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.036228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.054187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] Creating event network-vif-plugged:905b6b15-1615-469e-b334-8a1fb6e075a5 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:32.054844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] Creating event network-vif-plugged:77ad6923-4e68-4c74-b282-d1b5390b5f23 for instance 8ad765cc-a5f7-4748-922a-b6a7086787cc on n-h2-master-1 Oct 02 01:15:32.063634 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-22b75c45-27a6-4352-8983-cf1ed5369370 req-97b99357-4b0d-48cd-ac2d-52fe8055c0a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046041 Oct 02 01:15:32.064694 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1745/3338] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:32.070455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:32.071275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:32.078591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.079215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.079745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.080627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.081181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.081688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.269770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.293357 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e29c658-2bd2-4c62-80c0-4bb040dc1f30 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.368505 Oct 02 01:15:32.294553 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1594/3339] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:31 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:32.300551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:32.301370 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:32.309423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.310523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.311221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.312337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.313002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.313590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.506590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.516501 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e551e3e-e604-44ba-a82f-b43f5ebff998 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.450413 Oct 02 01:15:32.517230 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1746/3340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:32 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:32.523746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4cbd4c16-e13a-49e5-a070-792566df1b78 req-3b41603f-f4ea-46f8-8e66-5359e25f0830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bd8dfb-2194-4035-bf9a-f7f091b5772d", "tag": "8bd4ce70-0f92-4f8a-b79e-e7adeb56bcd9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:32.533717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4cbd4c16-e13a-49e5-a070-792566df1b78 req-3b41603f-f4ea-46f8-8e66-5359e25f0830 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.534566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4cbd4c16-e13a-49e5-a070-792566df1b78 req-3b41603f-f4ea-46f8-8e66-5359e25f0830 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.535180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4cbd4c16-e13a-49e5-a070-792566df1b78 req-3b41603f-f4ea-46f8-8e66-5359e25f0830 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.551365 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4cbd4c16-e13a-49e5-a070-792566df1b78 req-3b41603f-f4ea-46f8-8e66-5359e25f0830 service nova] Creating event network-changed:8bd4ce70-0f92-4f8a-b79e-e7adeb56bcd9 for instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d on n-h2-master-1 Oct 02 01:15:32.557843 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4cbd4c16-e13a-49e5-a070-792566df1b78 req-3b41603f-f4ea-46f8-8e66-5359e25f0830 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039184 Oct 02 01:15:32.558635 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1747/3341] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:32.564226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:32.565152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:32.573402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.574714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.575318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.576190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.576827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.577414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.717551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.725691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6270044-cbc6-4a54-b659-ad6ced618ebf tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.429803 Oct 02 01:15:32.726270 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1595/3342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:32 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:32.731303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:32.732084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:32.741864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.742424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.742967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.744305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.744305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.744841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.923640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:32.939010 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3230533-ef70-4fd4-8f14-adc3ffb14dc9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1517 microversion: 2.1 time: 0.375847 Oct 02 01:15:32.939740 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1748/3343] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:32 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:32.950309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:32.957485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:32.980399 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:32.982407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.984225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.984908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:32.986059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:32.986713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:32.987302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.015983 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:33.123564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:33.133440 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e710f75f-33d9-41f1-8899-380a5f5bb1c9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1323 microversion: 2.1 time: 0.405936 Oct 02 01:15:33.134836 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1596/3344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:32 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:33.143951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-766e0052-dee6-4826-91eb-633547a471f6 req-4bc2d1e3-fdf1-4202-9516-886d7701b85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485ed12e-6df6-419c-808f-d881aa00b7d0", "tag": "dd267363-5e67-46d0-9e6f-1602d2f6a401"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:33.163041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-766e0052-dee6-4826-91eb-633547a471f6 req-4bc2d1e3-fdf1-4202-9516-886d7701b85c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.163613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-766e0052-dee6-4826-91eb-633547a471f6 req-4bc2d1e3-fdf1-4202-9516-886d7701b85c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.164126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-766e0052-dee6-4826-91eb-633547a471f6 req-4bc2d1e3-fdf1-4202-9516-886d7701b85c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.176482 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-766e0052-dee6-4826-91eb-633547a471f6 req-4bc2d1e3-fdf1-4202-9516-886d7701b85c service nova] Creating event network-changed:dd267363-5e67-46d0-9e6f-1602d2f6a401 for instance 485ed12e-6df6-419c-808f-d881aa00b7d0 on n-h1-master-1 Oct 02 01:15:33.182076 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-766e0052-dee6-4826-91eb-633547a471f6 req-4bc2d1e3-fdf1-4202-9516-886d7701b85c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045499 Oct 02 01:15:33.182808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1597/3345] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:33.188483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:33.189700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:33.212041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.213727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.218627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.220262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.220999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.221601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.268153 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=7,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:33.280473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:33.307862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-976e5470-1aa4-489f-86d4-daac54139296 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.361860 Oct 02 01:15:33.328185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1749/3346] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:32 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:33.344345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:33.350631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:33.364934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.366223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.366890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.368597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.369234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.369881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.708512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:33.712886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:33.721493 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0484e07f-aa9b-432d-a6ff-19b96ceca0f0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.392058 Oct 02 01:15:33.722110 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1750/3347] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:33 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:33.739756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:33.744713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:33.745335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:33.752868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:33.753973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.754427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0511604-de65-49c7-8ac3-27e003fb942e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.570221 Oct 02 01:15:33.755378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.755983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.756833 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1598/3348] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:33 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:33.766427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:33.767420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:33.775740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.776508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.777131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.795330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.797843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.798412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:33.801945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:33.805128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:33.805780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.361714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:34.373766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:34.385813 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e5b92ea-21bb-4840-a50f-2e00a8471ee6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.649682 Oct 02 01:15:34.403195 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1751/3349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:33 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:34.404102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-745f59d4-7293-45ac-96d3-56c1e49ed6c6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.631146 Oct 02 01:15:34.409863 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1599/3350] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:33 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:34.415451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:34.419520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-45b74694-382f-440a-b741-dcd122fe0859 req-1a86dd13-e632-4737-b9ec-9e31e0e99906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:34.420422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:34.433998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.436396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.439203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.440888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.442298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.444729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-45b74694-382f-440a-b741-dcd122fe0859 req-1a86dd13-e632-4737-b9ec-9e31e0e99906 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.445512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.451046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-45b74694-382f-440a-b741-dcd122fe0859 req-1a86dd13-e632-4737-b9ec-9e31e0e99906 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.451806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-45b74694-382f-440a-b741-dcd122fe0859 req-1a86dd13-e632-4737-b9ec-9e31e0e99906 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.474413 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-45b74694-382f-440a-b741-dcd122fe0859 req-1a86dd13-e632-4737-b9ec-9e31e0e99906 service nova] Creating event network-vif-plugged:cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:34.486692 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-45b74694-382f-440a-b741-dcd122fe0859 req-1a86dd13-e632-4737-b9ec-9e31e0e99906 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073923 Oct 02 01:15:34.487645 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1600/3351] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:34.495457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:34.496767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:34.505211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.505956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.506669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.508383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.509063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.510804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.787845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:34.796871 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a922d19-6ba6-4df5-a96d-a7b7e49dabd2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1502 microversion: 2.1 time: 0.391516 Oct 02 01:15:34.801127 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1752/3352] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:34 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:34.809905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:34.813483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:34.814337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:34.822054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.822714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.823760 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ed0b6e7-8376-4e26-b2aa-8904e60e6238 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1323 microversion: 2.1 time: 0.330976 Oct 02 01:15:34.824398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.825356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.825580 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1601/3353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:34 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:34.826258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.827024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.830938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:34.831778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:34.842116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.846412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.847502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:34.849674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:34.850508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:34.851121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.055901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:35.063682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1a38f37-fd8f-437a-96a1-c90c3eaa4eb8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.260612 Oct 02 01:15:35.079053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1753/3354] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:34 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:35.084598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:35.085499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:35.090361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:35.091546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.092215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.092841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.093547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.094008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.094831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.100302 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f880354-9dbe-4322-87f5-7362082d3da3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.272718 Oct 02 01:15:35.101126 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1602/3355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:34 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:35.105670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:35.106289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:35.112484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.113288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.113733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.115220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.115855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.116459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.804566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:35.835293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:35.848759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:35.856301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:35.857216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7095dce-1739-4ac5-b8a9-512f072df416 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 200 len: 1502 microversion: 2.1 time: 0.754721 Oct 02 01:15:35.861237 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f09618b4-ddb3-4e2f-a1e4-8ec7c9d6b7f1 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.781225 Oct 02 01:15:35.861644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1603/3356] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:35 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 1502 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:35.871119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c2ce8bb7-bb97-4024-b75d-b0fb77160c8f req-9ab5123f-cdb9-4fec-a605-297f009f18ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485ed12e-6df6-419c-808f-d881aa00b7d0", "tag": "5630d9d4-8ed3-4c02-962b-c11d481bb1e7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:35.884470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1754/3357] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:35 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:35.896649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:35.897954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:35.909375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.915116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.915926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.917385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.917859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.918299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.926287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c2ce8bb7-bb97-4024-b75d-b0fb77160c8f req-9ab5123f-cdb9-4fec-a605-297f009f18ab service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.927613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c2ce8bb7-bb97-4024-b75d-b0fb77160c8f req-9ab5123f-cdb9-4fec-a605-297f009f18ab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.928945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c2ce8bb7-bb97-4024-b75d-b0fb77160c8f req-9ab5123f-cdb9-4fec-a605-297f009f18ab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.951773 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c2ce8bb7-bb97-4024-b75d-b0fb77160c8f req-9ab5123f-cdb9-4fec-a605-297f009f18ab service nova] Creating event network-changed:5630d9d4-8ed3-4c02-962b-c11d481bb1e7 for instance 485ed12e-6df6-419c-808f-d881aa00b7d0 on n-h1-master-1 Oct 02 01:15:35.960906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c2ce8bb7-bb97-4024-b75d-b0fb77160c8f req-9ab5123f-cdb9-4fec-a605-297f009f18ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097524 Oct 02 01:15:35.962261 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1604/3358] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:35.970635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:35.971433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:35.978492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.979234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.980484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:35.981572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:35.982198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:35.983014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.297361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:36.306244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b33f178-5986-4742-bf07-eb045147bde7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.420183 Oct 02 01:15:36.313769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:36.322123 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5834bac6-bc12-4f74-b1a3-10a3fae60b13 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.357598 Oct 02 01:15:36.324135 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1605/3359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:35 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:36.326258 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1755/3360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:35 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:36.330816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:36.331822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:36.335662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:36.336237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:36.342612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.343394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.344416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.346858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.347355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.347655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.348427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.349893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.351069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.351816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.352484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.352928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.406907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:36.523474 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-244b120a-8d25-4348-b2c8-2a766f28df81 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 204 len: 0 microversion: 2.1 time: 0.192843 Oct 02 01:15:36.528945 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1756/3361] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:36 2022] DELETE /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:36.534836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:36.536237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:36.543516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.544130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.544686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.545625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.546724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.546927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.563160 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:36.586761 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:36.828885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:36.837641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:36.848120 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9adef208-db45-4d0f-a532-751b42b68f93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.319767 Oct 02 01:15:36.848413 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7ab8f91-4819-4a90-ab41-fc31d33c2dc3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1323 microversion: 2.1 time: 0.522165 Oct 02 01:15:36.850257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1757/3362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:36 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:36.851896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1606/3363] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:36 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1323 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:36.867417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8"}, {"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "1eacffaa-d469-4d5d-8028-a6edca0baa66"}, {"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "4a47e1ce-0f9e-4ca0-a5e1-dc5927d7fb75"}, {"server_uuid": "9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f", "name": "network-vif-plugged", "status": "completed", "tag": "69297fdd-319c-4a70-9879-5ed633c66c9f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:36.872381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:36.873344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:36.882640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.882922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.884631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.884631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.884784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.885090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.888241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:36.888909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:36.889521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:36.907219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Creating event network-vif-plugged:b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:36.908065 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Creating event network-vif-plugged:1eacffaa-d469-4d5d-8028-a6edca0baa66 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:36.908643 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Creating event network-vif-plugged:4a47e1ce-0f9e-4ca0-a5e1-dc5927d7fb75 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:36.909130 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] Creating event network-vif-plugged:69297fdd-319c-4a70-9879-5ed633c66c9f for instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f on n-h1-master-1 Oct 02 01:15:36.918312 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-24099dfa-8dff-45ed-9f84-aabaa0a8cebd req-1b86d010-949a-4705-b968-a6f564b5b5d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.064962 Oct 02 01:15:36.919496 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1607/3364] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:36.924788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-330846128", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "5c5d890d-9575-4bd1-92a2-9257ae3243d4"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:36.992346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] validate_networks() for [('5c5d890d-9575-4bd1-92a2-9257ae3243d4', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:37.131901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:37.145498 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-992232a2-1270-4569-9bbc-7de8ca421751 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.294391 Oct 02 01:15:37.152513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1758/3365] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:36 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:37.163435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:37.164334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:37.172728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:37.175163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:37.175765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:37.185950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:37.186378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:37.187170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:37.623205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:37.634710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:37.636415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:37.637649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd595452-c316-471c-9eb2-98e71ef03246 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.484074 Oct 02 01:15:37.639645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1759/3366] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:37 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:37.643822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:37.644583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:37.653067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:37.653549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:37.653980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:37.654768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:37.655161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:37.655588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:37.870536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:37.871607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:37.872622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:37.873607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:37.874030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:37.884278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:37.884766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:37.885198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:37.885916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:37.886368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:37.886838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:37.910169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Getting quotas for project 53272886aeac4313b1e8ad37b6f9ff12. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:37.918333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Getting quotas for user 7f2fd89c34d84d77b2c0ad9d5ad45390 and project 53272886aeac4313b1e8ad37b6f9ff12. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:37.933011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:37.937769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:37.977816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:37.987336 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fd300ee-45e2-4a9d-8692-902825ab7dc7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.347959 Oct 02 01:15:37.988110 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1760/3367] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:37 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:37.993295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:37.993928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:38.007868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:38.008605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:38.009200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:38.010086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:38.010726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:38.011305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:38.028307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12e1fdb7-dd2d-44f8-92fa-cee5641e42e5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106742 Oct 02 01:15:38.029840 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1608/3368] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:15:38.040149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:38.040904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:38.049692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:38.050731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:38.051379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:38.054790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:38.056089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:38.056793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:38.637054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:38.645281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e71f9519-7238-4ec2-9c52-47ba48fbc502 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.613953 Oct 02 01:15:38.664514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:38.668935 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1609/3369] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:38 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:38.673531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9673fcb-dffa-437e-995d-3b6d9f13507c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.684206 Oct 02 01:15:38.675701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:38.676329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:38.686915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:38.687435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:38.687886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:38.688349 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1761/3370] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:37 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:38.688795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:38.689827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:38.690453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:38.709521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2afe8fca-1adc-4898-adaa-3caaf6c85815 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:38.710801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2afe8fca-1adc-4898-adaa-3caaf6c85815 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:38.947252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2afe8fca-1adc-4898-adaa-3caaf6c85815 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:38.964997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2afe8fca-1adc-4898-adaa-3caaf6c85815 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1217 microversion: 2.1 time: 0.272102 Oct 02 01:15:38.965879 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1762/3371] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:38 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:38.974156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:38.975149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:38.999609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.000236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.000756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.001588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.002092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.002768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.213336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:39.226884 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aeb52170-eac8-4f9d-9130-8bb687d583d3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1323 microversion: 2.1 time: 0.556682 Oct 02 01:15:39.247171 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1610/3372] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:38 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:39.255725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:39.258199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:39.267732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.268462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.269080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.269984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.271174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.272403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.433485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:39.444858 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-693a2785-52e9-45ea-9eac-c9e0df4deb90 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.477285 Oct 02 01:15:39.446003 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1763/3373] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:38 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:39.470114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-plugged", "status": "completed", "tag": "02b6b599-4c10-4fd0-8cd7-c5881f8a4780"}, {"server_uuid": "cff262c3-fb6b-4ac2-800a-50d89d5ccb69", "name": "network-vif-plugged", "status": "completed", "tag": "54762fa0-eec8-4c49-847c-9db64395b0d4"}, {"server_uuid": "c7bd8dfb-2194-4035-bf9a-f7f091b5772d", "name": "network-vif-plugged", "status": "completed", "tag": "8bd4ce70-0f92-4f8a-b79e-e7adeb56bcd9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:39.484241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.485179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.486037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.503425 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Creating event network-vif-plugged:02b6b599-4c10-4fd0-8cd7-c5881f8a4780 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:39.504344 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Creating event network-vif-plugged:54762fa0-eec8-4c49-847c-9db64395b0d4 for instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 on n-h1-master-1 Oct 02 01:15:39.505098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] Creating event network-vif-plugged:8bd4ce70-0f92-4f8a-b79e-e7adeb56bcd9 for instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d on n-h2-master-1 Oct 02 01:15:39.517716 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a20fb36b-47e1-4f9f-8620-e5d4ea0bc0e7 req-d946d1eb-878c-4fce-8413-3101e516f326 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051481 Oct 02 01:15:39.519112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1764/3374] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:39.526900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:39.527617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:39.534356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.535227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.535705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.537661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.538290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.539021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.842502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:39.853281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:39.855052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:39.856653 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ae2fbbb-04d8-439d-ae7c-cc63f08fd9ac tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.607782 Oct 02 01:15:39.873596 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1611/3375] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:39 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:39.884876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:39.885904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:39.892347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.893129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.893784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:39.896102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:39.896970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:39.897642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:40.669865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:40.681547 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-836b5a00-1431-4e23-ba41-eda791830ac2 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 1.160607 Oct 02 01:15:40.683232 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1765/3376] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:39 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:40.691628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:40.692986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:40.700912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:40.702351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:40.703998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:40.706575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:40.707485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:40.715406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:40.722878 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:40.856711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:40.864979 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-74f741d8-b528-4395-b96e-cb3aebceae11 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1292 microversion: 2.1 time: 0.989299 Oct 02 01:15:40.865525 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1612/3377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:39 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1292 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:40.870901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:40.871812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:40.877740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:40.878454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:40.879064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:40.880567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:40.881196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:40.881781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.003565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.012713 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e45d9a42-7a9c-4c10-896b-a65dc0ab4c58 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1275 microversion: 2.1 time: 0.146133 Oct 02 01:15:41.013680 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1613/3378] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:40 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:41.018962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:41.019860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:41.028868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.029730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.030388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.031133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.031597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.032031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.135481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.148686 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4804ad7a-fe43-47a9-b9f8-815421bec8c1 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.462663 Oct 02 01:15:41.150016 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1766/3379] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:40 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:41.157318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:41.158415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:41.166037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.167636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.168326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.170427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.171161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.171786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.411273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.421423 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6a14983-0ec6-404a-a05a-8e672c57cae9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1323 microversion: 2.1 time: 0.406459 Oct 02 01:15:41.422363 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1614/3380] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:41 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:41.446129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-19f7418a-ee0c-486e-950f-21d575d84771 req-d02ba7e8-076a-4e1d-8ce1-d97330c15f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad765cc-a5f7-4748-922a-b6a7086787cc", "name": "network-vif-deleted", "tag": "77ad6923-4e68-4c74-b282-d1b5390b5f23"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:41.457460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-19f7418a-ee0c-486e-950f-21d575d84771 req-d02ba7e8-076a-4e1d-8ce1-d97330c15f17 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.459390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-19f7418a-ee0c-486e-950f-21d575d84771 req-d02ba7e8-076a-4e1d-8ce1-d97330c15f17 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.460241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-19f7418a-ee0c-486e-950f-21d575d84771 req-d02ba7e8-076a-4e1d-8ce1-d97330c15f17 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.476866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-19f7418a-ee0c-486e-950f-21d575d84771 req-d02ba7e8-076a-4e1d-8ce1-d97330c15f17 service nova] Creating event network-vif-deleted:77ad6923-4e68-4c74-b282-d1b5390b5f23 for instance 8ad765cc-a5f7-4748-922a-b6a7086787cc on n-h2-master-1 Oct 02 01:15:41.484929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-19f7418a-ee0c-486e-950f-21d575d84771 req-d02ba7e8-076a-4e1d-8ce1-d97330c15f17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044450 Oct 02 01:15:41.486153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1615/3381] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:41.494547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:41.495586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:41.504232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.506074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.506949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.507798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.508266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.508691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.546944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.566283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1caa54d3-b313-4bed-831d-4e19bbbb9289 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.414616 Oct 02 01:15:41.568319 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1767/3382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:41 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:41.704827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:41.705453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:41.713887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.714797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.715911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.724270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.726541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.735303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.871654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.885126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.886637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:41.887820 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba86ec27-fde5-455d-a27b-88f2c0d36b59 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1875 microversion: 2.32 time: 0.400354 Oct 02 01:15:41.888576 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1616/3383] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:41 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1875 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:41.893227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:41.903035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:41.911910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.912681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.913126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:41.914489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:41.914995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:41.915425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:42.130843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:42.138821 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ddf5c9bd-53ba-40f6-9d20-9709fda71b3e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1308 microversion: 2.1 time: 0.438003 Oct 02 01:15:42.157711 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1768/3384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:41 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:15:42.164208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:42.165123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:42.171472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:42.172262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:42.172961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:42.173896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:42.174572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:42.175251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:42.274669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:42.280593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:42.288502 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50a3356e-89d2-4194-b766-c4f3c80d9ef4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1474 microversion: 2.1 time: 0.396878 Oct 02 01:15:42.289379 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1617/3385] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:41 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1474 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:42.297178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02c1b03c-8c46-483a-9de8-a6032985e7af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1275 microversion: 2.1 time: 0.137673 Oct 02 01:15:42.313526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1769/3386] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:42 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:42.319596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:42.320949 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:42.335813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:42.336700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:42.337153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:42.338059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:42.338526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:42.338993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:42.365249 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:42.422089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-406800946", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:42.491671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:42.795442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:42.809596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afee56a8-c0c1-4dd5-817c-7fd07bdfecd6 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.515745 Oct 02 01:15:42.810793 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1618/3387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:42 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:42.816359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:42.818835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:42.826287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:42.827127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:42.827657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:42.828525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:42.829048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:42.829545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:43.261249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:43.269761 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d30b090-b1ca-47f5-a1b6-0ee4a92a55ab tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1520 microversion: 2.1 time: 0.457788 Oct 02 01:15:43.283161 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1619/3388] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:42 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:43.293348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:43.294549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:43.302221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:43.303029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:43.303792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:43.305238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:43.305770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:43.306380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.035122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:44.037458 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:44.038138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:44.039288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:44.039716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:44.049701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.050193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.050643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.052890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.053545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.054149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.074338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:44.080534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:44.095026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:44.102393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:44.106237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 0b07024a-e029-45b9-b85a-1fb7f1751584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:44.111872 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2cf7902e-fcb0-49fc-9096-6216bf93a17d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1654 microversion: 2.1 time: 0.827190 Oct 02 01:15:44.112480 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1620/3389] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:43 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1654 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:44.117404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:44.118018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:44.137402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.137916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.138462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.139388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.139858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.140718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.169035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7930a001-432a-4330-b483-626628291123 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.751287 Oct 02 01:15:44.176968 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1770/3390] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:15:44.182273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:44.183162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:44.191701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.193044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.193661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.194663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.195282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.195870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.670876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:44.679540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:44.684242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:44.686258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:44.688507 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb65c3e4-ced5-436b-bd8b-4798e05f676e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2829 microversion: 2.32 time: 0.575036 Oct 02 01:15:44.689548 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1621/3391] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:15:44 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2829 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:44.695885 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87fe36d8-24e7-494f-8d78-4d2421bcd9af tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1489 microversion: 2.1 time: 0.517446 Oct 02 01:15:44.696372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:44.696774 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1771/3392] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:44 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1489 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:44.697416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:44.700695 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:44.702080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:44.703117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:44.709066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.710164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.712409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.713475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.714689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.715550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.734529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.736358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.737443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.738625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.741026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.741427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.761810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:44.914137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8ec03c3-2718-48fa-b0f7-561ea6272d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 204 len: 0 microversion: 2.1 time: 0.221918 Oct 02 01:15:44.916198 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1622/3393] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:44 2022] DELETE /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:44.930867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:44.933070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:44.940916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.941412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.941982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:44.942893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:44.943356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:44.943788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.089525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:45.100325 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2c5535c1-0666-4205-8b49-d785ecda1398 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.401174 Oct 02 01:15:45.101082 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1772/3394] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:44 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:45.123009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dd81c1cd-dcca-4822-aa85-921dbe97bbd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:45.129128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd81c1cd-dcca-4822-aa85-921dbe97bbd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.129801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd81c1cd-dcca-4822-aa85-921dbe97bbd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.130635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd81c1cd-dcca-4822-aa85-921dbe97bbd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.157262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dd81c1cd-dcca-4822-aa85-921dbe97bbd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Going to try to start instance {{(pid=122355) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 01:15:45.207274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dd81c1cd-dcca-4822-aa85-921dbe97bbd7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.087761 Oct 02 01:15:45.208589 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1773/3395] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:45 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:45.215787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:45.216559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 0b07024a-e029-45b9-b85a-1fb7f1751584] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:45.223565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.224685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.225148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.225917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.226322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.226770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.257280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 0b07024a-e029-45b9-b85a-1fb7f1751584] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:45.283055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.283504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.283952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.305306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'flavor' on Instance uuid 0b07024a-e029-45b9-b85a-1fb7f1751584 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:45.320033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'system_metadata' on Instance uuid 0b07024a-e029-45b9-b85a-1fb7f1751584 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:45.324460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:45.334345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3248f78-d0f7-4a4b-bcde-cd83c214367c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.414799 Oct 02 01:15:45.335314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1623/3396] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:44 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:45.352501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-72c95c40-6306-443a-9561-a975d42c90e0 req-283d8101-4e61-4a2e-9b88-de60f3b5dfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485ed12e-6df6-419c-808f-d881aa00b7d0", "name": "network-vif-plugged", "status": "completed", "tag": "dd267363-5e67-46d0-9e6f-1602d2f6a401"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:45.363585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-72c95c40-6306-443a-9561-a975d42c90e0 req-283d8101-4e61-4a2e-9b88-de60f3b5dfc0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.364069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-72c95c40-6306-443a-9561-a975d42c90e0 req-283d8101-4e61-4a2e-9b88-de60f3b5dfc0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.365040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-72c95c40-6306-443a-9561-a975d42c90e0 req-283d8101-4e61-4a2e-9b88-de60f3b5dfc0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.379605 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-72c95c40-6306-443a-9561-a975d42c90e0 req-283d8101-4e61-4a2e-9b88-de60f3b5dfc0 service nova] Creating event network-vif-plugged:dd267363-5e67-46d0-9e6f-1602d2f6a401 for instance 485ed12e-6df6-419c-808f-d881aa00b7d0 on n-h1-master-1 Oct 02 01:15:45.400816 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-72c95c40-6306-443a-9561-a975d42c90e0 req-283d8101-4e61-4a2e-9b88-de60f3b5dfc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064152 Oct 02 01:15:45.401850 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1624/3397] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:45.405673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'metadata' on Instance uuid 0b07024a-e029-45b9-b85a-1fb7f1751584 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:45.407535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1181543755"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:45.410719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:45.425612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.431309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.432053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.433168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.433801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.434396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.720166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5706b2e2-db5b-4872-95b7-37e388ebceda tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "POST /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69/action" status: 202 len: 0 microversion: 2.1 time: 0.316850 Oct 02 01:15:45.724877 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1625/3398] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:45 2022] POST /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:15:45.732589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:45.733007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:45.739864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.740418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.740920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.741562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.742293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.742419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.825992 n-d-master-1 devstack@n-api.service[122355]: INFO nova.scheduler.client.report [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Deleted allocations for instance 0b07024a-e029-45b9-b85a-1fb7f1751584 Oct 02 01:15:45.843502 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83fed404-4237-4537-bc91-47f3645d977d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584" status: 204 len: 0 microversion: 2.1 time: 0.633197 Oct 02 01:15:45.844336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1774/3399] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:45 2022] DELETE /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:45.849410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:45.850031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:45.855847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.856330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.856770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.857515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.857973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.858399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.937029 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87b03195-bbbe-4223-aa40-f4f14830a6a9 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.210820 Oct 02 01:15:45.939102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1626/3400] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:15:45 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b/os-interface => generated 1831 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:15:45.949829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:45.949829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:45.954497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.955184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.955785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:45.956493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:45.956947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:45.957369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.400733 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:46.409685 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c8be1d4-a082-43ef-b04d-dd687d7e45b9 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1526 microversion: 2.1 time: 0.564544 Oct 02 01:15:46.410401 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1775/3401] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:45 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1526 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:46.418877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fabcdaad-84c1-448d-84ab-715793a977aa req-90c9ce57-9e9c-4f4c-9ec7-662bf77b38cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f936fb-38a3-4baa-b74c-4cfd54e3156b", "tag": "f4f42c44-425a-4373-9d2e-f70717baa243"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:46.431731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fabcdaad-84c1-448d-84ab-715793a977aa req-90c9ce57-9e9c-4f4c-9ec7-662bf77b38cf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.432288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fabcdaad-84c1-448d-84ab-715793a977aa req-90c9ce57-9e9c-4f4c-9ec7-662bf77b38cf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.432788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fabcdaad-84c1-448d-84ab-715793a977aa req-90c9ce57-9e9c-4f4c-9ec7-662bf77b38cf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.445241 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fabcdaad-84c1-448d-84ab-715793a977aa req-90c9ce57-9e9c-4f4c-9ec7-662bf77b38cf service nova] Creating event network-changed:f4f42c44-425a-4373-9d2e-f70717baa243 for instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b on n-h2-master-1 Oct 02 01:15:46.450862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fabcdaad-84c1-448d-84ab-715793a977aa req-90c9ce57-9e9c-4f4c-9ec7-662bf77b38cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039170 Oct 02 01:15:46.451638 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1776/3402] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:46.456527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e086fa8-804b-4b34-a793-fe6210e07d47 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881210160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:46.457491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:46.473129 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a7c699b-7111-4378-b5aa-79cefbf455fe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1663 microversion: 2.1 time: 0.532685 Oct 02 01:15:46.487383 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1627/3403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:45 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1663 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:46.493779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:46.494689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 0b07024a-e029-45b9-b85a-1fb7f1751584] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:46.502824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.504852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.505073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.505792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.506351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.506841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.513212 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e086fa8-804b-4b34-a793-fe6210e07d47 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99" status: 200 len: 1414 microversion: 2.1 time: 0.060521 Oct 02 01:15:46.522679 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1777/3404] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:46 2022] GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 => generated 1414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:46.522679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:46.522679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:46.528016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.528283 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:15:46.528522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.528959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.529979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 HTTP/1.1 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0b07024a-e029-45b9-b85a-1fb7f1751584'} Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:46.530089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:15:46.534123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:46.534566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.535392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:46.535601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.535806 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99138abb-5d87-4608-ac64-dcf43ee6ea09 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584" status: 404 len: 111 microversion: 2.1 time: 0.055347 Oct 02 01:15:46.535806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1628/3405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:46 2022] GET /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:46.544790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:46.545323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:46.551633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.553003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.553494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:46.554198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:46.554673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:46.555099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:47.566449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:47.580398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:47.584409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c66684a-1f36-4560-8667-7cbf13688fc4 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 1.049896 Oct 02 01:15:47.600713 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1629/3406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:46 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:47.605866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6aeef0b-ec03-4b93-acc6-a8bb9541e684 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8814b2040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:47.606882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d1baa1b-ce29-4766-9e2a-3c3ab03a3e0a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 1.091463 Oct 02 01:15:47.607563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1778/3407] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:46 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:47.629741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1701072591", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:47.662405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6aeef0b-ec03-4b93-acc6-a8bb9541e684 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99" status: 200 len: 1414 microversion: 2.1 time: 0.059823 Oct 02 01:15:47.669237 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1630/3408] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:47 2022] GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:47.679172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0a4b4198-4026-49b0-9144-1887d8206d81 req-c857e0d5-b0b5-48ff-88fa-489324c78d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485ed12e-6df6-419c-808f-d881aa00b7d0", "name": "network-vif-plugged", "status": "completed", "tag": "5630d9d4-8ed3-4c02-962b-c11d481bb1e7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:47.700540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a4b4198-4026-49b0-9144-1887d8206d81 req-c857e0d5-b0b5-48ff-88fa-489324c78d52 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:47.701026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a4b4198-4026-49b0-9144-1887d8206d81 req-c857e0d5-b0b5-48ff-88fa-489324c78d52 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:47.701458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a4b4198-4026-49b0-9144-1887d8206d81 req-c857e0d5-b0b5-48ff-88fa-489324c78d52 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:47.716291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0a4b4198-4026-49b0-9144-1887d8206d81 req-c857e0d5-b0b5-48ff-88fa-489324c78d52 service nova] Creating event network-vif-plugged:5630d9d4-8ed3-4c02-962b-c11d481bb1e7 for instance 485ed12e-6df6-419c-808f-d881aa00b7d0 on n-h1-master-1 Oct 02 01:15:47.722241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0a4b4198-4026-49b0-9144-1887d8206d81 req-c857e0d5-b0b5-48ff-88fa-489324c78d52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051605 Oct 02 01:15:47.722912 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1631/3409] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:47.723430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:15:47.728020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:47.728731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:47.735111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:47.735888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:47.736279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:47.737253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:47.737809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:47.738329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:47.899023 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:47.925793 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:48.475981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:48.484444 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-796070fa-0ec5-4804-8bf6-a84bd7694627 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1526 microversion: 2.1 time: 0.760396 Oct 02 01:15:48.485034 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1632/3410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:47 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1526 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:48.490274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:48.490916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:48.496887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:48.497383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:48.497823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:48.498517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:48.499007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:48.499434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.360884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:49.369454 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a54e48e-5b1f-4753-ab97-669a90d40373 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.883207 Oct 02 01:15:49.383163 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1633/3411] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:48 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:49.393827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d92d7e51-7a6d-4351-81eb-94675ebad8d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb8811fddc0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:49.554341 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d92d7e51-7a6d-4351-81eb-94675ebad8d5 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99" status: 204 len: 0 microversion: 2.1 time: 0.169958 Oct 02 01:15:49.555325 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1634/3412] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:49 2022] DELETE /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:49.563189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:49.564059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:49.573610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:49.574351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:49.575005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.576628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:49.577410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:49.577999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.752563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:15:49.753067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:15:49.753546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:15:49.754033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:15:49.754522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:15:49.763821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:49.764417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:49.764932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.765723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:49.766414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:49.767069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.788223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:15:49.793895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:15:49.808050 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:49.809849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:15:49.812620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:15:49.850432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:49.863608 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e9c7266-0c6d-42e7-ac31-d078c85a4e2a tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1333 microversion: 2.1 time: 0.305041 Oct 02 01:15:49.865992 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1635/3413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:49 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1333 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:49.883331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:49.883955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:49.887365 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e8908b3-8ab0-4b8b-96c1-dd7908d91065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.257881 Oct 02 01:15:49.888711 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1779/3414] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:15:49.893984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:49.895253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:49.896957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.898505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:49.899790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:49.900448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:49.935378 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:50.096135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:50.105243 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-89670c7e-06f9-430f-a9c5-5ab8526ca45f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.237244 Oct 02 01:15:50.107185 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1636/3415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:49 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:50.112601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.114023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:50.130687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.131392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.131839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.132549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.133014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.133433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.134675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7ab4531-84a0-47ae-a493-3e778825ce4e tempest-FloatingIPDetailsNegativeTestJSON-1757245350 tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project] Calling method '.version_select at 0x7fb880931ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.222701 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-a7ab4531-84a0-47ae-a493-3e778825ce4e tempest-FloatingIPDetailsNegativeTestJSON-1757245350 tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dcec4551-469e-4381-b7a4-9124d1e1a850 could not be found", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:15:50.223596 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a7ab4531-84a0-47ae-a493-3e778825ce4e tempest-FloatingIPDetailsNegativeTestJSON-1757245350 tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project] HTTP exception thrown: Floating IP not found for ID dcec4551-469e-4381-b7a4-9124d1e1a850 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7ab4531-84a0-47ae-a493-3e778825ce4e tempest-FloatingIPDetailsNegativeTestJSON-1757245350 tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project] Request method failure captured: Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-floating-ips/dcec4551-469e-4381-b7a4-9124d1e1a850 HTTP/1.1 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZFPw7gEffbtsECoRclimYTZPy4lznkh_EIBQ0GfhXO2hwDZp_wlRn284aKaeRFK_mKm7lD3uItjCsa_vF7ephdVMHTHKtRwpP8JfRdYBt3lwLW41wmIBZ2k0X2SYI7buVGBQLKUbnBNkgKoc18C8F31U1V0IkX-n2OlOn1rvCkdqc Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 3f2e0151157f4c0481260e9f8cd58d5e Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1757245350 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f2e0151157f4c0481260e9f8cd58d5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f2e0151157f4c0481260e9f8cd58d5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f2e0151157f4c0481260e9f8cd58d5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f2e0151157f4c0481260e9f8cd58d5e"}]}] Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1757245350 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 3f2e0151157f4c0481260e9f8cd58d5e Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1757245350 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5054b2caf1774655a579aae5db2f1ff9 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: exception: Floating IP not found for ID dcec4551-469e-4381-b7a4-9124d1e1a850 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'dcec4551-469e-4381-b7a4-9124d1e1a850'} Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:15:50.226666 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dcec4551-469e-4381-b7a4-9124d1e1a850 could not be found Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72fad763-7aad-4a2c-8737-605bb1a920ce'] Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dcec4551-469e-4381-b7a4-9124d1e1a850. Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dcec4551-469e-4381-b7a4-9124d1e1a850 Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dcec4551-469e-4381-b7a4-9124d1e1a850 Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7ab4531-84a0-47ae-a493-3e778825ce4e tempest-FloatingIPDetailsNegativeTestJSON-1757245350 tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project] Returning 404 to user: Floating IP not found for ID dcec4551-469e-4381-b7a4-9124d1e1a850 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:50.230541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7ab4531-84a0-47ae-a493-3e778825ce4e tempest-FloatingIPDetailsNegativeTestJSON-1757245350 tempest-FloatingIPDetailsNegativeTestJSON-1757245350-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/dcec4551-469e-4381-b7a4-9124d1e1a850" status: 404 len: 111 microversion: 2.1 time: 0.338156 Oct 02 01:15:50.237143 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1780/3416] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:15:49 2022] GET /compute/v2.1/os-floating-ips/dcec4551-469e-4381-b7a4-9124d1e1a850 => generated 111 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:50.240523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.240523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:50.260243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.260796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.261178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.261888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.262351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.262817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.464206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1045d1468b4a2f814930f5ace5c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1963b4bf54123b0483de45b6617ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:50.483365 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:DELETE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:50.489257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5591b2fd-5801-455b-b9a1-32f5b14429c5 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 200 len: 1308 microversion: 2.1 time: 0.253946 Oct 02 01:15:50.494370 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1781/3417] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:50 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:50.517577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cbb3782f-a6e3-4f37-bcf3-d403a23eb219 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880a29040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.530047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:50.554195 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-35125886-fe05-45b0-a5e0-4df934d85a5d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.441384 Oct 02 01:15:50.554874 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1637/3418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:50 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:50.565573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2d613b30-c05f-45a8-bcfb-671d5e0b6cdb req-0f21ad19-9235-4675-90ad-e98d8cbf77db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bd8dfb-2194-4035-bf9a-f7f091b5772d", "name": "network-vif-deleted", "tag": "8bd4ce70-0f92-4f8a-b79e-e7adeb56bcd9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:50.592627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d613b30-c05f-45a8-bcfb-671d5e0b6cdb req-0f21ad19-9235-4675-90ad-e98d8cbf77db service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.594196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d613b30-c05f-45a8-bcfb-671d5e0b6cdb req-0f21ad19-9235-4675-90ad-e98d8cbf77db service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.595956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d613b30-c05f-45a8-bcfb-671d5e0b6cdb req-0f21ad19-9235-4675-90ad-e98d8cbf77db service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.601282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-cbb3782f-a6e3-4f37-bcf3-d403a23eb219 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Image not found. Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cbb3782f-a6e3-4f37-bcf3-d403a23eb219 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 HTTP/1.1 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'fe096176-39ec-4506-b28d-ceea74c71e99'} Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fe096176-39ec-4506-b28d-ceea74c71e99 Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:15:50.603310 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe096176-39ec-4506-b28d-ceea74c71e99 could not be found. Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cbb3782f-a6e3-4f37-bcf3-d403a23eb219 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cbb3782f-a6e3-4f37-bcf3-d403a23eb219 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99" status: 404 len: 62 microversion: 2.1 time: 0.104934 Oct 02 01:15:50.608280 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1782/3419] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:50 2022] GET /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:50.623013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a3b3448-53f7-49c9-8746-3290d410dce0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.623628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a3b3448-53f7-49c9-8746-3290d410dce0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:50.650386 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2d613b30-c05f-45a8-bcfb-671d5e0b6cdb req-0f21ad19-9235-4675-90ad-e98d8cbf77db service nova] Creating event network-vif-deleted:8bd4ce70-0f92-4f8a-b79e-e7adeb56bcd9 for instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d on n-h2-master-1 Oct 02 01:15:50.665871 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2d613b30-c05f-45a8-bcfb-671d5e0b6cdb req-0f21ad19-9235-4675-90ad-e98d8cbf77db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109329 Oct 02 01:15:50.666516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1638/3420] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:50.673699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:50.674581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:50.682719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.683791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.684567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.685710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.686413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.687099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.746429 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Unlocking {{(pid=122354) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 02 01:15:50.820784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ad4ef9b-5597-4a84-8cd5-ad6439cec887 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.151734 Oct 02 01:15:50.821489 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1639/3421] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:50 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:50.832412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.833106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:50.850866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.851999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.853960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.855182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.856489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.857454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.875601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8a3b3448-53f7-49c9-8746-3290d410dce0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:50.884598 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a3b3448-53f7-49c9-8746-3290d410dce0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1221 microversion: 2.1 time: 0.271236 Oct 02 01:15:50.885464 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1783/3422] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:50 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:50.903570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:50.904424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:50.915310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.916152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.920778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:50.921884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:50.922588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:50.923278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.440494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:51.449228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:51.451508 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ded28cf5-7eb8-4b03-9400-4a724a54d5b4 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.564717 Oct 02 01:15:51.452342 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1784/3423] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:50 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:51.464348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:51.467320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:51.468885 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca82c383-cfb4-4318-8244-1108a609599e tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1507 microversion: 2.1 time: 0.645923 Oct 02 01:15:51.469485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1640/3424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:50 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:51.487493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.490770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:51.491145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.491392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:51.491650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.492374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.492820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.493228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.512433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.513655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.514392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.517099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.518130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.518835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.884313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:51.898183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b09e14c5-b104-4fa7-aa3c-7e3bafc1eea7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.419290 Oct 02 01:15:51.900269 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1641/3425] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:51 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:51.908213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:51.908656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:51.909802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:51.918491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.919633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.920904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.921836 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc7eb511-e489-4968-90c9-a1645c601b69 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1669 microversion: 2.1 time: 0.467621 Oct 02 01:15:51.923209 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1785/3426] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:51 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1669 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:51.923953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.924596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.925048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.929606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:51.930752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: c7bd8dfb-2194-4035-bf9a-f7f091b5772d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:51.940002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.940797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.941598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.942915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:51.944075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:51.944586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:51.962251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d could not be found. Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d HTTP/1.1 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d could not be found. Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c7bd8dfb-2194-4035-bf9a-f7f091b5772d'} Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d could not be found. Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d could not be found. Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:51.964215 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d could not be found. Oct 02 01:15:51.968270 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:51.969969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance c7bd8dfb-2194-4035-bf9a-f7f091b5772d could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:51.971632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-406a3ce3-f575-4050-92f2-0c1980dbe17d tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d" status: 404 len: 111 microversion: 2.1 time: 0.046853 Oct 02 01:15:51.980771 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1786/3427] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:51 2022] GET /compute/v2.1/servers/c7bd8dfb-2194-4035-bf9a-f7f091b5772d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:51.992428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:51.995536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:52.004200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.005018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.005910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.007102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.007724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.008483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.176460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:52.193230 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3281e5e4-b098-445b-8b3f-a2567a533b8b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1273 microversion: 2.1 time: 0.210523 Oct 02 01:15:52.212998 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1787/3428] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:51 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:52.220647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:52.221198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:52.257511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.258065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.258609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.259330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.259802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.260235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.313997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ada8ed0-eaab-43c2-a75a-1f6f6059cd28 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0/ips" status: 200 len: 180 microversion: 2.1 time: 0.099755 Oct 02 01:15:52.330403 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1788/3429] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:15:52 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0/ips => generated 180 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:52.339236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a34c937-ded0-4cea-a46b-f04ed60e204f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '.version_select at 0x7fb88079dee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:52.396939 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1a34c937-ded0-4cea-a46b-f04ed60e204f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Image not found. Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a34c937-ded0-4cea-a46b-f04ed60e204f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902 HTTP/1.1 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '548abde7-b409-4f0a-b1c0-44a2798c6902'} Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 548abde7-b409-4f0a-b1c0-44a2798c6902 to delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 548abde7-b409-4f0a-b1c0-44a2798c6902 could not be found. Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:52.398802 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a34c937-ded0-4cea-a46b-f04ed60e204f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a34c937-ded0-4cea-a46b-f04ed60e204f tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902" status: 404 len: 62 microversion: 2.1 time: 0.068547 Oct 02 01:15:52.404169 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1789/3430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:52 2022] DELETE /compute/v2.1/images/548abde7-b409-4f0a-b1c0-44a2798c6902 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:52.408404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:52.409229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:52.442134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.442468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.443471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.444695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.445550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.446002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.520580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:52.603052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:52.616159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfd44e34-e40e-4cff-91a9-e1c41a6ea192 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.712966 Oct 02 01:15:52.617286 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1642/3431] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:51 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:52.623743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:52.624522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:52.632992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.633505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.634009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.635039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.635981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.637268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.688468 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 HTTP/1.1 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '8fdd09fc-040e-4612-92f3-b0902284af55'} Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:52.690407 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:52.699357 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2831948f-3dd3-424d-a3ac-abacd01a1d5b tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 404 len: 111 microversion: 2.1 time: 0.078877 Oct 02 01:15:52.702026 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1643/3432] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:52 2022] DELETE /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:52.707549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b1892fd-73bc-437d-bd46-969af1ec890d tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 204 len: 0 microversion: 2.1 time: 0.302588 Oct 02 01:15:52.707913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:52.708150 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1790/3433] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:52 2022] DELETE /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:52.708749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:52.717107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.717963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.718412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.719242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.719708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.720191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.725773 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:52.726495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:52.750612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.751282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.751748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:52.753207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:52.753900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:52.754728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.098322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:53.115499 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed63ff48-cb29-42c0-a5b2-87942e918ba9 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1502 microversion: 2.1 time: 0.412192 Oct 02 01:15:53.116509 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1644/3434] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:52 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1502 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:53.135250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d5f66487-5428-4963-a7a8-448c84d1abc9 req-e1f0f2af-0644-4fb0-a41d-2b549f941797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "tag": "905b6b15-1615-469e-b334-8a1fb6e075a5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:53.150029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d5f66487-5428-4963-a7a8-448c84d1abc9 req-e1f0f2af-0644-4fb0-a41d-2b549f941797 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.150516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d5f66487-5428-4963-a7a8-448c84d1abc9 req-e1f0f2af-0644-4fb0-a41d-2b549f941797 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.150991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d5f66487-5428-4963-a7a8-448c84d1abc9 req-e1f0f2af-0644-4fb0-a41d-2b549f941797 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.178485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:53.183887 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d5f66487-5428-4963-a7a8-448c84d1abc9 req-e1f0f2af-0644-4fb0-a41d-2b549f941797 service nova] Creating event network-changed:905b6b15-1615-469e-b334-8a1fb6e075a5 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:15:53.187326 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e5f9169-53e6-4f43-8308-c7e1409a5551 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.466750 Oct 02 01:15:53.192562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d5f66487-5428-4963-a7a8-448c84d1abc9 req-e1f0f2af-0644-4fb0-a41d-2b549f941797 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074878 Oct 02 01:15:53.192874 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1791/3435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:52 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:53.193865 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1645/3436] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:53.203365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:53.204689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 8fdd09fc-040e-4612-92f3-b0902284af55] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:53.211330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:53.212084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:53.219912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.220709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.221215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.221660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.221815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.222365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.223088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.228181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.228707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.229664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.230023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.230768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.251689 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 HTTP/1.1 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '8fdd09fc-040e-4612-92f3-b0902284af55'} Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:53.256065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. Oct 02 01:15:53.261918 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:53.265552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance 8fdd09fc-040e-4612-92f3-b0902284af55 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:53.269818 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22850cf8-6d05-4bf9-b3de-13800007dcfc tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55" status: 404 len: 111 microversion: 2.1 time: 0.075765 Oct 02 01:15:53.271037 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1792/3437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:53 2022] GET /compute/v2.1/servers/8fdd09fc-040e-4612-92f3-b0902284af55 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:53.276659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:53.277517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:53.287507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.289255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.289984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.290935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.291567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.292166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.785118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:53.790834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:53.804231 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bbaf0082-7737-443b-b795-5e207278be16 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1675 microversion: 2.1 time: 0.608309 Oct 02 01:15:53.805031 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dd8bef75-f971-431b-bad6-f635e0edaeeb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.529906 Oct 02 01:15:53.806076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1793/3438] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:53 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:53.811238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:53.812027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:53.815624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1646/3439] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:53 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1675 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:53.822095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.827037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.827705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:53.828400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:53.830065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.830976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.832547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.833034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.837533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.838088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.838534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:53.840581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:53.841330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:53.841774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.000389 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2764fae7-d6b9-4682-8740-1d1020c97758 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.192536 Oct 02 01:15:54.001743 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1794/3440] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:53 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:54.008070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b8fb36f-a3f2-46c6-a44c-3d036e483f30 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '.version_select at 0x7fb880931c10>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:54.043893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b8fb36f-a3f2-46c6-a44c-3d036e483f30 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922689143" status: 202 len: 0 microversion: 2.1 time: 0.040263 Oct 02 01:15:54.045656 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1795/3441] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922689143 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:54.053391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-deaab59d-1ade-46b4-a0a6-269cf1628c5e req-c90f3390-1a15-4982-9d66-4aa0cf393428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff262c3-fb6b-4ac2-800a-50d89d5ccb69", "name": "network-vif-plugged", "status": "completed", "tag": "54762fa0-eec8-4c49-847c-9db64395b0d4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:54.074562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-deaab59d-1ade-46b4-a0a6-269cf1628c5e req-c90f3390-1a15-4982-9d66-4aa0cf393428 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.075317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-deaab59d-1ade-46b4-a0a6-269cf1628c5e req-c90f3390-1a15-4982-9d66-4aa0cf393428 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.075952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-deaab59d-1ade-46b4-a0a6-269cf1628c5e req-c90f3390-1a15-4982-9d66-4aa0cf393428 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.091621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-deaab59d-1ade-46b4-a0a6-269cf1628c5e req-c90f3390-1a15-4982-9d66-4aa0cf393428 service nova] Creating event network-vif-plugged:54762fa0-eec8-4c49-847c-9db64395b0d4 for instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 on n-h1-master-1 Oct 02 01:15:54.096983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-deaab59d-1ade-46b4-a0a6-269cf1628c5e req-c90f3390-1a15-4982-9d66-4aa0cf393428 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049592 Oct 02 01:15:54.097690 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1796/3442] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:54.105743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:54.107610 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:54.116605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.117461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.118117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.119823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.121221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.122817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.300530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:54.312491 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16bef98a-9e36-4679-80b8-ec8b0028fe47 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.495702 Oct 02 01:15:54.316588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1647/3443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:53 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:54.325129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:54.325829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:54.350128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.356531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.357163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.358024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.359155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.361749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.883511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:54.899599 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4998b641-d08d-49e7-8b87-0f8c5f96c645 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1672 microversion: 2.1 time: 0.800175 Oct 02 01:15:54.900560 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1797/3444] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:54 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1672 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:54.905454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:54.906925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:54.913980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.915066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.915746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:54.917102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:54.917775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:54.918645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:55.119762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:55.131316 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0f4ac5ab-c1f1-401a-89ec-0f91bc9c3934 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1502 microversion: 2.1 time: 0.808859 Oct 02 01:15:55.132062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1648/3445] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:54 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1502 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:55.153685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:55.154810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:55.161613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:55.162406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:55.163038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:55.164097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:55.164717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:55.165340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:55.433100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:55.443396 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2dd4d52c-0bf6-45e2-9d72-c0f6ef18e6aa tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.541104 Oct 02 01:15:55.445180 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1798/3446] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:54 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:55.450617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:55.451656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:55.459622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:55.460710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:55.461572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:55.462644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:55.463274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:55.463710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:55.585692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:55.600923 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b8197f5-1056-44fb-9c08-eb2669133a3c tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1675 microversion: 2.1 time: 0.449551 Oct 02 01:15:55.601885 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1649/3447] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:55 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1675 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:55.929796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:55.930786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:55.956581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:55.957200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:55.957652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:55.977898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:55.979158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:55.979879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.324531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:56.346422 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c97915c2-b4c8-4cc2-ac95-467496360a62 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.898831 Oct 02 01:15:56.351207 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1799/3448] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:55 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:56.371952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-92d0acec-96c1-4c59-8d23-de60257277bb tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '.version_select at 0x7fb880745f70>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:56.410464 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-92d0acec-96c1-4c59-8d23-de60257277bb tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Image not found. Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-92d0acec-96c1-4c59-8d23-de60257277bb tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/4044ef71-d03b-414b-9d83-6915d03b8664 HTTP/1.1 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '4044ef71-d03b-414b-9d83-6915d03b8664'} Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4044ef71-d03b-414b-9d83-6915d03b8664 to delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4044ef71-d03b-414b-9d83-6915d03b8664 could not be found. Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:56.413377 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-92d0acec-96c1-4c59-8d23-de60257277bb tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:56.418881 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-92d0acec-96c1-4c59-8d23-de60257277bb tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/images/4044ef71-d03b-414b-9d83-6915d03b8664" status: 404 len: 62 microversion: 2.1 time: 0.059087 Oct 02 01:15:56.424394 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1800/3449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:56 2022] DELETE /compute/v2.1/images/4044ef71-d03b-414b-9d83-6915d03b8664 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:56.439880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-165037b2-7c7d-4829-8aa7-9398d1a708f4 req-4c009403-631d-4fc4-9f65-dfe96ee1e5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f936fb-38a3-4baa-b74c-4cfd54e3156b", "name": "network-vif-plugged", "status": "completed", "tag": "f4f42c44-425a-4373-9d2e-f70717baa243"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:56.444660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:56.460051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-165037b2-7c7d-4829-8aa7-9398d1a708f4 req-4c009403-631d-4fc4-9f65-dfe96ee1e5ef service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.460878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-165037b2-7c7d-4829-8aa7-9398d1a708f4 req-4c009403-631d-4fc4-9f65-dfe96ee1e5ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.461288 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12010899-c5fc-420c-a38a-ddff365835b7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1652 microversion: 2.1 time: 0.535136 Oct 02 01:15:56.461486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-165037b2-7c7d-4829-8aa7-9398d1a708f4 req-4c009403-631d-4fc4-9f65-dfe96ee1e5ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.472502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1650/3450] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:55 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1652 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:56.482464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:56.483705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:56.491342 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-165037b2-7c7d-4829-8aa7-9398d1a708f4 req-4c009403-631d-4fc4-9f65-dfe96ee1e5ef service nova] Creating event network-vif-plugged:f4f42c44-425a-4373-9d2e-f70717baa243 for instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b on n-h2-master-1 Oct 02 01:15:56.507587 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-165037b2-7c7d-4829-8aa7-9398d1a708f4 req-4c009403-631d-4fc4-9f65-dfe96ee1e5ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083848 Oct 02 01:15:56.508524 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1801/3451] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:56.510416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.511767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.512542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.513913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-3262221e-f2d3-4cb1-af88-7161d09ea7c9 req-611ec850-280b-4bc8-8db9-2c91fe73c38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485ed12e-6df6-419c-808f-d881aa00b7d0", "name": "network-vif-deleted", "tag": "5630d9d4-8ed3-4c02-962b-c11d481bb1e7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:56.514458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.515167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.516739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.534237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3262221e-f2d3-4cb1-af88-7161d09ea7c9 req-611ec850-280b-4bc8-8db9-2c91fe73c38c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.534673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3262221e-f2d3-4cb1-af88-7161d09ea7c9 req-611ec850-280b-4bc8-8db9-2c91fe73c38c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.535103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3262221e-f2d3-4cb1-af88-7161d09ea7c9 req-611ec850-280b-4bc8-8db9-2c91fe73c38c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.583430 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-3262221e-f2d3-4cb1-af88-7161d09ea7c9 req-611ec850-280b-4bc8-8db9-2c91fe73c38c service nova] Creating event network-vif-deleted:5630d9d4-8ed3-4c02-962b-c11d481bb1e7 for instance 485ed12e-6df6-419c-808f-d881aa00b7d0 on n-h1-master-1 Oct 02 01:15:56.593237 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-3262221e-f2d3-4cb1-af88-7161d09ea7c9 req-611ec850-280b-4bc8-8db9-2c91fe73c38c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082980 Oct 02 01:15:56.596164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1802/3452] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:56.608154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:56.612326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:56.624869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.625963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.626777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.627932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.628618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.629062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.654754 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 HTTP/1.1 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3'} Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:56.657151 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:56.663955 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e43defc-0a90-45ab-99b4-37b168d187c3 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 404 len: 111 microversion: 2.1 time: 0.062427 Oct 02 01:15:56.666261 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1803/3453] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:56 2022] DELETE /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:56.674486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:56.675318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:56.684378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.688257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.690674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:56.697253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:56.697253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:56.697253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.089607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:57.102227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d492452-d4a9-444d-bde3-11fce7960ed7 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1489 microversion: 2.1 time: 0.635149 Oct 02 01:15:57.128211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:57.129654 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1651/3454] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:56 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1489 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:57.137784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:57.138740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.148152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.148958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.150176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.151457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.152142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.152785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.178616 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7b87bd91-2a85-4e45-a787-f3e0ad4d56e6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.511070 Oct 02 01:15:57.203905 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1804/3455] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:56 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:57.215651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.219508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.237302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.240024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.240706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.244373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.245099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.245748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.250727 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:57.251297 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:57.372162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-46a5c288-d20a-4cbc-b04b-6c080f55f14f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.238857 Oct 02 01:15:57.376644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1652/3456] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:57 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:15:57.392416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.393954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] [instance: 56bb3075-cb62-451e-99ff-27487026bce3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.395405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:57.404372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.406495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.406887 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7704d21-209f-463e-9cbb-a3803211712b tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1454 microversion: 2.1 time: 0.199577 Oct 02 01:15:57.407700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.408931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.409794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.410705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.426509 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1805/3457] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:57 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:57.431946 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] HTTP exception thrown: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Request method failure captured: Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 HTTP/1.1 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOW5Xs7vQtsiHL8EC8phlZtjojXqEVn7jersJ-CdHAapRu-TwFU2Q5DTz2cr_FAcZCZX3y_vfb4eL2BTCsBn1AayjCedjht1SBMWbrY6CMS5ZNOsjUHa8qzXGcwecnWT5wbx67ZTQlyuYfRUMM2-gFURKuJG_m5qPXbDM2zapsJsWC4 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ac1963b4bf54123b0483de45b6617ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ac1963b4bf54123b0483de45b6617ea"}]}] Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4ac1963b4bf54123b0483de45b6617ea Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-637297662 Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: eb1045d1468b4a2f814930f5ace5c2ef Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-637297662-project Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '56bb3075-cb62-451e-99ff-27487026bce3'} Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.434073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. Oct 02 01:15:57.441025 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.443811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] Returning 404 to user: Instance 56bb3075-cb62-451e-99ff-27487026bce3 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:57.443988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.444315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.445907 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9a4c59e-eebb-4c6e-b629-237a8b5cec89 tempest-ImagesOneServerNegativeTestJSON-637297662 tempest-ImagesOneServerNegativeTestJSON-637297662-project] 10.222.0.23 "GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3" status: 404 len: 111 microversion: 2.1 time: 0.063106 Oct 02 01:15:57.446576 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1653/3458] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:57 2022] GET /compute/v2.1/servers/56bb3075-cb62-451e-99ff-27487026bce3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:57.454066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-88067e8e-6433-4784-9baf-41ebab7e0012 req-29e9a43d-e462-4082-bc07-e0d5bca74f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a044d2-dc3a-4f9e-adf0-d6bf84390331", "tag": "3575149c-4688-4fbc-bc87-4ad9a743f27f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:57.461441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.461938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.467083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.469426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-88067e8e-6433-4784-9baf-41ebab7e0012 req-29e9a43d-e462-4082-bc07-e0d5bca74f7d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.470231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-88067e8e-6433-4784-9baf-41ebab7e0012 req-29e9a43d-e462-4082-bc07-e0d5bca74f7d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.470536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.471143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.471464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-88067e8e-6433-4784-9baf-41ebab7e0012 req-29e9a43d-e462-4082-bc07-e0d5bca74f7d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.471627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.485215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-88067e8e-6433-4784-9baf-41ebab7e0012 req-29e9a43d-e462-4082-bc07-e0d5bca74f7d service nova] Creating event network-changed:3575149c-4688-4fbc-bc87-4ad9a743f27f for instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 on n-h2-master-1 Oct 02 01:15:57.491665 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-88067e8e-6433-4784-9baf-41ebab7e0012 req-29e9a43d-e462-4082-bc07-e0d5bca74f7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042086 Oct 02 01:15:57.492858 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1654/3459] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:57.498523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.499873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.509052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.509659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.510295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.511162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.511724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.512394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.553364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:57.703827 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9bec424b-035a-4074-9735-cdcbf1256888 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 204 len: 0 microversion: 2.1 time: 0.273984 Oct 02 01:15:57.706453 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1806/3460] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:57 2022] DELETE /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:15:57.718180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.720158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.729302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.730332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.731338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.733241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.733937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.734986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.882195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:57.890267 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4959ec12-45d7-45f0-896f-8fb732815d52 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.395737 Oct 02 01:15:57.906153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1655/3461] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:57 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:57.913183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-386629f4-15bc-4149-98c5-2f31311b4010 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb88146de50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.941827 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-386629f4-15bc-4149-98c5-2f31311b4010 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Image not found. Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-386629f4-15bc-4149-98c5-2f31311b4010 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 HTTP/1.1 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'fe096176-39ec-4506-b28d-ceea74c71e99'} Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fe096176-39ec-4506-b28d-ceea74c71e99 to delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe096176-39ec-4506-b28d-ceea74c71e99 could not be found. Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.944916 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:15:57.949939 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:15:57.953393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-386629f4-15bc-4149-98c5-2f31311b4010 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:57.955103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-386629f4-15bc-4149-98c5-2f31311b4010 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99" status: 404 len: 62 microversion: 2.1 time: 0.046996 Oct 02 01:15:57.955916 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1656/3462] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:57 2022] DELETE /compute/v2.1/images/fe096176-39ec-4506-b28d-ceea74c71e99 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:15:57.969461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:57.970245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:57.980133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.981597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.982231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:57.983628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:57.985445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:57.986042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.020101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:15:58.074740 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Instance is already in deleting state, ignoring this request Oct 02 01:15:58.076495 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81d879e7-fe4b-41f4-babd-26c6f2d6f3db tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 204 len: 0 microversion: 2.1 time: 0.115877 Oct 02 01:15:58.077260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1657/3463] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:15:57 2022] DELETE /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:15:58.087815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:58.088825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:58.096679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.097921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.098745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.100237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.101144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.102632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.208183 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:58.226359 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0b568095-0442-4db0-b598-46138235247f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1659 microversion: 2.1 time: 0.515749 Oct 02 01:15:58.229409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1807/3464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:57 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1659 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:58.261092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:58.263994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:58.281088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.281707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.282507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.292247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.293216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.294010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.515502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:58.525394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af9c1a6f-ea6e-424a-8cae-ede90a1f7b5c tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1495 microversion: 2.1 time: 0.443613 Oct 02 01:15:58.541558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1658/3465] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:58 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1495 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:58.547259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:58.548284 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:58.559306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.560509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.561325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.562404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.563143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.563920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.629859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.631660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.632345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.633017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lazy-loading 'fault' on Instance uuid 485ed12e-6df6-419c-808f-d881aa00b7d0 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:58.747833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:58.758456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-606094ce-6deb-4d9f-b7b4-ecfb0e165090 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1302 microversion: 2.1 time: 0.215221 Oct 02 01:15:58.759765 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1659/3466] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:58 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1302 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:58.765022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8f6b360d-8579-4f97-bfde-13ac104084f0 req-09cdc956-af7f-4824-818d-d98fd6165ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff262c3-fb6b-4ac2-800a-50d89d5ccb69", "name": "network-vif-unplugged", "status": "completed", "tag": "54762fa0-eec8-4c49-847c-9db64395b0d4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:58.776149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8f6b360d-8579-4f97-bfde-13ac104084f0 req-09cdc956-af7f-4824-818d-d98fd6165ab0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.776631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8f6b360d-8579-4f97-bfde-13ac104084f0 req-09cdc956-af7f-4824-818d-d98fd6165ab0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.777061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8f6b360d-8579-4f97-bfde-13ac104084f0 req-09cdc956-af7f-4824-818d-d98fd6165ab0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.793195 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8f6b360d-8579-4f97-bfde-13ac104084f0 req-09cdc956-af7f-4824-818d-d98fd6165ab0 service nova] Creating event network-vif-unplugged:54762fa0-eec8-4c49-847c-9db64395b0d4 for instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 on n-h1-master-1 Oct 02 01:15:58.798890 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8f6b360d-8579-4f97-bfde-13ac104084f0 req-09cdc956-af7f-4824-818d-d98fd6165ab0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037549 Oct 02 01:15:58.803939 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1660/3467] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:58.811447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f5f32579-4132-4dbf-a537-4403cb67ce9c req-e13ad01b-2621-4fb0-8bba-adc30cd1759b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485ed12e-6df6-419c-808f-d881aa00b7d0", "name": "network-vif-deleted", "tag": "dd267363-5e67-46d0-9e6f-1602d2f6a401"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:58.823422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f5f32579-4132-4dbf-a537-4403cb67ce9c req-e13ad01b-2621-4fb0-8bba-adc30cd1759b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.824314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f5f32579-4132-4dbf-a537-4403cb67ce9c req-e13ad01b-2621-4fb0-8bba-adc30cd1759b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.824909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f5f32579-4132-4dbf-a537-4403cb67ce9c req-e13ad01b-2621-4fb0-8bba-adc30cd1759b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.836798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:58.838506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f5f32579-4132-4dbf-a537-4403cb67ce9c req-e13ad01b-2621-4fb0-8bba-adc30cd1759b service nova] Creating event network-vif-deleted:dd267363-5e67-46d0-9e6f-1602d2f6a401 for instance 485ed12e-6df6-419c-808f-d881aa00b7d0 on n-h1-master-1 Oct 02 01:15:58.843581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f5f32579-4132-4dbf-a537-4403cb67ce9c req-e13ad01b-2621-4fb0-8bba-adc30cd1759b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Oct 02 01:15:58.844243 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1661/3468] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:58.846860 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45224dbb-e207-4fc5-aeb7-e975976e38e9 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1317 microversion: 2.1 time: 0.597009 Oct 02 01:15:58.862649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1808/3469] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:58 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:58.914489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:58.915323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:58.922054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.922615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.923313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:58.924080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:58.924679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:58.925169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.256757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:59.257380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:59.263923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:59.264654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:59.265267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.266170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:59.266714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:59.267322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.308303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:59.316907 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b38ad5ca-34b1-4403-8cd2-be53d59a7511 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.407702 Oct 02 01:15:59.318320 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1662/3470] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:58 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:15:59.547536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:15:59.556296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:59.557585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:59.571734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a054083-c7b1-44f0-b45f-0b847a127a75 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.318856 Oct 02 01:15:59.574832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:59.576186 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1809/3471] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:59 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:15:59.577050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:59.577729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.578676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:59.579353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:59.580217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.603792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:59.606493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:59.614158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:59.615474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:59.616126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.617486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:59.618148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:59.618789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:59.780228 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:00.274746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:00.288829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:00.299758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-60e0ddeb-9dc9-4e8e-913e-69bf08664085 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.699925 Oct 02 01:16:00.300359 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1810/3472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:59 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:00.301210 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c48ea24-85d4-45df-a559-f4d4936e9504 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1495 microversion: 2.1 time: 0.756510 Oct 02 01:16:00.301917 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1663/3473] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:15:59 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1495 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:00.332235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:00.336055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:00.336768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:00.340104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:00.347527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.348547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.350690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.352905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.352905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.352905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.354818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.354818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.358911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.363322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.364378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.365632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.429290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.430774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.433462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.434365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lazy-loading 'fault' on Instance uuid 485ed12e-6df6-419c-808f-d881aa00b7d0 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:00.595330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852e8ab225d64f40a4dc9ce54fe509fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf661665ac114503b71ac751f84bfdd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:00.607061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e0452ad7-4641-471c-bf08-35175ebb5d08 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 200 len: 1302 microversion: 2.1 time: 0.278898 Oct 02 01:16:00.608451 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1811/3474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:00 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 1302 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:00.616459 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:00.617321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:00.625788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.626736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.627527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.628961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:00.629586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:00.632550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:00.882159 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:00.960804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:00.990995 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06bf0ed1-7a0c-45ba-a500-b15aa6a3a18f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1503 microversion: 2.1 time: 0.664387 Oct 02 01:16:00.996918 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1664/3475] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:00 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1503 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:01.003052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:01.003671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:01.018422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.018964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.019406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.020466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.021990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.022505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.250749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:01.275036 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a83f5a3e-46ea-4509-bb7f-b29435485bdb tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.665102 Oct 02 01:16:01.275763 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1812/3476] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:00 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:01.288728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:01.290524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:01.314732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.315383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.315932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.317527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.318167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.318982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.470801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:01.483377 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9a5b8ae-261a-4554-a7cb-b1457d795d7c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.484689 Oct 02 01:16:01.484401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1665/3477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:00 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:01.508545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:01.514347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:01.547186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.547698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.548141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.549045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.549667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.550366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.797089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:01.805001 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c57e906-38cd-4552-8211-75033594e174 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1503 microversion: 2.1 time: 0.527336 Oct 02 01:16:01.806104 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1813/3478] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:01 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:01.811046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:01.812038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:01.818113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.818938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.819306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.820800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.821422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.822007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.860098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:01.860887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:01.861482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:01.862239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lazy-loading 'fault' on Instance uuid cff262c3-fb6b-4ac2-800a-50d89d5ccb69 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:01.959587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd2ad37e9b844ac8b7632fd9291023a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9231cac91fd14f51a4efc95c84202419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:01.968744 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b125fad7-165f-4dd6-82db-35c29a46bc19 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 200 len: 1298 microversion: 2.1 time: 0.161313 Oct 02 01:16:01.969806 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1814/3479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:01 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:01.995396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-09758744-ba1f-467f-8823-4af1c7ad9f57 req-7569cf34-71c1-496a-a6b8-b62a9d6c32d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff262c3-fb6b-4ac2-800a-50d89d5ccb69", "name": "network-vif-deleted", "tag": "54762fa0-eec8-4c49-847c-9db64395b0d4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:02.006329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-09758744-ba1f-467f-8823-4af1c7ad9f57 req-7569cf34-71c1-496a-a6b8-b62a9d6c32d9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.007242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-09758744-ba1f-467f-8823-4af1c7ad9f57 req-7569cf34-71c1-496a-a6b8-b62a9d6c32d9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.007867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-09758744-ba1f-467f-8823-4af1c7ad9f57 req-7569cf34-71c1-496a-a6b8-b62a9d6c32d9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.009152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:02.024114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5012a374-b203-4823-a38b-1fb2bd9c7080 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.538630 Oct 02 01:16:02.024717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1666/3480] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:01 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:02.045723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:02.045908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:02.055724 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-09758744-ba1f-467f-8823-4af1c7ad9f57 req-7569cf34-71c1-496a-a6b8-b62a9d6c32d9 service nova] Creating event network-vif-deleted:54762fa0-eec8-4c49-847c-9db64395b0d4 for instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 on n-h1-master-1 Oct 02 01:16:02.061882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.063342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.063799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.064538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.065130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.065257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-09758744-ba1f-467f-8823-4af1c7ad9f57 req-7569cf34-71c1-496a-a6b8-b62a9d6c32d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074058 Oct 02 01:16:02.065644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.066371 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1815/3481] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:02.073445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:02.076878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:02.088028 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] HTTP exception thrown: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:02.088547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.089163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.090705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Request method failure captured: Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 HTTP/1.1 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXal9JWOFiBgV0gCWe9-nI1BFgozf0raZolP_pIsnG2H4Y0hU796_NigYon6lje9OBmAoPJZHj7sCTtiDlGVUZXwYNsLO-YTjFcUqdXqGh8RBxx_m732sGNsDcIBujNbFRlj4z1f-L3xl24yUIm5oM3HMJnL3dZAH3TxOZfqVPk4yw Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf661665ac114503b71ac751f84bfdd7"}]}] Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 852e8ab225d64f40a4dc9ce54fe509fd Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '485ed12e-6df6-419c-808f-d881aa00b7d0'} Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:02.091744 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Returning 404 to user: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:02.096438 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5224bd2d-bb9e-4d57-bf55-01c779434585 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 404 len: 111 microversion: 2.1 time: 0.051862 Oct 02 01:16:02.097095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.097732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.098291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.106301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1667/3482] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:02 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:02.111437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:02.112059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:02.133107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.133866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.134495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.135414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.136032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.136616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.219718 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-037e551c-3126-4797-a95b-88d3b54284e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "PUT /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1075 microversion: 2.1 time: 0.151788 Oct 02 01:16:02.237437 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1816/3483] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:16:02 2022] PUT /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1075 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:02.245100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:02.248102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:02.258713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.259524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.260197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.265440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.266539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.267281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.628264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:02.633238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:02.666123 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-af5226b1-ca20-4eb6-9184-d9ac974a2b00 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1501 microversion: 2.1 time: 0.425675 Oct 02 01:16:02.670067 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1817/3484] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:02 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1501 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:02.670534 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f615af2-07af-4193-9071-87f653465cf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.561423 Oct 02 01:16:02.675547 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1668/3485] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:02 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:02.693609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:02.694725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:02.703076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.703301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:02.703953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:02.704261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.704926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.705801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.706450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.707039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.716581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.717360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.717964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:02.718848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:02.719463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:02.720041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.048468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:03.050662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:03.061352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1abb7633-0295-4924-8eb8-3a55cf15d308 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.386295 Oct 02 01:16:03.063794 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1818/3486] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:02 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:03.074793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17de0ca6-81e0-41c0-8cfb-fc733cbbb6fd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1501 microversion: 2.1 time: 0.378357 Oct 02 01:16:03.075265 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1669/3487] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:02 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:03.090983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:03.092278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:03.093054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: cff262c3-fb6b-4ac2-800a-50d89d5ccb69] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:03.094418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:03.102311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.103056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.103720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.104586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.105249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.105839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.112511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.114495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.120159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.121100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.121614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.122126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.135594 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 could not be found. Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 HTTP/1.1 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: exception: Instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 could not be found. Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'cff262c3-fb6b-4ac2-800a-50d89d5ccb69'} Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 could not be found. Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 could not be found. Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.137498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.142631 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:03.142631 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:03.142631 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:03.142631 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:03.142631 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 could not be found. Oct 02 01:16:03.142631 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.143785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance cff262c3-fb6b-4ac2-800a-50d89d5ccb69 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:03.144798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8134bbab-811c-4ee4-a32a-d693b400e6f6 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69" status: 404 len: 111 microversion: 2.1 time: 0.068367 Oct 02 01:16:03.145841 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1819/3488] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:03 2022] GET /compute/v2.1/servers/cff262c3-fb6b-4ac2-800a-50d89d5ccb69 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:03.151588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:03.155515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:03.176914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.177785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.178395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.179298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.179910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.180506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.185162 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:03.313770 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:03.323084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:03.323839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:03.329115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:03.329750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:03.330495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:03.483178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:03.501504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.502027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.502943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.503653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.514835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.515826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.575809 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-438da7f1-8e21-4655-9dcf-64e19def4c39 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "POST /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b/action" status: 202 len: 1107 microversion: 2.1 time: 0.428012 Oct 02 01:16:03.587307 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1820/3489] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:16:03 2022] POST /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b/action => generated 1107 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 02 01:16:03.598517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c23bc211-d998-427b-b6c0-7bec328e7892 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880547160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:03.660998 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c23bc211-d998-427b-b6c0-7bec328e7892 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Image not found. Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c23bc211-d998-427b-b6c0-7bec328e7892 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 HTTP/1.1 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'a431c1e9-b1f7-428c-b693-c1cdbc919b19'} Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a431c1e9-b1f7-428c-b693-c1cdbc919b19 to delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a431c1e9-b1f7-428c-b693-c1cdbc919b19 could not be found. Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.663004 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:16:03.668479 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:03.670572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c23bc211-d998-427b-b6c0-7bec328e7892 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:03.674935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c23bc211-d998-427b-b6c0-7bec328e7892 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19" status: 404 len: 62 microversion: 2.1 time: 0.085211 Oct 02 01:16:03.678569 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1821/3490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:03 2022] DELETE /compute/v2.1/images/a431c1e9-b1f7-428c-b693-c1cdbc919b19 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:16:03.704477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:03.705306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:03.728426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.729190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.736171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:03.737221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:03.737967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:03.738957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.397487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:04.411333 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ea57821-d56d-4d1e-b290-881cb09a61fa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 1.334501 Oct 02 01:16:04.413088 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1670/3491] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:03 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:04.418325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:04.419106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:04.439909 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:04.446667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.447472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.448212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.449175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.459553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.460376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.464186 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:04.498591 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c HTTP/1.1 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c277426b-e31d-455e-a9ed-17a3b7a7746c'} Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:04.504058 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:04.509095 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b51ca3a-62fa-4e84-ada2-e63af81f3939 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 404 len: 111 microversion: 2.1 time: 0.091240 Oct 02 01:16:04.511209 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1671/3492] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:04 2022] DELETE /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:04.520256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:04.524551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:04.545580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.549354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.550030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.550980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.551606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.554987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.661056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:04.676218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2df65e42-77e4-4bcc-9249-9e54965279f7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.998924 Oct 02 01:16:04.677563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1822/3493] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:03 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:04.685498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:04.691186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: c277426b-e31d-455e-a9ed-17a3b7a7746c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:04.705469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.706370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.708044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.711359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.715411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.716338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.752293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c HTTP/1.1 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c277426b-e31d-455e-a9ed-17a3b7a7746c'} Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.756250 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.760498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.760498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.760498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:04.760498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:04.760498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. Oct 02 01:16:04.760498 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.766154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance c277426b-e31d-455e-a9ed-17a3b7a7746c could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:04.768207 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9ac5d521-cd02-4014-bd3e-bd49d4e51a83 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c" status: 404 len: 111 microversion: 2.1 time: 0.089316 Oct 02 01:16:04.772405 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1823/3494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:04 2022] GET /compute/v2.1/servers/c277426b-e31d-455e-a9ed-17a3b7a7746c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:04.791809 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-046f0cd2-da7a-4f5b-badb-d4f100e6d795 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb880736ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:04.814836 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-046f0cd2-da7a-4f5b-badb-d4f100e6d795 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Image not found. Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-046f0cd2-da7a-4f5b-badb-d4f100e6d795 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 HTTP/1.1 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'da5abaf5-3ea5-4e52-942a-3dbc0aa74710'} Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image da5abaf5-3ea5-4e52-942a-3dbc0aa74710 to delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da5abaf5-3ea5-4e52-942a-3dbc0aa74710 could not be found. Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.816888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:16:04.821617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.824399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-046f0cd2-da7a-4f5b-badb-d4f100e6d795 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:04.825458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-046f0cd2-da7a-4f5b-badb-d4f100e6d795 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710" status: 404 len: 62 microversion: 2.1 time: 0.047562 Oct 02 01:16:04.829338 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1824/3495] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:04 2022] DELETE /compute/v2.1/images/da5abaf5-3ea5-4e52-942a-3dbc0aa74710 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:16:04.836479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:04.837760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:04.846030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.846772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.847396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.848279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.848906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.849567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.881512 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 HTTP/1.1 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: exception: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'b4164649-d919-44dd-8130-9f16db3e4dd2'} Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:04.883595 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.888374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.890172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:04.891414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f56e9b09-9d41-403a-937e-a2432388578f tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 404 len: 111 microversion: 2.1 time: 0.060805 Oct 02 01:16:04.898587 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1825/3496] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:04 2022] DELETE /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:04.906859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:04.910213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: b4164649-d919-44dd-8130-9f16db3e4dd2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:04.927139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.928453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.929066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.929964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:04.930588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:04.931195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:04.949400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 HTTP/1.1 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: exception: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'b4164649-d919-44dd-8130-9f16db3e4dd2'} Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.951263 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:04.955768 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:04.955768 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:04.955768 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:04.955768 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:04.955768 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. Oct 02 01:16:04.955768 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:04.958010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance b4164649-d919-44dd-8130-9f16db3e4dd2 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:04.978656 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e2e8dc5-e68e-4a97-8d59-bf4b76d37318 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2" status: 404 len: 111 microversion: 2.1 time: 0.078542 Oct 02 01:16:04.982682 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1826/3497] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:04 2022] GET /compute/v2.1/servers/b4164649-d919-44dd-8130-9f16db3e4dd2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:04.988629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02907012-cb87-45d5-b77d-d00e71028fed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '.version_select at 0x7fb881210940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:05.011892 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-02907012-cb87-45d5-b77d-d00e71028fed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Image not found. Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02907012-cb87-45d5-b77d-d00e71028fed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 HTTP/1.1 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: exception: Image not found. Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'ba7ea212-524f-4bb2-a27e-6305cd0067e7'} Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ba7ea212-524f-4bb2-a27e-6305cd0067e7 to delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba7ea212-524f-4bb2-a27e-6305cd0067e7 could not be found. Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.013896 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:16:05.018721 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.023778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02907012-cb87-45d5-b77d-d00e71028fed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Image not found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:05.024853 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02907012-cb87-45d5-b77d-d00e71028fed tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7" status: 404 len: 62 microversion: 2.1 time: 0.040848 Oct 02 01:16:05.028839 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1827/3498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:04 2022] DELETE /compute/v2.1/images/ba7ea212-524f-4bb2-a27e-6305cd0067e7 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:16:05.035284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:05.036504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:05.045646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:05.046410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:05.047211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:05.048166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:05.048878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:05.049642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:05.065410 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 HTTP/1.1 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '5159e837-6076-465b-9383-601745d7acb3'} Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:05.067550 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.073374 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.075327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:05.077672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:05.078765 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b523d974-0ec0-47ba-9e69-910fe7e53ee3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.566217 Oct 02 01:16:05.079072 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae6591e6-5a82-42b9-ac34-703bae058e85 tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 404 len: 111 microversion: 2.1 time: 0.048502 Oct 02 01:16:05.079359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1672/3499] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:04 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:05.083234 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1828/3500] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:05 2022] DELETE /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:05.089296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:05.089914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] [instance: 5159e837-6076-465b-9383-601745d7acb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:05.111430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:05.112221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:05.112840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:05.115852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:05.116622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:05.117253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:05.138404 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] HTTP exception thrown: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Request method failure captured: Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 HTTP/1.1 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOVMu6cqP-pzmwTiaSy03Thj-dgJN1jrLpybsN0nQjNiOQQwEmsUputWKgarzH9tKT7Qnuk3jo_dgsmArJritlVOKmghkQMjBardTnY2NPmdvKCjBlzyrgsd-rNFLlDxCwl1lTPR38q4-g35OWF98iIFatQShKGbXHKqhWz1kvYqyms Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9231cac91fd14f51a4efc95c84202419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9231cac91fd14f51a4efc95c84202419"}]}] Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9231cac91fd14f51a4efc95c84202419 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesTestJSON-1526821463 Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 8cd2ad37e9b844ac8b7632fd9291023a Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesTestJSON-1526821463-project Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5159e837-6076-465b-9383-601745d7acb3'} Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.141767 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:05.147250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:05.147250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:05.147250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:05.147250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:05.147250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. Oct 02 01:16:05.147250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:05.149864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] Returning 404 to user: Instance 5159e837-6076-465b-9383-601745d7acb3 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:05.151421 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01c8a0b6-c6df-4524-9f40-6106ce20386d tempest-ImagesTestJSON-1526821463 tempest-ImagesTestJSON-1526821463-project] 10.222.0.23 "GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3" status: 404 len: 111 microversion: 2.1 time: 0.065817 Oct 02 01:16:05.152536 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1673/3501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:05 2022] GET /compute/v2.1/servers/5159e837-6076-465b-9383-601745d7acb3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:05.701658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:05.702350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:05.710579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:05.711569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:05.712256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:05.713302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:05.714003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:05.714713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.033746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:06.046684 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a60fe2ac-5703-486c-b2d9-2c4abdfbf904 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.346097 Oct 02 01:16:06.054105 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1829/3502] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:05 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:06.107467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:06.108629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:06.122752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.123574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.124284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.125188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.132359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.133818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.378986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:06.379489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:06.389168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.389674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.390119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.390860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.397712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.398283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.414899 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] HTTP exception thrown: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Request method failure captured: Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 HTTP/1.1 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXal9JWOFiBgV0gCWe9-nI1BFgozf0raZolP_pIsnG2H4Y0hU796_NigYon6lje9OBmAoPJZHj7sCTtiDlGVUZXwYNsLO-YTjFcUqdXqGh8RBxx_m732sGNsDcIBujNbFRlj4z1f-L3xl24yUIm5oM3HMJnL3dZAH3TxOZfqVPk4yw Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf661665ac114503b71ac751f84bfdd7"}]}] Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 852e8ab225d64f40a4dc9ce54fe509fd Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '485ed12e-6df6-419c-808f-d881aa00b7d0'} Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:06.417095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Returning 404 to user: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:06.421468 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be1c6029-cb37-49fb-97c1-51e6ba7d9528 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 404 len: 111 microversion: 2.1 time: 0.044151 Oct 02 01:16:06.423145 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1830/3503] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:06 2022] DELETE /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:06.429382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:06.430058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 485ed12e-6df6-419c-808f-d881aa00b7d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:06.437873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.438664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.439839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.441032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.441946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.442856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.464042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] HTTP exception thrown: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Request method failure captured: Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 HTTP/1.1 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXal9JWOFiBgV0gCWe9-nI1BFgozf0raZolP_pIsnG2H4Y0hU796_NigYon6lje9OBmAoPJZHj7sCTtiDlGVUZXwYNsLO-YTjFcUqdXqGh8RBxx_m732sGNsDcIBujNbFRlj4z1f-L3xl24yUIm5oM3HMJnL3dZAH3TxOZfqVPk4yw Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf661665ac114503b71ac751f84bfdd7"}]}] Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 852e8ab225d64f40a4dc9ce54fe509fd Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '485ed12e-6df6-419c-808f-d881aa00b7d0'} Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.465999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. Oct 02 01:16:06.471262 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.475741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Returning 404 to user: Instance 485ed12e-6df6-419c-808f-d881aa00b7d0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:06.476861 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e6b77ba-7f99-43aa-b6d4-0de5483c6ee5 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0" status: 404 len: 111 microversion: 2.1 time: 0.053166 Oct 02 01:16:06.480726 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1831/3504] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:06 2022] GET /compute/v2.1/servers/485ed12e-6df6-419c-808f-d881aa00b7d0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:06.485692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:06.486197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:06.494092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.495304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.495970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.496520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:06.497283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.497905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.498498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.510460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a21c0588-06af-47ca-a07e-a00ad1cb7186 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.402289 Oct 02 01:16:06.511276 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1674/3505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:06 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:06.514947 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] HTTP exception thrown: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Request method failure captured: Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 HTTP/1.1 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXal9JWOFiBgV0gCWe9-nI1BFgozf0raZolP_pIsnG2H4Y0hU796_NigYon6lje9OBmAoPJZHj7sCTtiDlGVUZXwYNsLO-YTjFcUqdXqGh8RBxx_m732sGNsDcIBujNbFRlj4z1f-L3xl24yUIm5oM3HMJnL3dZAH3TxOZfqVPk4yw Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf661665ac114503b71ac751f84bfdd7"}]}] Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 852e8ab225d64f40a4dc9ce54fe509fd Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7b18734f-c4f5-4a75-9e20-38f3d20c04f5'} Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:06.516741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.522234 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.524687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Returning 404 to user: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:06.525737 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de5df01a-f4f0-41f9-b199-9de271e34b35 tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 404 len: 111 microversion: 2.1 time: 0.044006 Oct 02 01:16:06.530896 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1832/3506] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:06 2022] DELETE /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:06.536115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:06.537394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] [instance: 7b18734f-c4f5-4a75-9e20-38f3d20c04f5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:06.544566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.545071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.545510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.546461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:06.547438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:06.548057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:06.569319 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] HTTP exception thrown: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Request method failure captured: Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 HTTP/1.1 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXal9JWOFiBgV0gCWe9-nI1BFgozf0raZolP_pIsnG2H4Y0hU796_NigYon6lje9OBmAoPJZHj7sCTtiDlGVUZXwYNsLO-YTjFcUqdXqGh8RBxx_m732sGNsDcIBujNbFRlj4z1f-L3xl24yUIm5oM3HMJnL3dZAH3TxOZfqVPk4yw Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf661665ac114503b71ac751f84bfdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf661665ac114503b71ac751f84bfdd7"}]}] Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: bf661665ac114503b71ac751f84bfdd7 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestMultiNic-1894848516 Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 852e8ab225d64f40a4dc9ce54fe509fd Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestMultiNic-1894848516-project Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7b18734f-c4f5-4a75-9e20-38f3d20c04f5'} Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:06.571482 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. Oct 02 01:16:06.575706 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:06.578834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] Returning 404 to user: Instance 7b18734f-c4f5-4a75-9e20-38f3d20c04f5 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:06.579926 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b9c72ef-7d0c-4baf-bcb7-9debaeb3fd5f tempest-ServersTestMultiNic-1894848516 tempest-ServersTestMultiNic-1894848516-project] 10.222.0.23 "GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5" status: 404 len: 111 microversion: 2.1 time: 0.049345 Oct 02 01:16:06.581135 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1675/3507] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:06 2022] GET /compute/v2.1/servers/7b18734f-c4f5-4a75-9e20-38f3d20c04f5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:07.075221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:07.075856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:07.090777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:07.091518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:07.092139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:07.093034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:07.093652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:07.094229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:07.179047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-cf9c1645-0a87-4050-8c8d-c683aca14052 req-611f1229-9629-4867-a013-b722428dd3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a044d2-dc3a-4f9e-adf0-d6bf84390331", "name": "network-vif-plugged", "status": "completed", "tag": "3575149c-4688-4fbc-bc87-4ad9a743f27f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:07.198945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cf9c1645-0a87-4050-8c8d-c683aca14052 req-611f1229-9629-4867-a013-b722428dd3f8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:07.202289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cf9c1645-0a87-4050-8c8d-c683aca14052 req-611f1229-9629-4867-a013-b722428dd3f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:07.204245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cf9c1645-0a87-4050-8c8d-c683aca14052 req-611f1229-9629-4867-a013-b722428dd3f8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:07.228970 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-cf9c1645-0a87-4050-8c8d-c683aca14052 req-611f1229-9629-4867-a013-b722428dd3f8 service nova] Creating event network-vif-plugged:3575149c-4688-4fbc-bc87-4ad9a743f27f for instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 on n-h2-master-1 Oct 02 01:16:07.238411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-cf9c1645-0a87-4050-8c8d-c683aca14052 req-611f1229-9629-4867-a013-b722428dd3f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373220 Oct 02 01:16:07.241005 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1833/3508] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:07.541761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:07.542584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:07.565023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:07.565794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:07.566311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:07.567096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:07.567608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:07.568100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:07.905383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:07.920682 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-911102c5-190f-4c8a-aa6a-a934548eda8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.849172 Oct 02 01:16:07.923197 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1676/3509] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:07 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:08.109350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:08.118865 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59b7ecb8-9f46-4289-9e7e-9e51fd0be849 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.585346 Oct 02 01:16:08.119542 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1834/3510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:07 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:08.946619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:08.948237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:08.967650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:08.968819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:08.969970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:08.970973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:08.971685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:08.972337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:09.204412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:09.219982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb645094-2a1c-4e11-8bcb-62f1eb547ad6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.278237 Oct 02 01:16:09.221220 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1677/3511] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:08 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:09.228581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:09.229775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:09.244711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:09.247926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:09.248656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:09.251033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:09.252580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:09.254393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:09.618332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:09.629304 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97175c10-18d7-4055-a8a3-72700769f954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1321 microversion: 2.1 time: 0.406905 Oct 02 01:16:09.650975 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1678/3512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:09 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:09.680292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-116641013", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "dda3cda3-ddae-4e97-827f-90d7b130c4d8"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:09.781275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] validate_networks() for [('dda3cda3-ddae-4e97-827f-90d7b130c4d8', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:10.247606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:10.250266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:10.263924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:10.264715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:10.265468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:10.268735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:10.269410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:10.270847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:10.699907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:10.708275 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0adf2403-8137-443a-ab21-8d07c3c8e7d4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.464860 Oct 02 01:16:10.710583 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1679/3513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:10 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:10.913816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75185d9d-bf07-4cf1-84a8-84b606958e03 tempest-ListImageFiltersNegativeTestJSON-1686990992 tempest-ListImageFiltersNegativeTestJSON-1686990992-project] Calling method '.version_select at 0x7fb8814b2280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:10.957012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-75185d9d-bf07-4cf1-84a8-84b606958e03 tempest-ListImageFiltersNegativeTestJSON-1686990992 tempest-ListImageFiltersNegativeTestJSON-1686990992-project] HTTP exception thrown: Image not found. Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75185d9d-bf07-4cf1-84a8-84b606958e03 tempest-ListImageFiltersNegativeTestJSON-1686990992 tempest-ListImageFiltersNegativeTestJSON-1686990992-project] Request method failure captured: Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/images/3de9ef30-6de4-4fde-8a00-ea435648b384 HTTP/1.1 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZa6eR4kTDiEcQBpZ7IMtbGFEfGMhJmD4icb6Fvi7kWcLgnToru5j-l42_xKJea-fNrKIZWKP2L9JIu7E_23_hZqQbj7a6hKUNDPcp6xSMFlCcoRU7ARL1Uv-SqubESngo7aGK2nhmJ5pOP_6hYONBjW9zixNAyTYbv_etcHoF4qcE Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0c749fc01376448fb0d4f04bc8eb5528 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1686990992 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0c749fc01376448fb0d4f04bc8eb5528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c749fc01376448fb0d4f04bc8eb5528"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c749fc01376448fb0d4f04bc8eb5528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0c749fc01376448fb0d4f04bc8eb5528"}]}] Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1686990992 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0c749fc01376448fb0d4f04bc8eb5528 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1686990992 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ListImageFiltersNegativeTestJSON-1686990992-project Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bbc9ee7eb721413b833f4564ea64acb0 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1686990992-project Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: exception: Image not found. Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3de9ef30-6de4-4fde-8a00-ea435648b384'} Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3de9ef30-6de4-4fde-8a00-ea435648b384 Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 02 01:16:10.960075 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3de9ef30-6de4-4fde-8a00-ea435648b384 could not be found. Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 02 01:16:10.965688 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:10.972532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75185d9d-bf07-4cf1-84a8-84b606958e03 tempest-ListImageFiltersNegativeTestJSON-1686990992 tempest-ListImageFiltersNegativeTestJSON-1686990992-project] Returning 404 to user: Image not found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:10.973159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75185d9d-bf07-4cf1-84a8-84b606958e03 tempest-ListImageFiltersNegativeTestJSON-1686990992 tempest-ListImageFiltersNegativeTestJSON-1686990992-project] 10.222.0.23 "GET /compute/v2.1/images/3de9ef30-6de4-4fde-8a00-ea435648b384" status: 404 len: 62 microversion: 2.1 time: 0.261237 Oct 02 01:16:10.974048 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1680/3514] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:10 2022] GET /compute/v2.1/images/3de9ef30-6de4-4fde-8a00-ea435648b384 => generated 62 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:16:10.987114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:10.987755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:11.015945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.018199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.019039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.023614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.024406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.025853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.254776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:11.255505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:11.256374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:11.257068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:11.257824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:11.288556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.289665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.290863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.293323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.293874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.295715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.355506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Getting quotas for project 087deeb5d16442abaf8639044c1b1a46. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:11.375452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Getting quotas for user 565b532318284915b742bf70ff2cb226 and project 087deeb5d16442abaf8639044c1b1a46. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:11.406976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:16:11.410544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:11.419110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:16:11.425161 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-250231eb-bab5-4c78-ba20-7f5e2519636e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1502 microversion: 2.1 time: 0.449583 Oct 02 01:16:11.426008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1681/3515] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:10 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:11.455308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:11.456174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:11.470272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.472711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.473517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.474364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.479197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.479704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.523343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a84040f-cee9-433b-9c84-61bb4abc71f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419650 Oct 02 01:16:11.530894 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1835/3516] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:16:11.549108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7fe1cff2-2b48-4738-b295-a93f2e425ea8 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:11.550066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7fe1cff2-2b48-4738-b295-a93f2e425ea8 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:11.840120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7fe1cff2-2b48-4738-b295-a93f2e425ea8 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:11.848585 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7fe1cff2-2b48-4738-b295-a93f2e425ea8 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1215 microversion: 2.1 time: 0.311028 Oct 02 01:16:11.859360 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1836/3517] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:11 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:11.874289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:11.875488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:11.889800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.890750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.891489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:11.892502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:11.893190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:11.893896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:12.290301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:12.310486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-864ed8c4-d849-494f-b0fc-bfae99b59d2a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1502 microversion: 2.1 time: 0.860368 Oct 02 01:16:12.311246 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1682/3518] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:11 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1502 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:12.337042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:12.338488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:12.356656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:12.359490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:12.361187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:12.363092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:12.363870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:12.364656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:12.431553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:16:12.600692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:12.614307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1c0a6af-93cd-45d0-a018-6aa3881bb2bb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.750694 Oct 02 01:16:12.618216 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1837/3519] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:11 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:12.691336 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2153c25-56f9-4ee6-ad36-e0c51526f211 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 204 len: 0 microversion: 2.1 time: 0.361108 Oct 02 01:16:12.696212 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1683/3520] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:12 2022] DELETE /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:16:12.701665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:12.702821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:12.715214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:12.717173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:12.719926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:12.722256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:12.723018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:12.724791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:12.894117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:12.900909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:12.920327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:12.921238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:12.921924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:12.923416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:12.929444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:12.930192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:13.134398 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:13.151271 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6dcaf894-9a67-493a-b3c7-cb08ea8ab831 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1219 microversion: 2.1 time: 0.260445 Oct 02 01:16:13.167387 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1684/3521] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:12 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:13.260342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:13.274544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be891415-8aaa-43ee-94b1-c9c7527f4ae4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1508 microversion: 2.1 time: 0.576780 Oct 02 01:16:13.277819 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1838/3522] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:12 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:13.642449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:13.643542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:13.654478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:13.655133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:13.655784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:13.656579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:13.657105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:13.657601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:13.924275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:13.943514 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67cfc6a7-5264-495f-9457-fb6a5d439a9f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.304574 Oct 02 01:16:13.950121 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1685/3523] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:13 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:14.194115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:14.194876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:14.207291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:14.207818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:14.208431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:14.209959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:14.211053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:14.217259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:14.305744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:14.306556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:14.315133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:14.316647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:14.317673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:14.319315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:14.320883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:14.322968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:14.331166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:14.344146 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-456535e2-b96b-4f1a-9cd4-04c94abe935b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1273 microversion: 2.1 time: 0.155643 Oct 02 01:16:14.349468 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1839/3524] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:14 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:14.656137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:14.688212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4c39e5bf-1d5b-410b-b3f7-4c3f2deaf88f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1508 microversion: 2.1 time: 0.389290 Oct 02 01:16:14.701386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1686/3525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:14 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:14.990752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:14.993033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:15.012913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.013751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.014304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:15.023840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.024616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.025919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:15.398870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:15.425513 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b13b14f3-0652-4562-bd0d-e31a27a5a3ab tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.452725 Oct 02 01:16:15.446927 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1687/3526] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:14 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:15.485378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:15.486318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:15.494251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d89d3f45-3fa7-4c99-b162-88dc8f4ffbbb tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb880552d30>, body: {"keypair": {"name": "tempest-keypair-105012870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBkyeBPJ83hZsQBzdtI8Pxx6uKCtXdCnz7Ao/JOzp9Taq1V1NtylMmkemkCRqTEPvBpMlM4qmeOUuvm43zQtUQKh97OAfYshCX8guyVXGQVVUPuQnMHyagJspJRPfuJ+g=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:15.503753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.504511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.538049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d89d3f45-3fa7-4c99-b162-88dc8f4ffbbb tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:15.538536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:15.541404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.550684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.550905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d89d3f45-3fa7-4c99-b162-88dc8f4ffbbb tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:15.552309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:15.615266 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d89d3f45-3fa7-4c99-b162-88dc8f4ffbbb tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.637234 Oct 02 01:16:15.616664 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1840/3527] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 657 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:16:15.741541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5064c87b-57da-43e7-809a-08784195f828 req-d5eb6e13-4efe-451c-8e24-e26d1f45b499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a044d2-dc3a-4f9e-adf0-d6bf84390331", "name": "network-vif-deleted", "tag": "3575149c-4688-4fbc-bc87-4ad9a743f27f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:15.768313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5064c87b-57da-43e7-809a-08784195f828 req-d5eb6e13-4efe-451c-8e24-e26d1f45b499 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.768889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5064c87b-57da-43e7-809a-08784195f828 req-d5eb6e13-4efe-451c-8e24-e26d1f45b499 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.769346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5064c87b-57da-43e7-809a-08784195f828 req-d5eb6e13-4efe-451c-8e24-e26d1f45b499 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:15.800379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5064c87b-57da-43e7-809a-08784195f828 req-d5eb6e13-4efe-451c-8e24-e26d1f45b499 service nova] Creating event network-vif-deleted:3575149c-4688-4fbc-bc87-4ad9a743f27f for instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 on n-h2-master-1 Oct 02 01:16:15.811507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5064c87b-57da-43e7-809a-08784195f828 req-d5eb6e13-4efe-451c-8e24-e26d1f45b499 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193681 Oct 02 01:16:15.816398 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1841/3528] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:15.828841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-122e7813-e9fc-4d5f-a2a6-7bf7dcc024f5 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb880a29a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:15.852654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-122e7813-e9fc-4d5f-a2a6-7bf7dcc024f5 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-105012870" status: 200 len: 512 microversion: 2.2 time: 0.035025 Oct 02 01:16:15.855754 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1842/3529] 10.222.0.23 () {60 vars in 1255 bytes} [Sun Oct 2 01:16:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-105012870 => generated 512 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:15.864773 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:15.876168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:15.891225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.892210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.892847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:15.893750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:15.896064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:15.898041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:16.007420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:16.008165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:16.009146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:16.010373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'fault' on Instance uuid 20a044d2-dc3a-4f9e-adf0-d6bf84390331 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:16.048697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:16.067149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7dfbe66-ad6e-43c0-a594-41e3dd358e8b tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.612685 Oct 02 01:16:16.086326 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1688/3530] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:15 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:16.093438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20cbc406-6edc-41df-ada4-f68ea8706d2b tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb88113db80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.097385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:16.109708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6828cbc0-614b-4339-a091-b24c2bce16db tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 200 len: 1311 microversion: 2.1 time: 0.252789 Oct 02 01:16:16.110316 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1843/3531] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:15 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:16.125778 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20cbc406-6edc-41df-ada4-f68ea8706d2b tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105012870" status: 204 len: 0 microversion: 2.2 time: 0.036817 Oct 02 01:16:16.132846 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1689/3532] 10.222.0.23 () {60 vars in 1258 bytes} [Sun Oct 2 01:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105012870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:16.147835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41a7d5a8-5ba5-4da3-88ca-4c6385899cdd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb880547940>, body: {"keypair": {"name": "tempest-keypair-1928277395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErae4Pp390lFanD50r2YbgDR82OI5Q733iQ7CMfcRDwxKsn2Yo679sA9paJCU7vMyHUArmcJhkE37oavTy7ChzzxKfyfA0O9Ys2x4R5zX3Z1fophXo+PTxndt4NFideng=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:16.166327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-41a7d5a8-5ba5-4da3-88ca-4c6385899cdd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:16.172247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-41a7d5a8-5ba5-4da3-88ca-4c6385899cdd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:16.207010 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41a7d5a8-5ba5-4da3-88ca-4c6385899cdd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.064500 Oct 02 01:16:16.213647 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1844/3533] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:16:16.232951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0ec548f0-6747-4af6-aa7b-6e2235fbcffc tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb8856c5310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.266558 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0ec548f0-6747-4af6-aa7b-6e2235fbcffc tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928277395" status: 204 len: 0 microversion: 2.2 time: 0.045283 Oct 02 01:16:16.268931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1690/3534] 10.222.0.23 () {60 vars in 1261 bytes} [Sun Oct 2 01:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928277395 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:16.282436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1673559f-748b-42ae-896e-10fbef1f291c tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb8804f88b0>, body: {"keypair": {"name": "tempest-keypair-424390665", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:16.312704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1673559f-748b-42ae-896e-10fbef1f291c tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:16.322056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1673559f-748b-42ae-896e-10fbef1f291c tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:16.359058 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1673559f-748b-42ae-896e-10fbef1f291c tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.082922 Oct 02 01:16:16.360086 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1845/3535] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:16:16.377636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1ad7572-5ca2-4312-9b05-e2902b0c3280 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb88128eaf0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.418835 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1ad7572-5ca2-4312-9b05-e2902b0c3280 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424390665" status: 204 len: 0 microversion: 2.2 time: 0.051055 Oct 02 01:16:16.430062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1691/3536] 10.222.0.23 () {60 vars in 1258 bytes} [Sun Oct 2 01:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424390665 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:16.436641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8b9d1f68-bbf9-42b1-a7c3-538fa29afcf1 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb880529820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1069616130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVtD2aWMfkKRjlnQh3lkYlES4zzhePuv1TzHQadBtrjSk6ZpskffODwz2thqhR68+0fz4tU7CNilGmP5gttaVE5NKnDGSaXXd++QusYPY1H51iCWCWu2up2FlOc3lwq9A=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:16.454388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.455003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:16.462160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8b9d1f68-bbf9-42b1-a7c3-538fa29afcf1 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:16.462560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:16.468630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:16.469094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:16.469917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:16.471136 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:16.472484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:16.472915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8b9d1f68-bbf9-42b1-a7c3-538fa29afcf1 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:16.473037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:16.487968 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:16.524173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8b9d1f68-bbf9-42b1-a7c3-538fa29afcf1 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.092855 Oct 02 01:16:16.525957 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1846/3537] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 02 01:16:16.541923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89b3b79f-9379-4d7f-893f-e9ce27b2dfd0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb8804e2b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2076084901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnumUKes+4zDmJfKtjBH5tpOOqUze0IDOAVEfQvJ8P9e7LQ7AA2jZEgT/CWv9gDaF+AZLtHcANqNYAOzqBfB+LEBesTeafTo4H+psFBIHquCfdazYTcqaWQTAErmdEdHg=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:16.561895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-89b3b79f-9379-4d7f-893f-e9ce27b2dfd0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:16.571569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-89b3b79f-9379-4d7f-893f-e9ce27b2dfd0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:16.602498 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89b3b79f-9379-4d7f-893f-e9ce27b2dfd0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.066711 Oct 02 01:16:16.603812 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1847/3538] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:16:16.620716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6db194e6-f944-43cf-ac3b-31cf2e3ffe1a tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb8804fa310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1841040190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRXiVbHNEF5GOpDtRJQlK50k3fLjQFW5sas4CT0mhNkcFyPPTZXrE3pKXhVvR5TNVY6yP2UAvwjQOa5z8adLKL/MsQN+qrAX9jW64h+1qc7TTYaCfVuDtpIWZBg8dhqyQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:16.640756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-6db194e6-f944-43cf-ac3b-31cf2e3ffe1a tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:16.648272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-6db194e6-f944-43cf-ac3b-31cf2e3ffe1a tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:16.683462 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6db194e6-f944-43cf-ac3b-31cf2e3ffe1a tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.069164 Oct 02 01:16:16.684626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1848/3539] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:16:16.703208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-14b7cbc3-54fc-417c-b43b-4727d30212b0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb8804e2ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.712445 n-d-master-1 devstack@n-api.service[122355]: WARNING oslo_db.sqlalchemy.utils [None req-14b7cbc3-54fc-417c-b43b-4727d30212b0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 02 01:16:16.726785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-14b7cbc3-54fc-417c-b43b-4727d30212b0 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.029313 Oct 02 01:16:16.733578 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1849/3540] 10.222.0.23 () {60 vars in 1177 bytes} [Sun Oct 2 01:16:16 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:16.745589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-49dbd110-df7a-464b-af8f-03466a681c57 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb880a29790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.775728 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-49dbd110-df7a-464b-af8f-03466a681c57 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1841040190" status: 204 len: 0 microversion: 2.2 time: 0.034654 Oct 02 01:16:16.777380 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1850/3541] 10.222.0.23 () {60 vars in 1321 bytes} [Sun Oct 2 01:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1841040190 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:16:16.789710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58333a70-6a29-4c34-bb10-e674f463f037 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb880931b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.835049 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58333a70-6a29-4c34-bb10-e674f463f037 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2076084901" status: 204 len: 0 microversion: 2.2 time: 0.052548 Oct 02 01:16:16.838400 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1851/3542] 10.222.0.23 () {60 vars in 1321 bytes} [Sun Oct 2 01:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2076084901 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:16.855481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20a2bc5f-eb42-461b-bb2a-6046ce3db1d6 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb88055bca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.879579 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20a2bc5f-eb42-461b-bb2a-6046ce3db1d6 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1069616130" status: 204 len: 0 microversion: 2.2 time: 0.036517 Oct 02 01:16:16.889230 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1852/3543] 10.222.0.23 () {60 vars in 1321 bytes} [Sun Oct 2 01:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1069616130 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:16:16.894461 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cb68cd6-cd58-4f01-a607-e7f3961d16fd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb8804f8f70>, body: {"keypair": {"name": "tempest-keypair-2027071925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4YrIjMMc9kYGorN3aKRW3zy+qjv19K0IaPN4rX5K3tHcgn1SzsuKVJ9vJK/p3/e17Spd7YSoYL10O7J6rZgMAmbGON9OzBOQaNkvjGutHX27nNVog4KAvElUjma1iGfw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:16.911124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:16.914371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2cb68cd6-cd58-4f01-a607-e7f3961d16fd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:16.922237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2cb68cd6-cd58-4f01-a607-e7f3961d16fd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:16.923969 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e39ebfb0-bfbf-48d7-860e-6f9166bb1a7c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.473429 Oct 02 01:16:16.925193 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1692/3544] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:16 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:16.955943 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2cb68cd6-cd58-4f01-a607-e7f3961d16fd tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.065525 Oct 02 01:16:16.956843 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1853/3545] 10.222.0.23 () {62 vars in 1199 bytes} [Sun Oct 2 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 02 01:16:16.984785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d52eada-cdd1-4892-8f72-4111ad9ee3c7 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb88176ef70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:16.994829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d52eada-cdd1-4892-8f72-4111ad9ee3c7 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-2027071925" status: 200 len: 513 microversion: 2.2 time: 0.014028 Oct 02 01:16:16.996036 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1693/3546] 10.222.0.23 () {60 vars in 1258 bytes} [Sun Oct 2 01:16:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2027071925 => generated 513 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:17.007535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b30255a6-3b8c-4289-8d2a-16d3b6cbdc89 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb8804fa310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.011641 n-d-master-1 devstack@n-api.service[122355]: WARNING oslo_db.sqlalchemy.utils [None req-b30255a6-3b8c-4289-8d2a-16d3b6cbdc89 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 02 01:16:17.017074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b30255a6-3b8c-4289-8d2a-16d3b6cbdc89 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.013751 Oct 02 01:16:17.024077 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1854/3547] 10.222.0.23 () {60 vars in 1177 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:17.029721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d086ccf-a5fc-4302-8bb7-81e9365fe914 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb88128ea60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.048836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-363234ff-8949-439b-b5e8-55aa53227e6e req-ef36df41-da32-4881-ac2d-e45dead2bfaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf09edc9-4504-43ed-b620-b486973a5b17", "tag": "c6e83061-1ec1-4260-bd91-976d1e67c214"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:17.055713 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d086ccf-a5fc-4302-8bb7-81e9365fe914 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027071925" status: 204 len: 0 microversion: 2.2 time: 0.030226 Oct 02 01:16:17.056622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1694/3548] 10.222.0.23 () {60 vars in 1261 bytes} [Sun Oct 2 01:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027071925 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:16:17.064606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-363234ff-8949-439b-b5e8-55aa53227e6e req-ef36df41-da32-4881-ac2d-e45dead2bfaa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.065365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-363234ff-8949-439b-b5e8-55aa53227e6e req-ef36df41-da32-4881-ac2d-e45dead2bfaa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.066011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-363234ff-8949-439b-b5e8-55aa53227e6e req-ef36df41-da32-4881-ac2d-e45dead2bfaa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:17.067614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Action: 'create', calling method: .version_select at 0x7fb88566eb80>, body: {"keypair": {"name": "tempest-keypair-1625882036", "type": "x509"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:17.078458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-363234ff-8949-439b-b5e8-55aa53227e6e req-ef36df41-da32-4881-ac2d-e45dead2bfaa service nova] Creating event network-changed:c6e83061-1ec1-4260-bd91-976d1e67c214 for instance bf09edc9-4504-43ed-b620-b486973a5b17 on n-h1-master-1 Oct 02 01:16:17.085374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-363234ff-8949-439b-b5e8-55aa53227e6e req-ef36df41-da32-4881-ac2d-e45dead2bfaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039724 Oct 02 01:16:17.087004 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1855/3549] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:16:17.092706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.093739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:17.094432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:17.104418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.105141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.105984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:17.106974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.107094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:17.108110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.108776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:17.145402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.processutils [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp7s87youa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7s87youa/temp.key -subj /CN=52f506d959b44a29b6bffb72566a7c03 -extensions v3_req_client {{(pid=122354) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 02 01:16:17.286216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.processutils [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp7s87youa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7s87youa/temp.key -subj /CN=52f506d959b44a29b6bffb72566a7c03 -extensions v3_req_client" returned: 0 in 0.140s {{(pid=122354) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 02 01:16:17.289670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.processutils [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp7s87youa/temp.key -password pass: {{(pid=122354) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 02 01:16:17.333245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.processutils [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp7s87youa/temp.key -password pass:" returned: 0 in 0.043s {{(pid=122354) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 02 01:16:17.387532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:17.399023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6943c46d-ec67-4cae-9cdc-e83b77d28cf5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.310378 Oct 02 01:16:17.399531 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1856/3550] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:17.409844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.410694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:17.426001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.426669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.427083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:17.428185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.428831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.429234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:17.441334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:17.450914 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 HTTP/1.1 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '20a044d2-dc3a-4f9e-adf0-d6bf84390331'} Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:17.453388 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:17.457832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:17.458383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Getting quotas for user 52f506d959b44a29b6bffb72566a7c03 and project f1abef7656444b029fc945e0b6e134e0. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:17.458479 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eec00e8c-9c52-46f3-b2f0-986a9def7bd1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 404 len: 111 microversion: 2.1 time: 0.052056 Oct 02 01:16:17.458479 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1857/3551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:17.469396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d350951b-f944-40e0-8af0-68d350ed01c4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: .version_select at 0x7fb88055b550>, body: {"keypair": {"name": "tempest-key-1805721278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkxZ76VT3/eD1gy50gZ+A23r6oAEVhoMFn75ulAJ/FKnpD9VM+jUAowFf3asIF1PrupkICj/7CE0ZF+vFYXW/npA8tqUf5cjfw/NIK4OG0YzLB+HClB8zSyVN7pWgjrEw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:17.494266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d350951b-f944-40e0-8af0-68d350ed01c4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:17.499168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8403370b-965e-45d4-9a07-a82caa704208 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.436309 Oct 02 01:16:17.503842 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1695/3552] 10.222.0.23 () {62 vars in 1198 bytes} [Sun Oct 2 01:16:17 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 442 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:17.508719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d350951b-f944-40e0-8af0-68d350ed01c4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:17.522260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5660473-5820-480f-b635-36abbe47cf14 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb8856930d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.549413 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5660473-5820-480f-b635-36abbe47cf14 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1625882036" status: 200 len: 1534 microversion: 2.2 time: 0.039508 Oct 02 01:16:17.551336 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1696/3553] 10.222.0.23 () {60 vars in 1258 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1625882036 => generated 1534 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:17.553168 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d350951b-f944-40e0-8af0-68d350ed01c4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.087555 Oct 02 01:16:17.554334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1858/3554] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:16:17 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:17.564785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8afca158-88ec-4483-982c-68abef3c6ad4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '.version_select at 0x7fb88566e0d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.566128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa4820ec-58e7-4683-a7a2-e08c93a2abae tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb88055b8b0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.575198 n-d-master-1 devstack@n-api.service[122354]: WARNING oslo_db.sqlalchemy.utils [None req-8afca158-88ec-4483-982c-68abef3c6ad4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 02 01:16:17.579901 n-d-master-1 devstack@n-api.service[122355]: WARNING oslo_db.sqlalchemy.utils [None req-fa4820ec-58e7-4683-a7a2-e08c93a2abae tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 02 01:16:17.590075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8afca158-88ec-4483-982c-68abef3c6ad4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.027639 Oct 02 01:16:17.590308 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa4820ec-58e7-4683-a7a2-e08c93a2abae tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.029397 Oct 02 01:16:17.591457 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1859/3555] 10.222.0.23 () {60 vars in 1177 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:17.592196 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1697/3556] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:17.610318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da732369-a4a0-494c-a020-72855e190615 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] Calling method '.version_select at 0x7fb880a29430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.638136 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da732369-a4a0-494c-a020-72855e190615 tempest-KeyPairsV22TestJSON-1350722355 tempest-KeyPairsV22TestJSON-1350722355-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625882036" status: 204 len: 0 microversion: 2.2 time: 0.030167 Oct 02 01:16:17.640128 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1860/3557] 10.222.0.23 () {60 vars in 1261 bytes} [Sun Oct 2 01:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625882036 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:17.783702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-65358575", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-key-1805721278", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:17.931020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:17.948616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:17.949380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:17.960017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.963294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.964797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:17.968160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:17.968867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:17.969564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:18.719911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:18.735024 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9758f325-702d-4aa9-8d94-9c94c4f4fbca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.790501 Oct 02 01:16:18.752694 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1861/3558] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:17 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:18.761961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:18.763337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:18.775280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:18.778977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:18.779693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:18.781605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:18.783497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:18.784338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:18.833196 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:19.234344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:19.252664 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e8624c94-5ef1-462a-97a5-6a79ea40c110 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.498517 Oct 02 01:16:19.254358 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1862/3559] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:18 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:19.494313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:19.494962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:19.495444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:19.495849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:19.496483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:19.510416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:19.510968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:19.511618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:19.512564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:19.513180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:19.513759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:19.533936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:19.540229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:19.580200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:16:19.583285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:16:19.642786 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:19.691826 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d900412b-9bc7-470d-8399-069b82f559b4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.914778 Oct 02 01:16:19.708289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbaec093-9dc9-4122-8957-2d6e07acea20 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:19.709489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbaec093-9dc9-4122-8957-2d6e07acea20 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:19.713308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1698/3560] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:16:19.761969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:19.762626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:19.775925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:19.776426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:19.780574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:19.784427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:19.785330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:19.786138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:19.970096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbaec093-9dc9-4122-8957-2d6e07acea20 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:19.978453 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbaec093-9dc9-4122-8957-2d6e07acea20 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1227 microversion: 2.1 time: 0.274443 Oct 02 01:16:19.979130 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1863/3561] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:19 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1227 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:20.267369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:20.277475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:20.278934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:20.285338 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd19b694-3e9b-4626-a010-59e1a1a0504b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.527209 Oct 02 01:16:20.285950 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1699/3562] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:19 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:20.288844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:20.289334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:20.289775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:20.290476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:20.298791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:20.299438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:20.661969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:20.698955 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aa4e1c17-d0cb-4c20-88ea-d3b0cbc4c443 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.422544 Oct 02 01:16:20.702937 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1864/3563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:20 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:21.007791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:21.009170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:21.023121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:21.025082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:21.026655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:21.027983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:21.029021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:21.029803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:21.284731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:21.295730 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d2d8bf1-d4da-4d89-a1ec-dad4ef5ab23c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1279 microversion: 2.1 time: 0.292997 Oct 02 01:16:21.315600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:21.316669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:21.317169 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1700/3564] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:20 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1279 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:21.320728 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:21.334525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:21.335135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:21.341163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:21.341998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:21.342683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:21.343349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:21.663272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:21.680188 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8e4da0e-009d-424f-a38e-8aed6dcb622d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.368795 Oct 02 01:16:21.680806 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1865/3565] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:21 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:21.731738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:21.732673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:21.748359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:21.749248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:21.751476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:21.752486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:21.762017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:21.762725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:22.324145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:22.324978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:22.353778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:22.355927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:22.357809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:22.359963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:22.360628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:22.363979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:22.468462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:22.483216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f438230-f579-411a-a7eb-78509beb72c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.757034 Oct 02 01:16:22.485600 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1701/3566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:21 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:22.541515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:22.562876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c4d40dd1-6659-4eb4-a5fc-74b36240dc0a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1285 microversion: 2.1 time: 0.241211 Oct 02 01:16:22.574070 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1866/3567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:22 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:22.712205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:22.712837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:22.725518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:22.731925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:22.732669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:22.735221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:22.739615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:22.742249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:23.515873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:23.516491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:23.531647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:23.532612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:23.533237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:23.534183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:23.534857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:23.536080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:24.651667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:24.664526 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b96f46ca-8150-4b48-9764-d6709dd353e2 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 1.957657 Oct 02 01:16:24.668268 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1702/3568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:22 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:24.696900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:24.700143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:24.721691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:24.723193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:24.727426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:24.728662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:24.729343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:24.729997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:24.806864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:24.820674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5a7151b-50a3-409d-abc3-7a4cd984823e tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 1.310234 Oct 02 01:16:24.821692 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1867/3569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:23 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:25.150441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:25.175021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e998f263-5def-4085-af29-1ddd5a6ebdde tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1327 microversion: 2.1 time: 0.496912 Oct 02 01:16:25.177510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1703/3570] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:24 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1327 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:25.696275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:25.697532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:25.705225 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:25.708155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:25.711373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:25.711918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:25.712754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:25.716220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:25.716775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:25.855774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:25.856689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:25.871923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:25.872414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:25.874566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:25.878442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:25.880018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:25.882242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:26.361997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:26.379407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e8e68e3-0c20-4443-8dd5-c69a940bd6e1 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.687907 Oct 02 01:16:26.380698 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1868/3571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:25 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:26.386150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:26.387105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:26.399161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:26.411445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:26.412849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:26.413955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:26.414791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:26.415485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:26.419414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:26.445759 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b1da93b-1603-4f4e-aaa2-97753803fd76 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.602305 Oct 02 01:16:26.446745 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1704/3572] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:25 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:26.917682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:26.932030 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-03474256-f1fb-4271-85b7-ca517cfdbc39 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1327 microversion: 2.1 time: 0.549429 Oct 02 01:16:26.937760 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1869/3573] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:26 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1327 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:27.048022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e632ee96-dc09-48a5-9e70-7e7b5dd6c878 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8811eee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-623691609", "description": "tempest-description-1911915182"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:27.140571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d0627b37-54dc-4fba-8813-fa21bf9efb64 req-bdf5fc7d-17d5-4a6a-ada8-6da54cca9100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf09edc9-4504-43ed-b620-b486973a5b17", "name": "network-vif-plugged", "status": "completed", "tag": "c6e83061-1ec1-4260-bd91-976d1e67c214"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:27.161301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d0627b37-54dc-4fba-8813-fa21bf9efb64 req-bdf5fc7d-17d5-4a6a-ada8-6da54cca9100 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:27.163859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d0627b37-54dc-4fba-8813-fa21bf9efb64 req-bdf5fc7d-17d5-4a6a-ada8-6da54cca9100 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:27.166581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d0627b37-54dc-4fba-8813-fa21bf9efb64 req-bdf5fc7d-17d5-4a6a-ada8-6da54cca9100 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:27.192614 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d0627b37-54dc-4fba-8813-fa21bf9efb64 req-bdf5fc7d-17d5-4a6a-ada8-6da54cca9100 service nova] Creating event network-vif-plugged:c6e83061-1ec1-4260-bd91-976d1e67c214 for instance bf09edc9-4504-43ed-b620-b486973a5b17 on n-h1-master-1 Oct 02 01:16:27.201384 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d0627b37-54dc-4fba-8813-fa21bf9efb64 req-bdf5fc7d-17d5-4a6a-ada8-6da54cca9100 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064030 Oct 02 01:16:27.202657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1870/3574] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:16:27.256949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:27.260141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:27.267796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:27.268557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:27.269202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:27.270261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:27.270913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:27.272090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:27.505425 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1d5599e9-7b8d-46a0-b024-d658a5a46e6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.260159 Oct 02 01:16:27.508001 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1871/3575] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:16:27 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:16:27.524127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:27.525399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:27.543552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:27.544699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:27.545399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:27.546487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:27.547182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:27.547820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:28.104235 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e632ee96-dc09-48a5-9e70-7e7b5dd6c878 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.294954 Oct 02 01:16:28.107036 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1705/3576] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:16:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:16:28.125621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:28.126995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:28.160628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:28.161464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:28.164549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:28.165513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:28.166141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:28.182641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:28.732381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:28.745028 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ab90a2f-6152-477b-a2f4-381dc09ef089 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1315 microversion: 2.1 time: 0.634880 Oct 02 01:16:28.745642 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1706/3577] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:28 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:28.758072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:28.762260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:28.791261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:28.793795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:28.794276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:28.798235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:28.798796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:28.799244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:29.374558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:29.386886 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5412454-dc8b-4b38-b10f-998c5810fcc5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 1.876638 Oct 02 01:16:29.388090 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1872/3578] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:27 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:29.392992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-082d7030-e685-4aa9-a813-728beb482051 req-a846f4c5-93fe-42f7-83dc-ee347e7837ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3049e07a-5840-473e-8046-e9820c95f991", "tag": "d5b452f2-aef9-4c0e-a573-08097fb3be15"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:29.405119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-082d7030-e685-4aa9-a813-728beb482051 req-a846f4c5-93fe-42f7-83dc-ee347e7837ee service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:29.405794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-082d7030-e685-4aa9-a813-728beb482051 req-a846f4c5-93fe-42f7-83dc-ee347e7837ee service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:29.406376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-082d7030-e685-4aa9-a813-728beb482051 req-a846f4c5-93fe-42f7-83dc-ee347e7837ee service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:29.427466 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-082d7030-e685-4aa9-a813-728beb482051 req-a846f4c5-93fe-42f7-83dc-ee347e7837ee service nova] Creating event network-changed:d5b452f2-aef9-4c0e-a573-08097fb3be15 for instance 3049e07a-5840-473e-8046-e9820c95f991 on n-h2-master-1 Oct 02 01:16:29.432651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-082d7030-e685-4aa9-a813-728beb482051 req-a846f4c5-93fe-42f7-83dc-ee347e7837ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043121 Oct 02 01:16:29.433336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1873/3579] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:29.443232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:29.445141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:29.452660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:29.455367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:29.455995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:29.458155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:29.460230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:29.460862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:29.524539 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:29.566115 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=14 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:29.978350 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=42 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:30.047820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:30.065536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff140627-50b0-45ab-adc9-45fed41c660b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1669 microversion: 2.1 time: 1.305605 Oct 02 01:16:30.066805 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1707/3580] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:28 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1669 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:30.072768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68744922-85ee-4ba0-a520-d8191dd8dd98 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8816788b0>, body: {"security_group_rule": {"parent_group_id": "8f30a84f-61a7-460e-98f1-38735fec6a64", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:30.652749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:30.661375 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f42a340-d228-419f-95ad-2da97527f065 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1327 microversion: 2.1 time: 1.226814 Oct 02 01:16:30.674623 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1874/3581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:29 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1327 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:30.732910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1026878726", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:30.804305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:31.276266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68744922-85ee-4ba0-a520-d8191dd8dd98 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.207480 Oct 02 01:16:31.277963 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1708/3582] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:31.283607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:31.284846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:31.293897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:31.294821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:31.295699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:31.296937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:31.297683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:31.298666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:31.628732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:31.639613 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b772633-70cf-43c7-ad46-22af9f91d2f0 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1503 microversion: 2.1 time: 0.360342 Oct 02 01:16:31.640301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1709/3583] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:31 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:31.645096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:31.645971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:31.661101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:31.662142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:31.663108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:31.663995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:31.664687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:31.665336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:32.093991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:32.094532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:32.095003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:32.095764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:32.096249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:32.108846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:32.109321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:32.109833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:32.110675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:32.111232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:32.112839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:32.131477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:32.139217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:32.154508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:16:32.158870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:16:32.161150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:32.173294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cba676a0-63c5-47de-a967-5cab616ca22c tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.531684 Oct 02 01:16:32.174427 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1710/3584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:31 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:32.184553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:32.187531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:32.237759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:32.246946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:32.247536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:32.248366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:32.250016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:32.250463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:32.257372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ef3547e-5c19-4309-ae64-0fdd521d210e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593191 Oct 02 01:16:32.265389 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1875/3585] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:16:32.273363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dcd431b4-f04f-4191-ba17-83de46dcd3c0 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb880736700>, body: {"security_group_rule": {"parent_group_id": "8f30a84f-61a7-460e-98f1-38735fec6a64", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:33.061985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-dcd431b4-f04f-4191-ba17-83de46dcd3c0 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: This rule already exists in group 8f30a84f-61a7-460e-98f1-38735fec6a64 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dcd431b4-f04f-4191-ba17-83de46dcd3c0 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 138 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: {"security_group_rule": {"parent_group_id": "8f30a84f-61a7-460e-98f1-38735fec6a64", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: exception: This rule already exists in group 8f30a84f-61a7-460e-98f1-38735fec6a64 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8f30a84f-61a7-460e-98f1-38735fec6a64', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 8f30a84f-61a7-460e-98f1-38735fec6a64 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 8f30a84f-61a7-460e-98f1-38735fec6a64 Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:33.064353 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 8f30a84f-61a7-460e-98f1-38735fec6a64 Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dcd431b4-f04f-4191-ba17-83de46dcd3c0 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 400 to user: This rule already exists in group 8f30a84f-61a7-460e-98f1-38735fec6a64 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dcd431b4-f04f-4191-ba17-83de46dcd3c0 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.799663 Oct 02 01:16:33.071218 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1876/3586] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:32 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 802 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:16:33.075683 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:33.086267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:33.096865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.097452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.097945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.098756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.101976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.102155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.166678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:16:33.289642 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-60de3610-8fb4-4a9e-83f0-aeef2fd197da tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 204 len: 0 microversion: 2.1 time: 0.218722 Oct 02 01:16:33.291050 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1877/3587] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:33 2022] DELETE /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:33.297789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:33.299173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:33.307075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.308057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.309046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.310067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.310876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.311579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.424883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:33.438469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c8464f6-c24c-4a30-a6db-cc0b967f098f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1674 microversion: 2.1 time: 1.258152 Oct 02 01:16:33.439197 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1711/3588] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:32 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1674 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:33.456139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:33.456776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:33.471649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.474168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.474667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.478995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.479720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.480272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.884319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:33.923182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ca6c7ed-a144-44cc-8ccc-6f52ba48ba66 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1327 microversion: 2.1 time: 0.630050 Oct 02 01:16:33.925309 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1878/3589] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:33 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1327 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:33.932307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:33.932973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:33.947907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.950332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.951138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:33.952425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:33.953800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:33.955521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:34.277677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:34.289075 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-755e47ce-2783-4c1a-8899-ec4c27e71c5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1267 microversion: 2.1 time: 0.362201 Oct 02 01:16:34.290035 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1879/3590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:33 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:34.294776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43dedc9a-8e15-4281-9d4a-89b6684ab455 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb88552e310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:34.326826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:34.338270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:34.340895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:34.345654 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb51a7f4-84a1-4d14-a159-1370767ba393 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2948 microversion: 2.32 time: 0.905246 Oct 02 01:16:34.346685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1712/3591] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:33 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2948 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:34.355143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:34.356318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:34.364049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:34.364633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:34.365152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:34.366119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:34.366800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:34.367453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:34.801699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:34.814332 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4929fa8b-7065-4305-9e23-072834f9326d tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1512 microversion: 2.1 time: 0.464217 Oct 02 01:16:34.819707 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1713/3592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:34 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:34.841048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:34.842290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:34.852594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:34.853484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:34.854333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:34.855386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:34.856103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:34.856742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:34.946777 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43dedc9a-8e15-4281-9d4a-89b6684ab455 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/666d1ef0-b9f8-40fc-b7dd-7b51d2160848" status: 202 len: 0 microversion: 2.1 time: 0.654556 Oct 02 01:16:34.948392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1880/3593] 10.222.0.23 () {58 vars in 1287 bytes} [Sun Oct 2 01:16:34 2022] DELETE /compute/v2.1/os-security-group-rules/666d1ef0-b9f8-40fc-b7dd-7b51d2160848 => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:16:34.956748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:34.957519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:34.980132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:34.981614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:34.988292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:34.989576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:34.990398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:34.992187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:35.019386 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:35.224805 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23c2ddfe-6118-4e7b-9008-de0c86b97094 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.273345 Oct 02 01:16:35.250387 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1881/3594] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:16:34 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b/os-interface => generated 1831 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:35.257225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:35.257850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:35.264801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:35.265228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:35.265695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:35.266485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:35.267205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:35.267735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:35.425367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:35.433816 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aee5d2b1-9933-491e-894b-b47ec48b2b13 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1509 microversion: 2.1 time: 0.611550 Oct 02 01:16:35.434506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1714/3595] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:34 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:35.439257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:35.439931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:35.446832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:35.447562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:35.448076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:35.449733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:35.450316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:35.450847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:36.172496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:36.181197 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ab3af09-2e72-47dd-a3eb-5ddc2e0b5033 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.929592 Oct 02 01:16:36.181783 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1882/3596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:35 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:36.186483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e303c5a0-4f8b-4c49-8d0e-697d413b13e3 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb88552e160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1691704700", "description": "tempest-description-127613413"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:36.398329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:36.411393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c969525c-9e3f-4524-8df9-b14470262ff8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1327 microversion: 2.1 time: 0.975658 Oct 02 01:16:36.429708 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1715/3597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:35 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1327 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:36.435386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:36.436558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:36.444812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:36.445761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:36.446279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:36.447324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:36.447861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:36.448523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:36.467250 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:36.597792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:36.609401 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c443644-1d16-44f6-91a6-11ab83320be8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1273 microversion: 2.1 time: 0.178070 Oct 02 01:16:36.625485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1716/3598] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:36 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:36.642506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:36.643104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:36.651076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:36.651854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:36.652825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:36.653741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:36.654378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:36.655024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:36.937670 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e303c5a0-4f8b-4c49-8d0e-697d413b13e3 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.754725 Oct 02 01:16:36.944986 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1883/3599] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:16:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:36.954917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:36.963592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:36.973227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:36.981136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:36.981846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:36.982990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:36.983786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:36.984517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.255488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565b532318284915b742bf70ff2cb226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087deeb5d16442abaf8639044c1b1a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:37.275709 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ac8bcd3-fb35-4bec-84ee-03591c9287eb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 200 len: 1467 microversion: 2.1 time: 0.329059 Oct 02 01:16:37.276318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1884/3600] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:36 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 1467 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:37.296148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62d5e90e-c358-4027-955f-e851766b9bf7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb880931a60>, body: {"security_group_rule": {"parent_group_id": "ea863f1f-be0a-40f9-a17b-239f2be95863", "ip_protocol": "tcp", "from_port": 1949158263, "to_port": 22}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:37.415611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:37.448812 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1dbedb7f-34d1-42e1-9b1a-8ef09f8b4650 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1518 microversion: 2.1 time: 0.817569 Oct 02 01:16:37.450345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1717/3601] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:36 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1518 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:37.457698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-264471cf-144c-4763-a0ff-d46c11e614cd req-d661d44f-7e43-426d-976d-8b5d01d05da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3049e07a-5840-473e-8046-e9820c95f991", "name": "network-vif-plugged", "status": "completed", "tag": "d5b452f2-aef9-4c0e-a573-08097fb3be15"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:37.484698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-264471cf-144c-4763-a0ff-d46c11e614cd req-d661d44f-7e43-426d-976d-8b5d01d05da3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:37.485200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-264471cf-144c-4763-a0ff-d46c11e614cd req-d661d44f-7e43-426d-976d-8b5d01d05da3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:37.485693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-264471cf-144c-4763-a0ff-d46c11e614cd req-d661d44f-7e43-426d-976d-8b5d01d05da3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.516241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-264471cf-144c-4763-a0ff-d46c11e614cd req-d661d44f-7e43-426d-976d-8b5d01d05da3 service nova] Creating event network-vif-plugged:d5b452f2-aef9-4c0e-a573-08097fb3be15 for instance 3049e07a-5840-473e-8046-e9820c95f991 on n-h2-master-1 Oct 02 01:16:37.534244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-264471cf-144c-4763-a0ff-d46c11e614cd req-d661d44f-7e43-426d-976d-8b5d01d05da3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082046 Oct 02 01:16:37.553184 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1718/3602] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:37.565535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:37.566587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:37.596682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:37.598209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:37.598730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.603790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:37.606110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:37.608617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.644807 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-62d5e90e-c358-4027-955f-e851766b9bf7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Invalid port range 1949158263:22. Former value cannot be greater than the later Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62d5e90e-c358-4027-955f-e851766b9bf7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 146 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: {"security_group_rule": {"parent_group_id": "ea863f1f-be0a-40f9-a17b-239f2be95863", "ip_protocol": "tcp", "from_port": 1949158263, "to_port": 22}} Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid port range 1949158263:22. Former value cannot be greater than the later Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ea863f1f-be0a-40f9-a17b-239f2be95863', 'ip_protocol': 'tcp', 'from_port': 1949158263, 'to_port': 22}}} Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1949158263:22. Former value cannot be greater than the later Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1949158263:22. Former value cannot be greater than the later Oct 02 01:16:37.646465 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1949158263:22. Former value cannot be greater than the later Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62d5e90e-c358-4027-955f-e851766b9bf7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 400 to user: Invalid port range 1949158263:22. Former value cannot be greater than the later {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62d5e90e-c358-4027-955f-e851766b9bf7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.370480 Oct 02 01:16:37.650897 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1885/3603] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:37 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:16:37.654991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5e04c212-69c4-48fe-9345-672ef2536aed req-5fc1dbff-8a6b-4bd0-bd08-8d525a667eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf09edc9-4504-43ed-b620-b486973a5b17", "name": "network-vif-deleted", "tag": "c6e83061-1ec1-4260-bd91-976d1e67c214"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:37.689304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5e04c212-69c4-48fe-9345-672ef2536aed req-5fc1dbff-8a6b-4bd0-bd08-8d525a667eca service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:37.690057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5e04c212-69c4-48fe-9345-672ef2536aed req-5fc1dbff-8a6b-4bd0-bd08-8d525a667eca service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:37.690719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5e04c212-69c4-48fe-9345-672ef2536aed req-5fc1dbff-8a6b-4bd0-bd08-8d525a667eca service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.704407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5e04c212-69c4-48fe-9345-672ef2536aed req-5fc1dbff-8a6b-4bd0-bd08-8d525a667eca service nova] Creating event network-vif-deleted:c6e83061-1ec1-4260-bd91-976d1e67c214 for instance bf09edc9-4504-43ed-b620-b486973a5b17 on n-h1-master-1 Oct 02 01:16:37.712765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5e04c212-69c4-48fe-9345-672ef2536aed req-5fc1dbff-8a6b-4bd0-bd08-8d525a667eca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062568 Oct 02 01:16:37.713758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1886/3604] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:37.719534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:37.720312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:37.729114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:37.729680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:37.730188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.730993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:37.731518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:37.732009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:37.862032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:37.870877 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27d0ee04-aa17-4fac-9094-46834f9f3567 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1273 microversion: 2.1 time: 0.155815 Oct 02 01:16:37.871781 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1887/3605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:37 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:37.883036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f10b4bf7-cb9e-4d88-86f1-9d2ae2c52df7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8804bc5e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-261795444", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:37.885420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f10b4bf7-cb9e-4d88-86f1-9d2ae2c52df7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Security group id should be uuid Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f10b4bf7-cb9e-4d88-86f1-9d2ae2c52df7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 130 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-261795444", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: exception: Security group id should be uuid Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-261795444', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:37.887411 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:37.891601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 02 01:16:37.891601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:37.893148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f10b4bf7-cb9e-4d88-86f1-9d2ae2c52df7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 400 to user: Security group id should be uuid {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:37.894086 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f10b4bf7-cb9e-4d88-86f1-9d2ae2c52df7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015230 Oct 02 01:16:37.895063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1888/3606] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:37 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:37.904315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c620d14-4af7-452c-89fe-9fae936c7b90 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb881210820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-463573334", "description": "tempest-description-644831357"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.076186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:38.085908 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f56e42e-933c-457f-9a79-b08435ff4e04 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1327 microversion: 2.1 time: 0.529371 Oct 02 01:16:38.086589 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1719/3607] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:37 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1327 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:38.299726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:38.300288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:38.313264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.313773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.314364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.315366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.315834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.316425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.339669 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 HTTP/1.1 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: exception: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bf09edc9-4504-43ed-b620-b486973a5b17'} Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.343544 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.348627 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.352272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.354236 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fcb9afe4-e806-4180-99f2-9064ed484278 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 404 len: 111 microversion: 2.1 time: 0.057980 Oct 02 01:16:38.355227 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1720/3608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:38 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:38.369202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-677883699", "metadata": {"image_type": "test"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.379071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:38.391044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.391858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.394338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.395342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.397848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.398504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.418175 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17/action HTTP/1.1 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 111 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-677883699", "metadata": {"image_type": "test"}}} Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: exception: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bf09edc9-4504-43ed-b620-b486973a5b17', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-677883699', 'metadata': {'image_type': 'test'}}}} Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:16:38.423099 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7173ba5-cd8f-45ed-9a60-5591f2fd2aeb tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "POST /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17/action" status: 404 len: 111 microversion: 2.1 time: 0.062682 Oct 02 01:16:38.427215 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1721/3609] 10.222.0.23 () {60 vars in 1279 bytes} [Sun Oct 2 01:16:38 2022] POST /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:38.449983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c30b2568-d9d2-4275-a1ea-af70d4dd07d5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1480829387", "metadata": {"image_type": "test"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.454033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c30b2568-d9d2-4275-a1ea-af70d4dd07d5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Failed to fetch instance by id tempest-invalid-664286238 {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:16:38.455420 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c30b2568-d9d2-4275-a1ea-af70d4dd07d5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance tempest-invalid-664286238 could not be found. Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c30b2568-d9d2-4275-a1ea-af70d4dd07d5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/tempest-invalid-664286238/action HTTP/1.1 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 112 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1480829387", "metadata": {"image_type": "test"}}} Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: exception: Instance tempest-invalid-664286238 could not be found. Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'tempest-invalid-664286238', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1480829387', 'metadata': {'image_type': 'test'}}}} Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-664286238 could not be found. Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.458285 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-664286238 could not be found. Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-664286238 could not be found. Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c30b2568-d9d2-4275-a1ea-af70d4dd07d5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance tempest-invalid-664286238 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c30b2568-d9d2-4275-a1ea-af70d4dd07d5 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-664286238/action" status: 404 len: 100 microversion: 2.1 time: 0.029151 Oct 02 01:16:38.463359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1722/3610] 10.222.0.23 () {60 vars in 1246 bytes} [Sun Oct 2 01:16:38 2022] POST /compute/v2.1/servers/tempest-invalid-664286238/action => generated 100 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:16:38.472782 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d53bde73-120a-47c3-be39-b14553e8e428 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1945865732"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.480362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d53bde73-120a-47c3-be39-b14553e8e428 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:16:38.481143 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d53bde73-120a-47c3-be39-b14553e8e428 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d53bde73-120a-47c3-be39-b14553e8e428 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 57 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: {"createImage": {"name": "tempest-test-snap-1945865732"}} Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1945865732'}}} Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.483439 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.487846 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.491481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d53bde73-120a-47c3-be39-b14553e8e428 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.492603 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d53bde73-120a-47c3-be39-b14553e8e428 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025061 Oct 02 01:16:38.493431 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1723/3611] 10.222.0.23 () {60 vars in 1275 bytes} [Sun Oct 2 01:16:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:16:38.499620 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c620d14-4af7-452c-89fe-9fae936c7b90 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.599113 Oct 02 01:16:38.502414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:38.503436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:38.509618 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1889/3612] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:16:37 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:38.512147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.512752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.513315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.514107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.514662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.515168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.517097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8ec9e7f-cb80-4cb7-b8e3-fdb385679d68 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-249792958"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.523440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8ec9e7f-cb80-4cb7-b8e3-fdb385679d68 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:16:38.524060 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a8ec9e7f-cb80-4cb7-b8e3-fdb385679d68 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8ec9e7f-cb80-4cb7-b8e3-fdb385679d68 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 56 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: {"createImage": {"name": "tempest-test-snap-249792958"}} Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-249792958'}}} Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.529167 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.534397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8ec9e7f-cb80-4cb7-b8e3-fdb385679d68 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.537130 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8ec9e7f-cb80-4cb7-b8e3-fdb385679d68 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.024683 Oct 02 01:16:38.537130 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1890/3613] 10.222.0.23 () {60 vars in 1281 bytes} [Sun Oct 2 01:16:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:38.546429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66979014-b90c-40d4-9d14-c73dfc9871b7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8804fadc0>, body: {"security_group_rule": {"parent_group_id": "6b5ec81b-8da0-4223-9d07-e50b3ef04d66", "ip_protocol": "tempest-999-1308771459", "from_port": 22, "to_port": 22}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.767369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-66979014-b90c-40d4-9d14-c73dfc9871b7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Invalid IP protocol tempest-999-1308771459. Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66979014-b90c-40d4-9d14-c73dfc9871b7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 157 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: {"security_group_rule": {"parent_group_id": "6b5ec81b-8da0-4223-9d07-e50b3ef04d66", "ip_protocol": "tempest-999-1308771459", "from_port": 22, "to_port": 22}} Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid IP protocol tempest-999-1308771459. Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6b5ec81b-8da0-4223-9d07-e50b3ef04d66', 'ip_protocol': 'tempest-999-1308771459', 'from_port': 22, 'to_port': 22}}} Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1308771459. Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1308771459. Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.769009 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1308771459. Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66979014-b90c-40d4-9d14-c73dfc9871b7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 400 to user: Invalid IP protocol tempest-999-1308771459. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66979014-b90c-40d4-9d14-c73dfc9871b7 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.232104 Oct 02 01:16:38.775330 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1891/3614] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:38 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:38.779983 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:38.780558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:38.788137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.788720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.789326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.790104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.790867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.791367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.808048 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 HTTP/1.1 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: exception: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'bf09edc9-4504-43ed-b620-b486973a5b17'} Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.810003 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.814534 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.824115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.829755 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e137ff81-7045-441e-b9a8-d764310c81c7 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 404 len: 111 microversion: 2.1 time: 0.055966 Oct 02 01:16:38.838580 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1892/3615] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:38 2022] DELETE /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:38.843617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a441c8ab-dfce-45c1-8cac-69cb670b6f84 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8804fa790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2130218689", "description": "tempest-description-295353039"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:38.865795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:38.879212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4755c3a4-d3b6-4cb5-83ca-8d07b7f3a1e7 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1518 microversion: 2.1 time: 0.382386 Oct 02 01:16:38.880062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1724/3616] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:38 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1518 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:38.889020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:38.889894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] [instance: bf09edc9-4504-43ed-b620-b486973a5b17] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:38.901999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.902991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.904182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.905236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.905911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.906715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.928617 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] HTTP exception thrown: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Request method failure captured: Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 HTTP/1.1 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZYGfxnUbXH3_38M5ozJasHmlnDhI7A_lBFIzzV9oQQumj2sW3LjbFqJX9DwWvBZcH2v22lOTWmrDJKXvn7hWZLUDYibPOTdOW2ZnJKy_Xgs1hVjJTpMYQ6BvSj865jSRzo3n7dbLV7nrqnHP_ysmNztXV3jO5sn7L9IIbFeo4-C40 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/087deeb5d16442abaf8639044c1b1a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_087deeb5d16442abaf8639044c1b1a46"}]}] Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 087deeb5d16442abaf8639044c1b1a46 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658326351 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 565b532318284915b742bf70ff2cb226 Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ImagesNegativeTestJSON-658326351-project Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: exception: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bf09edc9-4504-43ed-b620-b486973a5b17'} Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:38.931239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. Oct 02 01:16:38.936287 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:38.938307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] Returning 404 to user: Instance bf09edc9-4504-43ed-b620-b486973a5b17 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:38.939561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e920048-fbab-4a45-ba78-b6ed503c1409 tempest-ImagesNegativeTestJSON-658326351 tempest-ImagesNegativeTestJSON-658326351-project] 10.222.0.23 "GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17" status: 404 len: 111 microversion: 2.1 time: 0.057048 Oct 02 01:16:38.946356 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1725/3617] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:38 2022] GET /compute/v2.1/servers/bf09edc9-4504-43ed-b620-b486973a5b17 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:38.952436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:38.953056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:38.960483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.961011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.961453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:38.962438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:38.962938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:38.963367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:39.515912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:39.526544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57983913-06b2-4b42-b233-f2b92e521e71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.578903 Oct 02 01:16:39.531340 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a441c8ab-dfce-45c1-8cac-69cb670b6f84 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.690773 Oct 02 01:16:39.532558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1893/3618] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:16:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:39.540356 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1726/3619] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:38 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:39.548151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:39.548971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:39.555553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:39.556309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:39.557759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:39.559219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:39.560201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:39.560887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:39.603446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-148178337", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "d763fc17-a2f4-4fea-baac-da2245bd8f31"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:39.686260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] validate_networks() for [('d763fc17-a2f4-4fea-baac-da2245bd8f31', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:40.278153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:40.288648 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85b85bde-d3ab-4b81-9952-eff33eca3070 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1508 microversion: 2.1 time: 0.747131 Oct 02 01:16:40.303617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1727/3620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:39 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1508 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:40.309498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-691eb81f-6031-439b-85ae-27cbf2c7ab17 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8856934c0>, body: {"security_group_rule": {"parent_group_id": "174bf18c-07d4-4513-b7ef-f0b1f9bf3c37", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:40.530743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-691eb81f-6031-439b-85ae-27cbf2c7ab17 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-691eb81f-6031-439b-85ae-27cbf2c7ab17 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 138 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: {"security_group_rule": {"parent_group_id": "174bf18c-07d4-4513-b7ef-f0b1f9bf3c37", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'security_group_rule': {'parent_group_id': '174bf18c-07d4-4513-b7ef-f0b1f9bf3c37', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 02 01:16:40.532345 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 02 01:16:40.536828 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:40.539418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-691eb81f-6031-439b-85ae-27cbf2c7ab17 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:40.540466 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-691eb81f-6031-439b-85ae-27cbf2c7ab17 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.237532 Oct 02 01:16:40.541058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1728/3621] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:40 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:16:40.546069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:40.548024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:40.556345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:40.556900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:40.557322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:40.557948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:40.558656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:40.559244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.013602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:41.026529 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2abe4d45-d6f9-45ca-b50a-3be88eb72349 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1518 microversion: 2.1 time: 0.484012 Oct 02 01:16:41.027912 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1729/3622] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:40 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1518 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:41.032971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:41.033915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:41.042546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.043442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.043845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.044752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.045226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.045662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.295701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:41.296220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:41.296664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:41.297372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:41.297850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:41.310165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.310882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.311839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.312913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.313566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.314201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.339474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Getting quotas for project 52c591d1679f478981bbe151f38dcb2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:41.345340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Getting quotas for user 39f8d72cfddb4f4c84f40e02574c3410 and project 52c591d1679f478981bbe151f38dcb2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:41.369468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:16:41.371838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:16:41.429986 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-386346ce-c188-42ad-a871-7a150b682cc0 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.895726 Oct 02 01:16:41.431006 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1894/3623] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:16:41.431612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:41.440260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3893b0ae-b848-4cc8-83b3-eb818ececaa4 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8804fa5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1869762957", "description": "tempest-description-1188885172"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:41.445788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b159a83e-3c85-4e49-b653-caab691564de tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1508 microversion: 2.1 time: 0.416545 Oct 02 01:16:41.451008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1730/3624] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:41 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:41.456365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:41.457298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:41.470593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.471441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.472096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.473041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.473709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.474421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.909574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:41.920904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f6e706f-3e81-47b4-9861-b385935f0dc5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.468539 Oct 02 01:16:41.921976 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1731/3625] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:41 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:41.926893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0ff2648a-222e-4b68-9717-ef4dd1eb9b6a req-27828ef7-d90a-41c5-a03c-c22c9bcf889f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f936fb-38a3-4baa-b74c-4cfd54e3156b", "name": "network-vif-plugged", "status": "completed", "tag": "f4f42c44-425a-4373-9d2e-f70717baa243"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:41.939123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ff2648a-222e-4b68-9717-ef4dd1eb9b6a req-27828ef7-d90a-41c5-a03c-c22c9bcf889f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.939751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ff2648a-222e-4b68-9717-ef4dd1eb9b6a req-27828ef7-d90a-41c5-a03c-c22c9bcf889f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.940148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ff2648a-222e-4b68-9717-ef4dd1eb9b6a req-27828ef7-d90a-41c5-a03c-c22c9bcf889f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.954864 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0ff2648a-222e-4b68-9717-ef4dd1eb9b6a req-27828ef7-d90a-41c5-a03c-c22c9bcf889f service nova] Creating event network-vif-plugged:f4f42c44-425a-4373-9d2e-f70717baa243 for instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b on n-h2-master-1 Oct 02 01:16:41.961866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0ff2648a-222e-4b68-9717-ef4dd1eb9b6a req-27828ef7-d90a-41c5-a03c-c22c9bcf889f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038589 Oct 02 01:16:41.963094 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1732/3626] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:41.968762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ddb4e8fd-1678-46ac-9a96-47d3e2e7a3db req-42023989-c722-4c97-a59a-0b4a4001d95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3bb7393-ea02-4ff2-a222-2d0faa65f524", "tag": "29fc7568-74ef-4951-86d2-a1bde61727f2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:41.980722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ddb4e8fd-1678-46ac-9a96-47d3e2e7a3db req-42023989-c722-4c97-a59a-0b4a4001d95f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:41.981478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ddb4e8fd-1678-46ac-9a96-47d3e2e7a3db req-42023989-c722-4c97-a59a-0b4a4001d95f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:41.981917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ddb4e8fd-1678-46ac-9a96-47d3e2e7a3db req-42023989-c722-4c97-a59a-0b4a4001d95f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:41.994783 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ddb4e8fd-1678-46ac-9a96-47d3e2e7a3db req-42023989-c722-4c97-a59a-0b4a4001d95f service nova] Creating event network-changed:29fc7568-74ef-4951-86d2-a1bde61727f2 for instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 on n-h2-master-1 Oct 02 01:16:41.999431 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ddb4e8fd-1678-46ac-9a96-47d3e2e7a3db req-42023989-c722-4c97-a59a-0b4a4001d95f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034888 Oct 02 01:16:42.000197 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1733/3627] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:42.005485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:42.006748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:42.014959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.015810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.017304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.018223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.018909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.019543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.186454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3893b0ae-b848-4cc8-83b3-eb818ececaa4 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.753700 Oct 02 01:16:42.195205 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1895/3628] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:16:41 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:42.195205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:42.195205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:42.202651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.203387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.204106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.205205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.205859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.206476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.263798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:16:42.292788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:42.302363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:42.305394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:42.306721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-34135d26-e25a-49eb-a4cf-fa9322081b7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1265 microversion: 2.26 time: 0.305161 Oct 02 01:16:42.307522 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1734/3629] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:42 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:42.312750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:42.313937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:42.323774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.326866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.329845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.331267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.332672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.339543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.449971 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-922050d2-250f-4755-8109-399359669586 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 204 len: 0 microversion: 2.1 time: 0.261394 Oct 02 01:16:42.451891 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1896/3630] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:42 2022] DELETE /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:42.458874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-700f8cae-4736-43e2-98b3-b35912a8b2d1 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb8804fa940>, body: {"security_group_rule": {"parent_group_id": "d75e7625-054d-40c6-bbdd-953aec0078fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 748958459}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:42.702646 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-700f8cae-4736-43e2-98b3-b35912a8b2d1 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Invalid port range 22:748958459. Valid TCP ports should be between 1-65535 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-700f8cae-4736-43e2-98b3-b35912a8b2d1 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 145 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: {"security_group_rule": {"parent_group_id": "d75e7625-054d-40c6-bbdd-953aec0078fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 748958459}} Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid port range 22:748958459. Valid TCP ports should be between 1-65535 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd75e7625-054d-40c6-bbdd-953aec0078fd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 748958459}}} Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:748958459. Valid TCP ports should be between 1-65535 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:748958459. Valid TCP ports should be between 1-65535 Oct 02 01:16:42.705095 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:748958459. Valid TCP ports should be between 1-65535 Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-700f8cae-4736-43e2-98b3-b35912a8b2d1 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 400 to user: Invalid port range 22:748958459. Valid TCP ports should be between 1-65535 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-700f8cae-4736-43e2-98b3-b35912a8b2d1 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.253253 Oct 02 01:16:42.711012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1897/3631] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:42 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:16:42.715053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:42.716161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:42.723731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.724469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.725753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.726874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.727510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.728312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.828528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:42.838050 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f27a8644-0b62-49c2-8471-6e28b43d2b6f tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1518 microversion: 2.1 time: 0.528183 Oct 02 01:16:42.838896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1735/3632] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:42 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1518 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:42.843635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Action: 'create', calling method: .version_select at 0x7fb88128eee0>, body: {"security_group_rule": {"parent_group_id": "735c71ae-0d62-40ab-927d-931b988ee208", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:42.942821 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:16:42.943470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Neutron security group 735c71ae-0d62-40ab-927d-931b988ee208 not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:16:42.944813 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.944813 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 138 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: {"security_group_rule": {"parent_group_id": "735c71ae-0d62-40ab-927d-931b988ee208", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: exception: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'security_group_rule': {'parent_group_id': '735c71ae-0d62-40ab-927d-931b988ee208', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:16:42.947228 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 404 to user: Security group 735c71ae-0d62-40ab-927d-931b988ee208 does not exist Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-0f8c0b9d-de70-4134-b9a7-04ed5996418a'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6dfe1851-2dbc-49c2-97d9-64333552cb93 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.108653 Oct 02 01:16:42.951607 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1736/3633] 10.222.0.23 () {60 vars in 1195 bytes} [Sun Oct 2 01:16:42 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:42.957636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:42.957636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:42.969169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.970198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.971048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:42.972023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:42.972699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:42.973328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:43.128123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:43.136277 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc53fe24-476c-4ad5-8ce2-f3d88fcc7bab tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1514 microversion: 2.1 time: 0.428024 Oct 02 01:16:43.136957 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1898/3634] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:42 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1514 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:43.141549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb8804fa820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:43.532061 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:16:43.532676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.security_group_api [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Neutron security group rule 66c1d855-a4eb-4145-b241-3305d20b084b not found {{(pid=122355) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 02 01:16:43.534283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] HTTP exception thrown: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.534283 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Request method failure captured: Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-security-group-rules/66c1d855-a4eb-4145-b241-3305d20b084b HTTP/1.1 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZqWm9nuKAPZxprvW3kOqUjYmD3Bz6fPJZJjzgfQdpPZhop_cxfqhSSjslf1G3yimfaCgmXVp4LE0smFnI_BktqtOb--xq3cc8XBTrabzXOKg0h8NVkGrahm8r1U2m9ObiKTt5l4OVbPEbrtx7ChmVbVzLdFCJnr3bm3-5qLQh4WcM Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/33dead72204946dd9bb526d037b4f0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_33dead72204946dd9bb526d037b4f0a0"}]}] Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 33dead72204946dd9bb526d037b4f0a0 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: acca7051bf9f4cae9dbd1435a08a57fd Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-154355113-project Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: exception: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '66c1d855-a4eb-4145-b241-3305d20b084b'} Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:16:43.536188 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Returning 404 to user: Security group rule 66c1d855-a4eb-4145-b241-3305d20b084b does not exist Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-2b328466-3349-478a-9707-1e1c0dcefb41'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78f41703-c4f2-4857-bd5f-9fff05b08e34 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/66c1d855-a4eb-4145-b241-3305d20b084b" status: 404 len: 199 microversion: 2.1 time: 0.399760 Oct 02 01:16:43.541422 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1899/3635] 10.222.0.23 () {58 vars in 1287 bytes} [Sun Oct 2 01:16:43 2022] DELETE /compute/v2.1/os-security-group-rules/66c1d855-a4eb-4145-b241-3305d20b084b => generated 199 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:43.545732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:43.546387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:43.554910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:43.555246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:43.555845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:43.556534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:43.556825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:43.557334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:43.687549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:43.696855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:43.698282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:43.699454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61eac92c-6ad5-4e4e-b671-732bae5c1c91 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1319 microversion: 2.26 time: 0.159699 Oct 02 01:16:43.700017 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1900/3636] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:43 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:43.704446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-19144e91-76ab-4efe-9c92-a09f02b09982 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb880547c10>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:43.714951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:43.723636 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d13dae4-2a4b-4cc6-97d1-2bc2a3c991fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.773350 Oct 02 01:16:43.724537 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1737/3637] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:42 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:43.864323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:43.864945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:43.871723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:43.872220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:43.872664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:43.873371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:43.873834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:43.874266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:44.183028 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:44.198947 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9486405c-39a3-4d60-8b03-596b64c0a021 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1518 microversion: 2.1 time: 0.338374 Oct 02 01:16:44.201040 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1738/3638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:43 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1518 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:44.208581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:44.226548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:44.236634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:44.237199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:44.237663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:44.239173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:44.239588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:44.240191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:44.280327 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-19144e91-76ab-4efe-9c92-a09f02b09982 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d75e7625-054d-40c6-bbdd-953aec0078fd" status: 202 len: 0 microversion: 2.1 time: 0.579241 Oct 02 01:16:44.281104 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1901/3639] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:16:43 2022] DELETE /compute/v2.1/os-security-groups/d75e7625-054d-40c6-bbdd-953aec0078fd => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:16:44.292387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8bf02022-9195-4801-af0b-bc33c12a5511 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb88560ed30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:44.585965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:44.598769 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba5dd5dd-2e8f-459a-8d04-3f8a81808634 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1514 microversion: 2.1 time: 0.394162 Oct 02 01:16:44.600684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1739/3640] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:44 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:44.727742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:44.728774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:44.737079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:44.737878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:44.738781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:44.739738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:44.740425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:44.741113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:44.861568 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8bf02022-9195-4801-af0b-bc33c12a5511 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/174bf18c-07d4-4513-b7ef-f0b1f9bf3c37" status: 202 len: 0 microversion: 2.1 time: 0.576368 Oct 02 01:16:44.862713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1902/3641] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:16:44 2022] DELETE /compute/v2.1/os-security-groups/174bf18c-07d4-4513-b7ef-f0b1f9bf3c37 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:16:44.869205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:44.870942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:44.884003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:44.884735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:44.885328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:44.886209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:44.887031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:44.887638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:45.045947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:45.056998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:45.058498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:45.059861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-663751cb-a8bc-43ab-945e-9033110acf86 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 0.336819 Oct 02 01:16:45.060913 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1740/3642] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:44 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:16:45.066434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4cc0c769-8429-4e6a-a876-09c455ff7725 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb881ce79d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:45.262691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:45.270686 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b8319bd-86c4-4b72-ad97-63efa5741662 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.406676 Oct 02 01:16:45.271199 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1903/3643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:44 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:45.298010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:45.299009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:45.308215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:45.309354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:45.310185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:45.311945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:45.312802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:45.313569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:45.947828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:45.964592 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbdf96fd-72d1-454e-8907-102804bde905 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1518 microversion: 2.1 time: 0.671992 Oct 02 01:16:45.966888 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1904/3644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:45 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1518 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:45.973323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:45.974260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:45.983973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:45.984713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:45.985356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:45.986571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:45.987484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:45.988249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:46.135746 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4cc0c769-8429-4e6a-a876-09c455ff7725 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6b5ec81b-8da0-4223-9d07-e50b3ef04d66" status: 202 len: 0 microversion: 2.1 time: 1.073430 Oct 02 01:16:46.137032 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1741/3645] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:16:45 2022] DELETE /compute/v2.1/os-security-groups/6b5ec81b-8da0-4223-9d07-e50b3ef04d66 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:16:46.143052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:46.144515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:46.153778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:46.154163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:46.155124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:46.156043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:46.156496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:46.157099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:46.181167 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:46.545305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:46.567991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed436c1c-98b3-47ac-a8a7-0ed952361987 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1514 microversion: 2.1 time: 0.599921 Oct 02 01:16:46.568758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1905/3646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:45 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1514 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:46.574829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-715af551-e887-4a87-8747-364e043c4a88 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb880542040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:46.752411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:46.767758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:46.770310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:46.772540 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ad1bae2-a29d-44a0-b36d-d0cf84338eb8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 0.633681 Oct 02 01:16:46.774538 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1742/3647] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:46 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:46.780425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:46.781301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:46.788864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:46.790041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:46.790974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:46.791914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:46.792620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:46.793510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:47.632324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:47.653017 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5da6f8f0-e0ea-4fc8-992b-4be119d81462 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.877031 Oct 02 01:16:47.654344 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1743/3648] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:46 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:47.673309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:47.674013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:47.691690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:47.692254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:47.695963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:47.699609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:47.703842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:47.704440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:47.839391 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-715af551-e887-4a87-8747-364e043c4a88 tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ea863f1f-be0a-40f9-a17b-239f2be95863" status: 202 len: 0 microversion: 2.1 time: 1.267937 Oct 02 01:16:47.840899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1906/3649] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:16:46 2022] DELETE /compute/v2.1/os-security-groups/ea863f1f-be0a-40f9-a17b-239f2be95863 => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:16:47.847388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:47.848298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:47.857426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:47.858535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:47.859528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:47.860532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:47.861327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:47.862279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:47.904783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:47.905329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:47.906005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:47.907192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'fault' on Instance uuid 3049e07a-5840-473e-8046-e9820c95f991 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:47.982154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:47.993819 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30b2e804-0397-4cc2-845e-4f1362b232a7 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 200 len: 1317 microversion: 2.1 time: 0.151524 Oct 02 01:16:48.006918 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1907/3650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:47 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:48.016750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4ec907f9-9100-47aa-8f6d-de13c2d66d73 req-0632d9db-4c32-44f4-84c5-011653e3fc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3049e07a-5840-473e-8046-e9820c95f991", "name": "network-vif-deleted", "tag": "d5b452f2-aef9-4c0e-a573-08097fb3be15"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:48.027771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4ec907f9-9100-47aa-8f6d-de13c2d66d73 req-0632d9db-4c32-44f4-84c5-011653e3fc67 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.028448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4ec907f9-9100-47aa-8f6d-de13c2d66d73 req-0632d9db-4c32-44f4-84c5-011653e3fc67 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.029053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4ec907f9-9100-47aa-8f6d-de13c2d66d73 req-0632d9db-4c32-44f4-84c5-011653e3fc67 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.044568 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4ec907f9-9100-47aa-8f6d-de13c2d66d73 req-0632d9db-4c32-44f4-84c5-011653e3fc67 service nova] Creating event network-vif-deleted:d5b452f2-aef9-4c0e-a573-08097fb3be15 for instance 3049e07a-5840-473e-8046-e9820c95f991 on n-h2-master-1 Oct 02 01:16:48.051332 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4ec907f9-9100-47aa-8f6d-de13c2d66d73 req-0632d9db-4c32-44f4-84c5-011653e3fc67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042467 Oct 02 01:16:48.052380 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1908/3651] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:48.060139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:48.061320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:48.071019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.071686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.072462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.073344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.074079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.074707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.154626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:48.162761 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-963748c2-26c6-4dad-a9c0-7bab0dc60839 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1503 microversion: 2.1 time: 0.506886 Oct 02 01:16:48.163379 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1744/3652] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:47 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:48.168005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc0fad0a-6268-41c8-923f-701e065194ca tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] Calling method '.version_select at 0x7fb8855044c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:48.479750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:48.489876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:48.493557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:48.495533 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0ab0aaf-599b-4387-baea-85f00e4ed96e tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 0.441593 Oct 02 01:16:48.498326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1909/3653] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:48 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:48.525767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:48.526550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:48.534124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.534795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.535362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.536241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.536866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.537357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.923420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:48.932508 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-698ebdd6-3060-43d9-8036-59e84d9b0683 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 200 len: 1503 microversion: 2.1 time: 0.419848 Oct 02 01:16:48.933103 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1910/3654] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:48 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:48.937769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:48.938375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:48.944835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.945302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.946015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.946394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc0fad0a-6268-41c8-923f-701e065194ca tempest-SecurityGroupRulesNegativeTestJSON-154355113 tempest-SecurityGroupRulesNegativeTestJSON-154355113-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8f30a84f-61a7-460e-98f1-38735fec6a64" status: 202 len: 0 microversion: 2.1 time: 0.780177 Oct 02 01:16:48.946948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.946948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.947310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.948687 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1745/3655] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:16:48 2022] DELETE /compute/v2.1/os-security-groups/8f30a84f-61a7-460e-98f1-38735fec6a64 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:16:48.956893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-127fe7a0-e003-40a2-8540-6537088bcce9 req-c10b591a-1a3a-4ed3-96b4-9bef05f0782d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bb7393-ea02-4ff2-a222-2d0faa65f524", "name": "network-vif-plugged", "status": "completed", "tag": "29fc7568-74ef-4951-86d2-a1bde61727f2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:48.972700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-127fe7a0-e003-40a2-8540-6537088bcce9 req-c10b591a-1a3a-4ed3-96b4-9bef05f0782d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:48.973776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-127fe7a0-e003-40a2-8540-6537088bcce9 req-c10b591a-1a3a-4ed3-96b4-9bef05f0782d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:48.974491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-127fe7a0-e003-40a2-8540-6537088bcce9 req-c10b591a-1a3a-4ed3-96b4-9bef05f0782d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:48.991482 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-127fe7a0-e003-40a2-8540-6537088bcce9 req-c10b591a-1a3a-4ed3-96b4-9bef05f0782d service nova] Creating event network-vif-plugged:29fc7568-74ef-4951-86d2-a1bde61727f2 for instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 on n-h2-master-1 Oct 02 01:16:48.998938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-127fe7a0-e003-40a2-8540-6537088bcce9 req-c10b591a-1a3a-4ed3-96b4-9bef05f0782d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048065 Oct 02 01:16:48.999798 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1746/3656] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:49.026505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:49.027417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:49.035676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:49.036438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:49.037114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:49.038130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:49.038858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:49.040234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:49.084899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:16:49.244886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8bfb8b2-59c5-43f4-a263-b62cff3514ca tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 204 len: 0 microversion: 2.1 time: 0.238649 Oct 02 01:16:49.245800 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1747/3657] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:48 2022] DELETE /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:49.252630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:49.253618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:49.261345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:49.262102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:49.263647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:49.264721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:49.266045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:49.266669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:49.284228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:49.298494 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 HTTP/1.1 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3049e07a-5840-473e-8046-e9820c95f991'} Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:49.301894 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:16:49.307469 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:16:49.308336 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1f9a7adf-cc6d-43e4-aa81-56bcbcc6aa37 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.367869 Oct 02 01:16:49.308336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1911/3658] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:48 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:49.310351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:49.311596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40c0ec84-60f8-40f7-8e29-f1d86529ffb1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 404 len: 111 microversion: 2.1 time: 0.064380 Oct 02 01:16:49.316290 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1748/3659] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:49 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:16:49.321569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e38a9430-2818-425c-b3d0-878b25ceb24e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '.version_select at 0x7fb880736d30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:49.336895 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:49.360888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e38a9430-2818-425c-b3d0-878b25ceb24e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1805721278" status: 202 len: 0 microversion: 2.1 time: 0.043954 Oct 02 01:16:49.373406 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1912/3660] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:16:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1805721278 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:16:49.529221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:49.530246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:49.551053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:49.552124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:49.552825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:49.554629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:49.555319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:49.555975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:49.581433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1495052259", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:49.665843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:49.934420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:49.942924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:49.944795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:49.946223 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a1fe668-0f50-493b-bf4f-77a8a0263f7a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 0.422025 Oct 02 01:16:49.964059 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1749/3661] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:49 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:49.972545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-433631431", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "5c5d890d-9575-4bd1-92a2-9257ae3243d4"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:49.993797 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:50.044766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] validate_networks() for [('5c5d890d-9575-4bd1-92a2-9257ae3243d4', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:51.145850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:51.147060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:51.147895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:51.148503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:51.149592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:51.163113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.163875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.164478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.165410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.166932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.167568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.180587 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:51.195306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:51.202451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:51.226985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:16:51.231492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:16:51.298447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d132323c-5e0c-4a6b-9949-152348de68c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721781 Oct 02 01:16:51.308137 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1913/3662] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:16:51.313420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-80df3b4f-452f-4716-83f0-d814b9d4cf07 req-9b9a8320-5b2c-430c-bcab-23a0e28bdadb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf842a78-fa66-4d09-8f89-07c72c46bbfe", "tag": "6b18801d-ebf6-465e-b88f-c7b1f79d0041"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:51.323930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-80df3b4f-452f-4716-83f0-d814b9d4cf07 req-9b9a8320-5b2c-430c-bcab-23a0e28bdadb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.324683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-80df3b4f-452f-4716-83f0-d814b9d4cf07 req-9b9a8320-5b2c-430c-bcab-23a0e28bdadb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.325296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-80df3b4f-452f-4716-83f0-d814b9d4cf07 req-9b9a8320-5b2c-430c-bcab-23a0e28bdadb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.338268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-80df3b4f-452f-4716-83f0-d814b9d4cf07 req-9b9a8320-5b2c-430c-bcab-23a0e28bdadb service nova] Creating event network-changed:6b18801d-ebf6-465e-b88f-c7b1f79d0041 for instance cf842a78-fa66-4d09-8f89-07c72c46bbfe on n-h1-master-1 Oct 02 01:16:51.358691 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-80df3b4f-452f-4716-83f0-d814b9d4cf07 req-9b9a8320-5b2c-430c-bcab-23a0e28bdadb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038555 Oct 02 01:16:51.369270 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1914/3663] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:51.374629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:51.375345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:51.391466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.391968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.392417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.393130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.393589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.394019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.471322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:16:51.473205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:16:51.473981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:16:51.474776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:16:51.475975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:16:51.493216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.499827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.500127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.501097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.501737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.502180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.566556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Getting quotas for project 53272886aeac4313b1e8ad37b6f9ff12. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:16:51.595090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Getting quotas for user 7f2fd89c34d84d77b2c0ad9d5ad45390 and project 53272886aeac4313b1e8ad37b6f9ff12. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:16:51.624813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:16:51.631160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:16:51.750814 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5319d6e-e74e-48ea-b331-1f4c29f156fc tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784512 Oct 02 01:16:51.762137 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1750/3664] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:16:51.769200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:51.770207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:51.789527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.793030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.793472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:51.794231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:51.794733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:51.795170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:52.282592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:52.293424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f74a93d7-524d-4c43-9c2d-dfc2e06f6572 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1315 microversion: 2.1 time: 0.922857 Oct 02 01:16:52.300428 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1915/3665] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:51 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:52.316386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:52.321507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:52.337828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:52.340764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:52.344162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:52.345017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:52.347669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:52.349265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:52.824696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:52.839351 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0597cae9-321a-41e0-b890-096b268283f2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1205 microversion: 2.1 time: 0.535920 Oct 02 01:16:52.840909 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1916/3666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:52 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1205 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:52.854588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:52.858019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:52.875998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:52.876729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:52.878873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:52.880626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:52.882107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:52.884282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:52.974006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:52.986364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:52.990024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:52.996367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-598298a9-7916-424d-9812-437a9f9ebad5 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 1.233002 Oct 02 01:16:52.998861 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1751/3667] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:51 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:53.184476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:53.211779 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3df83e40-dc68-4780-b50a-c2d4967ea0da tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1221 microversion: 2.1 time: 0.367613 Oct 02 01:16:53.216031 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1917/3668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:52 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1221 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:53.326467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:53.327898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:53.358009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:53.359495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:53.360196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:53.362741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:53.363665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:53.367647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:53.879763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:53.880921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:53.896407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:53.898687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:53.899347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:53.901786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:53.902422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:53.903755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.018198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:54.028797 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c6f51b32-eac1-47db-8e4f-79b609ebf79b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1267 microversion: 2.1 time: 0.168481 Oct 02 01:16:54.031607 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1918/3669] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:53 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:54.044040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2a919dfe-2ca1-4549-acfb-e792c6deafca req-b0615487-cbad-4966-b335-b0c0ea7c4b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f936fb-38a3-4baa-b74c-4cfd54e3156b", "name": "network-vif-deleted", "tag": "f4f42c44-425a-4373-9d2e-f70717baa243"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:54.071115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a919dfe-2ca1-4549-acfb-e792c6deafca req-b0615487-cbad-4966-b335-b0c0ea7c4b93 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.071861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a919dfe-2ca1-4549-acfb-e792c6deafca req-b0615487-cbad-4966-b335-b0c0ea7c4b93 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.072463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a919dfe-2ca1-4549-acfb-e792c6deafca req-b0615487-cbad-4966-b335-b0c0ea7c4b93 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.102291 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2a919dfe-2ca1-4549-acfb-e792c6deafca req-b0615487-cbad-4966-b335-b0c0ea7c4b93 service nova] Creating event network-vif-deleted:f4f42c44-425a-4373-9d2e-f70717baa243 for instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b on n-h2-master-1 Oct 02 01:16:54.112774 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2a919dfe-2ca1-4549-acfb-e792c6deafca req-b0615487-cbad-4966-b335-b0c0ea7c4b93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079617 Oct 02 01:16:54.116318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1919/3670] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:54.128209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:54.129727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:54.139593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.140101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.141055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.142124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.142830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.143426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.154431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:54.163178 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a065376d-5d89-4367-8375-012dc1569f9a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1502 microversion: 2.1 time: 0.841061 Oct 02 01:16:54.164760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1752/3671] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:53 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1502 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:54.190081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:54.190887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:54.202743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.203245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.203686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.204401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.204862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.205291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.274621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:16:54.471938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d11efc7b-e33e-4927-9a1b-4dd6070b3171 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 204 len: 0 microversion: 2.1 time: 0.279582 Oct 02 01:16:54.473253 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1753/3672] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:16:54 2022] DELETE /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:16:54.505548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:54.510327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:54.525657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.527166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.527822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.528784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.529467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.530050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.852391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:54.870703 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e10174a6-b74d-4571-bdbe-f0b3ac8443ae tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1277 microversion: 2.1 time: 0.391583 Oct 02 01:16:54.871270 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1754/3673] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:54 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1277 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:54.876203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:54.876832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:54.889008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.889509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.889948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:54.890674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:54.891350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:54.891783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:55.043947 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:55.058337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:55.060669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:55.067002 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-530babe7-6ca9-42b3-b48a-92c631196f20 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 0.949018 Oct 02 01:16:55.069853 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1920/3674] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:54 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:55.087603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:55.088920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:55.099507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:55.100701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:55.101310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:55.102677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:55.103310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:55.103900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:55.417637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:55.430191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1aa96bf8-4db0-4319-95bc-9ddb4eeaf696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1508 microversion: 2.1 time: 0.557834 Oct 02 01:16:55.432413 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1755/3675] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:54 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:55.438383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4aff3fcc-f543-4064-9a22-70c7eccfcda9 req-1c381057-2c54-4c4b-8532-1a75265c442f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf842a78-fa66-4d09-8f89-07c72c46bbfe", "name": "network-vif-plugged", "status": "completed", "tag": "6b18801d-ebf6-465e-b88f-c7b1f79d0041"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:55.467148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4aff3fcc-f543-4064-9a22-70c7eccfcda9 req-1c381057-2c54-4c4b-8532-1a75265c442f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:55.467938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4aff3fcc-f543-4064-9a22-70c7eccfcda9 req-1c381057-2c54-4c4b-8532-1a75265c442f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:55.468548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4aff3fcc-f543-4064-9a22-70c7eccfcda9 req-1c381057-2c54-4c4b-8532-1a75265c442f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:55.486556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4aff3fcc-f543-4064-9a22-70c7eccfcda9 req-1c381057-2c54-4c4b-8532-1a75265c442f service nova] Creating event network-vif-plugged:6b18801d-ebf6-465e-b88f-c7b1f79d0041 for instance cf842a78-fa66-4d09-8f89-07c72c46bbfe on n-h1-master-1 Oct 02 01:16:55.496622 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4aff3fcc-f543-4064-9a22-70c7eccfcda9 req-1c381057-2c54-4c4b-8532-1a75265c442f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061726 Oct 02 01:16:55.498674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1756/3676] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:55.628863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:55.645357 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e01c3bf0-de2e-4bcf-9c43-63dab5a0ed37 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.571325 Oct 02 01:16:55.645796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1921/3677] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:55 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:55.894497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:55.895493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:55.903826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:55.904705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:55.905410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:55.906361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:55.907086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:55.907754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.013492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:56.025378 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-614b659c-726c-4469-8990-07c252e667a3 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1275 microversion: 2.1 time: 0.135714 Oct 02 01:16:56.040545 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1757/3678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:55 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:56.101991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:56.104574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:56.118979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.119922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.122036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.124843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.125699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.127232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.277523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9482a376-76f5-4733-81eb-278eeebecfb3 req-d941d5fd-ed7d-484a-912f-953496ffb0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85611874-af48-48e1-9ff7-9bc74ee0d658", "tag": "83ee666b-67a4-4a5e-b88e-875a9248b1c5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:56.294999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9482a376-76f5-4733-81eb-278eeebecfb3 req-d941d5fd-ed7d-484a-912f-953496ffb0e4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.295760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9482a376-76f5-4733-81eb-278eeebecfb3 req-d941d5fd-ed7d-484a-912f-953496ffb0e4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.296395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9482a376-76f5-4733-81eb-278eeebecfb3 req-d941d5fd-ed7d-484a-912f-953496ffb0e4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.313064 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9482a376-76f5-4733-81eb-278eeebecfb3 req-d941d5fd-ed7d-484a-912f-953496ffb0e4 service nova] Creating event network-changed:83ee666b-67a4-4a5e-b88e-875a9248b1c5 for instance 85611874-af48-48e1-9ff7-9bc74ee0d658 on n-h1-master-1 Oct 02 01:16:56.319938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9482a376-76f5-4733-81eb-278eeebecfb3 req-d941d5fd-ed7d-484a-912f-953496ffb0e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046984 Oct 02 01:16:56.320896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1758/3679] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:16:56.460126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:56.460991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:56.473882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.474393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.475071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.476417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.477180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.477892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.671812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:56.684888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:56.691546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:56.697483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ba4af86-3c5c-4af1-907a-aa55367a2189 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1361 microversion: 2.26 time: 0.600292 Oct 02 01:16:56.701824 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1922/3680] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:56 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1361 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:56.719625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:56.720578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:56.729924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.730425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.730921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:56.736193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:56.736853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:56.737453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:57.056081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:57.059599 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:57.081684 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d265d4b6-7757-4e86-8e69-e9d11d7b2a27 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1508 microversion: 2.1 time: 0.621935 Oct 02 01:16:57.083779 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1759/3681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:56 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1508 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:57.102693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:57.103921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:57.129869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:57.130963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:57.132947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:57.133928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:57.136121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:57.137014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:57.344071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:57.352762 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-69371c39-2c7a-4d96-a4fd-bcfbcf0e2f3b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.649006 Oct 02 01:16:57.353363 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1923/3682] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:56 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:57.611035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:57.621525 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cee7bda5-0e7b-4d30-802f-1bbb69a144f5 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.535034 Oct 02 01:16:57.628091 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1760/3683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:57 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:57.731457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:57.732079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:57.744980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:57.748463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:57.749311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:57.752504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:57.753988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:57.754626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.109509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:58.110330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:58.120768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.125815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.126706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.127763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.134080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.134859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.465619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:58.488969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:58.495284 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:58.505208 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80c34c22-3bab-48fa-a85a-9fe1d1564324 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1546 microversion: 2.26 time: 0.769380 Oct 02 01:16:58.507496 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1924/3684] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:16:57 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1546 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:16:58.509300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:58.525055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60dac8b0-60b7-4262-82de-9cd9afd19102 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 200 len: 1466 microversion: 2.1 time: 0.418978 Oct 02 01:16:58.526209 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1761/3685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:58 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:16:58.530465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-149927c9-5b64-451e-8f3d-d4cd16da264e req-c0984e2c-c471-4cd3-9f5f-0133964d84fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bb7393-ea02-4ff2-a222-2d0faa65f524", "name": "network-vif-deleted", "tag": "29fc7568-74ef-4951-86d2-a1bde61727f2"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:58.539579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:58.540234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:58.560576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.562464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.566019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.566184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-149927c9-5b64-451e-8f3d-d4cd16da264e req-c0984e2c-c471-4cd3-9f5f-0133964d84fb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.567216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-149927c9-5b64-451e-8f3d-d4cd16da264e req-c0984e2c-c471-4cd3-9f5f-0133964d84fb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.568544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.568701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-149927c9-5b64-451e-8f3d-d4cd16da264e req-c0984e2c-c471-4cd3-9f5f-0133964d84fb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.570752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.573575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.588562 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-149927c9-5b64-451e-8f3d-d4cd16da264e req-c0984e2c-c471-4cd3-9f5f-0133964d84fb service nova] Creating event network-vif-deleted:29fc7568-74ef-4951-86d2-a1bde61727f2 for instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 on n-h2-master-1 Oct 02 01:16:58.598358 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-149927c9-5b64-451e-8f3d-d4cd16da264e req-c0984e2c-c471-4cd3-9f5f-0133964d84fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089350 Oct 02 01:16:58.601457 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1925/3686] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:16:58.608707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb880488280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:58.630062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.631219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.632644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.634750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:58.654008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.657932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.659048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.659904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.661891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.663988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.745452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.746479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.747211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.782948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.783806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.784763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.864669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:58.910892 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d6369ed1-c40c-4f0f-a808-1c1f51b6f541 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-841077396" status: 201 len: 0 microversion: 2.26 time: 0.307593 Oct 02 01:16:58.912935 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1926/3687] 10.222.0.23 () {62 vars in 1377 bytes} [Sun Oct 2 01:16:58 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-841077396 => generated 0 bytes in 310 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 02 01:16:58.929742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:58.930184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:58.951481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.951978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.952420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:58.953132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:58.953591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:58.958886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.339567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:59.369003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d4acd795-439b-447c-b2d7-807e65208c65 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.841288 Oct 02 01:16:59.391765 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1762/3688] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:58 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:59.407977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6c374f9-3045-40ad-a89a-e3656eec3259 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb8812a0550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.427324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6c374f9-3045-40ad-a89a-e3656eec3259 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.428095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6c374f9-3045-40ad-a89a-e3656eec3259 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.429352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6c374f9-3045-40ad-a89a-e3656eec3259 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.453989 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6c374f9-3045-40ad-a89a-e3656eec3259 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-841077396" status: 204 len: 0 microversion: 2.26 time: 0.060261 Oct 02 01:16:59.456220 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1763/3689] 10.222.0.23 () {60 vars in 1358 bytes} [Sun Oct 2 01:16:59 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-841077396 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:16:59.466126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:16:59.467533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb885519ca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.474626 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b5f50384-eb1e-4b9f-a04f-267a7f564f37 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.560329 Oct 02 01:16:59.477405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.478100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.478743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.479400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:59.486803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.487523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.488162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.489044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.489675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.490276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.493142 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1927/3690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:58 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:59.519766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.520258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.520697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.542468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:59.557838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.558905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:59.565385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2421064-aec2-4f0a-8d59-f6359e355b0a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 204 len: 0 microversion: 2.26 time: 0.103010 Oct 02 01:16:59.566520 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1764/3691] 10.222.0.23 () {60 vars in 1295 bytes} [Sun Oct 2 01:16:59 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:16:59.568257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.571586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.572050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.572831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.573254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.573708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.578871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7be92159-4f41-49fd-b67d-b99c511de907 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb88561baf0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.596487 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:16:59.597221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7be92159-4f41-49fd-b67d-b99c511de907 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.597884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7be92159-4f41-49fd-b67d-b99c511de907 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.598577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7be92159-4f41-49fd-b67d-b99c511de907 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 HTTP/1.1 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c3bb7393-ea02-4ff2-a222-2d0faa65f524'} Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:16:59.608723 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:16:59.615684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:16:59.618836 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f77a0c70-d09e-494f-90ec-0907c575f164 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 404 len: 111 microversion: 2.1 time: 0.059413 Oct 02 01:16:59.619406 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1928/3692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:16:59 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:16:59.630433 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7be92159-4f41-49fd-b67d-b99c511de907 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 200 len: 12 microversion: 2.26 time: 0.057443 Oct 02 01:16:59.633308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1765/3693] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 01:16:59 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:59.647753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb8804ced30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.667785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.668406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.668863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.669346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:59.676256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.676952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.677564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.678997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.679717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.680493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.719900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.720397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.720853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.743150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.744484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.745089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.773604 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:59.785793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:16:59.805323 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e381e576-669d-496b-8b55-ebf0dd337052 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-647665764" status: 201 len: 0 microversion: 2.26 time: 0.163817 Oct 02 01:16:59.806460 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1929/3694] 10.222.0.23 () {62 vars in 1377 bytes} [Sun Oct 2 01:16:59 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-647665764 => generated 0 bytes in 165 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 02 01:16:59.825984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-79d298f6-708e-4b98-8e7f-eccc50e00e4a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb881678430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.828210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1959587730", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:16:59.837526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79d298f6-708e-4b98-8e7f-eccc50e00e4a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.838558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79d298f6-708e-4b98-8e7f-eccc50e00e4a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.839770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79d298f6-708e-4b98-8e7f-eccc50e00e4a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.879099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-79d298f6-708e-4b98-8e7f-eccc50e00e4a tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 200 len: 35 microversion: 2.26 time: 0.066358 Oct 02 01:16:59.885643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1766/3695] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 01:16:59 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 35 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:16:59.892570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb885566a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:16:59.923203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.925376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.925843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.926342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:16:59.950745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.951260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.951710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.952441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:16:59.954496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:16:59.955634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:16:59.955869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:16:59.999377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.000166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.000818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.049984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:00.068044 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3bc44a9-71f0-4944-b4be-6a4d48ad4a97 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-647665764" status: 204 len: 0 microversion: 2.26 time: 0.181219 Oct 02 01:17:00.082845 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1767/3696] 10.222.0.23 () {60 vars in 1361 bytes} [Sun Oct 2 01:16:59 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-647665764 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:17:00.101343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16802e79-28cd-41c2-b444-11a7eaa29635 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb885504820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:00.111723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16802e79-28cd-41c2-b444-11a7eaa29635 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.113938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16802e79-28cd-41c2-b444-11a7eaa29635 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.115034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16802e79-28cd-41c2-b444-11a7eaa29635 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.137741 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16802e79-28cd-41c2-b444-11a7eaa29635 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 200 len: 12 microversion: 2.26 time: 0.048023 Oct 02 01:17:00.139194 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1768/3697] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 01:17:00 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:00.153008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb881678a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:00.164157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.164656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.165096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.165579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:00.172024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.172512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.173384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.185268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.186277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.186931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.220768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.221421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.222074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.243122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:00.261862 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fdcee818-79ea-4061-abdb-a2b19f0cac74 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 204 len: 0 microversion: 2.26 time: 0.112996 Oct 02 01:17:00.262746 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1769/3698] 10.222.0.23 () {60 vars in 1295 bytes} [Sun Oct 2 01:17:00 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:17:00.276070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb8855669d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:00.290739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.294434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.294993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.295566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:00.305222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.305809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.309962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.311172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.312028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.312664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.360376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.360997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.361624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.372292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:00.372784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:00.373216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:00.411724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:00.434892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-108e6e63-324c-4ff0-9291-d9406963c406 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-79965849" status: 201 len: 0 microversion: 2.26 time: 0.165572 Oct 02 01:17:00.436159 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1770/3699] 10.222.0.23 () {62 vars in 1374 bytes} [Sun Oct 2 01:17:00 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-79965849 => generated 0 bytes in 168 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 02 01:17:00.574963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bce0d2d-6170-4a34-8299-280ee0faa9f5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb880991f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1513081603", "description": "tempest-description-1965305020"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:01.181324 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:01.211710 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=18 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:01.300203 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:01.300906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:01.302400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:01.303173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:01.304477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:01.315332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.315907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.316544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.317310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.317766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.318347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.342916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:01.350240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:01.371102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:01.373709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:01.439404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be58b919-9d0d-4757-a7a2-e966ff7c4696 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615671 Oct 02 01:17:01.449316 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1930/3700] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:17:01.453791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:01.456718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:01.470508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.471036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.479493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.481383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.482034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.482284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bce0d2d-6170-4a34-8299-280ee0faa9f5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.044907 Oct 02 01:17:01.483373 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1771/3701] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:01.484544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.489058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb880b22550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:01.513481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.514276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.514749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.515241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:01.528627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.529128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.529568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.530305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.530773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.536619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.537132 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:01.608010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.609421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.610464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.615900 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:01.628508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.629398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.630006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.675629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:01.704276 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb9ce395-e0fe-4b9d-b01f-5fc0d276a511 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-1832939592" status: 201 len: 0 microversion: 2.26 time: 0.215951 Oct 02 01:17:01.705337 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1772/3702] 10.222.0.23 () {62 vars in 1380 bytes} [Sun Oct 2 01:17:01 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-1832939592 => generated 0 bytes in 221 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 02 01:17:01.728092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:01.730185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:01.742408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.743145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.743771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:01.745339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:01.745989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:01.746583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.126342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:02.137286 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1c54941a-4892-4f8a-b428-1a1262fb3362 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.689120 Oct 02 01:17:02.156804 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1931/3703] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:01 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:02.163749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-61b33792-a701-4078-a735-5699f2b2d778 req-6299ccdd-1c20-4906-b2f5-d68426c31336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12dbc4ef-3666-4384-b934-8599e8ae04b0", "tag": "8781dac2-41f9-4bab-8d65-3b08348921fd"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:02.181366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-61b33792-a701-4078-a735-5699f2b2d778 req-6299ccdd-1c20-4906-b2f5-d68426c31336 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.182691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-61b33792-a701-4078-a735-5699f2b2d778 req-6299ccdd-1c20-4906-b2f5-d68426c31336 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.183401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-61b33792-a701-4078-a735-5699f2b2d778 req-6299ccdd-1c20-4906-b2f5-d68426c31336 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.200353 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-61b33792-a701-4078-a735-5699f2b2d778 req-6299ccdd-1c20-4906-b2f5-d68426c31336 service nova] Creating event network-changed:8781dac2-41f9-4bab-8d65-3b08348921fd for instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 on n-h1-master-1 Oct 02 01:17:02.205544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-61b33792-a701-4078-a735-5699f2b2d778 req-6299ccdd-1c20-4906-b2f5-d68426c31336 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047218 Oct 02 01:17:02.206375 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1932/3704] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:02.219462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:02.222927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:02.224647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:02.231192 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:02.236485 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8422d6a4-3e42-46ec-8062-bc2fcb53ae17 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.528529 Oct 02 01:17:02.237706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.238502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1773/3705] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:01 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:02.239377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.241601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.242537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.245191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.245662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.247237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-458ed3f7-7589-4d8f-b8c0-e3d1718904f4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb88569fee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-140205734", "description": "tempest-description-1382598320"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:02.355477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:02.374904 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc525662-012c-456a-b392-406d940f67e8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1219 microversion: 2.1 time: 0.166707 Oct 02 01:17:02.390871 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1933/3706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:02 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:02.396190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb880547b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:02.404586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.405384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.405909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.406425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:02.412244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.413567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.413717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.414362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.414853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.415283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.461280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.462103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.462733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.491852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:02.513766 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9579cd34-f6a5-403e-8640-5307a1c3df54 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 204 len: 0 microversion: 2.26 time: 0.121519 Oct 02 01:17:02.515123 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1934/3707] 10.222.0.23 () {60 vars in 1295 bytes} [Sun Oct 2 01:17:02 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:17:02.527258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5cd9c13c-0575-4384-b9e4-3bc79ef63be8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb880506040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:02.538584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd9c13c-0575-4384-b9e4-3bc79ef63be8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.539777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd9c13c-0575-4384-b9e4-3bc79ef63be8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.540414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cd9c13c-0575-4384-b9e4-3bc79ef63be8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.557978 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5cd9c13c-0575-4384-b9e4-3bc79ef63be8 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 200 len: 12 microversion: 2.26 time: 0.038643 Oct 02 01:17:02.559456 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1935/3708] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 01:17:02 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:02.572439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb880736ee0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:02.588428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.589926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.590659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.591548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:02.599475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.600346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.602160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.603254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.604006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.605397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.637912 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-458ed3f7-7589-4d8f-b8c0-e3d1718904f4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.397954 Oct 02 01:17:02.653311 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1774/3709] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:02.662579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.663981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.664542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.678043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:02.701127 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9e8e368-51d9-4487-9501-11aa06485f33 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 204 len: 0 microversion: 2.26 time: 0.135104 Oct 02 01:17:02.703315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1936/3710] 10.222.0.23 () {60 vars in 1295 bytes} [Sun Oct 2 01:17:02 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:17:02.714079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb88128e160>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:02.735819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.736659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.737422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.739243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:02.749750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1491791250", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "a122e3ee-b4c8-45e1-bf4b-5f8f96282722"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:02.760098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.764335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.766214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.767230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.768008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.774897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.859165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.860185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.861425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.876492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] validate_networks() for [('a122e3ee-b4c8-45e1-bf4b-5f8f96282722', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:02.877652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.878803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.879623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.922815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:02.949198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6f3830b-0cc1-4009-8c18-861fc5da31cc tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-1827175030" status: 201 len: 0 microversion: 2.26 time: 0.237495 Oct 02 01:17:02.951409 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1775/3711] 10.222.0.23 () {62 vars in 1380 bytes} [Sun Oct 2 01:17:02 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-1827175030 => generated 0 bytes in 244 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 02 01:17:02.962672 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb880bde5e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:02.977784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.978342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.978819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.979309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:02.986097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.987185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.987965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:02.989032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:02.989677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:02.990349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.022625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.023409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.023921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.064401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.066056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.066768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.109714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:03.129754 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-745c2372-9df3-4201-aaf4-1c55f5f0df25 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-691058293" status: 201 len: 0 microversion: 2.26 time: 0.172677 Oct 02 01:17:03.131234 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1776/3712] 10.222.0.23 () {62 vars in 1377 bytes} [Sun Oct 2 01:17:02 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags/tempest-tag-691058293 => generated 0 bytes in 175 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 02 01:17:03.144036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Action: 'update_all', calling method: .version_select at 0x7fb8812a0310>, body: {"tags": ["tempest-tag-1309135160", "tempest-tag-148478905"]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:03.169772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.169772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.170299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.175434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:03.186418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.190584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.191072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.191801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.192264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.192692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.243542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.244037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.244480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.281518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:03.306826 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a16952a5-39fa-446c-a24b-45b63b50a07b tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 200 len: 61 microversion: 2.26 time: 0.169161 Oct 02 01:17:03.312354 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1777/3713] 10.222.0.23 () {62 vars in 1312 bytes} [Sun Oct 2 01:17:03 2022] PUT /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 61 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:03.312659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:03.313283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:03.322876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.323497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.323802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.324883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.325645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.326369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.871866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:03.887054 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bce485ec-e069-4058-b011-80a3fe13b76d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.577813 Oct 02 01:17:03.887989 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1778/3714] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:03 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:03.909343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:03.909992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:03.918307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.919107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.919703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:03.920600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:03.921349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:03.921944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.121285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:04.123113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:04.129435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:04.131489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:04.133244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:04.150331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.152123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.152566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.153449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.154080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.154515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.200487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Getting quotas for project 94224832aed24d2f83c72250cbfb4a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:04.215217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Getting quotas for user 63e0eaf9b9e34b8d80e9ddadd09989fa and project 94224832aed24d2f83c72250cbfb4a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:04.233012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:04.236938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:04.242224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:04.251898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef77ac99-d6b5-442a-ab34-73d391ba1bce tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.361604 Oct 02 01:17:04.254140 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1779/3715] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:03 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:04.269844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27661497-35c8-4cde-bb37-c45d147177d4 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb885566280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:04.287681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27661497-35c8-4cde-bb37-c45d147177d4 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.288019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27661497-35c8-4cde-bb37-c45d147177d4 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.289118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27661497-35c8-4cde-bb37-c45d147177d4 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.289254 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:04.314237 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27661497-35c8-4cde-bb37-c45d147177d4 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 200 len: 61 microversion: 2.26 time: 0.058538 Oct 02 01:17:04.332581 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1780/3716] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 2 01:17:04 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 61 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:04.339921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:04.342005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:04.358243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.358790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.359229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.359934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.360599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.362889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.440326 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6498fa1a-a3d2-4da3-a33d-1a3210d18071 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694981 Oct 02 01:17:04.448828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1937/3717] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:17:04.455257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '.version_select at 0x7fb8804bc790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:04.464962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.466365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.467160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.467864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:04.476539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.477040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.477482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.478199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.478691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.479125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.548680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:04.549515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:04.550190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:04.578524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lazy-loading 'flavor' on Instance uuid cf842a78-fa66-4d09-8f89-07c72c46bbfe {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:04.601654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-86747c9c-d76c-4aa5-b309-5b08372d92f1 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags" status: 204 len: 0 microversion: 2.26 time: 0.151192 Oct 02 01:17:04.608628 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1938/3718] 10.222.0.23 () {60 vars in 1295 bytes} [Sun Oct 2 01:17:04 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:17:04.614007 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-235e2aba-01a9-4ea3-a200-e1c444c7a533 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:04.614656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-235e2aba-01a9-4ea3-a200-e1c444c7a533 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:04.978329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:04.987677 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-023fb19e-904e-4679-96a3-db89d91cc335 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1273 microversion: 2.1 time: 0.653872 Oct 02 01:17:04.999015 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1781/3719] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:04 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1273 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:05.009694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:05.010779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:05.021386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.023206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.025968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.027003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.030901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.031700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.085227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:05.094864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-235e2aba-01a9-4ea3-a200-e1c444c7a533 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:05.104632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-235e2aba-01a9-4ea3-a200-e1c444c7a533 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1216 microversion: 2.1 time: 0.494705 Oct 02 01:17:05.105167 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1939/3720] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:04 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1216 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:05.118037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:05.121098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:05.139809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.140979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.141992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.142920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.143597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.144200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.228618 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:05.247344 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e5476bd-23b5-43c0-8851-5ae52398862d tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 204 len: 0 microversion: 2.26 time: 0.246590 Oct 02 01:17:05.247980 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1782/3721] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:17:04 2022] DELETE /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:17:05.259740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:05.261360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:05.269095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.269557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.270242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.271522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.272622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.273288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.610329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:05.623625 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8bfa6849-102c-4ce2-a7dd-7966f36c458f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.512185 Oct 02 01:17:05.624241 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1940/3722] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:05 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:05.641667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:05.642296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:05.653506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.654088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.654655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.655413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.655855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.658826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.799093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:05.821571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:05.833451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:05.839047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0daa4632-8390-416d-b326-a5e4fc2fe83f tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1552 microversion: 2.26 time: 0.586188 Oct 02 01:17:05.839595 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1783/3723] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:05 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1552 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:05.860682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-23ea6607-3ae4-462b-bc0e-8c2c2f96c9cd req-a099c76d-0f0b-4702-a248-eb5410743cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85611874-af48-48e1-9ff7-9bc74ee0d658", "name": "network-vif-plugged", "status": "completed", "tag": "83ee666b-67a4-4a5e-b88e-875a9248b1c5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:05.895986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-23ea6607-3ae4-462b-bc0e-8c2c2f96c9cd req-a099c76d-0f0b-4702-a248-eb5410743cf6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:05.896757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-23ea6607-3ae4-462b-bc0e-8c2c2f96c9cd req-a099c76d-0f0b-4702-a248-eb5410743cf6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:05.898290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-23ea6607-3ae4-462b-bc0e-8c2c2f96c9cd req-a099c76d-0f0b-4702-a248-eb5410743cf6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:05.931848 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-23ea6607-3ae4-462b-bc0e-8c2c2f96c9cd req-a099c76d-0f0b-4702-a248-eb5410743cf6 service nova] Creating event network-vif-plugged:83ee666b-67a4-4a5e-b88e-875a9248b1c5 for instance 85611874-af48-48e1-9ff7-9bc74ee0d658 on n-h1-master-1 Oct 02 01:17:05.937218 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-23ea6607-3ae4-462b-bc0e-8c2c2f96c9cd req-a099c76d-0f0b-4702-a248-eb5410743cf6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092092 Oct 02 01:17:05.938062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1784/3724] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:06.017063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:06.018493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:06.032441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.033338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.033964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.035028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.036379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.036976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.046043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:06.058427 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-34e37a83-63c3-46ae-bfe4-67cd385bde54 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.433095 Oct 02 01:17:06.063713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1941/3725] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:05 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:06.117386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:06.133549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:06.134433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:06.138895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bfcd394-2a75-4c35-8555-b33e590e3dc1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1273 microversion: 2.1 time: 0.128118 Oct 02 01:17:06.143234 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1785/3726] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:06 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:06.143945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.145215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.145830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.146815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.147540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.148160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.283622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:06.296282 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0351d070-fc1e-4d97-a53d-4933e33eb720 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1268 microversion: 2.1 time: 0.167746 Oct 02 01:17:06.300748 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1942/3727] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:06 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:06.654295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:06.655245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:06.675594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.676463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.686545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.687202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.688211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.688211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.741639 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:06.872056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:06.874408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:06.883971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.887225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.889718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.890617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:06.892875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:06.894822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:06.999951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:07.008365 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0d204d0-c24c-4f8b-9d2c-aeedac283203 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.359021 Oct 02 01:17:07.018991 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1786/3728] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:06 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:07.093128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:07.093933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:07.108248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:07.108849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:07.109733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:07.112435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:07.113792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:07.114337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:07.480214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:07.492149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:07.493811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:07.495183 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8c32c35-a142-486a-9444-e5ba4cf885a2 tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1552 microversion: 2.26 time: 0.630483 Oct 02 01:17:07.511243 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1943/3729] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:06 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1552 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:07.522213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:07.523232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:07.530061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:07.530941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:07.531895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:07.532842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:07.533550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:07.534208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:07.662207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:07.683890 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3c7fa00-fd72-491a-ab89-16f55cb464f6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.598679 Oct 02 01:17:07.702388 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1787/3730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:07 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:07.710182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:07.711112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:07.718841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:07.719620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:07.720224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:07.721104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:07.722057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:07.722679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:07.840389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:07.855194 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0186339-d49a-4c72-9af0-9aa31c54d8e4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1274 microversion: 2.1 time: 0.151002 Oct 02 01:17:07.856788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1788/3731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:07 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:07.997404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:08.006129 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a9af0b2-1eed-4076-8661-705d071a514f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1315 microversion: 2.1 time: 0.493302 Oct 02 01:17:08.012264 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1944/3732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:07 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:08.049402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:08.051502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:08.067470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.069174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.073004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.076111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.076853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.077760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.461651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:08.462538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:08.470751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.477296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.477923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.478854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.479477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.480771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.511044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:08.523459 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87001387-fdb0-4f14-9a5c-16913f714922 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1309 microversion: 2.1 time: 0.487392 Oct 02 01:17:08.532946 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1789/3733] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:08 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:08.538174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:08.539180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:08.558212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.559131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.559806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.560778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.561470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.562146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.728533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:08.738059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:08.740690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39f8d72cfddb4f4c84f40e02574c3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c591d1679f478981bbe151f38dcb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:08.744387 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26066ddd-3f19-4205-be50-5f1af3682ede tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 200 len: 1510 microversion: 2.26 time: 0.209981 Oct 02 01:17:08.758627 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1790/3734] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:08 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:08.862223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Calling method '.version_select at 0x7fb88561bca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:08.866579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:08.881561 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1cabbef0-c5ca-4f98-8587-612e2cbe32d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.423589 Oct 02 01:17:08.882828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1945/3735] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:08 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:08.902326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2a77fd6d-333b-4ad0-a4d4-9b7a56360982 req-675d3ce4-0db3-4ff4-82d0-2b62bda3e0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf842a78-fa66-4d09-8f89-07c72c46bbfe", "name": "network-vif-deleted", "tag": "6b18801d-ebf6-465e-b88f-c7b1f79d0041"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:08.921326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a77fd6d-333b-4ad0-a4d4-9b7a56360982 req-675d3ce4-0db3-4ff4-82d0-2b62bda3e0f6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.922973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a77fd6d-333b-4ad0-a4d4-9b7a56360982 req-675d3ce4-0db3-4ff4-82d0-2b62bda3e0f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.923567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a77fd6d-333b-4ad0-a4d4-9b7a56360982 req-675d3ce4-0db3-4ff4-82d0-2b62bda3e0f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.936402 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:08.937023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Neutron security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:08.937688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] HTTP exception thrown: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.937688 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Request method failure captured: Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/83562a61-f2ce-464f-ab54-7e5d05bc84a4 HTTP/1.1 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaUGNo7btgSo0I-CmLRTevcH8zFQG6DMFyZaTmt5EZX_UvfCI3zBN2RCP5NHIZ0EkDh93qGIFZOUV9E3tuOFycaPOri1vDx3-XXw2QjxeWnfaCo91aFHVWJdlj2N9U70T0gxxaT_XwrEfNAEBZ3L5KaVtQb5N25rNtcqHotJthPDb8 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f302c6ba27b649e995c9f2efc56ddc80"}]}] Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e67fb3437fbc41129b85e8937f21e560 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: exception: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '83562a61-f2ce-464f-ab54-7e5d05bc84a4'} Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:08.939847 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] Oct 02 01:17:08.945823 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:08.953881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Returning 404 to user: Security group 83562a61-f2ce-464f-ab54-7e5d05bc84a4 does not exist Oct 02 01:17:08.953881 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-ca84b5fb-9e94-401f-94c4-e2206bb5dbab'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:08.953881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a60d851-4097-4cc5-b9e2-c8991f013296 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/83562a61-f2ce-464f-ab54-7e5d05bc84a4" status: 404 len: 194 microversion: 2.1 time: 0.201472 Oct 02 01:17:08.953881 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1791/3736] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:17:08 2022] DELETE /compute/v2.1/os-security-groups/83562a61-f2ce-464f-ab54-7e5d05bc84a4 => generated 194 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:08.963841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:08.964790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:08.972404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2a77fd6d-333b-4ad0-a4d4-9b7a56360982 req-675d3ce4-0db3-4ff4-82d0-2b62bda3e0f6 service nova] Creating event network-vif-deleted:6b18801d-ebf6-465e-b88f-c7b1f79d0041 for instance cf842a78-fa66-4d09-8f89-07c72c46bbfe on n-h1-master-1 Oct 02 01:17:08.982058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.982585 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2a77fd6d-333b-4ad0-a4d4-9b7a56360982 req-675d3ce4-0db3-4ff4-82d0-2b62bda3e0f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097411 Oct 02 01:17:08.983189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.983876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.984875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:08.986234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:08.987096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:08.988737 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1946/3737] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:08.995076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:08.995920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:09.004151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.005562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.007788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.009458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.010108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.010728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.361124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:09.369738 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-301f59b4-a69f-4e89-90ae-ee3c2bac53d6 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.414015 Oct 02 01:17:09.370418 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1792/3738] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:08 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:09.390844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:09.391462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:09.397776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.398558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.399093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.400646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.401180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.401841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.450220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:09.477714 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de447def-d21f-4abf-9405-9b8d0317acd8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.487517 Oct 02 01:17:09.478320 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1947/3739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:08 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:09.494614 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9086c35-b145-4476-b8e5-dba0fc38667c tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008320 Oct 02 01:17:09.495942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1948/3740] 10.222.0.23 () {58 vars in 1164 bytes} [Sun Oct 2 01:17:09 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 01:17:09.505246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:09.506189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:09.513677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.514425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.515366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.516662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.517226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.517658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.767731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:09.781366 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7038db83-2812-4f6a-9e6c-9eeb197258d8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.397525 Oct 02 01:17:09.781953 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1793/3741] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:09 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:09.786295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d8a2be57-1650-405a-bd47-b198d2307aef req-2732895e-8ceb-4cf4-96ef-be5ab472d373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b621df-a125-42a6-a9d9-2f65d0e618b1", "tag": "15b9bb9a-5280-4d53-9ec0-f2ef5f4a82c4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:09.798263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d8a2be57-1650-405a-bd47-b198d2307aef req-2732895e-8ceb-4cf4-96ef-be5ab472d373 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:09.798828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d8a2be57-1650-405a-bd47-b198d2307aef req-2732895e-8ceb-4cf4-96ef-be5ab472d373 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:09.799259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d8a2be57-1650-405a-bd47-b198d2307aef req-2732895e-8ceb-4cf4-96ef-be5ab472d373 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:09.810417 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d8a2be57-1650-405a-bd47-b198d2307aef req-2732895e-8ceb-4cf4-96ef-be5ab472d373 service nova] Creating event network-changed:15b9bb9a-5280-4d53-9ec0-f2ef5f4a82c4 for instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 on n-h2-master-1 Oct 02 01:17:09.815250 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d8a2be57-1650-405a-bd47-b198d2307aef req-2732895e-8ceb-4cf4-96ef-be5ab472d373 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032184 Oct 02 01:17:09.815855 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1794/3742] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:09.821658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b2618ddb-cc8a-41d3-a800-52bb3923a3ed tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Calling method '.version_select at 0x7fb8856c58b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:10.227497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:10.231595 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:10.237728 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ce9f8f26-ed44-430f-bbd8-c668c684f53d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1315 microversion: 2.1 time: 0.740649 Oct 02 01:17:10.239117 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1949/3743] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:09 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:10.245859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:10.246728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:10.265549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.266048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.266480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.274414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.274940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.275477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.673763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:10.683080 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f8ad7165-bb49-4100-9b6c-cb7252f9718c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1490 microversion: 2.1 time: 0.442614 Oct 02 01:17:10.683756 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1950/3744] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:10 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1490 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:10.688644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:10.689242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] [instance: cf842a78-fa66-4d09-8f89-07c72c46bbfe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:10.696847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.698245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.699153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.700649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.701566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.702439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.731953 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] HTTP exception thrown: Instance cf842a78-fa66-4d09-8f89-07c72c46bbfe could not be found. Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Request method failure captured: Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe HTTP/1.1 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZ2IGgIEArGbodDVpT7nugdOYweVWBaoe9B6uWUKObApJPrRVayzMQaYU2gbwapwBPpn2b9G6CK6i8Ps-i5ZCPtUCgSCljaO_lBFHnrsWzUqVtvAnNnbHJGzhsQwMX2aqcvgPmZUwwyXiCDymYJEecatVomnmaag5vA0_LkGh0ytIs Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.26 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 52c591d1679f478981bbe151f38dcb2f Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerTagsTestJSON-217367837 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52c591d1679f478981bbe151f38dcb2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52c591d1679f478981bbe151f38dcb2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52c591d1679f478981bbe151f38dcb2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52c591d1679f478981bbe151f38dcb2f"}]}] Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerTagsTestJSON-217367837 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 52c591d1679f478981bbe151f38dcb2f Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerTagsTestJSON-217367837 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerTagsTestJSON-217367837-project Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 39f8d72cfddb4f4c84f40e02574c3410 Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerTagsTestJSON-217367837-project Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: exception: Instance cf842a78-fa66-4d09-8f89-07c72c46bbfe could not be found. Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'cf842a78-fa66-4d09-8f89-07c72c46bbfe'} Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf842a78-fa66-4d09-8f89-07c72c46bbfe could not be found. Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf842a78-fa66-4d09-8f89-07c72c46bbfe could not be found. Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:10.734410 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf842a78-fa66-4d09-8f89-07c72c46bbfe could not be found. Oct 02 01:17:10.740755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:10.742255 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b2618ddb-cc8a-41d3-a800-52bb3923a3ed tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.921916 Oct 02 01:17:10.742255 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1795/3745] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:17:09 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:10.743852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] Returning 404 to user: Instance cf842a78-fa66-4d09-8f89-07c72c46bbfe could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:10.744909 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c99bc046-eb19-46e9-a377-802541f8e0db tempest-ServerTagsTestJSON-217367837 tempest-ServerTagsTestJSON-217367837-project] 10.222.0.23 "GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe" status: 404 len: 111 microversion: 2.26 time: 0.060062 Oct 02 01:17:10.745955 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1951/3746] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:10 2022] GET /compute/v2.1/servers/cf842a78-fa66-4d09-8f89-07c72c46bbfe => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:17:10.757729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d331ffea-4087-43a1-a586-fac7a38852c3 req-269645f9-5f50-4434-b000-c6ab87524a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12dbc4ef-3666-4384-b934-8599e8ae04b0", "name": "network-vif-plugged", "status": "completed", "tag": "8781dac2-41f9-4bab-8d65-3b08348921fd"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:10.762911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:10.763213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:10.774407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d331ffea-4087-43a1-a586-fac7a38852c3 req-269645f9-5f50-4434-b000-c6ab87524a56 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.775194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d331ffea-4087-43a1-a586-fac7a38852c3 req-269645f9-5f50-4434-b000-c6ab87524a56 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.775860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d331ffea-4087-43a1-a586-fac7a38852c3 req-269645f9-5f50-4434-b000-c6ab87524a56 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.776321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.776822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.777491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.778204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.778701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.779135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.792374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d331ffea-4087-43a1-a586-fac7a38852c3 req-269645f9-5f50-4434-b000-c6ab87524a56 service nova] Creating event network-vif-plugged:8781dac2-41f9-4bab-8d65-3b08348921fd for instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 on n-h1-master-1 Oct 02 01:17:10.797497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d331ffea-4087-43a1-a586-fac7a38852c3 req-269645f9-5f50-4434-b000-c6ab87524a56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050181 Oct 02 01:17:10.798153 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1952/3747] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:10.806947 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:10.808228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:10.815120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.815863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.816475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:10.817365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:10.817995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:10.818633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:11.192383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:11.201720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a760345-7ec0-4bde-959c-4e2ed7196413 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.458669 Oct 02 01:17:11.202576 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1796/3748] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:10 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:11.226827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:11.228020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:11.235150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:11.235932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:11.236726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:11.237449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:11.237902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:11.238498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:11.285352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:11.294466 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-528c306f-445d-4afe-9eac-60ac658cdf29 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1317 microversion: 2.1 time: 0.493859 Oct 02 01:17:11.295107 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1953/3749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:10 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:11.316570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-931f316c-9ea2-45ff-b942-0a9eb44b4efb tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Calling method '.version_select at 0x7fb880426ca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:11.587986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:11.596603 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e17f1b1-4bc9-4abd-a864-d8833f29d4a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.392519 Oct 02 01:17:11.597528 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1797/3750] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:11 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:11.616159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1495052259", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:11.681146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:11.818577 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-931f316c-9ea2-45ff-b942-0a9eb44b4efb tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:11.819436 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-931f316c-9ea2-45ff-b942-0a9eb44b4efb tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 02 01:17:11.819436 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-931f316c-9ea2-45ff-b942-0a9eb44b4efb tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Request method failure captured: Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-security-groups/7036b119-ddce-458e-ab60-41dabb7bb320 HTTP/1.1 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaUGNo7btgSo0I-CmLRTevcH8zFQG6DMFyZaTmt5EZX_UvfCI3zBN2RCP5NHIZ0EkDh93qGIFZOUV9E3tuOFycaPOri1vDx3-XXw2QjxeWnfaCo91aFHVWJdlj2N9U70T0gxxaT_XwrEfNAEBZ3L5KaVtQb5N25rNtcqHotJthPDb8 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f302c6ba27b649e995c9f2efc56ddc80"}]}] Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: e67fb3437fbc41129b85e8937f21e560 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: exception: Insufficient rights for removing default security group. Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7036b119-ddce-458e-ab60-41dabb7bb320'} Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:11.822176 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] Oct 02 01:17:11.826673 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:11.831549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-931f316c-9ea2-45ff-b942-0a9eb44b4efb tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 02 01:17:11.831549 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-cea914d9-c36d-4b3d-a6a6-283ddec469e7'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:11.832847 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-931f316c-9ea2-45ff-b942-0a9eb44b4efb tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7036b119-ddce-458e-ab60-41dabb7bb320" status: 400 len: 182 microversion: 2.1 time: 0.526600 Oct 02 01:17:11.833530 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1954/3751] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:17:11 2022] DELETE /compute/v2.1/os-security-groups/7036b119-ddce-458e-ab60-41dabb7bb320 => generated 182 bytes in 529 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:17:11.845769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:11.847137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:11.865482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:11.866136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:11.866875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:11.867804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:11.868366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:11.869014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:12.860590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:12.870147 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36aaccae-614d-491a-9156-ba5d3993ce84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 1.035352 Oct 02 01:17:12.871916 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1955/3752] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:11 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:12.894205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:12.895649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:12.907229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:12.909825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:12.910489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:12.911504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:12.912141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:12.912766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.455357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:13.463161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1140d3c-ae22-4961-acb5-8bb8be6d8026 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1315 microversion: 2.1 time: 0.589669 Oct 02 01:17:13.463745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1956/3753] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:12 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:13.468976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Calling method '.version_select at 0x7fb880547940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:13.555398 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:13.555997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.security_group_api [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Neutron security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 not found {{(pid=122355) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:13.556554 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] HTTP exception thrown: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.556554 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Request method failure captured: Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-security-groups/2972c86c-e4d9-4ace-ad73-f86b7adc61c5 HTTP/1.1 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaUGNo7btgSo0I-CmLRTevcH8zFQG6DMFyZaTmt5EZX_UvfCI3zBN2RCP5NHIZ0EkDh93qGIFZOUV9E3tuOFycaPOri1vDx3-XXw2QjxeWnfaCo91aFHVWJdlj2N9U70T0gxxaT_XwrEfNAEBZ3L5KaVtQb5N25rNtcqHotJthPDb8 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f302c6ba27b649e995c9f2efc56ddc80"}]}] Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: e67fb3437fbc41129b85e8937f21e560 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: exception: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '2972c86c-e4d9-4ace-ad73-f86b7adc61c5'} Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:13.558366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Returning 404 to user: Security group 2972c86c-e4d9-4ace-ad73-f86b7adc61c5 does not exist Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-8c4097de-5672-42b4-a8c1-a3814872e2e3'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-040904b9-9c20-4b70-94e6-37980bbfda66 tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/2972c86c-e4d9-4ace-ad73-f86b7adc61c5" status: 404 len: 194 microversion: 2.1 time: 0.094718 Oct 02 01:17:13.565205 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1957/3754] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:17:13 2022] GET /compute/v2.1/os-security-groups/2972c86c-e4d9-4ace-ad73-f86b7adc61c5 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:13.571049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-85dde1e0-d583-4be4-b3b6-333c7b62fdbc req-8d5bc37d-a7ef-4162-aa4e-f424443e6a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1536ba-614a-483e-9565-45379729caf1", "tag": "6546a8d9-b30f-41f7-a24d-9bd99290af6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:13.583248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-85dde1e0-d583-4be4-b3b6-333c7b62fdbc req-8d5bc37d-a7ef-4162-aa4e-f424443e6a3e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.583821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-85dde1e0-d583-4be4-b3b6-333c7b62fdbc req-8d5bc37d-a7ef-4162-aa4e-f424443e6a3e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.584256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-85dde1e0-d583-4be4-b3b6-333c7b62fdbc req-8d5bc37d-a7ef-4162-aa4e-f424443e6a3e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.595689 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-85dde1e0-d583-4be4-b3b6-333c7b62fdbc req-8d5bc37d-a7ef-4162-aa4e-f424443e6a3e service nova] Creating event network-changed:6546a8d9-b30f-41f7-a24d-9bd99290af6a for instance 3b1536ba-614a-483e-9565-45379729caf1 on n-h2-master-1 Oct 02 01:17:13.602328 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-85dde1e0-d583-4be4-b3b6-333c7b62fdbc req-8d5bc37d-a7ef-4162-aa4e-f424443e6a3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035661 Oct 02 01:17:13.602988 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1958/3755] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:13.607979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:13.608681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:13.614981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.615468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.615936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.617503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.618061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.618480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.628808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:13.629320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:13.630021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:13.630679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:13.631108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:13.640662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.641153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.641724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.642462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.642984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.643410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.660923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:13.667748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:13.680429 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:13.683061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:13.733274 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-41655667-c5d5-4e35-aa64-387905778ac0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.124035 Oct 02 01:17:13.740705 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1798/3756] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:17:13.747520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:13.748405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:13.755070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.756102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.756212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:13.757528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:13.758569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:13.759020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:14.031755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:14.042003 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da0ca548-c0c4-4ce2-a404-e1b2f46f0496 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1504 microversion: 2.1 time: 0.437792 Oct 02 01:17:14.042897 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1959/3757] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:13 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:14.047897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1620217652", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:14.098899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:14.110618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0ba1f01-6998-439e-8013-77bf21fa1d26 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.367220 Oct 02 01:17:14.121921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] validate_networks() for [('ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:14.126789 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1799/3758] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:13 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:14.132892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Action: 'update', calling method: .version_select at 0x7fb8856c5940>, body: {"security_group": {"name": "tempest-sg-414477625", "description": "tempest-description-39501127"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:14.183747 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:14.232671 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:14.234198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Neutron security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:14.235044 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] HTTP exception thrown: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.235044 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Request method failure captured: Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/os-security-groups/a77d2b84-6922-405a-9b2c-4bc91b7a2f74 HTTP/1.1 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 99 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaUGNo7btgSo0I-CmLRTevcH8zFQG6DMFyZaTmt5EZX_UvfCI3zBN2RCP5NHIZ0EkDh93qGIFZOUV9E3tuOFycaPOri1vDx3-XXw2QjxeWnfaCo91aFHVWJdlj2N9U70T0gxxaT_XwrEfNAEBZ3L5KaVtQb5N25rNtcqHotJthPDb8 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f302c6ba27b649e995c9f2efc56ddc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f302c6ba27b649e995c9f2efc56ddc80"}]}] Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: f302c6ba27b649e995c9f2efc56ddc80 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-262418338 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e67fb3437fbc41129b85e8937f21e560 Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-262418338-project Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: {"security_group": {"name": "tempest-sg-414477625", "description": "tempest-description-39501127"}} Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: exception: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a77d2b84-6922-405a-9b2c-4bc91b7a2f74', 'body': {'security_group': {'name': 'tempest-sg-414477625', 'description': 'tempest-description-39501127'}}} Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:14.244987 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] Oct 02 01:17:14.249199 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:14.254486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] Returning 404 to user: Security group a77d2b84-6922-405a-9b2c-4bc91b7a2f74 does not exist Oct 02 01:17:14.254486 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-ab22bfc7-519c-4379-ae20-bd1a6722f467'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:14.255423 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-710ab523-8390-438d-8610-2d45191fa11d tempest-SecurityGroupsNegativeTestJSON-262418338 tempest-SecurityGroupsNegativeTestJSON-262418338-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/a77d2b84-6922-405a-9b2c-4bc91b7a2f74" status: 404 len: 194 microversion: 2.1 time: 0.127335 Oct 02 01:17:14.256009 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1800/3759] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Oct 2 01:17:14 2022] PUT /compute/v2.1/os-security-groups/a77d2b84-6922-405a-9b2c-4bc91b7a2f74 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:14.268346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:14.268503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:14.278659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:14.279411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:14.280020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:14.280916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:14.282586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:14.284363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:14.399836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:14.407992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83012af4-67c0-4ff8-91ab-aa3488321c76 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1213 microversion: 2.1 time: 0.146955 Oct 02 01:17:14.408581 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1801/3760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:14 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:14.423532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:14.424410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:14.436473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:14.436999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:14.440091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:14.441603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:14.442074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:14.442511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:14.867768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:14.878396 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9962f788-9f5f-4b67-8bb9-961e7221bcf0 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1504 microversion: 2.1 time: 0.468748 Oct 02 01:17:14.889605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1802/3761] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:14 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:14.906617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:14.907735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:14.914732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:14.923374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:14.924105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:14.925081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:14.925708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:14.926312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.100543 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:15.661995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:15.676098 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8a60d54-4c31-45dd-80ff-16fa79a39f0e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1315 microversion: 2.1 time: 0.785086 Oct 02 01:17:15.677286 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1803/3762] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:14 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:15.682811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-809b0b0d-4aac-42d3-b2c3-3c430d9e92e5 req-c4a7e9a6-68b8-49c0-9108-25a79cff0236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b621df-a125-42a6-a9d9-2f65d0e618b1", "name": "network-vif-plugged", "status": "completed", "tag": "15b9bb9a-5280-4d53-9ec0-f2ef5f4a82c4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:15.692934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-809b0b0d-4aac-42d3-b2c3-3c430d9e92e5 req-c4a7e9a6-68b8-49c0-9108-25a79cff0236 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.693732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-809b0b0d-4aac-42d3-b2c3-3c430d9e92e5 req-c4a7e9a6-68b8-49c0-9108-25a79cff0236 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.695477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-809b0b0d-4aac-42d3-b2c3-3c430d9e92e5 req-c4a7e9a6-68b8-49c0-9108-25a79cff0236 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.709522 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-809b0b0d-4aac-42d3-b2c3-3c430d9e92e5 req-c4a7e9a6-68b8-49c0-9108-25a79cff0236 service nova] Creating event network-vif-plugged:15b9bb9a-5280-4d53-9ec0-f2ef5f4a82c4 for instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 on n-h2-master-1 Oct 02 01:17:15.723751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:15.724260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:15.724857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:15.725221 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-809b0b0d-4aac-42d3-b2c3-3c430d9e92e5 req-c4a7e9a6-68b8-49c0-9108-25a79cff0236 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045743 Oct 02 01:17:15.725402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:15.727131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:15.727281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1804/3763] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:15.733967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:15.738577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:15.752409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.753387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.754038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.757304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.757995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.759340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.760042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.760709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.761801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.762482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.763184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.767503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.820623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:15.832782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for user 66a9d6a142d444be90b2101f23603522 and project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:15.868999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:15.878984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:15.917959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e40f712-b408-4335-9c7b-21eb0f49698a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "PUT /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1076 microversion: 2.1 time: 0.189255 Oct 02 01:17:15.921555 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1805/3764] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:17:15 2022] PUT /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1076 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:15.928934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:15.930054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:15.952534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.954354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.956473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:15.970911 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f36d6a94-fbf2-4d87-ba9d-136d98d1e267 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.926563 Oct 02 01:17:15.973769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1960/3765] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:17:15.990755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:15.992626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:15.996907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:15.997861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:15.999142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.010472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:16.012852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:16.014677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.016993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:16.018585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:16.020188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.223444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:16.231861 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-743822e9-2967-42ad-801e-967cc0761101 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1267 microversion: 2.1 time: 0.255699 Oct 02 01:17:16.232975 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1961/3766] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:15 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:16.237731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:16.238540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:16.245768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:16.246439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:16.247089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.247999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:16.248698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:16.249303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.561029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:16.575920 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ada3a6a-93d1-4dee-8a78-0db6b95ede92 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.652278 Oct 02 01:17:16.602113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1806/3767] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:15 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:16.610677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70fc2dfa-e296-4d46-821e-6e6b2e19ee8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:16.611292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70fc2dfa-e296-4d46-821e-6e6b2e19ee8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:16.845083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70fc2dfa-e296-4d46-821e-6e6b2e19ee8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:16.861027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70fc2dfa-e296-4d46-821e-6e6b2e19ee8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1215 microversion: 2.1 time: 0.257411 Oct 02 01:17:16.863289 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1807/3768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:16 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:16.876605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:16.878485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:16.896637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:16.900431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:16.901518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.906244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:16.907168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:16.909280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:16.923331 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:16.992372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:17.000911 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d56f11e3-9a88-47db-9edb-c1e3ebee27a8 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1502 microversion: 2.1 time: 0.766710 Oct 02 01:17:17.001632 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1962/3769] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:16 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1502 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:17.029889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:17.030906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:17.040474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.041699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.042303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.043805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.045700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.046268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.474804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:17.485360 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4da58b9c-7a56-4698-8963-af1a6d16e415 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1502 microversion: 2.1 time: 0.462507 Oct 02 01:17:17.493036 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1963/3770] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:17 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1502 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:17.509298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:17.509932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:17.527589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.528088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.528524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.529266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.529962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.530626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.738618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:17.756474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bba99490-b690-4edd-a6ab-487ac9fbf9e9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1315 microversion: 2.1 time: 0.890950 Oct 02 01:17:17.766447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:17.776433 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d76e00d3-df9f-494d-bbba-76144a5c51e9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1267 microversion: 2.1 time: 0.282228 Oct 02 01:17:17.778039 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1808/3771] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:16 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:17.790637 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1964/3772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:17 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:17.792591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:17.792844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:17.794230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:17.797930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:17.807175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.808275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.808723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.810007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.810106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.810385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.810546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.811744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.812090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:17.812728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:17.813199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:17.813626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.002978 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a14e87d0-8965-48ae-8987-75cf379b01b4 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "PUT /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1078 microversion: 2.1 time: 0.221494 Oct 02 01:17:18.004541 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1809/3773] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:17:17 2022] PUT /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1078 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:18.012281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:18.013109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:18.025796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.027203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.028073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.029075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.029751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.030369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.145868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:18.156594 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c6022c43-727c-49ae-bf6d-0c60bf23dc1d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1275 microversion: 2.1 time: 0.150527 Oct 02 01:17:18.157724 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1810/3774] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:18 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:18.158739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:18.163594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:18.166697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:18.172338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-765576af-97c7-4b9f-97ce-ea6be4c1dd8f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.388978 Oct 02 01:17:18.182630 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1965/3775] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:17 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:18.182846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.182846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.182846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.182846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.182846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.182846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.466688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:18.509792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eca12cc1-f631-40bc-b4ca-0a1078df58ef tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1504 microversion: 2.1 time: 0.350784 Oct 02 01:17:18.511262 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1811/3776] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:18 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:18.533583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:18.534211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:18.547535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.548096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.548556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.549327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.549768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.551206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.784379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:18.785332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:18.803062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.805105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.805697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:18.809607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:18.809607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:18.809607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.093270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:19.134874 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a539a5f7-8d4a-4d64-9b0a-28330af58f40 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1504 microversion: 2.1 time: 0.605944 Oct 02 01:17:19.138861 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1966/3777] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:18 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:19.145686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:19.146972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:19.154451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.155960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.156577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.159480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.160835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.161428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.217023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:19.225345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b13e0d7-96e3-4f34-96d8-e7ba89aed76d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1503 microversion: 2.1 time: 0.445812 Oct 02 01:17:19.228167 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1812/3778] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:18 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:19.234779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f3a167a3-b0b3-40ab-a0cc-8f738f650d77 req-f34ece47-5627-4dce-bfa0-2265a8d30066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1536ba-614a-483e-9565-45379729caf1", "name": "network-vif-plugged", "status": "completed", "tag": "6546a8d9-b30f-41f7-a24d-9bd99290af6a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:19.248985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f3a167a3-b0b3-40ab-a0cc-8f738f650d77 req-f34ece47-5627-4dce-bfa0-2265a8d30066 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.250439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f3a167a3-b0b3-40ab-a0cc-8f738f650d77 req-f34ece47-5627-4dce-bfa0-2265a8d30066 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.251380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f3a167a3-b0b3-40ab-a0cc-8f738f650d77 req-f34ece47-5627-4dce-bfa0-2265a8d30066 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.277987 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f3a167a3-b0b3-40ab-a0cc-8f738f650d77 req-f34ece47-5627-4dce-bfa0-2265a8d30066 service nova] Creating event network-vif-plugged:6546a8d9-b30f-41f7-a24d-9bd99290af6a for instance 3b1536ba-614a-483e-9565-45379729caf1 on n-h2-master-1 Oct 02 01:17:19.291460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f3a167a3-b0b3-40ab-a0cc-8f738f650d77 req-f34ece47-5627-4dce-bfa0-2265a8d30066 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062700 Oct 02 01:17:19.292396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1813/3779] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:19.297597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:19.298189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:19.309832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.310344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.310827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.311581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.311978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.312601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.377537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:19.524089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eac5f0d4-8364-4a0c-bc40-2d66767c94af tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 204 len: 0 microversion: 2.1 time: 0.230002 Oct 02 01:17:19.524791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1814/3780] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:19 2022] DELETE /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:17:19.536678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:19.544800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:19.545885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:19.560388 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b1ab888-f735-4f61-bd83-5a1ff1b362c9 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.417940 Oct 02 01:17:19.560981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.561544 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1967/3781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:19 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:19.572512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:19.574633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:19.579992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.580818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.584011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.584735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.585499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.587248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.587745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.588180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.591878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.592413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.594991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.908227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:19.923539 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de724541-bc9d-4437-a7fd-d715b6b97d5b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1273 microversion: 2.1 time: 0.397142 Oct 02 01:17:19.939805 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1815/3782] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:19 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:19.946680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:19.947203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:19.953579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.954837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.955446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.956801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:19.957431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:19.958027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:19.992638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:20.062775 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Instance is already in deleting state, ignoring this request Oct 02 01:17:20.064505 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e44a084-0aa3-4afb-a39d-9de9092a6bbb tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 204 len: 0 microversion: 2.1 time: 0.123587 Oct 02 01:17:20.065334 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1816/3783] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:19 2022] DELETE /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:17:20.074632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:20.075476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:20.099326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:20.099850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:20.100254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:20.101599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:20.102329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:20.102467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:20.190349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:20.201701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-38c0ab9d-460f-4487-885b-a80195442fff tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.638487 Oct 02 01:17:20.218711 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1968/3784] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:19 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:20.585781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:20.587276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:20.595997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:20.596491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:20.596927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:20.597629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:20.598084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:20.598505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.085640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:21.097972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85dc6106-0345-409f-9c24-7816fdc65121 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1510 microversion: 2.1 time: 1.027510 Oct 02 01:17:21.099386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1817/3785] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:20 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1510 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:21.105127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:21.105832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:21.113357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:21.114184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:21.114857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.115786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:21.116603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:21.117564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.221708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:21.236630 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b6e971bb-ab73-420a-a80c-14f9e0b23e91 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.654259 Oct 02 01:17:21.252798 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1969/3786] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:20 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:21.263032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:21.264623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:21.274404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:21.278002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:21.278002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.279081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:21.279734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:21.280371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.570088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:21.579186 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1396e591-d5f4-48ab-909c-fe6d454a319d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.478269 Oct 02 01:17:21.595783 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1818/3787] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:21 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:21.710707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:21.725531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8fe410e-7ff9-409a-90fd-72f2343bba53 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1316 microversion: 2.1 time: 0.468301 Oct 02 01:17:21.726722 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1970/3788] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:21 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:21.888632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-30aa5ac2-c786-4a7b-9d72-e0d09a387969 req-e5b801ea-4ee4-44d2-a10b-ddbc29999e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b17f445-1e8e-4f9e-b327-b481f300bbb7", "tag": "b4bca5c7-1ddd-403d-b744-fd4732a49134"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:21.904975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30aa5ac2-c786-4a7b-9d72-e0d09a387969 req-e5b801ea-4ee4-44d2-a10b-ddbc29999e42 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:21.906458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30aa5ac2-c786-4a7b-9d72-e0d09a387969 req-e5b801ea-4ee4-44d2-a10b-ddbc29999e42 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:21.907159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30aa5ac2-c786-4a7b-9d72-e0d09a387969 req-e5b801ea-4ee4-44d2-a10b-ddbc29999e42 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.912608 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:21.925485 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-30aa5ac2-c786-4a7b-9d72-e0d09a387969 req-e5b801ea-4ee4-44d2-a10b-ddbc29999e42 service nova] Creating event network-changed:b4bca5c7-1ddd-403d-b744-fd4732a49134 for instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 on n-h2-master-1 Oct 02 01:17:21.926030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4d469d41-b5bb-4175-96f2-3c83d2893730 req-d2fff038-2ff6-4825-92a0-bdca20161a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e8b7de-9bd5-4ad8-8082-92453a8e584d", "tag": "c910a0d3-67b0-4c03-859b-64f56ae4c159"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:21.931532 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-30aa5ac2-c786-4a7b-9d72-e0d09a387969 req-e5b801ea-4ee4-44d2-a10b-ddbc29999e42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047235 Oct 02 01:17:21.932712 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1971/3789] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:21.937078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4d469d41-b5bb-4175-96f2-3c83d2893730 req-d2fff038-2ff6-4825-92a0-bdca20161a3f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:21.937712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4d469d41-b5bb-4175-96f2-3c83d2893730 req-d2fff038-2ff6-4825-92a0-bdca20161a3f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:21.938163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4d469d41-b5bb-4175-96f2-3c83d2893730 req-d2fff038-2ff6-4825-92a0-bdca20161a3f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:21.954712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4d469d41-b5bb-4175-96f2-3c83d2893730 req-d2fff038-2ff6-4825-92a0-bdca20161a3f service nova] Creating event network-changed:c910a0d3-67b0-4c03-859b-64f56ae4c159 for instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d on n-h1-master-1 Oct 02 01:17:21.961348 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4d469d41-b5bb-4175-96f2-3c83d2893730 req-d2fff038-2ff6-4825-92a0-bdca20161a3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162181 Oct 02 01:17:21.962325 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1819/3790] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:21.990487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1b179b7-466c-4e2d-a5ea-e7f87694f383"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:21.993349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:22.000015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.000716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.001329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.002217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.002873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.003472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.125046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:22.126536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:22.133353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.133846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.134470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.135774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.136247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.136680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.359936 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-67d6c6da-a6ad-495d-8271-ecbdd4cbfd3d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373872 Oct 02 01:17:22.361304 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1972/3791] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:17:21 2022] POST /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:22.389381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:22.390034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:22.402255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.403444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.404410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.406757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.407945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.409135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.464715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:22.490567 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4046779-7379-4d6f-892a-091f3a5cea8b tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1510 microversion: 2.1 time: 0.370072 Oct 02 01:17:22.494588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1820/3792] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:22 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:22.605611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:22.606763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:22.619094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.619923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.620756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.622117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.623042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.623819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.897297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:22.907644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a3908fa-9764-4b31-a701-52a83ffdfe53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.543992 Oct 02 01:17:22.908236 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1973/3793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:22 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:22.919637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:22.927907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:22.941209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.945044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.945726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:22.946656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:22.947285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:22.947882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:23.056542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:23.064226 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e261c2fe-c151-4bd2-893a-3b9f93a02470 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.463350 Oct 02 01:17:23.064806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1821/3794] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:22 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:23.221316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:23.230465 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e5d1add-21e1-4a7a-bef0-ecd01c6b27c8 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1505 microversion: 2.1 time: 0.314886 Oct 02 01:17:23.234637 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1974/3795] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:22 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:23.264485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1513081603"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:23.265100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:23.279621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:23.280445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:23.281079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:23.281795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:23.282259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:23.284166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:23.319601 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:23.519867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:23.521083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:23.530816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:23.532059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:23.532246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:23.533336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:23.534577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:23.535302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:23.535749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Adding security group 0cb25545-4372-441e-9702-2e7ed9d59495 to port 6546a8d9-b30f-41f7-a24d-9bd99290af6a Oct 02 01:17:23.651137 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:23.696275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:23.713658 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6aaa5aa0-7ee3-4789-8193-a08e2388e96a tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1302 microversion: 2.1 time: 0.198633 Oct 02 01:17:23.727948 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1975/3796] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:23 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1302 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:23.933552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:23.935103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:23.942300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:23.943986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:23.945360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:23.948192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:23.949866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:23.951315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:24.049362 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24909b13-b40d-4ea4-b68c-76fa98440f32 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1/action" status: 202 len: 0 microversion: 2.1 time: 0.797282 Oct 02 01:17:24.050301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1822/3797] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:17:23 2022] POST /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:17:24.057458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2763d157-02e8-4113-a605-6bf802cc17ed req-bb5f3c53-5e14-4180-abdf-f1897050f9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12dbc4ef-3666-4384-b934-8599e8ae04b0", "name": "network-vif-deleted", "tag": "8781dac2-41f9-4bab-8d65-3b08348921fd"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:24.090968 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:24.093150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2763d157-02e8-4113-a605-6bf802cc17ed req-bb5f3c53-5e14-4180-abdf-f1897050f9ec service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:24.093634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2763d157-02e8-4113-a605-6bf802cc17ed req-bb5f3c53-5e14-4180-abdf-f1897050f9ec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:24.094160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2763d157-02e8-4113-a605-6bf802cc17ed req-bb5f3c53-5e14-4180-abdf-f1897050f9ec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:24.111441 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2763d157-02e8-4113-a605-6bf802cc17ed req-bb5f3c53-5e14-4180-abdf-f1897050f9ec service nova] Creating event network-vif-deleted:8781dac2-41f9-4bab-8d65-3b08348921fd for instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 on n-h1-master-1 Oct 02 01:17:24.137109 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2763d157-02e8-4113-a605-6bf802cc17ed req-bb5f3c53-5e14-4180-abdf-f1897050f9ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080586 Oct 02 01:17:24.141986 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1823/3798] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:24.154087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-140205734"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:24.158926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:24.167107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:24.167604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:24.168047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:24.168750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:24.183385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:24.184339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:24.675564 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Adding security group 13f1f66f-bac1-496e-aea0-fa3ad5672447 to port 6546a8d9-b30f-41f7-a24d-9bd99290af6a Oct 02 01:17:24.683999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:24.697408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2674e0c-73dc-40d3-aeb2-8cda52fa4e69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.768661 Oct 02 01:17:24.698408 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1976/3799] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:23 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:24.707815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-889bc949-d133-435b-954a-96f58209b940 req-d9fc342e-8f52-4595-8e21-095e97c0f0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1536ba-614a-483e-9565-45379729caf1", "tag": "6546a8d9-b30f-41f7-a24d-9bd99290af6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:24.730548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-889bc949-d133-435b-954a-96f58209b940 req-d9fc342e-8f52-4595-8e21-095e97c0f0de service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:24.731069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-889bc949-d133-435b-954a-96f58209b940 req-d9fc342e-8f52-4595-8e21-095e97c0f0de service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:24.731504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-889bc949-d133-435b-954a-96f58209b940 req-d9fc342e-8f52-4595-8e21-095e97c0f0de service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:24.765783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-889bc949-d133-435b-954a-96f58209b940 req-d9fc342e-8f52-4595-8e21-095e97c0f0de service nova] Creating event network-changed:6546a8d9-b30f-41f7-a24d-9bd99290af6a for instance 3b1536ba-614a-483e-9565-45379729caf1 on n-h2-master-1 Oct 02 01:17:24.774098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-889bc949-d133-435b-954a-96f58209b940 req-d9fc342e-8f52-4595-8e21-095e97c0f0de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073490 Oct 02 01:17:24.779211 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1977/3800] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:24.791681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:24.794645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:24.826678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:24.827105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:24.827605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:24.838783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:24.839358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:24.840154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.245123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:25.267102 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e55e3051-c9fb-4483-9beb-a810679daa96 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.481901 Oct 02 01:17:25.270586 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1978/3801] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:24 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:25.277479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:25.278307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:25.285458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.286117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.286757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.287643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.288300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.288922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.331033 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:25.336524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.337193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.337795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.338415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lazy-loading 'fault' on Instance uuid 12dbc4ef-3666-4384-b934-8599e8ae04b0 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:25.561599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fd89c34d84d77b2c0ad9d5ad45390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53272886aeac4313b1e8ad37b6f9ff12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:25.581598 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-033172fd-4ceb-47a4-9be5-f973d45c323e tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 200 len: 1307 microversion: 2.1 time: 0.309185 Oct 02 01:17:25.584871 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1979/3802] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:25 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:25.796440 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:25.848987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:25.850361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.851674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.852151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.855458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.855996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.856442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.856931 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:25.891734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da494905-53cc-41b1-9f31-71b7941b1718 tempest-AZV2TestJSON-2124391912 tempest-AZV2TestJSON-2124391912-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.304478 Oct 02 01:17:25.892686 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1980/3803] 10.222.0.23 () {58 vars in 1164 bytes} [Sun Oct 2 01:17:25 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:17:25.899425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:25.900431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:25.908001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.908729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.909363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:25.910263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:25.910937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:25.911538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:26.588337 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5c8aabf-389f-4fac-82a9-b6fe57831d3a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1/action" status: 202 len: 0 microversion: 2.1 time: 2.445008 Oct 02 01:17:26.589481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1824/3804] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:17:24 2022] POST /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1/action => generated 0 bytes in 2447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:17:26.594770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:26.595388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:26.612458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:26.613357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:26.613818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:26.617329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:26.617827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:26.620921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:26.696172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:26.720738 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45b8e377-75f4-48ee-9ad3-5ddfbacc1876 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.826555 Oct 02 01:17:26.721414 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1981/3805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:25 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:26.726486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:26.730579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:26.754102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:26.761113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:26.761729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:26.762649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:26.763184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:26.763703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:26.859714 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:27.220764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:27.265945 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e266d05-7d8e-4a49-8402-2880b8b43309 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.675051 Oct 02 01:17:27.267366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1825/3806] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:26 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:27.279158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:27.279741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 12dbc4ef-3666-4384-b934-8599e8ae04b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:27.281673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5c53262-4c18-46b6-899e-b3ac0f8e36d6 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.559118 Oct 02 01:17:27.293700 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1982/3807] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:17:26 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1/os-security-groups => generated 1158 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:27.294842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.294842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.294842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.294842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.294842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.294842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.304559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-45c9b311-9381-4587-85f2-441f69403935 req-6119bfae-4106-4c63-99a0-136af750a1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1536ba-614a-483e-9565-45379729caf1", "tag": "6546a8d9-b30f-41f7-a24d-9bd99290af6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:27.321080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-45c9b311-9381-4587-85f2-441f69403935 req-6119bfae-4106-4c63-99a0-136af750a1d8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.321957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-45c9b311-9381-4587-85f2-441f69403935 req-6119bfae-4106-4c63-99a0-136af750a1d8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.322396 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] HTTP exception thrown: Instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 could not be found. Oct 02 01:17:27.322912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-45c9b311-9381-4587-85f2-441f69403935 req-6119bfae-4106-4c63-99a0-136af750a1d8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Request method failure captured: Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 HTTP/1.1 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOXll2EK9e1n8sm0wH6sQ2pFBvIF5GkmPnfA2KzpKUVEVbn1iAj_LvZVt-EKiSJVHT1GXQ4pRfCbFKE8MfIEOOmPCS6ICsd3A_I74p9te44pAhJguAhj3tOInENH5NLm2gHhauQFiZj0x0VkbbgEHW7JugRv0WSBqKCoIoYrLi_1T5w Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53272886aeac4313b1e8ad37b6f9ff12"}]}] Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7f2fd89c34d84d77b2c0ad9d5ad45390 Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 could not be found. Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '12dbc4ef-3666-4384-b934-8599e8ae04b0'} Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 could not be found. Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 could not be found. Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.325914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 could not be found. Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Returning 404 to user: Instance 12dbc4ef-3666-4384-b934-8599e8ae04b0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:27.330816 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed526ba6-7386-4f48-b46b-f3f38c484a60 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0" status: 404 len: 111 microversion: 2.1 time: 0.058888 Oct 02 01:17:27.336384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1826/3808] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:27 2022] GET /compute/v2.1/servers/12dbc4ef-3666-4384-b934-8599e8ae04b0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:27.347871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b83b1085-bca3-4b83-8937-f2b23d1b8577 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb8808ab160>, body: {"security_group": {"name": " tempest-securitygroup -495681854 ", "description": "tempest-description-1746125272"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:27.353296 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-45c9b311-9381-4587-85f2-441f69403935 req-6119bfae-4106-4c63-99a0-136af750a1d8 service nova] Creating event network-changed:6546a8d9-b30f-41f7-a24d-9bd99290af6a for instance 3b1536ba-614a-483e-9565-45379729caf1 on n-h2-master-1 Oct 02 01:17:27.359512 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-45c9b311-9381-4587-85f2-441f69403935 req-6119bfae-4106-4c63-99a0-136af750a1d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071839 Oct 02 01:17:27.360807 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1983/3809] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:27.367917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:27.368866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:27.378119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.379001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.379689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.380647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.381855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.382758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.401891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] HTTP exception thrown: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Request method failure captured: Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b HTTP/1.1 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXll2EK9e1n8sm0wH6sQ2pFBvIF5GkmPnfA2KzpKUVEVbn1iAj_LvZVt-EKiSJVHT1GXQ4pRfCbFKE8MfIEOOmPCS6ICsd3A_I74p9te44pAhJguAhj3tOInENH5NLm2gHhauQFiZj0x0VkbbgEHW7JugRv0WSBqKCoIoYrLi_1T5w Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53272886aeac4313b1e8ad37b6f9ff12"}]}] Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7f2fd89c34d84d77b2c0ad9d5ad45390 Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '44f936fb-38a3-4baa-b74c-4cfd54e3156b'} Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:27.404100 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.408562 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.412528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Returning 404 to user: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:27.413654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a5a021c-d76d-4f6c-abf1-ca8d35f37677 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 404 len: 111 microversion: 2.1 time: 0.051285 Oct 02 01:17:27.414090 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1984/3810] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:27 2022] DELETE /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:27.439939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:27.441940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 44f936fb-38a3-4baa-b74c-4cfd54e3156b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:27.483726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.484370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.484821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.488001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.490571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.491934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.536768 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] HTTP exception thrown: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Request method failure captured: Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b HTTP/1.1 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXll2EK9e1n8sm0wH6sQ2pFBvIF5GkmPnfA2KzpKUVEVbn1iAj_LvZVt-EKiSJVHT1GXQ4pRfCbFKE8MfIEOOmPCS6ICsd3A_I74p9te44pAhJguAhj3tOInENH5NLm2gHhauQFiZj0x0VkbbgEHW7JugRv0WSBqKCoIoYrLi_1T5w Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53272886aeac4313b1e8ad37b6f9ff12"}]}] Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7f2fd89c34d84d77b2c0ad9d5ad45390 Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '44f936fb-38a3-4baa-b74c-4cfd54e3156b'} Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.543012 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. Oct 02 01:17:27.549364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.551623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Returning 404 to user: Instance 44f936fb-38a3-4baa-b74c-4cfd54e3156b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:27.553646 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18df3c88-af0a-482b-bfd7-4b033e997698 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b" status: 404 len: 111 microversion: 2.1 time: 0.124742 Oct 02 01:17:27.555542 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1985/3811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:27 2022] GET /compute/v2.1/servers/44f936fb-38a3-4baa-b74c-4cfd54e3156b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:27.585105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:27.586906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:27.597922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.598919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.599544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.600586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.601485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.602534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.627279 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] HTTP exception thrown: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Request method failure captured: Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc HTTP/1.1 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXll2EK9e1n8sm0wH6sQ2pFBvIF5GkmPnfA2KzpKUVEVbn1iAj_LvZVt-EKiSJVHT1GXQ4pRfCbFKE8MfIEOOmPCS6ICsd3A_I74p9te44pAhJguAhj3tOInENH5NLm2gHhauQFiZj0x0VkbbgEHW7JugRv0WSBqKCoIoYrLi_1T5w Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53272886aeac4313b1e8ad37b6f9ff12"}]}] Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7f2fd89c34d84d77b2c0ad9d5ad45390 Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '8ad765cc-a5f7-4748-922a-b6a7086787cc'} Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:27.629507 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.634710 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.638679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Returning 404 to user: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:27.639913 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4d131d2-be4b-4c55-a5b4-2b95a3126752 tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 404 len: 111 microversion: 2.1 time: 0.064520 Oct 02 01:17:27.641311 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1986/3812] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:27 2022] DELETE /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:27.662952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:27.664678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] [instance: 8ad765cc-a5f7-4748-922a-b6a7086787cc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:27.682635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.684625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.687008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.691016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.691693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.694424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.777816 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] HTTP exception thrown: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Request method failure captured: Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc HTTP/1.1 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOXll2EK9e1n8sm0wH6sQ2pFBvIF5GkmPnfA2KzpKUVEVbn1iAj_LvZVt-EKiSJVHT1GXQ4pRfCbFKE8MfIEOOmPCS6ICsd3A_I74p9te44pAhJguAhj3tOInENH5NLm2gHhauQFiZj0x0VkbbgEHW7JugRv0WSBqKCoIoYrLi_1T5w Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53272886aeac4313b1e8ad37b6f9ff12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53272886aeac4313b1e8ad37b6f9ff12"}]}] Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 53272886aeac4313b1e8ad37b6f9ff12 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1106030672 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7f2fd89c34d84d77b2c0ad9d5ad45390 Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerDiskConfigTestJSON-1106030672-project Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '8ad765cc-a5f7-4748-922a-b6a7086787cc'} Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:27.795375 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] Returning 404 to user: Instance 8ad765cc-a5f7-4748-922a-b6a7086787cc could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:27.804617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f9f14eb5-7446-45ad-a799-d14e333208dd tempest-ServerDiskConfigTestJSON-1106030672 tempest-ServerDiskConfigTestJSON-1106030672-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc" status: 404 len: 111 microversion: 2.1 time: 0.153446 Oct 02 01:17:27.809672 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1987/3813] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:27 2022] GET /compute/v2.1/servers/8ad765cc-a5f7-4748-922a-b6a7086787cc => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:27.823549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:27.826791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:27.855738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.856240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.856957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.859954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:27.862337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:27.864004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:27.914140 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b83b1085-bca3-4b83-8937-f2b23d1b8577 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.575109 Oct 02 01:17:27.915339 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1827/3814] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:27 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:27.931624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13f04413-cbb1-42a5-a587-be475c438657 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb8808ab430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:28.252883 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13f04413-cbb1-42a5-a587-be475c438657 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc" status: 200 len: 223 microversion: 2.1 time: 0.327734 Oct 02 01:17:28.261558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1828/3815] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:17:27 2022] GET /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc => generated 223 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:17:28.266957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-35308234-0f23-4019-9757-de858c2a75a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb885566310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:28.671452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:28.684389 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a6947e96-2d99-4965-b95e-27dd02079711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.871050 Oct 02 01:17:28.685167 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1988/3816] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:27 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:28.694173 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:28.698013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:28.713433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:28.714239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:28.715325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:28.716242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:28.716945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:28.717543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:29.066026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:29.094714 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65d2f1b6-f42d-450a-9e5b-44ef9ac3a88e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.390661 Oct 02 01:17:29.094714 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1989/3817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:28 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:29.214389 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-35308234-0f23-4019-9757-de858c2a75a5 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc" status: 202 len: 0 microversion: 2.1 time: 0.950895 Oct 02 01:17:29.222030 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1829/3818] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:17:28 2022] DELETE /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:17:29.223991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880460550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:29.420040 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:29.420999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.security_group_api [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc not found {{(pid=122355) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:29.421791 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.421791 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc HTTP/1.1 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: exception: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '60a88656-9780-4b1c-93ed-b532b0ad9ecc'} Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:29.424359 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] Oct 02 01:17:29.432444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:29.445330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:17:29.445330 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-ae4167fe-d538-4008-a0d8-f75564a2187f'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:29.447554 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a6961b6c-f803-493f-a222-4a1003d7becd tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc" status: 404 len: 194 microversion: 2.1 time: 0.227143 Oct 02 01:17:29.449170 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1990/3819] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:17:29 2022] GET /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc => generated 194 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:17:29.468690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85f28a03-21c0-4f60-8e5c-a2823b3ca12f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb8809483a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-525227912", "description": "tempest-description-778134716"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:29.716836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:29.719439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:29.732893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:29.734277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:29.736517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:29.740492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:29.742061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:29.743121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:30.011376 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85f28a03-21c0-4f60-8e5c-a2823b3ca12f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.557662 Oct 02 01:17:30.012507 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1830/3820] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:17:30.026753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68b621fd-e5e9-4a31-a4dc-1a81c9990e3b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb8808abaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-960951654", "description": "tempest-description-1887101484"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:30.121878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:30.137175 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bee9a3b2-ef06-4d89-9ae5-dfe8e75cda3a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.429258 Oct 02 01:17:30.155374 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1991/3821] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:29 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:30.165342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:30.166436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:30.177922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:30.179867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:30.181207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:30.182699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:30.183701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:30.184692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:30.769021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68b621fd-e5e9-4a31-a4dc-1a81c9990e3b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.747453 Oct 02 01:17:30.771111 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1831/3822] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:30.783656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe93a789-73e0-4733-86f2-6941cec0ce50 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb8808b4b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2052342814", "description": "tempest-description-1798978603"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:30.886921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:30.890401 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:30.905864 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c153c511-c0dc-4981-88d4-08f9535adefe tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.748683 Oct 02 01:17:30.906924 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1992/3823] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:30 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:30.935347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b8e23416-3ee8-4a1b-94be-9832e2d92e64 req-a7320590-7779-467a-9956-153e88a8d8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e8b7de-9bd5-4ad8-8082-92453a8e584d", "name": "network-vif-plugged", "status": "completed", "tag": "c910a0d3-67b0-4c03-859b-64f56ae4c159"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:30.994778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b8e23416-3ee8-4a1b-94be-9832e2d92e64 req-a7320590-7779-467a-9956-153e88a8d8a9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:30.996940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b8e23416-3ee8-4a1b-94be-9832e2d92e64 req-a7320590-7779-467a-9956-153e88a8d8a9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:30.999322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b8e23416-3ee8-4a1b-94be-9832e2d92e64 req-a7320590-7779-467a-9956-153e88a8d8a9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:31.022338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b8e23416-3ee8-4a1b-94be-9832e2d92e64 req-a7320590-7779-467a-9956-153e88a8d8a9 service nova] Creating event network-vif-plugged:c910a0d3-67b0-4c03-859b-64f56ae4c159 for instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d on n-h1-master-1 Oct 02 01:17:31.030852 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b8e23416-3ee8-4a1b-94be-9832e2d92e64 req-a7320590-7779-467a-9956-153e88a8d8a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122351 Oct 02 01:17:31.031863 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1993/3824] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:31.173472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:31.174909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:31.192922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:31.193565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:31.194008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:31.195366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:31.195828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:31.196359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:31.633376 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe93a789-73e0-4733-86f2-6941cec0ce50 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.854328 Oct 02 01:17:31.634427 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1832/3825] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:31.649426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c855d675-a15f-495a-9d78-975fa5eafbf2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb8809129d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:31.990628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:31.998575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc83174e-211a-4a7e-87eb-637cf262bacd tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.829490 Oct 02 01:17:32.007669 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1994/3826] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:31 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:32.012952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:32.013583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:32.038267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:32.039422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:32.039983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:32.040704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:32.041164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:32.041592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:32.542895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:32.553551 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-730df1cc-7b95-48e7-8676-a35df3c6b362 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1315 microversion: 2.1 time: 0.544434 Oct 02 01:17:32.555892 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1995/3827] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:32 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:32.762176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c855d675-a15f-495a-9d78-975fa5eafbf2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.118658 Oct 02 01:17:32.766350 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1833/3828] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:17:31 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:32.783386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ad3ccb3-0adc-4a92-88f5-24c4f3b52353 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb8804db790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:33.034198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:33.035274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:33.048378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:33.049210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:33.050319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:33.051800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:33.052512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:33.053169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:33.550548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:33.564797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-935db569-13e7-44cc-942f-22dd7487bd1a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.537160 Oct 02 01:17:33.566782 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1834/3829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:33 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:33.576487 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ad3ccb3-0adc-4a92-88f5-24c4f3b52353 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5" status: 202 len: 0 microversion: 2.1 time: 0.799044 Oct 02 01:17:33.577565 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1996/3830] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:17:32 2022] DELETE /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5 => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:17:33.579310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9508b6e9-fdc7-46fa-979c-d80a412e2103 req-012e62d1-9731-4045-8d93-ff98d21ff4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b17f445-1e8e-4f9e-b327-b481f300bbb7", "name": "network-vif-plugged", "status": "completed", "tag": "b4bca5c7-1ddd-403d-b744-fd4732a49134"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:33.582956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:33.586205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:33.601129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9508b6e9-fdc7-46fa-979c-d80a412e2103 req-012e62d1-9731-4045-8d93-ff98d21ff4df service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:33.602309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9508b6e9-fdc7-46fa-979c-d80a412e2103 req-012e62d1-9731-4045-8d93-ff98d21ff4df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:33.602790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9508b6e9-fdc7-46fa-979c-d80a412e2103 req-012e62d1-9731-4045-8d93-ff98d21ff4df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:33.604187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:33.604701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:33.605831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:33.607579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:33.608412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:33.609105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:33.637870 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9508b6e9-fdc7-46fa-979c-d80a412e2103 req-012e62d1-9731-4045-8d93-ff98d21ff4df service nova] Creating event network-vif-plugged:b4bca5c7-1ddd-403d-b744-fd4732a49134 for instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 on n-h2-master-1 Oct 02 01:17:33.656945 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9508b6e9-fdc7-46fa-979c-d80a412e2103 req-012e62d1-9731-4045-8d93-ff98d21ff4df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087577 Oct 02 01:17:33.657972 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1835/3831] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:33.683337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880b228b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:33.822950 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:33.825441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group 5064189c-129b-4eaf-a483-bc67870c73f5 not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:33.826332 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.826332 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5 HTTP/1.1 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: exception: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5064189c-129b-4eaf-a483-bc67870c73f5'} Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:33.854350 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] Oct 02 01:17:33.859691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:33.869248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:17:33.869248 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-cdf5ded6-5781-465b-b2e8-1fb745e553f8'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:33.869248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f86dff11-eb74-46ef-80da-92bc0051a271 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5" status: 404 len: 194 microversion: 2.1 time: 0.200643 Oct 02 01:17:33.871409 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1836/3832] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:17:33 2022] GET /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5 => generated 194 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:33.890131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01d1ed66-fb8f-4d3b-93a6-a1f82f72ad35 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880903c10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:34.518963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:34.546735 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-84c4e5a5-4e73-45ce-a9a6-428842f7ca50 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1502 microversion: 2.1 time: 0.968008 Oct 02 01:17:34.565053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1997/3833] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:33 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1502 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:34.584032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:34.587120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:34.599894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:34.603304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:34.604887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:34.607461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:34.608214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:34.608905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:34.974305 n-d-master-1 devstack@n-api.service[122355]: INFO nova.network.security_group_api [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Removing security group da1030ec-e5f4-4660-b97b-08aacb5c055a from port c910a0d3-67b0-4c03-859b-64f56ae4c159 Oct 02 01:17:35.350169 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01d1ed66-fb8f-4d3b-93a6-a1f82f72ad35 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e" status: 202 len: 0 microversion: 2.1 time: 1.473527 Oct 02 01:17:35.352536 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1837/3834] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:17:33 2022] DELETE /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e => generated 0 bytes in 1477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:17:35.358506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:35.359547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:35.386580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:35.387117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:35.387619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:35.388700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:35.389418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:35.394390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:35.870103 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:35.933223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:35.947944 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-41fa8582-38a5-4d2d-8f06-f03e50ff641b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1309 microversion: 2.1 time: 0.594070 Oct 02 01:17:35.948543 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1838/3835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:35 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:35.981983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb8809039d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:36.238569 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:36.239208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group a3316e8c-17e6-4990-a72c-d1e13325bd1e not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:36.239737 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.239737 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e HTTP/1.1 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: exception: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a3316e8c-17e6-4990-a72c-d1e13325bd1e'} Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:36.241549 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-8180dfe1-673c-47ec-bbfe-3a6c57c97d38'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2472cd7-dee3-4870-a4b7-76edee761f93 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e" status: 404 len: 194 microversion: 2.1 time: 0.293019 Oct 02 01:17:36.247089 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1839/3836] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:17:35 2022] GET /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e => generated 194 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:36.251458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbf8b47d-4940-4bd5-8318-906b04e27cad tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb8808d8160>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:36.307210 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d851065b-6188-4c2b-82d2-3449b973bd8b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d/action" status: 202 len: 0 microversion: 2.1 time: 1.730062 Oct 02 01:17:36.312185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1998/3837] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:17:34 2022] POST /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d/action => generated 0 bytes in 1736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:17:36.317914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:36.318511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:36.334166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:36.334988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:36.337140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:36.342348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:36.343073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:36.343748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:36.723631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:36.739516 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d54219be-ee20-4663-945e-0bc4c60370fd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1460 microversion: 2.1 time: 0.425228 Oct 02 01:17:36.754933 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 1999/3838] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:36 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1460 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:36.770185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-bc49e7e0-5005-4473-8f31-d429a8dc258e req-583ce935-4c24-4583-8075-7cc7fd17951d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e8b7de-9bd5-4ad8-8082-92453a8e584d", "tag": "c910a0d3-67b0-4c03-859b-64f56ae4c159"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:36.804570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bc49e7e0-5005-4473-8f31-d429a8dc258e req-583ce935-4c24-4583-8075-7cc7fd17951d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:36.805300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bc49e7e0-5005-4473-8f31-d429a8dc258e req-583ce935-4c24-4583-8075-7cc7fd17951d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:36.805421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bc49e7e0-5005-4473-8f31-d429a8dc258e req-583ce935-4c24-4583-8075-7cc7fd17951d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:36.849883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-bc49e7e0-5005-4473-8f31-d429a8dc258e req-583ce935-4c24-4583-8075-7cc7fd17951d service nova] Creating event network-changed:c910a0d3-67b0-4c03-859b-64f56ae4c159 for instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d on n-h1-master-1 Oct 02 01:17:36.860361 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-bc49e7e0-5005-4473-8f31-d429a8dc258e req-583ce935-4c24-4583-8075-7cc7fd17951d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093727 Oct 02 01:17:36.865151 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2000/3839] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:36.881978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:36.887209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:36.904210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:36.905028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:36.906467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:36.908956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:36.909701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:36.911141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:36.988372 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bbf8b47d-4940-4bd5-8318-906b04e27cad tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e" status: 202 len: 0 microversion: 2.1 time: 0.740015 Oct 02 01:17:36.990014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1840/3840] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:17:36 2022] DELETE /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:17:36.997420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:36.999701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:37.017277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.018025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.019001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.020252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.021144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.022467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.292922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:37.306928 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e51a637-cfb3-4763-bb96-f2dd4462be63 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.440155 Oct 02 01:17:37.307888 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2001/3841] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:36 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:37.319143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88055b8b0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:37.379988 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:17:37.381139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.security_group_api [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group f307260e-3967-4633-9791-aa9b11572e2e not found {{(pid=122355) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:17:37.381934 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.381934 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e HTTP/1.1 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: exception: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f307260e-3967-4633-9791-aa9b11572e2e'} Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:17:37.385007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] Oct 02 01:17:37.390071 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:37.394953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:17:37.394953 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-ada659a8-0119-4c8c-8999-3abea95f5207'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:37.395683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72feb170-8b61-4ce5-a769-dbb5e1efa67f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e" status: 404 len: 194 microversion: 2.1 time: 0.084310 Oct 02 01:17:37.396466 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2002/3842] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:17:37 2022] GET /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:37.407613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:37.412742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:37.422667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:37.426427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93ab0831-88b9-45c4-8ee6-616ec12a76d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1491 microversion: 2.1 time: 0.434735 Oct 02 01:17:37.431932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1841/3843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:36 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1491 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:37.445101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:37.446172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:37.450590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.456994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.458246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.460225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.462900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.464348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.466008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.469374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.470087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.473265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.476526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.477272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.509290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:37.622294 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3526d1fd-c3de-41bd-84dc-4edd97661929 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 204 len: 0 microversion: 2.1 time: 0.224160 Oct 02 01:17:37.625374 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2003/3844] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:37 2022] DELETE /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:17:37.636878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-23f3ad4e-4d13-4106-9854-ee61d18625ae tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880506b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:37.654504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:37.664344 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae67f7e6-e166-408c-8a33-40021433b6ae tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.230358 Oct 02 01:17:37.665240 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1842/3845] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:37 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:37.670204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:37.671236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:37.678079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.680160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.680904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.682474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.683243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.683942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.937394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:37.951891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8c48528-aabf-47b1-b3ec-34e826918039 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1490 microversion: 2.1 time: 0.283728 Oct 02 01:17:37.952555 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1843/3846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:37 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1490 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:37.958038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:37.958702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:37.966802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.967298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.967820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.969159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:37.970053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:37.970563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:37.999922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-23f3ad4e-4d13-4106-9854-ee61d18625ae tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.372897 Oct 02 01:17:38.001424 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2004/3847] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:17:37 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:38.020144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:38.021143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:38.034906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:38.035883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:38.036507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:38.051904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:38.052719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:38.053404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:38.308782 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:38.318425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56a49034-de7c-4364-a5e8-0a68e1205fb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1555 microversion: 2.1 time: 0.364463 Oct 02 01:17:38.319270 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1844/3848] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:37 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:38.350534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:38.355626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:38.385113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:38.388010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:38.388969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:38.393637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:38.398003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:38.399088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:38.421485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:38.430316 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a7b34d8-39f2-43f5-9250-79cb81032061 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.422005 Oct 02 01:17:38.435344 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2005/3849] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:38 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:38.442417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58fcccea-122a-4d16-b3ec-7b49b0e1a8c4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb880506a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-117164270", "description": "tempest-description-1647725595"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:38.894754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:38.928523 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81dd17f9-b3dc-4b77-8006-c88ac89a2c55 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1491 microversion: 2.1 time: 0.583726 Oct 02 01:17:38.934206 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1845/3850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:38 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1491 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:38.944408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58fcccea-122a-4d16-b3ec-7b49b0e1a8c4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.507499 Oct 02 01:17:38.945917 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2006/3851] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:38.967131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e693515-bbb0-4963-8711-4eb17d8817c4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb8805429d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1189667167", "description": "tempest-description-466482934"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:38.981826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:38.984923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:38.999493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.001682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.003275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.007233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.008105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.010061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.316818 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e693515-bbb0-4963-8711-4eb17d8817c4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.357552 Oct 02 01:17:39.326674 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2007/3852] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:17:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:39.331393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:39.346676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:39.372298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.373479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.378280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.379783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.381808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.389657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.401713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:39.419329 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06ba1614-ce07-4c46-b01f-b17ed3c33e89 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.479915 Oct 02 01:17:39.426454 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1846/3853] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:38 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:39.436722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:39.437669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:39.447084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.447890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.448605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.449591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.451153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.451685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.504589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:39.699297 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10b37b53-3e03-45e6-9173-933bdfb59752 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 204 len: 0 microversion: 2.1 time: 0.379104 Oct 02 01:17:39.704469 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2008/3854] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:39 2022] DELETE /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:17:39.711616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1205705461", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "a122e3ee-b4c8-45e1-bf4b-5f8f96282722"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:39.787276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] validate_networks() for [('a122e3ee-b4c8-45e1-bf4b-5f8f96282722', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:39.860680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:39.881909 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfbd123e-d5d9-4c42-8d5a-794bd5997cbe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1555 microversion: 2.1 time: 0.454233 Oct 02 01:17:39.886241 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1847/3855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:39 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1555 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:39.891616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:39.898462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:39.905451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.906142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.906931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:39.908019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:39.908879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:39.910192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:40.437438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:40.457501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-adfe3002-a06d-4eac-a6dd-334a1446e564 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1497 microversion: 2.1 time: 0.569712 Oct 02 01:17:40.467560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1848/3856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:39 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1497 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:40.480554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-763329289", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:40.581479 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] validate_networks() for [('ff4d9f8b-bbe1-4d5b-96ef-dc0090a857d2', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:40.912612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:40.913336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:40.914689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:40.915039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:40.916100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:40.938390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:40.939277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:40.940033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:40.941052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:40.941623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:40.942094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:41.014991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Getting quotas for project 94224832aed24d2f83c72250cbfb4a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:41.026428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Getting quotas for user 63e0eaf9b9e34b8d80e9ddadd09989fa and project 94224832aed24d2f83c72250cbfb4a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:41.043857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:41.047426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:41.134648 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ebcdbcf7-a6f9-4de3-a89a-65a885e74a05 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427962 Oct 02 01:17:41.135565 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2009/3857] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:17:41.140962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:41.141959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:41.148792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:41.149426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:41.154858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:41.155887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:41.156545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:41.157018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:41.357487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:41.371789 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3007d31-68c7-48bb-b9b2-7641ed52400a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1513 microversion: 2.1 time: 0.234641 Oct 02 01:17:41.372635 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2010/3858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:41 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:41.377881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-622a4782-7acd-4d69-b1c6-7d6d56e17b9c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:41.378507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-622a4782-7acd-4d69-b1c6-7d6d56e17b9c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:41.646913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-622a4782-7acd-4d69-b1c6-7d6d56e17b9c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:41.660512 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-622a4782-7acd-4d69-b1c6-7d6d56e17b9c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1216 microversion: 2.1 time: 0.285999 Oct 02 01:17:41.666241 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2011/3859] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:41 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1216 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:42.328918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-736448431", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "0c7348db-cede-4ce7-892d-3a6fe29dc1d3"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:42.503895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] validate_networks() for [('0c7348db-cede-4ce7-892d-3a6fe29dc1d3', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:43.148534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:43.149929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:43.151381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:43.151807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:43.152234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:43.170559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.173174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.175559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.176561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.178310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.178982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.234845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:43.255922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Getting quotas for user 66a9d6a142d444be90b2101f23603522 and project 3c94ca45e7684b3c818871e232e08342. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:43.309043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:43.318147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:43.453542 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef7bfc34-9055-4b7d-8b3c-d20401370984 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.976926 Oct 02 01:17:43.454817 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1849/3860] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:17:43.459795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:43.474955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:43.484818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.485251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.485693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.486408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.486901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.487331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.602773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.603286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.609856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.610660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'fault' on Instance uuid 7b17f445-1e8e-4f9e-b327-b481f300bbb7 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:17:43.795246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:43.805103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6299c71c-daea-4bc2-a708-4014194fe768 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 200 len: 1299 microversion: 2.1 time: 0.348524 Oct 02 01:17:43.808826 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1850/3861] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:43 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:43.823035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cee6105d-89c9-45d5-bd8d-de90be82757d req-172a86b1-9c56-45ca-9d67-3dfe48d6d061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b621df-a125-42a6-a9d9-2f65d0e618b1", "name": "network-vif-deleted", "tag": "15b9bb9a-5280-4d53-9ec0-f2ef5f4a82c4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:43.847532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cee6105d-89c9-45d5-bd8d-de90be82757d req-172a86b1-9c56-45ca-9d67-3dfe48d6d061 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.849663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cee6105d-89c9-45d5-bd8d-de90be82757d req-172a86b1-9c56-45ca-9d67-3dfe48d6d061 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.860323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cee6105d-89c9-45d5-bd8d-de90be82757d req-172a86b1-9c56-45ca-9d67-3dfe48d6d061 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.893065 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cee6105d-89c9-45d5-bd8d-de90be82757d req-172a86b1-9c56-45ca-9d67-3dfe48d6d061 service nova] Creating event network-vif-deleted:15b9bb9a-5280-4d53-9ec0-f2ef5f4a82c4 for instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 on n-h2-master-1 Oct 02 01:17:43.907525 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cee6105d-89c9-45d5-bd8d-de90be82757d req-172a86b1-9c56-45ca-9d67-3dfe48d6d061 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095654 Oct 02 01:17:43.909537 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1851/3862] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:43.926215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:43.932615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:43.958061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.976321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.981987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:43.983773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:43.986741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:43.988140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:44.045764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:44.048377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:44.050347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:44.051095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:44.051765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:44.094283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:44.105302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:44.106178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:44.106707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:44.110424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:44.111340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:44.113670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:44.121515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5fcd6717-9902-48e0-a677-f58774a17494 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1346 microversion: 2.1 time: 0.208908 Oct 02 01:17:44.126941 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1852/3863] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:43 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1346 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:44.140997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:44.145014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:44.171903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:44.174299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:44.176325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:44.181349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:44.181923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:44.183954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:44.188404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Getting quotas for project aa4f0ad95a5e4ed294828e036dfef60a. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:44.208609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Getting quotas for user 4bfef22ac4e54465930158887c923f60 and project aa4f0ad95a5e4ed294828e036dfef60a. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:44.235909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:44.239708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:44.385105 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0c2a448-5c6e-4b21-a531-0f6213f3786e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.712963 Oct 02 01:17:44.385767 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2012/3864] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2715 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:17:44.416674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b81b043-d163-4121-941f-e75115371f79 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:44.417590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b81b043-d163-4121-941f-e75115371f79 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:44.424268 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:45.249527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:45.254040 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:45.307216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a9c7ff7d-f3ba-4fc7-972f-37a618897300 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1274 microversion: 2.1 time: 1.178844 Oct 02 01:17:45.310817 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1853/3865] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:44 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1274 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:45.326476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9645271e-1d20-4a67-b8dd-f4dd69efed85 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:45.333490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9645271e-1d20-4a67-b8dd-f4dd69efed85 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:45.499324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2b81b043-d163-4121-941f-e75115371f79 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:45.515446 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b81b043-d163-4121-941f-e75115371f79 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1214 microversion: 2.1 time: 1.124933 Oct 02 01:17:45.531554 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2013/3866] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:44 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1214 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:45.560957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:45.563805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:45.582566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:45.583559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:45.584398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:45.587919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:45.588722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:45.589368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:45.638213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9645271e-1d20-4a67-b8dd-f4dd69efed85 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:45.644788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:17:45.645956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9645271e-1d20-4a67-b8dd-f4dd69efed85 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 HTTP/1.1 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7b17f445-1e8e-4f9e-b327-b481f300bbb7'} Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:45.646473 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:17:45.652770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:45.653316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9645271e-1d20-4a67-b8dd-f4dd69efed85 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:45.653316 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9645271e-1d20-4a67-b8dd-f4dd69efed85 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1258 microversion: 2.21 time: 0.336375 Oct 02 01:17:45.658918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:45.661216 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-416a2a6e-c5dd-4083-ad86-fa0a929e0711 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 404 len: 111 microversion: 2.1 time: 0.119516 Oct 02 01:17:45.661955 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2014/3867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:45 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:45.677656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:45.678695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:45.679046 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1854/3868] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:45 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1258 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:45.684346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:45.684854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:45.695850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:45.697901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:45.698562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:45.699570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:45.702159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:45.702822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:45.731080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:45.731677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:45.732160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:45.732941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:45.733499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:45.733927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:45.800542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:45.997630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:46.016308 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0a7e831d-937d-433b-a731-541acba4a0bc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1346 microversion: 2.1 time: 0.346756 Oct 02 01:17:46.019885 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2015/3869] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:45 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1346 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:46.034445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-66df7a82-ad16-44b4-9de4-1922ccea93af req-d6c88ee7-5034-4283-82f0-e309a71cfb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b17f445-1e8e-4f9e-b327-b481f300bbb7", "name": "network-vif-deleted", "tag": "b4bca5c7-1ddd-403d-b744-fd4732a49134"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:46.049352 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e7e6758-9cd9-48e0-a337-dc64ffa7b437 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 204 len: 0 microversion: 2.1 time: 0.368459 Oct 02 01:17:46.050301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1855/3870] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:45 2022] DELETE /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:17:46.076272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:46.081486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:46.096142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-66df7a82-ad16-44b4-9de4-1922ccea93af req-d6c88ee7-5034-4283-82f0-e309a71cfb66 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:46.097205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-66df7a82-ad16-44b4-9de4-1922ccea93af req-d6c88ee7-5034-4283-82f0-e309a71cfb66 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:46.102746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-66df7a82-ad16-44b4-9de4-1922ccea93af req-d6c88ee7-5034-4283-82f0-e309a71cfb66 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:46.117388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:46.118666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:46.120021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:46.125906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:46.126374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:46.126849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:46.152693 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-66df7a82-ad16-44b4-9de4-1922ccea93af req-d6c88ee7-5034-4283-82f0-e309a71cfb66 service nova] Creating event network-vif-deleted:b4bca5c7-1ddd-403d-b744-fd4732a49134 for instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 on n-h2-master-1 Oct 02 01:17:46.172510 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-66df7a82-ad16-44b4-9de4-1922ccea93af req-d6c88ee7-5034-4283-82f0-e309a71cfb66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151142 Oct 02 01:17:46.173611 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2016/3871] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:46.338285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:46.339025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:46.359132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:46.362166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:46.365309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:46.366483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:46.370917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:46.371452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:46.431307 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:47.056481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.070430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfcda195-1623-48b9-af46-0743eb5bc806 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1496 microversion: 2.1 time: 1.009560 Oct 02 01:17:47.072613 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1856/3872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:46 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1496 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:47.082494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:47.083157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:47.120807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.121482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.128874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.129666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.130147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.133555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.302247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.315033 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0270fced-a586-4d9a-8268-a7354294a582 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1272 microversion: 2.1 time: 0.240038 Oct 02 01:17:47.316872 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1857/3873] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:47 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:47.322379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:47.322949 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:47.330631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.331137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.331614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.332359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.332877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.333513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.433696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.442152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-777be146-488c-49d6-8acc-3f8ef5c0f6d2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1316 microversion: 2.1 time: 1.109355 Oct 02 01:17:47.442772 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2017/3874] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:46 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1316 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:47.448647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:47.449477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:47.456055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.456891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.457548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.458509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.459388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.460169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.570392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.584845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.588085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.591881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-663c8d14-1866-467e-a60c-27c3e0ffb7d9 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1328 microversion: 2.21 time: 0.273814 Oct 02 01:17:47.610628 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1858/3875] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:47 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:47.616917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ab2ba718-9661-437e-8b2d-25552e977c24 req-ed4a81ec-475c-4f4e-905d-680f918ee69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae307f0-4800-4d26-a187-0756b4bcbf56", "tag": "8aea3ba4-26eb-42af-9ac1-a72bc89883e5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:47.636555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ab2ba718-9661-437e-8b2d-25552e977c24 req-ed4a81ec-475c-4f4e-905d-680f918ee69c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:47.637490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ab2ba718-9661-437e-8b2d-25552e977c24 req-ed4a81ec-475c-4f4e-905d-680f918ee69c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:47.642084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ab2ba718-9661-437e-8b2d-25552e977c24 req-ed4a81ec-475c-4f4e-905d-680f918ee69c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:47.669268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ab2ba718-9661-437e-8b2d-25552e977c24 req-ed4a81ec-475c-4f4e-905d-680f918ee69c service nova] Creating event network-changed:8aea3ba4-26eb-42af-9ac1-a72bc89883e5 for instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 on n-h1-master-1 Oct 02 01:17:47.681219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ab2ba718-9661-437e-8b2d-25552e977c24 req-ed4a81ec-475c-4f4e-905d-680f918ee69c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079940 Oct 02 01:17:47.690520 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1859/3876] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:47.695158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:47.712432 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad6a376d-85fb-4489-bed0-89d3280b0046 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1346 microversion: 2.1 time: 0.268072 Oct 02 01:17:47.713887 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2018/3877] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:47 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1346 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:48.097462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:48.098989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:48.105866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.106767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.107509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.108500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.109221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.109899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.346186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:48.350413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:48.362739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.363798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.364830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.366437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.367504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.369100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.626199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:48.638886 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7c88e084-9e05-4fac-a201-e2dd16aff24a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1272 microversion: 2.1 time: 0.296941 Oct 02 01:17:48.639924 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2019/3878] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:48 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:48.640432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:48.644782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:48.659492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:48.661150 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f3102c6-53a0-44fd-9a95-7795c426d249 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1496 microversion: 2.1 time: 0.567868 Oct 02 01:17:48.663901 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1860/3879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:48 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1496 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:48.667329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.667927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.668634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.669572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.670257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.678724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.683290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:48.685328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:48.704259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.704837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.705356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.706213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:48.706545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:48.706999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:48.921329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:48.936171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:48.940825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:48.945740 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40906a1f-427b-4c1d-814c-2e2d479c5f95 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1316 microversion: 2.21 time: 0.278062 Oct 02 01:17:48.962384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1861/3880] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:48 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:48.988019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:48.991017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:49.006147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:49.012348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:49.013397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:49.015057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:49.019522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:49.021602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:49.237681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:49.254162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5a6b8ce-b281-4d3a-873a-0866db334513 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 200 len: 1346 microversion: 2.1 time: 0.283522 Oct 02 01:17:49.255174 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1862/3881] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:48 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 1346 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:49.300160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:49.319317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f943b32-528b-49f9-80d3-919fdcf0c685 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1316 microversion: 2.1 time: 0.676985 Oct 02 01:17:49.343193 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2020/3882] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:48 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:49.667203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:49.667824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:49.675194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:49.685448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:49.686732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:49.692346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:49.696523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:49.701679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:49.702218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:49.702712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:49.708460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:49.708918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:49.709357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:49.710089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:49.710677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:49.711616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:50.035572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:50.065743 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-166ea900-aa70-4b17-9570-8d6079af6b32 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1454 microversion: 2.1 time: 0.384052 Oct 02 01:17:50.070973 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2021/3883] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:49 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1454 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:50.079262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e3621193-e2f6-42a5-9d67-fac8f9b855ce req-30987f5f-5542-4c1d-8bf5-15a67ce5ebc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85611874-af48-48e1-9ff7-9bc74ee0d658", "name": "network-vif-deleted", "tag": "83ee666b-67a4-4a5e-b88e-875a9248b1c5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:50.121558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e3621193-e2f6-42a5-9d67-fac8f9b855ce req-30987f5f-5542-4c1d-8bf5-15a67ce5ebc8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:50.133382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e3621193-e2f6-42a5-9d67-fac8f9b855ce req-30987f5f-5542-4c1d-8bf5-15a67ce5ebc8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:50.134066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e3621193-e2f6-42a5-9d67-fac8f9b855ce req-30987f5f-5542-4c1d-8bf5-15a67ce5ebc8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:50.167309 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e3621193-e2f6-42a5-9d67-fac8f9b855ce req-30987f5f-5542-4c1d-8bf5-15a67ce5ebc8 service nova] Creating event network-vif-deleted:83ee666b-67a4-4a5e-b88e-875a9248b1c5 for instance 85611874-af48-48e1-9ff7-9bc74ee0d658 on n-h1-master-1 Oct 02 01:17:50.178998 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e3621193-e2f6-42a5-9d67-fac8f9b855ce req-30987f5f-5542-4c1d-8bf5-15a67ce5ebc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106360 Oct 02 01:17:50.181032 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2022/3884] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:50.197906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:50.201063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:50.220840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:50.221620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:50.222311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:50.223298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:50.223998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:50.224697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:50.897831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:50.907590 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42f084ee-fa18-4db3-b366-56460618bcf8 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 1.244870 Oct 02 01:17:50.910015 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1863/3885] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:49 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:50.917785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:50.918799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:50.948438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:50.948994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:50.950381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:50.951170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:50.951644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:50.952301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:50.990190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 HTTP/1.1 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '73b621df-a125-42a6-a9d9-2f65d0e618b1'} Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:50.992922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:50.997545 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c86ee21d-b77b-4319-928b-3c05497d3624 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 404 len: 111 microversion: 2.1 time: 0.083207 Oct 02 01:17:51.014910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1864/3886] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:50 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:51.025891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:51.027337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:51.040690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.042004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.042640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.043730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.044754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.045524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.259312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:51.271902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:51.274650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:51.275943 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea58dfb0-4a81-4acc-a765-b27a95529c2b tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 1.093528 Oct 02 01:17:51.277189 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2023/3887] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:50 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:51.282264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:51.283145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:51.289755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.290487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.291230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.292198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.292884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.293536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.487652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:51.504575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a3e0921-1be3-41ef-a380-762c72f5d1a4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 200 len: 1294 microversion: 2.1 time: 0.224609 Oct 02 01:17:51.506529 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2024/3888] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:51 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 1294 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:51.519180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:51.521759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:51.546447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.547356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.547999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.549804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.550480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.551173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.577174 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1/os-volume_attachments HTTP/1.1 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '73b621df-a125-42a6-a9d9-2f65d0e618b1'} Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:51.578946 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:51.583435 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9cad4b79-2a54-4909-8bb2-004e00746ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071214 Oct 02 01:17:51.594239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2025/3889] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:17:51 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1/os-volume_attachments => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:51.651813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:51.668187 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7cfbf461-9c1a-428d-a105-c6ac16fb244e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1316 microversion: 2.1 time: 0.651994 Oct 02 01:17:51.672031 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1865/3890] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:51 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:51.884542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-200598766", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:51.934477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:51.935223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:51.954366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.955084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.955708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:51.957050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:51.957385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:51.958017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:51.958631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:52.553041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:52.577523 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d20bbd0a-5151-4a20-b760-efb51d29e1de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.647558 Oct 02 01:17:52.594806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1866/3891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:51 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:52.602440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:52.608003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:52.616765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:52.617621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:52.618431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:52.619358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:52.619990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:52.622366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:53.209807 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:53.270227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:53.281632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:53.283886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:53.286068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e705ba2c-93c2-4265-8da3-adf39fe80197 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 0.689557 Oct 02 01:17:53.302756 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1867/3892] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:52 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:53.314162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:53.315868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:53.322879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:53.323376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:53.324015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:53.325282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:53.326588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:53.327212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:53.343972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 HTTP/1.1 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '85611874-af48-48e1-9ff7-9bc74ee0d658'} Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:17:53.345514 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-edbc13d7-461b-45fa-a9eb-7c616a76ac64 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 404 len: 111 microversion: 2.1 time: 0.042730 Oct 02 01:17:53.351055 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1868/3893] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:53 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:17:53.358760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:53.359598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:53.369640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:53.370466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:53.372000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:53.381270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:53.382116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:53.383831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:54.037071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:54.037702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:54.038105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:54.038828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:54.039741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:54.049260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:54.049965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:54.050489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:54.051455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:54.051988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:54.052480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:54.074163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:54.079708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:54.093247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:54.095657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:54.147046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e764df6e-2e77-414e-b8b7-fc07fff09570 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.268726 Oct 02 01:17:54.147892 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2026/3894] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:17:54.154492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-719643692", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:54.225810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:17:54.260681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:54.271273 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f91b3529-476e-46a3-9d1b-df1abe8c36c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1316 microversion: 2.1 time: 0.922287 Oct 02 01:17:54.283725 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1869/3895] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:53 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1316 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:54.283725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:54.283725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:54.287902 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:54.303004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:54.303500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:54.303938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:54.305198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:54.305988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:54.306452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:55.050315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:55.069180 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdafcea1-c849-4c02-a3aa-e462238cd981 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.795871 Oct 02 01:17:55.072896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1870/3896] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:54 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:55.082396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:55.087461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:55.096157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:55.096952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:55.097451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:55.098265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:55.098786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:55.100179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:55.307463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:55.318554 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:55.326653 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3048bc5-44e5-4247-a117-a42891fb7fb2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1266 microversion: 2.1 time: 0.252578 Oct 02 01:17:55.341888 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1871/3897] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:55 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:55.341888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:55.341888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:55.341888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:55.341888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:55.341888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:55.342520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:55.342923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:55.343533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:55.644993 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:55.839177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:55.857863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:55.865172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:55.869748 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6af75eb6-a624-4f6f-8280-8b516a2af3b2 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 0.541185 Oct 02 01:17:55.874345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1872/3898] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:55 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:55.881591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d9447682-cade-409c-a101-98e44217ae51 req-e2250131-618c-4566-828c-ce86374dac3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a89bcf-fd50-4436-8a33-9826ac115649", "tag": "1861f789-246c-4e58-af88-6d22e5d13829"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:55.907767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9447682-cade-409c-a101-98e44217ae51 req-e2250131-618c-4566-828c-ce86374dac3e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:55.911451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9447682-cade-409c-a101-98e44217ae51 req-e2250131-618c-4566-828c-ce86374dac3e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:55.912196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9447682-cade-409c-a101-98e44217ae51 req-e2250131-618c-4566-828c-ce86374dac3e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:55.941312 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d9447682-cade-409c-a101-98e44217ae51 req-e2250131-618c-4566-828c-ce86374dac3e service nova] Creating event network-changed:1861f789-246c-4e58-af88-6d22e5d13829 for instance f1a89bcf-fd50-4436-8a33-9826ac115649 on n-h2-master-1 Oct 02 01:17:55.953983 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d9447682-cade-409c-a101-98e44217ae51 req-e2250131-618c-4566-828c-ce86374dac3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077697 Oct 02 01:17:55.962139 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1873/3899] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:55.969173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-beed8819-fced-431e-96d0-4059c165e44d req-bac0e9c6-03a3-4619-8e9c-abc8192b151c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae307f0-4800-4d26-a187-0756b4bcbf56", "name": "network-vif-plugged", "status": "completed", "tag": "8aea3ba4-26eb-42af-9ac1-a72bc89883e5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:55.994414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-beed8819-fced-431e-96d0-4059c165e44d req-bac0e9c6-03a3-4619-8e9c-abc8192b151c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:55.995004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-beed8819-fced-431e-96d0-4059c165e44d req-bac0e9c6-03a3-4619-8e9c-abc8192b151c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:55.995694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-beed8819-fced-431e-96d0-4059c165e44d req-bac0e9c6-03a3-4619-8e9c-abc8192b151c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.011577 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-beed8819-fced-431e-96d0-4059c165e44d req-bac0e9c6-03a3-4619-8e9c-abc8192b151c service nova] Creating event network-vif-plugged:8aea3ba4-26eb-42af-9ac1-a72bc89883e5 for instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 on n-h1-master-1 Oct 02 01:17:56.017058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-beed8819-fced-431e-96d0-4059c165e44d req-bac0e9c6-03a3-4619-8e9c-abc8192b151c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053090 Oct 02 01:17:56.017689 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1874/3900] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:17:56.024683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:56.025387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:56.031755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.032244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.032688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.033389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.033844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.034274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.049026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:17:56.050948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:17:56.052092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:17:56.053853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:17:56.056023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:17:56.097660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.098411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.098887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.102048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.102891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.105383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.183828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:17:56.210700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:17:56.247350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:17:56.256364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:17:56.351961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c86c19b5-cad3-4b3b-82a4-f88b6f3ef355 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202299 Oct 02 01:17:56.355085 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2027/3901] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:17:56.368690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:56.369483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:56.382163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.384342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.388459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.389231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.389713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.390154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.470008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:17:56.506572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:56.518555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1563db81-5e8a-4694-bc14-dab9a38e5d52 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1316 microversion: 2.1 time: 0.499446 Oct 02 01:17:56.520568 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1875/3902] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:56 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:56.530162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:56.531525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:56.548558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.549348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.549963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.550961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:56.552717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:56.559324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:56.650631 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2572fc6-6abf-45cb-835b-fffdaa0b53ea tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 204 len: 0 microversion: 2.1 time: 0.291633 Oct 02 01:17:56.657332 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2028/3903] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:17:56 2022] DELETE /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:17:56.663521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cadd749f-8b02-4d9d-8b0f-dc03bba8d6f8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:56.664306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cadd749f-8b02-4d9d-8b0f-dc03bba8d6f8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:57.203538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cadd749f-8b02-4d9d-8b0f-dc03bba8d6f8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:57.221223 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cadd749f-8b02-4d9d-8b0f-dc03bba8d6f8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1208 microversion: 2.1 time: 0.559927 Oct 02 01:17:57.230790 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2029/3904] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:56 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1208 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:57.235718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:57.236327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:57.258283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:57.258973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:57.259424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:57.260159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:57.260613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:57.261049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:57.392724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:57.405361 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b02ca22-b23c-4226-a1b2-c97ed61c16f2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.883520 Oct 02 01:17:57.413733 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1876/3905] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:56 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:57.424522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:57.431501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:57.439944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:57.442926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:57.443586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:57.451619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:57.452353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:57.452965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:57.733741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:57.742200 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3aebaba7-c14f-4664-90d0-1f0108ca950f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.510222 Oct 02 01:17:57.748073 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2030/3906] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:57 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:57.753176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:57.758637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:57.770042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:57.783439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:57.784243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:57.785233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:57.785979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:57.786665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:57.840739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:57.856936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:57.864608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:57.876402 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68dd02ab-0ce0-44d9-82ef-d2df8cdf8572 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 0.461126 Oct 02 01:17:57.877395 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1877/3907] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:17:57 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:17:58.042138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0b7e890e-afc0-459d-919a-77dde51937cb req-ef0d8ee4-a7d5-4eef-880d-28ab5562886c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7bf04e1-aaac-453a-8736-7187abe3084e", "tag": "0943776c-7aa0-4058-af11-9cb5231e2457"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:58.063160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0b7e890e-afc0-459d-919a-77dde51937cb req-ef0d8ee4-a7d5-4eef-880d-28ab5562886c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.064583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0b7e890e-afc0-459d-919a-77dde51937cb req-ef0d8ee4-a7d5-4eef-880d-28ab5562886c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.065325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0b7e890e-afc0-459d-919a-77dde51937cb req-ef0d8ee4-a7d5-4eef-880d-28ab5562886c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:58.101022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0b7e890e-afc0-459d-919a-77dde51937cb req-ef0d8ee4-a7d5-4eef-880d-28ab5562886c service nova] Creating event network-changed:0943776c-7aa0-4058-af11-9cb5231e2457 for instance a7bf04e1-aaac-453a-8736-7187abe3084e on n-h2-master-1 Oct 02 01:17:58.109793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0b7e890e-afc0-459d-919a-77dde51937cb req-ef0d8ee4-a7d5-4eef-880d-28ab5562886c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077077 Oct 02 01:17:58.111100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1878/3908] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:17:58.252211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:58.254343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:58.270042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.271270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:58.271793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.273022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:58.276522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.278816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.280000 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31acd944-e2e6-41ea-9c1c-eaec2ef82a4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1504 microversion: 2.1 time: 0.530546 Oct 02 01:17:58.280584 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2031/3909] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:57 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:58.281641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:58.306555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-117164270"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:17:58.307391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:58.317175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.320375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.321065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:58.322378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.323176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.325148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:58.444474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:58.470546 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e08cbaf8-0c5b-4ace-b951-2b4dcdd1760b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1204 microversion: 2.1 time: 0.223883 Oct 02 01:17:58.472842 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1879/3910] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:58 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1204 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:17:58.488534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:58.489587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:58.515413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.516110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.516712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:58.517606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:58.518762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:58.519505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:59.055788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.network.security_group_api [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Adding security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 to port 8aea3ba4-26eb-42af-9ac1-a72bc89883e5 Oct 02 01:17:59.099557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:17:59.121645 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf86839b-561a-43b9-8c56-737d5bbd1fdc tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.646776 Oct 02 01:17:59.129682 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1880/3911] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:58 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:17:59.134844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:17:59.144467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:17:59.160822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:59.161483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:59.162040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:17:59.163053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:17:59.163628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:17:59.164706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:00.209246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:00.224331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d48d53b-21f9-42c4-9aae-7e06dee3b4a6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 1.093463 Oct 02 01:18:00.226380 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1881/3912] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:59 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:00.247373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:00.249779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:00.258458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:00.260039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:00.260987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:00.261824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:00.262346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:00.262746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.369334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:01.379776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:01.381266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:01.383199 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5dd83d3-70d3-4d09-85fa-4a8ffac19a77 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 1.155575 Oct 02 01:18:01.383776 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1882/3913] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:00 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:01.388987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b9f1532c-7692-4f45-aee3-941e271a25ab req-9a669bac-d630-4aff-9bfc-07a98581878a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e4d6b8-53e5-4964-a874-14fafa5fb900", "tag": "ab85cb8a-a2bf-4631-9df6-f7ccd8b6596f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:01.401016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b9f1532c-7692-4f45-aee3-941e271a25ab req-9a669bac-d630-4aff-9bfc-07a98581878a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.401802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b9f1532c-7692-4f45-aee3-941e271a25ab req-9a669bac-d630-4aff-9bfc-07a98581878a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.402504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b9f1532c-7692-4f45-aee3-941e271a25ab req-9a669bac-d630-4aff-9bfc-07a98581878a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.417012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b9f1532c-7692-4f45-aee3-941e271a25ab req-9a669bac-d630-4aff-9bfc-07a98581878a service nova] Creating event network-changed:ab85cb8a-a2bf-4631-9df6-f7ccd8b6596f for instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 on n-h1-master-1 Oct 02 01:18:01.423791 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b9f1532c-7692-4f45-aee3-941e271a25ab req-9a669bac-d630-4aff-9bfc-07a98581878a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037988 Oct 02 01:18:01.424342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1883/3914] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:01.434623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:01.435331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:01.444286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.445284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.446154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.446896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.447650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.448339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.600104 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a32b603-a22c-4be1-8a52-a93c5504456e tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56/action" status: 202 len: 0 microversion: 2.1 time: 3.298816 Oct 02 01:18:01.602380 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2032/3915] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:17:58 2022] POST /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56/action => generated 0 bytes in 3302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:18:01.610485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:01.611142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:01.620286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.621066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.621693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.622464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.623139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.623737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.656486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:01.673754 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0677427-472e-4768-b7dc-091745f9df21 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1266 microversion: 2.1 time: 0.240115 Oct 02 01:18:01.688347 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1884/3916] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:01 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:01.706183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:01.709401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:01.719731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.720659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.721909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:01.724197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:01.724681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:01.725119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.093937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:02.106458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-05206a60-8b22-4452-a1a1-246b53d06ac0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.502653 Oct 02 01:18:02.107178 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2033/3917] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:01 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:02.112756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b0181ce-7251-420c-8d7e-911b057f1565 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880422310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:02.156554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:02.182164 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de313d84-f817-4b10-8dbc-9a7d3d5e8caf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.482009 Oct 02 01:18:02.186470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1885/3918] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:01 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:02.207157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-be156035-b387-4ff3-86c4-633872fec1f2 req-75e3e22c-6e0f-455c-9bdf-2d2a833921a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae307f0-4800-4d26-a187-0756b4bcbf56", "tag": "8aea3ba4-26eb-42af-9ac1-a72bc89883e5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:02.230593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-be156035-b387-4ff3-86c4-633872fec1f2 req-75e3e22c-6e0f-455c-9bdf-2d2a833921a3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.231092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-be156035-b387-4ff3-86c4-633872fec1f2 req-75e3e22c-6e0f-455c-9bdf-2d2a833921a3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.231530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-be156035-b387-4ff3-86c4-633872fec1f2 req-75e3e22c-6e0f-455c-9bdf-2d2a833921a3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.254016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-be156035-b387-4ff3-86c4-633872fec1f2 req-75e3e22c-6e0f-455c-9bdf-2d2a833921a3 service nova] Creating event network-changed:8aea3ba4-26eb-42af-9ac1-a72bc89883e5 for instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 on n-h1-master-1 Oct 02 01:18:02.266463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-be156035-b387-4ff3-86c4-633872fec1f2 req-75e3e22c-6e0f-455c-9bdf-2d2a833921a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077529 Oct 02 01:18:02.268011 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1886/3919] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:02.416293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:02.417005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:02.426798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.427581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.429023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.430304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.431023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.433135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.576006 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-9b0181ce-7251-420c-8d7e-911b057f1565 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use.", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:02.576713 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9b0181ce-7251-420c-8d7e-911b057f1565 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.576713 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b0181ce-7251-420c-8d7e-911b057f1565 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315 HTTP/1.1 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: exception: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9dadb54d-7a79-4626-97ec-2c9de0acf315'} Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:02.578870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b0181ce-7251-420c-8d7e-911b057f1565 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 400 to user: Security Group 9dadb54d-7a79-4626-97ec-2c9de0acf315 in use. Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-46b79e98-9e19-41b5-9b5b-9ddc8fb8fb30'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b0181ce-7251-420c-8d7e-911b057f1565 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315" status: 400 len: 185 microversion: 2.1 time: 0.471711 Oct 02 01:18:02.583741 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2034/3920] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:02 2022] DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315 => generated 185 bytes in 473 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:02.594761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:02.594761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:02.602811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.603546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.604033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.604761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.605223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.605672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.721491 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d00f22c-f390-4db7-97e8-850a210c34c7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56/action" status: 202 len: 0 microversion: 2.1 time: 0.135529 Oct 02 01:18:02.722899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2035/3921] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:02 2022] POST /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:02.730992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:02.732118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:02.742676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.743520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.744154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.746172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.747690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.748745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.774334 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:02.808246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:02.826146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:02.827871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:02.829256 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8cc58a65-3f52-447d-9a3e-6bb6e427f4c7 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 0.419960 Oct 02 01:18:02.846646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1887/3922] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:02 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:18:02.853076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:02.853859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:02.863731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.864647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.865253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:02.866178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:02.866915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:02.867449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:03.420982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:03.429609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:03.439544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6f742de4-9af9-4645-813d-fbae10d39969 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1574 microversion: 2.1 time: 0.604308 Oct 02 01:18:03.450539 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-74b139fb-8989-46a3-9e3d-e71df1ec8333 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.724401 Oct 02 01:18:03.452426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2036/3923] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:02 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:03.456225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1888/3924] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:02 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1574 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:03.469492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:03.470072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:03.470482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:03.476860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:03.483538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:03.484329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:03.484945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:03.486214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:03.486960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:03.487552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:03.487745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:03.488260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:03.489687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:03.490429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:03.491464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:03.491902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.006076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:04.023807 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56f072b3-cb98-41a6-ae57-906d2563002f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.566180 Oct 02 01:18:04.024417 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1889/3925] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:03 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:04.043331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-90fc1fdc-4943-43fa-a26b-892f87d53af7 req-de84b324-1ff1-47fe-944c-b0625ec64d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a89bcf-fd50-4436-8a33-9826ac115649", "name": "network-vif-plugged", "status": "completed", "tag": "1861f789-246c-4e58-af88-6d22e5d13829"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:04.062338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-90fc1fdc-4943-43fa-a26b-892f87d53af7 req-de84b324-1ff1-47fe-944c-b0625ec64d24 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.062870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-90fc1fdc-4943-43fa-a26b-892f87d53af7 req-de84b324-1ff1-47fe-944c-b0625ec64d24 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.063307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-90fc1fdc-4943-43fa-a26b-892f87d53af7 req-de84b324-1ff1-47fe-944c-b0625ec64d24 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.086301 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-90fc1fdc-4943-43fa-a26b-892f87d53af7 req-de84b324-1ff1-47fe-944c-b0625ec64d24 service nova] Creating event network-vif-plugged:1861f789-246c-4e58-af88-6d22e5d13829 for instance f1a89bcf-fd50-4436-8a33-9826ac115649 on n-h2-master-1 Oct 02 01:18:04.100210 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-90fc1fdc-4943-43fa-a26b-892f87d53af7 req-de84b324-1ff1-47fe-944c-b0625ec64d24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074402 Oct 02 01:18:04.103975 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1890/3926] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:04.108535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:04.114992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:04.118910 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72c635a6-0eb1-4477-8e69-7a66d01ac652 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.664222 Oct 02 01:18:04.123538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:04.131067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.134534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.135230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.135724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2037/3927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:03 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:04.136401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.139668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.140118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.464686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:04.465566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:04.478228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.478781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.479428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.480339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.481558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.485554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.532466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:04.546206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:04.556362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:04.558182 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d92253b5-6f0e-4410-935f-0b8fa00ee800 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1358 microversion: 2.21 time: 0.452485 Oct 02 01:18:04.559043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1891/3928] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:04 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1358 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:04.566661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:04.570181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:04.583586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.588924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.589737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.591028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:04.592379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:04.594199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:04.631646 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:05.321475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:05.344657 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f25fa020-e90f-4bcb-abaf-003fc7b1fbbe tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1574 microversion: 2.1 time: 0.883763 Oct 02 01:18:05.345397 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2038/3929] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:04 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1574 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:05.445804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:05.455756 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f0eff5c-a863-4872-8e68-5427b1097646 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.894899 Oct 02 01:18:05.456633 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1892/3930] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:04 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:05.474636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:05.476326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:05.483650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:05.484525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:05.485451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:05.486894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:05.487565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:05.488274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:05.522836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1335730407", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:05.616672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] validate_networks() for [('0a2ac087-19c4-4d83-8d50-14e6b0887610', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:18:05.959075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:05.978999 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9b25e4d-b1c3-48e5-b4eb-3aec383f8dd7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.520751 Oct 02 01:18:05.983429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1893/3931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:05 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:06.021402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:06.022446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:06.055445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:06.059115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:06.059615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:06.063691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:06.064701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:06.065759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:06.133485 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:06.486697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:06.501487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-914084cb-c6b1-46c2-af93-87584d7e7281 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.516528 Oct 02 01:18:06.502088 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1894/3932] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:05 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:06.519304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:06.519933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:06.530561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:06.531199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:06.531714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:06.533185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:06.533725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:06.534882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:06.864391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:06.864915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:06.865841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:06.866693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:06.867116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:06.874320 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=31 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:06.882906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:06.883410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:06.883856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:06.884582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:06.885597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:06.886208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:06.909135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Getting quotas for project b55ff3938f914b23a0a911b78d9da173. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:06.916051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Getting quotas for user 039f66a7c47b47e39672b8a49683f6ab and project b55ff3938f914b23a0a911b78d9da173. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:06.930118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:06.937687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:18:06.940798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:18:06.956662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:06.970420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:06.977657 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:06.980297 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26cebf37-a93a-4213-bd54-47fae3c88814 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1552 microversion: 2.21 time: 0.474622 Oct 02 01:18:06.982120 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1895/3933] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:06 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1552 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:07.001117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e8e555aa-078c-4b75-861f-285a7a3fe5cb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654348 Oct 02 01:18:07.008621 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2039/3934] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:18:07.018032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2a0a9c0e-8fce-4282-93a1-ff25f364d7d2 req-c43c9397-8543-42e8-8a54-65fc8e341c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bf04e1-aaac-453a-8736-7187abe3084e", "name": "network-vif-plugged", "status": "completed", "tag": "0943776c-7aa0-4058-af11-9cb5231e2457"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:07.023871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ca6e1ff6-c19b-44fc-9ac1-25b0b27fcab4 req-dd6ede82-4919-42d5-b3af-e76a53a442bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfca093a-b241-4946-9093-15c7ec39042e", "tag": "4fd3cd5f-b61a-4002-a82e-13d8c9d56436"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:07.032318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a0a9c0e-8fce-4282-93a1-ff25f364d7d2 req-c43c9397-8543-42e8-8a54-65fc8e341c35 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.032990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a0a9c0e-8fce-4282-93a1-ff25f364d7d2 req-c43c9397-8543-42e8-8a54-65fc8e341c35 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.033590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a0a9c0e-8fce-4282-93a1-ff25f364d7d2 req-c43c9397-8543-42e8-8a54-65fc8e341c35 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.045833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ca6e1ff6-c19b-44fc-9ac1-25b0b27fcab4 req-dd6ede82-4919-42d5-b3af-e76a53a442bb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.046745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ca6e1ff6-c19b-44fc-9ac1-25b0b27fcab4 req-dd6ede82-4919-42d5-b3af-e76a53a442bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.047179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ca6e1ff6-c19b-44fc-9ac1-25b0b27fcab4 req-dd6ede82-4919-42d5-b3af-e76a53a442bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.055771 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2a0a9c0e-8fce-4282-93a1-ff25f364d7d2 req-c43c9397-8543-42e8-8a54-65fc8e341c35 service nova] Creating event network-vif-plugged:0943776c-7aa0-4058-af11-9cb5231e2457 for instance a7bf04e1-aaac-453a-8736-7187abe3084e on n-h2-master-1 Oct 02 01:18:07.060531 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ca6e1ff6-c19b-44fc-9ac1-25b0b27fcab4 req-dd6ede82-4919-42d5-b3af-e76a53a442bb service nova] Creating event network-changed:4fd3cd5f-b61a-4002-a82e-13d8c9d56436 for instance bfca093a-b241-4946-9093-15c7ec39042e on n-h2-master-1 Oct 02 01:18:07.062259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2a0a9c0e-8fce-4282-93a1-ff25f364d7d2 req-c43c9397-8543-42e8-8a54-65fc8e341c35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052026 Oct 02 01:18:07.065466 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ca6e1ff6-c19b-44fc-9ac1-25b0b27fcab4 req-dd6ede82-4919-42d5-b3af-e76a53a442bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081003 Oct 02 01:18:07.066148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1896/3935] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:07.068900 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2040/3936] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:07.072837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:07.073605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.075407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:07.076381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.080666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.081156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.081643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.082733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.083365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.083980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.087953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.088745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.091135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.091914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.092575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.093045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.351526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:07.358036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:07.362847 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de855dda-2e78-443d-9516-2def243439b5 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.292359 Oct 02 01:18:07.370479 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17187824-2641-4deb-8698-605d6f13b8c2 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1572 microversion: 2.1 time: 0.302812 Oct 02 01:18:07.377921 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2041/3937] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:07 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:07.382013 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1897/3938] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:07 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1572 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:07.384924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:07.385615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.391196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:07.392313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.393642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.394453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.395194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.396053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.396701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.397428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.411447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.412909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.413346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.415948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.417809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.418252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.433320 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:07.570272 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb11cb4d-6e12-4e36-8316-08eb18a3d249 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 204 len: 0 microversion: 2.21 time: 0.190920 Oct 02 01:18:07.571015 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2042/3939] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:18:07 2022] DELETE /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:18:07.581387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5be1175-5403-408f-991b-0f9561667f3a tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:07.583408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5be1175-5403-408f-991b-0f9561667f3a tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.675460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:07.688159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-045c7349-fa64-4b87-8ae1-a4d8ac199655 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.304631 Oct 02 01:18:07.689034 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1898/3940] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:07 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:07.689849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5be1175-5403-408f-991b-0f9561667f3a tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:07.698483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5be1175-5403-408f-991b-0f9561667f3a tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1224 microversion: 2.1 time: 0.121114 Oct 02 01:18:07.700564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1189667167"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:07.700801 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2043/3941] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:07 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:07.703781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.706849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:07.707775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:07.719626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.720133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.720578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.721294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.721757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.722196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.724249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.724961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.725470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.726244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:07.726737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:07.727166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:07.976354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:07.982697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Adding security group 46511846-707f-4b3f-b547-047e9eb9bd9f to port 8aea3ba4-26eb-42af-9ac1-a72bc89883e5 Oct 02 01:18:07.987516 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-088e6162-79ba-4927-a77b-f92d06f32add tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.284892 Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2044/3942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:07 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:08.002703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:08.003751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:08.296194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:08.311009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:08.312663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:08.314077 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3c06a41-0761-4a6b-86e2-59fa7d55fa6c tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1558 microversion: 2.21 time: 0.324653 Oct 02 01:18:08.315146 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2045/3943] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:07 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1558 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:08.388015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:08.388637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:08.395716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:08.396499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:08.396920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:08.398621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:08.398621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:08.399047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:08.606264 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2bc9f89-6e9f-4dd5-95be-747db7a50c88 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56/action" status: 202 len: 0 microversion: 2.1 time: 0.916121 Oct 02 01:18:08.610668 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1899/3944] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:07 2022] POST /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56/action => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:08.617185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-343670d7-542d-4c23-bc54-670a4eb3226b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88082c1f0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:08.667499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:08.713939 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0bd736a-ec85-4a83-9227-12f3ca08ab8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.314706 Oct 02 01:18:08.721254 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2046/3945] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:08 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:08.730511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:08.738814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:08.756957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:08.760222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:08.761026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:08.762144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:08.764943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:08.765771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:08.990424 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-343670d7-542d-4c23-bc54-670a4eb3226b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use.", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:08.994129 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-343670d7-542d-4c23-bc54-670a4eb3226b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:08.994129 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-343670d7-542d-4c23-bc54-670a4eb3226b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f HTTP/1.1 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: exception: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '46511846-707f-4b3f-b547-047e9eb9bd9f'} Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:08.996545 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] Oct 02 01:18:09.001128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:09.010055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-343670d7-542d-4c23-bc54-670a4eb3226b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 400 to user: Security Group 46511846-707f-4b3f-b547-047e9eb9bd9f in use. Oct 02 01:18:09.010055 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-7be5764c-e73f-465f-b7b0-1233c3bb2c63'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:09.012038 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-343670d7-542d-4c23-bc54-670a4eb3226b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f" status: 400 len: 185 microversion: 2.1 time: 0.399952 Oct 02 01:18:09.013369 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1900/3946] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:08 2022] DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f => generated 185 bytes in 402 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:09.020491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:09.022850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:09.033304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.034124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.034865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.038007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.039523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.041203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.048771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:09.062613 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5f3289f-b7ec-4dcd-9cc5-1f12148ef65b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.331012 Oct 02 01:18:09.066720 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2047/3947] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:08 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:09.074760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:09.091872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:09.114631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.115189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.117406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.118349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.119032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.119642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.143781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:09.151943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-652ec752-437b-4288-a1df-9591089a7678 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1282 microversion: 2.1 time: 0.137295 Oct 02 01:18:09.153331 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1901/3948] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:09 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:09.158828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:09.159602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:09.167095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.167913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.168628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.169684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.170359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.171165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.202113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:09.342410 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1d1eec8-4f72-4779-a87a-324c1dcee478 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 204 len: 0 microversion: 2.1 time: 0.187263 Oct 02 01:18:09.344165 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1902/3949] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:18:09 2022] DELETE /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:18:09.347631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:09.353950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-990d6817-116f-4e57-af1a-e5ecf3a44f99 req-81673a55-6a5f-4ff7-bd35-df187ab01c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae307f0-4800-4d26-a187-0756b4bcbf56", "tag": "8aea3ba4-26eb-42af-9ac1-a72bc89883e5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:09.360091 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4167cd75-ca94-4c58-9e47-0f48c26a145f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.291986 Oct 02 01:18:09.363288 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2048/3950] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:09 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:09.370485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-990d6817-116f-4e57-af1a-e5ecf3a44f99 req-81673a55-6a5f-4ff7-bd35-df187ab01c79 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.371419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-990d6817-116f-4e57-af1a-e5ecf3a44f99 req-81673a55-6a5f-4ff7-bd35-df187ab01c79 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.372019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-990d6817-116f-4e57-af1a-e5ecf3a44f99 req-81673a55-6a5f-4ff7-bd35-df187ab01c79 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.389478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9ebcb7ee-b90d-40a7-b7fd-5eaee92bf41e req-22ca9406-bfcc-40cb-85d6-dfcf692a923b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e4d6b8-53e5-4964-a874-14fafa5fb900", "name": "network-vif-plugged", "status": "completed", "tag": "ab85cb8a-a2bf-4631-9df6-f7ccd8b6596f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:09.390902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-990d6817-116f-4e57-af1a-e5ecf3a44f99 req-81673a55-6a5f-4ff7-bd35-df187ab01c79 service nova] Creating event network-changed:8aea3ba4-26eb-42af-9ac1-a72bc89883e5 for instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 on n-h1-master-1 Oct 02 01:18:09.398938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-990d6817-116f-4e57-af1a-e5ecf3a44f99 req-81673a55-6a5f-4ff7-bd35-df187ab01c79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052754 Oct 02 01:18:09.400695 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1903/3951] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:09.421480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9ebcb7ee-b90d-40a7-b7fd-5eaee92bf41e req-22ca9406-bfcc-40cb-85d6-dfcf692a923b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.423460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9ebcb7ee-b90d-40a7-b7fd-5eaee92bf41e req-22ca9406-bfcc-40cb-85d6-dfcf692a923b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.424747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9ebcb7ee-b90d-40a7-b7fd-5eaee92bf41e req-22ca9406-bfcc-40cb-85d6-dfcf692a923b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.426835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:09.431476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:09.439565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.440521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.441140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.442312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.443754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.444370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.450049 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9ebcb7ee-b90d-40a7-b7fd-5eaee92bf41e req-22ca9406-bfcc-40cb-85d6-dfcf692a923b service nova] Creating event network-vif-plugged:ab85cb8a-a2bf-4631-9df6-f7ccd8b6596f for instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 on n-h1-master-1 Oct 02 01:18:09.456637 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9ebcb7ee-b90d-40a7-b7fd-5eaee92bf41e req-22ca9406-bfcc-40cb-85d6-dfcf692a923b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074917 Oct 02 01:18:09.458766 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2049/3952] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:09.466124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:09.467246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:09.475200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.475985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.476600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.477505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:09.478219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:09.478883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:09.968618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:09.983638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:09.997087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:09.998348 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2a3978d3-6123-4954-996a-bb2fe28a700f tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1558 microversion: 2.21 time: 0.596246 Oct 02 01:18:09.998985 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1904/3953] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:09 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1558 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:10.000738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:10.012456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:10.017726 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8fa80361-f84f-4abd-af12-44f5a6db0b83 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1647 microversion: 2.1 time: 0.557448 Oct 02 01:18:10.018483 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2050/3954] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:09 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1647 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:10.019305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:10.027542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.028009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.028988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.030492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.031198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.031997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.091012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:10.092274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:10.099274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.100105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.100674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.104377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.105027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.105579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.411303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:10.422844 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3fea9635-27b0-4dbf-9b0c-20a4dc898072 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.421525 Oct 02 01:18:10.423404 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1905/3955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:09 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:10.428647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:10.429374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:10.435693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.436360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.436894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.437751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.438303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.438997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.472953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:10.484142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cf20ae38-41bf-4b11-af63-00e51580c0d7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.397111 Oct 02 01:18:10.484745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2051/3956] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:10 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:10.490252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:10.491113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:10.500551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.501085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.501522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.502231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:10.502790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:10.503226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:10.828869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:10.839570 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49d8cfd5-7de0-4687-951f-6caf35019f87 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.414674 Oct 02 01:18:10.840791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1906/3957] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:10 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:10.885640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:10.897061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c2ecc37-a5f5-4dd7-b81c-cbf08a9c2a56 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1314 microversion: 2.1 time: 0.410973 Oct 02 01:18:10.912784 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2052/3958] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:10 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:11.033247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:11.036608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:11.044181 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:11.045296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:11.067365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.067974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.068427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.069163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.069630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.070062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.075584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.076102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.077145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.077880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.078339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.081527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.382619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:11.392456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:11.400315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4bfef22ac4e54465930158887c923f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4f0ad95a5e4ed294828e036dfef60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:11.404721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b0903d6-c56c-4e06-93f4-8db06be9755e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 200 len: 1516 microversion: 2.21 time: 0.383211 Oct 02 01:18:11.420195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1907/3959] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:11 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 1516 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:11.449468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:11.450079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:11.457401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.458573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.459040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.459902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.460356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.460781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.545178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:11.559992 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24a0895a-2650-4981-bef0-38a07c30f25a tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1647 microversion: 2.1 time: 0.521401 Oct 02 01:18:11.564318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2053/3960] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:11 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1647 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:11.574712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-df1c778c-c558-41f3-8fd4-c53595dc0811 req-b593ff75-853d-4e3e-ae0b-01ac83279d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a89bcf-fd50-4436-8a33-9826ac115649", "name": "network-vif-deleted", "tag": "1861f789-246c-4e58-af88-6d22e5d13829"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:11.603275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-df1c778c-c558-41f3-8fd4-c53595dc0811 req-b593ff75-853d-4e3e-ae0b-01ac83279d1a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.603786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-df1c778c-c558-41f3-8fd4-c53595dc0811 req-b593ff75-853d-4e3e-ae0b-01ac83279d1a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.604260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-df1c778c-c558-41f3-8fd4-c53595dc0811 req-b593ff75-853d-4e3e-ae0b-01ac83279d1a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.619195 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-df1c778c-c558-41f3-8fd4-c53595dc0811 req-b593ff75-853d-4e3e-ae0b-01ac83279d1a service nova] Creating event network-vif-deleted:1861f789-246c-4e58-af88-6d22e5d13829 for instance f1a89bcf-fd50-4436-8a33-9826ac115649 on n-h2-master-1 Oct 02 01:18:11.628645 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-df1c778c-c558-41f3-8fd4-c53595dc0811 req-b593ff75-853d-4e3e-ae0b-01ac83279d1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059771 Oct 02 01:18:11.631013 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2054/3961] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:11.642352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:11.655050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:11.661081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.664208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.665146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.666090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:11.667264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:11.667903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:11.671184 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:12.331532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:12.352656 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-684239d3-2b8d-4cec-9bf6-4ece98f97036 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.904326 Oct 02 01:18:12.370691 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1908/3962] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:11 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:12.376545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7b50c89e-1422-46a6-9c0c-cad90b4be174 req-bb5730f1-15b1-4968-9dc1-5bc2b09df7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfca093a-b241-4946-9093-15c7ec39042e", "name": "network-vif-plugged", "status": "completed", "tag": "4fd3cd5f-b61a-4002-a82e-13d8c9d56436"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:12.387392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7b50c89e-1422-46a6-9c0c-cad90b4be174 req-bb5730f1-15b1-4968-9dc1-5bc2b09df7d6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.388374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7b50c89e-1422-46a6-9c0c-cad90b4be174 req-bb5730f1-15b1-4968-9dc1-5bc2b09df7d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.389156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7b50c89e-1422-46a6-9c0c-cad90b4be174 req-bb5730f1-15b1-4968-9dc1-5bc2b09df7d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.408797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7b50c89e-1422-46a6-9c0c-cad90b4be174 req-bb5730f1-15b1-4968-9dc1-5bc2b09df7d6 service nova] Creating event network-vif-plugged:4fd3cd5f-b61a-4002-a82e-13d8c9d56436 for instance bfca093a-b241-4946-9093-15c7ec39042e on n-h2-master-1 Oct 02 01:18:12.415314 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7b50c89e-1422-46a6-9c0c-cad90b4be174 req-bb5730f1-15b1-4968-9dc1-5bc2b09df7d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042817 Oct 02 01:18:12.420341 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1909/3963] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:12.429505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:12.430023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:12.431513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:12.439879 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7c6b6b39-c1c3-4430-9755-a37848fc7126 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.804325 Oct 02 01:18:12.441512 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2055/3964] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:11 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:12.455781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.456272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:12.457182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:12.458296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.462017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.462909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.463479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.464239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.465207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.465697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.466133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.466859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.467515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.467950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.868254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:12.871685 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:12.888545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:12.889342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3248747-bd04-4abf-bdba-c39908c1df42 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.467517 Oct 02 01:18:12.889941 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1910/3965] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:12 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:12.895271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c234f1fb-23ec-41c2-96fb-f029cb7637dc req-a292acd9-83f6-4e6c-ba6e-c38e5e0e3680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5cefe3-3202-46ef-b652-40206d39b7a7", "tag": "93fffe62-8f4c-4259-ace2-d401024cd80b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:12.896697 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81939652-e9ce-4867-baff-fe2499734637 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1500 microversion: 2.1 time: 0.453894 Oct 02 01:18:12.907152 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2056/3966] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:12 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1500 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:12.908360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c234f1fb-23ec-41c2-96fb-f029cb7637dc req-a292acd9-83f6-4e6c-ba6e-c38e5e0e3680 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.909013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c234f1fb-23ec-41c2-96fb-f029cb7637dc req-a292acd9-83f6-4e6c-ba6e-c38e5e0e3680 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.909632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c234f1fb-23ec-41c2-96fb-f029cb7637dc req-a292acd9-83f6-4e6c-ba6e-c38e5e0e3680 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.913027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:12.913724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:12.923548 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c234f1fb-23ec-41c2-96fb-f029cb7637dc req-a292acd9-83f6-4e6c-ba6e-c38e5e0e3680 service nova] Creating event network-changed:93fffe62-8f4c-4259-ace2-d401024cd80b for instance ac5cefe3-3202-46ef-b652-40206d39b7a7 on n-h1-master-1 Oct 02 01:18:12.925723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.927861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.928335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.929062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.931204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c234f1fb-23ec-41c2-96fb-f029cb7637dc req-a292acd9-83f6-4e6c-ba6e-c38e5e0e3680 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Oct 02 01:18:12.932289 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1911/3967] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:12.933045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.933592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.939339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:12.940260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:12.948309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.949025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.949628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.950517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:12.951167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:12.951753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:12.970442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] HTTP exception thrown: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Request method failure captured: Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 HTTP/1.1 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOa0Hr7LGJf4JwG6ik8ceCfoa7rl-hxIVFox88xj9hbtPII0hQOFdCd-s2iD0ftAoS-KvYoelp_OwrhmQh2wBEKH4DGkrKRkLdeI28c8m1k5owc9Pf5H7J-srZ_TkGQgEau_qK6t8SDddSBhzyVWcQFvUrHyjbKfFwgjJH9fiH9s288 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.21 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: aa4f0ad95a5e4ed294828e036dfef60a Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa4f0ad95a5e4ed294828e036dfef60a"}]}] Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: aa4f0ad95a5e4ed294828e036dfef60a Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceActionsV221TestJSON-916060191-project Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 4bfef22ac4e54465930158887c923f60 Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceActionsV221TestJSON-916060191-project Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: exception: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f1a89bcf-fd50-4436-8a33-9826ac115649'} Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:12.975547 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:12.981134 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:12.984197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Returning 404 to user: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:12.989677 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4ffd4cf-1ff4-4775-82e5-f017c8e1ad16 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 404 len: 111 microversion: 2.21 time: 0.081192 Oct 02 01:18:12.990791 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2057/3968] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:12 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:12.999532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:13.005134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.017126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.017627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.018070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.018811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.019285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.019698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.054193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:13.072852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3b6df68-e39e-4ef0-8e8f-ed02c66a6902 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1468 microversion: 2.1 time: 0.138884 Oct 02 01:18:13.091196 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1912/3969] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:12 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1468 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:13.105295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '.version_select at 0x7fb8856c5940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.105911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.125982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.127186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.130996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.132553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.133522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.134220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.220233 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ac9690e-8197-4ed5-b28c-ec33c6250cf3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e/action" status: 202 len: 0 microversion: 2.1 time: 0.227231 Oct 02 01:18:13.224082 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2058/3970] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:12 2022] POST /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:13.236683 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.237900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.256420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.257194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.257829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.258769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.259398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.259997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.325315 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e936cece-6acc-405a-a99d-4ab73789dc97 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.232814 Oct 02 01:18:13.342424 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1913/3971] 10.222.0.23 () {60 vars in 1337 bytes} [Sun Oct 2 01:18:13 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649/os-instance-actions => generated 611 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:18:13.362284 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.366009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.394089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.394581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.395351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.402059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.402568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.403036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.435127 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] HTTP exception thrown: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Request method failure captured: Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 HTTP/1.1 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOa0Hr7LGJf4JwG6ik8ceCfoa7rl-hxIVFox88xj9hbtPII0hQOFdCd-s2iD0ftAoS-KvYoelp_OwrhmQh2wBEKH4DGkrKRkLdeI28c8m1k5owc9Pf5H7J-srZ_TkGQgEau_qK6t8SDddSBhzyVWcQFvUrHyjbKfFwgjJH9fiH9s288 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.21 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: aa4f0ad95a5e4ed294828e036dfef60a Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa4f0ad95a5e4ed294828e036dfef60a"}]}] Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: aa4f0ad95a5e4ed294828e036dfef60a Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-InstanceActionsV221TestJSON-916060191-project Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 4bfef22ac4e54465930158887c923f60 Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-InstanceActionsV221TestJSON-916060191-project Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: exception: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f1a89bcf-fd50-4436-8a33-9826ac115649'} Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:13.442162 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Returning 404 to user: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7e86d6c-7570-49cb-981d-6c7963c03d5e tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 404 len: 111 microversion: 2.21 time: 0.099519 Oct 02 01:18:13.449238 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1914/3972] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:18:13 2022] DELETE /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:13.455697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.457080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.464646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.465381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.466000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.466867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.467506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.468410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.520736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:13.531037 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50fbd33c-59f6-4152-95af-f340c4d18165 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1505 microversion: 2.1 time: 0.302664 Oct 02 01:18:13.536707 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2059/3973] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:13 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:13.541464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.542074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] [instance: f1a89bcf-fd50-4436-8a33-9826ac115649] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.552221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.552723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.553166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.553897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.554357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.554816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.570324 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] HTTP exception thrown: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Request method failure captured: Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 HTTP/1.1 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOa0Hr7LGJf4JwG6ik8ceCfoa7rl-hxIVFox88xj9hbtPII0hQOFdCd-s2iD0ftAoS-KvYoelp_OwrhmQh2wBEKH4DGkrKRkLdeI28c8m1k5owc9Pf5H7J-srZ_TkGQgEau_qK6t8SDddSBhzyVWcQFvUrHyjbKfFwgjJH9fiH9s288 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.21 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: aa4f0ad95a5e4ed294828e036dfef60a Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4f0ad95a5e4ed294828e036dfef60a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa4f0ad95a5e4ed294828e036dfef60a"}]}] Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: aa4f0ad95a5e4ed294828e036dfef60a Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-916060191 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceActionsV221TestJSON-916060191-project Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 4bfef22ac4e54465930158887c923f60 Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceActionsV221TestJSON-916060191-project Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: exception: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f1a89bcf-fd50-4436-8a33-9826ac115649'} Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.572403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. Oct 02 01:18:13.577166 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:13.579325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] Returning 404 to user: Instance f1a89bcf-fd50-4436-8a33-9826ac115649 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:13.580811 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cccf8962-c6f6-4138-8232-1f1ddf005cc0 tempest-InstanceActionsV221TestJSON-916060191 tempest-InstanceActionsV221TestJSON-916060191-project] 10.222.0.23 "GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649" status: 404 len: 111 microversion: 2.21 time: 0.042894 Oct 02 01:18:13.581989 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2060/3974] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:13 2022] GET /compute/v2.1/servers/f1a89bcf-fd50-4436-8a33-9826ac115649 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:13.588387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.590233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.597499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.598718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.599518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.600568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.601309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.602293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.890801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:13.901373 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e286124-0adc-40b8-9608-ce9b40c1b063 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1308 microversion: 2.1 time: 0.452401 Oct 02 01:18:13.902387 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1915/3975] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:13 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:13.904491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:13.908080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0fab95a4-2f52-42bf-b0ba-e4e07e606522 req-16d96bb1-e050-4c66-910d-db57f01ff628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae307f0-4800-4d26-a187-0756b4bcbf56", "name": "network-vif-deleted", "tag": "8aea3ba4-26eb-42af-9ac1-a72bc89883e5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:13.913914 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f743610a-0743-45ef-9157-76548623f790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1314 microversion: 2.1 time: 0.330087 Oct 02 01:18:13.914490 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2061/3976] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:13 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:13.918393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0fab95a4-2f52-42bf-b0ba-e4e07e606522 req-16d96bb1-e050-4c66-910d-db57f01ff628 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.919367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0fab95a4-2f52-42bf-b0ba-e4e07e606522 req-16d96bb1-e050-4c66-910d-db57f01ff628 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.920044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0fab95a4-2f52-42bf-b0ba-e4e07e606522 req-16d96bb1-e050-4c66-910d-db57f01ff628 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.928280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:13.929017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:13.933415 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0fab95a4-2f52-42bf-b0ba-e4e07e606522 req-16d96bb1-e050-4c66-910d-db57f01ff628 service nova] Creating event network-vif-deleted:8aea3ba4-26eb-42af-9ac1-a72bc89883e5 for instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 on n-h1-master-1 Oct 02 01:18:13.939226 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0fab95a4-2f52-42bf-b0ba-e4e07e606522 req-16d96bb1-e050-4c66-910d-db57f01ff628 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035291 Oct 02 01:18:13.940131 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1916/3977] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:13.944758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.945265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.945713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:13.946426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:13.946935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:13.947367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.105386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:14.106366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:14.118466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.120474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.124202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.125365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.126059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.127096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.172843 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:14.175351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.176391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.177068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.177848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lazy-loading 'fault' on Instance uuid 0ae307f0-4800-4d26-a187-0756b4bcbf56 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:14.301309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:14.309850 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d49dc09-6755-47b7-9129-3e97e9abcf23 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1306 microversion: 2.1 time: 0.210158 Oct 02 01:18:14.310675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1917/3978] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:14 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1306 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:14.317223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:14.328080 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d21833a2-ad73-464a-9adb-55358dc3248b tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.412549 Oct 02 01:18:14.328968 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2062/3979] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:13 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:14.558179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:14.558883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:14.566782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.567586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.567878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.568689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.569150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.569953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.791045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:14.799314 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39406acd-1a8b-4180-80d8-a46fcaa25291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1485 microversion: 2.1 time: 0.245057 Oct 02 01:18:14.799893 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1918/3980] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:14 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:14.822893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:14.823435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:14.834343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.835245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.835924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.836933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.837628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.838547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.865520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lazy-loading 'flavor' on Instance uuid a7bf04e1-aaac-453a-8736-7187abe3084e {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:14.933465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:14.934207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:14.944048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.948435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.951017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:14.953426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:14.955314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:14.958913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.113870 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4d8d899-fa8d-42be-8218-313ec9f63882 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e/action" status: 202 len: 0 microversion: 2.1 time: 0.294819 Oct 02 01:18:15.115360 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2063/3981] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:14 2022] POST /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:15.123022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:15.123905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.131424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.131949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.132792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.133691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.134248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.134923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.221596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:15.234395 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea913039-a029-4780-996a-4fc5192075a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1490 microversion: 2.1 time: 0.304854 Oct 02 01:18:15.235332 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1919/3982] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:14 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1490 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.241343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2fa66410-a855-461e-b4e1-0e1c182b8621 req-ef65a34b-752e-4d3c-91af-095686a6916a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e4d6b8-53e5-4964-a874-14fafa5fb900", "name": "network-vif-deleted", "tag": "ab85cb8a-a2bf-4631-9df6-f7ccd8b6596f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:15.254384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2fa66410-a855-461e-b4e1-0e1c182b8621 req-ef65a34b-752e-4d3c-91af-095686a6916a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.255250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2fa66410-a855-461e-b4e1-0e1c182b8621 req-ef65a34b-752e-4d3c-91af-095686a6916a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.255691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2fa66410-a855-461e-b4e1-0e1c182b8621 req-ef65a34b-752e-4d3c-91af-095686a6916a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.261807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:15.271405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2fa66410-a855-461e-b4e1-0e1c182b8621 req-ef65a34b-752e-4d3c-91af-095686a6916a service nova] Creating event network-vif-deleted:ab85cb8a-a2bf-4631-9df6-f7ccd8b6596f for instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 on n-h1-master-1 Oct 02 01:18:15.273523 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c897fbd7-d9f3-46e8-b146-e0c3f2317e29 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1272 microversion: 2.1 time: 0.156560 Oct 02 01:18:15.273989 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2064/3983] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:15 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.277977 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2fa66410-a855-461e-b4e1-0e1c182b8621 req-ef65a34b-752e-4d3c-91af-095686a6916a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041361 Oct 02 01:18:15.278811 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1920/3984] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:15.288452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:15.289873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.291481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:15.295093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.300284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.302248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.302699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.303087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.303362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.303826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.304333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.304729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.305007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.306363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.307100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.308436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.414098 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d567eaa3-11af-4074-b629-88f4c8ff1659 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "PUT /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1085 microversion: 2.1 time: 0.131937 Oct 02 01:18:15.419091 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1921/3985] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:18:15 2022] PUT /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1085 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.427178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:15.427894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.436373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.436956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.437464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.438135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.439109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.439548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.489216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.489773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.490246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.490693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lazy-loading 'fault' on Instance uuid 0ae307f0-4800-4d26-a187-0756b4bcbf56 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:15.556461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:15.564146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:15.565698 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ec40f60-c758-45d5-8262-2535b78e140d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 200 len: 1306 microversion: 2.1 time: 0.145504 Oct 02 01:18:15.582496 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1922/3986] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:15 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 1306 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.582872 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bfdc7377-eb02-4047-9c51-9c59abcf3fc2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1491 microversion: 2.1 time: 0.298042 Oct 02 01:18:15.582872 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2065/3987] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:15 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1491 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.587927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:15.590205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.592223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:15.593757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.603022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.604525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.605192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.606889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.607774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.608183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.608317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.608717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.609154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.610327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.613577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.614161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.863472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:15.872534 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28512cc1-5c35-4b6c-a13b-3298c6a242dd tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.299381 Oct 02 01:18:15.873502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1923/3988] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:15 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.932144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:15.942376 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c3364e4-eea3-489d-8884-69d841da2c27 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1511 microversion: 2.1 time: 0.366104 Oct 02 01:18:15.954138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2066/3989] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:15 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:15.966821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:15.967423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:15.974328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.975154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.975777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:15.976491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:15.976952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:15.977566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:16.297562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:16.298895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:16.308751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:16.309265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:16.309707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:16.321504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:16.322018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:16.322506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:16.899501 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:16.904799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:16.911327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:16.921792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88ea77b3-b8ee-48a7-a4b1-c43bea7dfcba tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1511 microversion: 2.1 time: 0.959022 Oct 02 01:18:16.923291 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1924/3990] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:15 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1511 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:16.929618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:16.930436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:16.939640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:16.939640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:16.940234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:16.941443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:16.942045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:16.942624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:16.949581 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bca3db17-0bb2-4f1f-972c-5d412805f901 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1272 microversion: 2.1 time: 0.655092 Oct 02 01:18:16.949581 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2067/3991] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:16 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1272 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:16.963369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:16.964324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:16.971181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:16.971940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:16.973303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 HTTP/1.1 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0ae307f0-4800-4d26-a187-0756b4bcbf56'} Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:16.979671 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:16.984632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a625a6eb-9345-41ab-8dc3-10340269e1d3 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 404 len: 111 microversion: 2.1 time: 0.054917 Oct 02 01:18:16.986159 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1925/3992] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:16 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:16.991876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:16.992963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:17.000684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.001337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.002033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.003131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.004269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.005073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.025363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.026758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.027392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.353099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:17.361578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96372704-1573-4478-a2c1-cfc262197259 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.374424 Oct 02 01:18:17.362903 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1926/3993] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:16 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:17.367371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:17.367864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:17.373981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.374490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.374959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.375622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.376075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.376500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.411210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:17.492698 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:17.502047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:17.523611 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b279f715-b8ab-4c10-86bf-ecf194432b82 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1512 microversion: 2.1 time: 0.573019 Oct 02 01:18:17.524240 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2068/3994] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:16 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:17.543532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-df618bee-1160-45ee-a56a-072213525229 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880745a60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:17.548245 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5d5ba23-6b31-403b-9fa0-f0e404b48cc4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 204 len: 0 microversion: 2.1 time: 0.184270 Oct 02 01:18:17.548946 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1927/3995] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:18:17 2022] DELETE /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:18:17.560992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:17.561698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:17.570740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.571363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.571812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.572579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.573202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.573642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.696994 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:17.888355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:17.903874 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87882b85-e85a-4656-8d16-3503f6d94a6c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1517 microversion: 2.1 time: 0.344037 Oct 02 01:18:17.904700 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1928/3996] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:17 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:17.977477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:17.977477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:17.994857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.995359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.995796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:17.996517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:17.997065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:17.997519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:18.122269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:18.134382 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e20dd47-12a1-4b85-9432-ff0afb4313b3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1293 microversion: 2.1 time: 0.159967 Oct 02 01:18:18.147406 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1929/3997] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:17 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1293 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:18.233311 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-df618bee-1160-45ee-a56a-072213525229 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315" status: 202 len: 0 microversion: 2.1 time: 0.704869 Oct 02 01:18:18.234752 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2069/3998] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:17 2022] DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:18.247966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c42d26ab-1451-4c55-9324-3ddb201784c4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88084e9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:18.387852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:18.388480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:18.400400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:18.401483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:18.402127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:18.404046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:18.404864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:18.405478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:18.709748 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c42d26ab-1451-4c55-9324-3ddb201784c4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f" status: 202 len: 0 microversion: 2.1 time: 0.469152 Oct 02 01:18:18.711057 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1930/3999] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:18 2022] DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:18:18.720596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:18.725271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:18.739871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:18.747907 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e04db66-2f8f-4c15-8809-68aab19a2385 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.362757 Oct 02 01:18:18.750236 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2070/4000] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:18 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:18.756704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12c590fd-b93f-4d03-b3e7-fb43c96c3644 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'create', calling method: .version_select at 0x7fb880745670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1803461976", "description": "tempest-description-1945118480"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:18.759978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:18.761386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:18.762000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:18.763090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:18.763823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:18.764411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.080895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:19.104547 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e4c2de2-d3ed-43dd-94d7-fb5de9d31211 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1512 microversion: 2.1 time: 0.392081 Oct 02 01:18:19.125949 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1931/4001] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:18 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:19.140029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:19.140662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:19.156977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.157487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.157931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.162497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.163092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.163733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.452184 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12c590fd-b93f-4d03-b3e7-fb43c96c3644 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.700524 Oct 02 01:18:19.453745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2071/4002] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:18:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:19.467856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:19.469712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:19.479159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.487226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.488477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.489587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.490360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.491573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.499537 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:19.530756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.531445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.532185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.532824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lazy-loading 'fault' on Instance uuid c8e4d6b8-53e5-4964-a874-14fafa5fb900 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:19.569877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:19.583415 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57162398-d4dc-40c2-967b-53fab61c1d8c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1517 microversion: 2.1 time: 0.454206 Oct 02 01:18:19.591141 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1932/4003] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:19 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1517 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:19.601964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49ca8edb-f331-4882-9391-ff70d622af44 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Action: 'update', calling method: .version_select at 0x7fb880807af0>, body: {"security_group": {"name": "tempest-sg-hth-1656574820", "description": "tempest-description-hth-1604822097"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:19.660922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:19.672223 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b44200d-dd14-41a9-9971-83976407797b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 200 len: 1304 microversion: 2.1 time: 0.217226 Oct 02 01:18:19.676445 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2072/4004] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:19 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:19.745537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a574a56d-22d8-4f10-b858-932374d85f09 req-714b59db-5db1-490d-83e3-aadbd66c64ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bf04e1-aaac-453a-8736-7187abe3084e", "name": "network-vif-plugged", "status": "completed", "tag": "0943776c-7aa0-4058-af11-9cb5231e2457"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:19.770433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a574a56d-22d8-4f10-b858-932374d85f09 req-714b59db-5db1-490d-83e3-aadbd66c64ea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.777855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a574a56d-22d8-4f10-b858-932374d85f09 req-714b59db-5db1-490d-83e3-aadbd66c64ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.781311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a574a56d-22d8-4f10-b858-932374d85f09 req-714b59db-5db1-490d-83e3-aadbd66c64ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.829411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a574a56d-22d8-4f10-b858-932374d85f09 req-714b59db-5db1-490d-83e3-aadbd66c64ea service nova] Creating event network-vif-plugged:0943776c-7aa0-4058-af11-9cb5231e2457 for instance a7bf04e1-aaac-453a-8736-7187abe3084e on n-h2-master-1 Oct 02 01:18:19.858958 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a574a56d-22d8-4f10-b858-932374d85f09 req-714b59db-5db1-490d-83e3-aadbd66c64ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102656 Oct 02 01:18:19.860295 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2073/4005] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:18:19.876855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:19.883470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:19.908731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.910267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.913109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:19.914084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:19.916040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:19.918309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:20.064709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49ca8edb-f331-4882-9391-ff70d622af44 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/dce2b416-95f5-4a17-a4fc-412011f94326" status: 200 len: 218 microversion: 2.1 time: 0.469832 Oct 02 01:18:20.064709 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1933/4006] 10.222.0.23 () {60 vars in 1290 bytes} [Sun Oct 2 01:18:19 2022] PUT /compute/v2.1/os-security-groups/dce2b416-95f5-4a17-a4fc-412011f94326 => generated 218 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:20.077202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14922a5b-05eb-4b67-9724-0301568cec4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88089a940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:20.254520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14922a5b-05eb-4b67-9724-0301568cec4b tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/dce2b416-95f5-4a17-a4fc-412011f94326" status: 200 len: 218 microversion: 2.1 time: 0.181190 Oct 02 01:18:20.255169 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1934/4007] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:18:20 2022] GET /compute/v2.1/os-security-groups/dce2b416-95f5-4a17-a4fc-412011f94326 => generated 218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:20.265138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:20.265138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:20.272162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:20.274290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:20.275389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:20.275834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:20.281070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:20.281070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:20.281070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:20.294484 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c550f8a-07b4-4f67-8973-171d8fffde47 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.432239 Oct 02 01:18:20.295124 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2074/4008] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:19 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:20.300367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9bf1aa8-517a-491b-a378-68c8c998b4d7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880736ca0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.237848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9bf1aa8-517a-491b-a378-68c8c998b4d7 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/dce2b416-95f5-4a17-a4fc-412011f94326" status: 202 len: 0 microversion: 2.1 time: 0.940787 Oct 02 01:18:21.238676 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2075/4009] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:20 2022] DELETE /compute/v2.1/os-security-groups/dce2b416-95f5-4a17-a4fc-412011f94326 => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:21.245408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.247188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:21.263890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.266391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.269240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.270088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.271433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.271960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.374792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.382684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.383258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.383748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lazy-loading 'fault' on Instance uuid bfca093a-b241-4946-9093-15c7ec39042e {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:21.443970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:21.455232 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7c8e7c39-0ade-4521-adeb-d32d863294c5 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 1.199004 Oct 02 01:18:21.456981 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1935/4010] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:20 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:21.462305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.463188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:21.470649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.471435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.472065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.472944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.473560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.474144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.497188 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 HTTP/1.1 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c8e4d6b8-53e5-4964-a874-14fafa5fb900'} Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.499410 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:18:21.505681 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.507276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:21.508465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a90a847-cda4-455b-9cb5-b62743080e2b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 404 len: 111 microversion: 2.1 time: 0.050300 Oct 02 01:18:21.509225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1936/4011] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:21 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:21.518177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-29478109-db0a-420c-b79e-4eca209a0415 req-8b10182e-dafd-4a93-ad21-6820994a1eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfca093a-b241-4946-9093-15c7ec39042e", "name": "network-vif-deleted", "tag": "4fd3cd5f-b61a-4002-a82e-13d8c9d56436"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:21.525196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:21.530109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-29478109-db0a-420c-b79e-4eca209a0415 req-8b10182e-dafd-4a93-ad21-6820994a1eb4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.530845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-29478109-db0a-420c-b79e-4eca209a0415 req-8b10182e-dafd-4a93-ad21-6820994a1eb4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.531588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-29478109-db0a-420c-b79e-4eca209a0415 req-8b10182e-dafd-4a93-ad21-6820994a1eb4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.539659 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e621d498-1771-4585-b7c4-d327be0e1f74 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 200 len: 1319 microversion: 2.1 time: 0.299309 Oct 02 01:18:21.540915 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2076/4012] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:21 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:21.545197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-29478109-db0a-420c-b79e-4eca209a0415 req-8b10182e-dafd-4a93-ad21-6820994a1eb4 service nova] Creating event network-vif-deleted:4fd3cd5f-b61a-4002-a82e-13d8c9d56436 for instance bfca093a-b241-4946-9093-15c7ec39042e on n-h2-master-1 Oct 02 01:18:21.546207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.546846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:21.551848 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-29478109-db0a-420c-b79e-4eca209a0415 req-8b10182e-dafd-4a93-ad21-6820994a1eb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Oct 02 01:18:21.552666 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1937/4013] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:21.559184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.559665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.560281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:21.560856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.561410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.562248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.562857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.563378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.568116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.568628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.574764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.575903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.579408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.580298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.585780 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 HTTP/1.1 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0ae307f0-4800-4d26-a187-0756b4bcbf56'} Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:21.589767 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.597477 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.602096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:21.603588 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4468870-7430-480c-8c41-8941eaf6d42c tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 404 len: 111 microversion: 2.1 time: 0.061343 Oct 02 01:18:21.604804 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2077/4014] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:18:21 2022] DELETE /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:21.614748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.615805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 0ae307f0-4800-4d26-a187-0756b4bcbf56] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:21.622522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.623976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.624649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.626068 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.626822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.627659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.671949 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 HTTP/1.1 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0ae307f0-4800-4d26-a187-0756b4bcbf56'} Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.677295 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. Oct 02 01:18:21.682065 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.684775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Instance 0ae307f0-4800-4d26-a187-0756b4bcbf56 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:21.687584 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32139fdb-540c-43c3-b9e3-515dd0d831a1 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56" status: 404 len: 111 microversion: 2.1 time: 0.079001 Oct 02 01:18:21.691308 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2078/4015] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:21 2022] GET /compute/v2.1/servers/0ae307f0-4800-4d26-a187-0756b4bcbf56 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:21.705726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880931790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.815979 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:21.817072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.security_group_api [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group 46511846-707f-4b3f-b547-047e9eb9bd9f not found {{(pid=122355) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:18:21.817699 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.817699 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f HTTP/1.1 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: exception: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '46511846-707f-4b3f-b547-047e9eb9bd9f'} Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:21.820112 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group 46511846-707f-4b3f-b547-047e9eb9bd9f does not exist Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-034b0b45-719d-408c-8972-79c8223b293b'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27cc8db9-eacc-4a21-818d-f273203a6f41 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f" status: 404 len: 194 microversion: 2.1 time: 0.128392 Oct 02 01:18:21.825338 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2079/4016] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:21 2022] DELETE /compute/v2.1/os-security-groups/46511846-707f-4b3f-b547-047e9eb9bd9f => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:21.833210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880736160>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.915153 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist", "detail": ""}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:21.915795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.security_group_api [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 not found {{(pid=122355) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:18:21.916490 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.916490 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315 HTTP/1.1 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: exception: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9dadb54d-7a79-4626-97ec-2c9de0acf315'} Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:21.918229 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group 9dadb54d-7a79-4626-97ec-2c9de0acf315 does not exist Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: Neutron server returns request_ids: ['req-428e500c-e85f-4c50-b8e2-178df96f5dfd'] {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-933c7e30-7dd8-4b8a-990a-b470a412b765 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315" status: 404 len: 194 microversion: 2.1 time: 0.091510 Oct 02 01:18:21.928406 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2080/4017] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:21 2022] DELETE /compute/v2.1/os-security-groups/9dadb54d-7a79-4626-97ec-2c9de0acf315 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:18:21.934979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:21.935114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a8ee6a52-eca4-4b6c-b6a2-ed3718c2434e req-ab6e6c11-a3d7-43d7-8c73-f911275f1318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5cefe3-3202-46ef-b652-40206d39b7a7", "name": "network-vif-plugged", "status": "completed", "tag": "93fffe62-8f4c-4259-ace2-d401024cd80b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:21.942112 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6edeafbd-d128-43b6-9740-8db9a9716b0f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.384598 Oct 02 01:18:21.943727 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1938/4018] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:21 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:21.950687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a8ee6a52-eca4-4b6c-b6a2-ed3718c2434e req-ab6e6c11-a3d7-43d7-8c73-f911275f1318 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:21.951194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a8ee6a52-eca4-4b6c-b6a2-ed3718c2434e req-ab6e6c11-a3d7-43d7-8c73-f911275f1318 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:21.951648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a8ee6a52-eca4-4b6c-b6a2-ed3718c2434e req-ab6e6c11-a3d7-43d7-8c73-f911275f1318 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:21.965601 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a8ee6a52-eca4-4b6c-b6a2-ed3718c2434e req-ab6e6c11-a3d7-43d7-8c73-f911275f1318 service nova] Creating event network-vif-plugged:93fffe62-8f4c-4259-ace2-d401024cd80b for instance ac5cefe3-3202-46ef-b652-40206d39b7a7 on n-h1-master-1 Oct 02 01:18:21.968150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88084b4c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:21.973590 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a8ee6a52-eca4-4b6c-b6a2-ed3718c2434e req-ab6e6c11-a3d7-43d7-8c73-f911275f1318 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051757 Oct 02 01:18:21.978805 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2081/4019] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:22.055341 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:22.056216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group f307260e-3967-4633-9791-aa9b11572e2e not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:18:22.056919 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.056919 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e HTTP/1.1 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: exception: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f307260e-3967-4633-9791-aa9b11572e2e'} Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:22.059592 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] Oct 02 01:18:22.064843 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.070349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group f307260e-3967-4633-9791-aa9b11572e2e does not exist Oct 02 01:18:22.070349 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-916672cf-0b71-4f2d-8e80-54094c32e09e'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:22.070738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1759495999", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:22.070895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2503d23-5df1-44ed-9f40-7f62835f8f1f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e" status: 404 len: 194 microversion: 2.1 time: 0.108973 Oct 02 01:18:22.070895 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1939/4020] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:21 2022] DELETE /compute/v2.1/os-security-groups/f307260e-3967-4633-9791-aa9b11572e2e => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:22.089946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88084e550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:22.147127 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:22.147920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group a3316e8c-17e6-4990-a72c-d1e13325bd1e not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:18:22.148565 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.148565 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e HTTP/1.1 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: exception: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a3316e8c-17e6-4990-a72c-d1e13325bd1e'} Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:22.150632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] Oct 02 01:18:22.156070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.162834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group a3316e8c-17e6-4990-a72c-d1e13325bd1e does not exist Oct 02 01:18:22.162834 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-e32c2c47-6bc8-4b2a-b4f0-6b794cf486b2'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:22.162834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7c476043-7919-4a1e-bb76-478355d4df4f tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e" status: 404 len: 194 microversion: 2.1 time: 0.085446 Oct 02 01:18:22.162834 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1940/4021] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:22 2022] DELETE /compute/v2.1/os-security-groups/a3316e8c-17e6-4990-a72c-d1e13325bd1e => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:18:22.172785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:18:22.178044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88084be50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:22.250383 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:22.251032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group 5064189c-129b-4eaf-a483-bc67870c73f5 not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:18:22.251912 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.251912 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5 HTTP/1.1 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: exception: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5064189c-129b-4eaf-a483-bc67870c73f5'} Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:22.254152 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] Oct 02 01:18:22.258720 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.262790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group 5064189c-129b-4eaf-a483-bc67870c73f5 does not exist Oct 02 01:18:22.262790 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-a84a513a-3f15-4529-913e-5ad5d3dd4a96'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:22.263953 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b954bae-15cc-4a40-9a45-46e3f44a09a4 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5" status: 404 len: 194 microversion: 2.1 time: 0.098207 Oct 02 01:18:22.264714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1941/4022] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:22 2022] DELETE /compute/v2.1/os-security-groups/5064189c-129b-4eaf-a483-bc67870c73f5 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:22.273601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb880807af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:22.355847 n-d-master-1 devstack@n-api.service[122354]: DEBUG neutronclient.v2_0.client [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist", "detail": ""}} {{(pid=122354) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 01:18:22.356658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Neutron security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc not found {{(pid=122354) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 02 01:18:22.357343 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.357343 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc HTTP/1.1 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: exception: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '60a88656-9780-4b1c-93ed-b532b0ad9ecc'} Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 02 01:18:22.360036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] Oct 02 01:18:22.364800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:22.370328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Security group 60a88656-9780-4b1c-93ed-b532b0ad9ecc does not exist Oct 02 01:18:22.370328 n-d-master-1 devstack@n-api.service[122354]: Neutron server returns request_ids: ['req-633e707c-7e55-4dfc-aae2-3393c014309e'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:22.371632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-950a69cf-929e-4e38-ad4c-d3fbdf98e437 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc" status: 404 len: 194 microversion: 2.1 time: 0.102051 Oct 02 01:18:22.372416 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1942/4023] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:22 2022] DELETE /compute/v2.1/os-security-groups/60a88656-9780-4b1c-93ed-b532b0ad9ecc => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:18:22.385392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:22.388104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:22.402036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:22.402802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:22.403567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:22.404741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:22.405624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:22.406346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:22.439295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:22.579619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0898cf5-2d05-4e0c-8c27-b8979211b968 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 204 len: 0 microversion: 2.1 time: 0.200126 Oct 02 01:18:22.586072 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1943/4024] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:18:22 2022] DELETE /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:18:22.592075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:22.593108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:22.602244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:22.603960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:22.604819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:22.606277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:22.607226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:22.609755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:22.943934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:22.953946 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70efbf6e-8ef3-4a62-b58e-49e958f2c2d2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.366175 Oct 02 01:18:22.958485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1944/4025] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:22 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:22.969430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:22.970463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:22.972375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:22.972857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:22.973341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:22.973936 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:22.974523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:22.985318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:22.986053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:22.987474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:22.988884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:22.989558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:22.990208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.004458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.005428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.009844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.011025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:23.011201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.012138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.012580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.017719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:23.032556 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:23.034913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:18:23.038237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:18:23.067303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e HTTP/1.1 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: exception: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'bfca093a-b241-4946-9093-15c7ec39042e'} Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:23.082454 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04686b1e-8326-4048-aaef-a64e25e93f6a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 404 len: 111 microversion: 2.1 time: 0.123516 Oct 02 01:18:23.089022 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1945/4026] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:22 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:23.102013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:23.109100 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a840f2de-a7a8-46ff-aa07-aa910044f23d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044389 Oct 02 01:18:23.110404 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2082/4027] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:18:23.116506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:23.117628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:23.126125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.126930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.127798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.128767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.129428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.130052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.135026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:23.150978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.151519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.151971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.152695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.153767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.153767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:23.475980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:23.488997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47cd7466-240d-47c7-aa50-f9a007745c4c tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1324 microversion: 2.1 time: 0.374059 Oct 02 01:18:23.491847 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2083/4028] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:23 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:23.504758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8cc9ea66-5d5a-4921-b0b2-4b8007a10ac2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:23.508659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8cc9ea66-5d5a-4921-b0b2-4b8007a10ac2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:23.534219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:23.596248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-225dc2c9-dcb9-4269-8216-07295855e4b0 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1648 microversion: 2.1 time: 0.484702 Oct 02 01:18:23.597717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1946/4029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:23 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1648 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:23.629882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1426113648", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "6075ff80-003c-43e7-a23d-f20fa2a88748"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:23.665397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8cc9ea66-5d5a-4921-b0b2-4b8007a10ac2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:23.673378 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8cc9ea66-5d5a-4921-b0b2-4b8007a10ac2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1215 microversion: 2.1 time: 0.178080 Oct 02 01:18:23.675424 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2084/4030] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:23 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:23.735061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] validate_networks() for [('6075ff80-003c-43e7-a23d-f20fa2a88748', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:18:23.987259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:23.988390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:23.998445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:23.999272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:23.999889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.000802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.001436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.002102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.607644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:24.608160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:24.608528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:24.608938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:24.609339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:24.634354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.634875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.635305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.636146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.636603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.637024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.680817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:24.686843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Getting quotas for user 5104bda5de774e93bd494d64a8f11faf and project e44feebec98b4cd49f7a80597f47be35. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:24.719851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:24.723067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:18:24.728065 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4446f88-2545-4cb0-a28b-9e8cecd54410 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.745732 Oct 02 01:18:24.730257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:18:24.731107 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2085/4031] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:23 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:24.738561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:24.740836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:24.756235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.757598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.758536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.760279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.761569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.762859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.858158 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e42ee6d-4dcf-47de-97ad-4750b1b9a1ea tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238636 Oct 02 01:18:24.859140 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1947/4032] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:18:24.865316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:24.866188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:24.875811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.877156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.877921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:24.878943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:24.879589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:24.880232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:25.260102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:25.278405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2221e509-bb77-490b-828b-6013e9fd6bbc tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1469 microversion: 2.1 time: 0.417972 Oct 02 01:18:25.281626 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1948/4033] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:24 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:25.294670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:25.297566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:25.331941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:25.332579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:25.336529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:25.337423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:25.341310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:25.341768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:25.856630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:25.875877 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9157902b-e4ab-4ad7-84a5-a06a9e5a901a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1275 microversion: 2.1 time: 0.592178 Oct 02 01:18:25.876873 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1949/4034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:25 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1275 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:25.889068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d46dd01-f9e2-4795-8458-e267f9fcd1e4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:25.891411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d46dd01-f9e2-4795-8458-e267f9fcd1e4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:26.194770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d46dd01-f9e2-4795-8458-e267f9fcd1e4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:26.202213 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d46dd01-f9e2-4795-8458-e267f9fcd1e4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1209 microversion: 2.1 time: 0.324150 Oct 02 01:18:26.203257 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1950/4035] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:25 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1209 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:26.211531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:26.217125 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:26.233944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:26.234871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:26.235557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:26.236845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:26.237549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:26.247571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:26.293438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:26.336102 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2cf91cfd-9d88-4ba4-ad5c-0924d5d03bbc tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1518 microversion: 2.1 time: 1.582299 Oct 02 01:18:26.340152 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2086/4036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:24 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1518 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:26.366625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c47a7641-ad3f-4e9c-b186-5796307b9d1e req-6d8b495b-7e69-405a-a444-b17fb6509cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1536ba-614a-483e-9565-45379729caf1", "name": "network-vif-deleted", "tag": "6546a8d9-b30f-41f7-a24d-9bd99290af6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:26.395055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c47a7641-ad3f-4e9c-b186-5796307b9d1e req-6d8b495b-7e69-405a-a444-b17fb6509cba service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:26.395553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c47a7641-ad3f-4e9c-b186-5796307b9d1e req-6d8b495b-7e69-405a-a444-b17fb6509cba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:26.395992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c47a7641-ad3f-4e9c-b186-5796307b9d1e req-6d8b495b-7e69-405a-a444-b17fb6509cba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:26.432273 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c47a7641-ad3f-4e9c-b186-5796307b9d1e req-6d8b495b-7e69-405a-a444-b17fb6509cba service nova] Creating event network-vif-deleted:6546a8d9-b30f-41f7-a24d-9bd99290af6a for instance 3b1536ba-614a-483e-9565-45379729caf1 on n-h2-master-1 Oct 02 01:18:26.440905 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c47a7641-ad3f-4e9c-b186-5796307b9d1e req-6d8b495b-7e69-405a-a444-b17fb6509cba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096707 Oct 02 01:18:26.444557 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2087/4037] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:26.458340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:26.459502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:26.476845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:26.478111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:26.480706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:26.484875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:26.488220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:26.489585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:26.605551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:26.611901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:26.612629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:26.613498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lazy-loading 'fault' on Instance uuid 3b1536ba-614a-483e-9565-45379729caf1 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:27.102753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e0eaf9b9e34b8d80e9ddadd09989fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94224832aed24d2f83c72250cbfb4a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:27.119713 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a18d6b2f-1e78-4a53-a4f9-5b73114999bf tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 200 len: 1306 microversion: 2.1 time: 0.673619 Oct 02 01:18:27.122930 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2088/4038] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:26 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 1306 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:27.127926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dfbc7d9-5cfe-4070-bd2a-061806226117 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1869587948", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dfbc7d9-5cfe-4070-bd2a-061806226117 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 243 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1869587948", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1869587948', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '0a2ac087-19c4-4d83-8d50-14e6b0887610'}]}}} Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:27.151921 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.158238 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.163949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dfbc7d9-5cfe-4070-bd2a-061806226117 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:27.165539 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9dfbc7d9-5cfe-4070-bd2a-061806226117 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.041611 Oct 02 01:18:27.167795 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2089/4039] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:27 2022] POST /compute/v2.1/servers => generated 175 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:27.180258 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:27.181235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:27.191281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:27.191923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:27.192327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:27.193026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:27.193488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:27.194733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:27.314979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:27.324511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:27.327705 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1ec1f9a-9748-4a86-9fee-d36fbab2b113 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1273 microversion: 2.1 time: 0.156122 Oct 02 01:18:27.342828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2090/4040] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:27 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:27.348418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9716e93-bab5-4dad-b24c-2ac2d84dcda1 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:27.349878 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aab38f44-8cf8-40ca-b461-361af037fc6b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 1.142316 Oct 02 01:18:27.350472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1951/4041] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:26 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:27.351126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9716e93-bab5-4dad-b24c-2ac2d84dcda1 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: 026f1cae-57b7-4169-9ef9-08981fea984e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:27.366247 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d9716e93-bab5-4dad-b24c-2ac2d84dcda1 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] HTTP exception thrown: Instance 026f1cae-57b7-4169-9ef9-08981fea984e could not be found. Oct 02 01:18:27.375026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:27.375789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9716e93-bab5-4dad-b24c-2ac2d84dcda1 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/026f1cae-57b7-4169-9ef9-08981fea984e/metadata HTTP/1.1 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 026f1cae-57b7-4169-9ef9-08981fea984e could not be found. Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '026f1cae-57b7-4169-9ef9-08981fea984e'} Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026f1cae-57b7-4169-9ef9-08981fea984e could not be found. Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026f1cae-57b7-4169-9ef9-08981fea984e could not be found. Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.378156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.386247 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:27.386247 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:27.386247 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026f1cae-57b7-4169-9ef9-08981fea984e could not be found. Oct 02 01:18:27.386247 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.386796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:27.386796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:27.386796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:27.386796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:27.386796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:27.388141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9716e93-bab5-4dad-b24c-2ac2d84dcda1 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 404 to user: Instance 026f1cae-57b7-4169-9ef9-08981fea984e could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:27.388647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:27.389974 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9716e93-bab5-4dad-b24c-2ac2d84dcda1 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/026f1cae-57b7-4169-9ef9-08981fea984e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.055176 Oct 02 01:18:27.391563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2091/4042] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:18:27 2022] GET /compute/v2.1/servers/026f1cae-57b7-4169-9ef9-08981fea984e/metadata => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:27.519051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b49a2ad-ac5e-4c2f-9617-e1ff9272ce55 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1236155544", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b49a2ad-ac5e-4c2f-9617-e1ff9272ce55 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 499 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1236155544", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1236155544', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0a2ac087-19c4-4d83-8d50-14e6b0887610'}]}}} Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:18:27.529690 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.534251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b49a2ad-ac5e-4c2f-9617-e1ff9272ce55 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:27.538465 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7b49a2ad-ac5e-4c2f-9617-e1ff9272ce55 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.027207 Oct 02 01:18:27.540261 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2092/4043] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:27 2022] POST /compute/v2.1/servers => generated 687 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:27.659353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:27.674765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05f2e9ac-615e-45f6-b676-adbdbd01adeb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2097574452", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:27.687597 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad4e02b4-6833-46bb-9766-619d6f3a4447 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1205 microversion: 2.1 time: 0.330084 Oct 02 01:18:27.688191 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1952/4044] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:27 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1205 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05f2e9ac-615e-45f6-b676-adbdbd01adeb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 500 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2097574452", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2097574452', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0a2ac087-19c4-4d83-8d50-14e6b0887610'}]}}} Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:18:27.724824 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.728520 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.739186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05f2e9ac-615e-45f6-b676-adbdbd01adeb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:27.743506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-05f2e9ac-615e-45f6-b676-adbdbd01adeb tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.086208 Oct 02 01:18:27.745326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2093/4045] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:27 2022] POST /compute/v2.1/servers => generated 689 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:18:27.868073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1cd0c9aa-41bf-4796-acfa-95d688f4e45d tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-700883259", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1cd0c9aa-41bf-4796-acfa-95d688f4e45d tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 753 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-700883259", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-700883259', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0a2ac087-19c4-4d83-8d50-14e6b0887610'}]}}} Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:18:27.872628 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:18:27.876849 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:18:27.880291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:27.880291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:27.880291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1cd0c9aa-41bf-4796-acfa-95d688f4e45d tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:27.880291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1cd0c9aa-41bf-4796-acfa-95d688f4e45d tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.015252 Oct 02 01:18:27.880291 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1953/4046] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:27 2022] POST /compute/v2.1/servers => generated 1197 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 02 01:18:27.998784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2eb2ddb5-b62b-4eca-9539-fbdd229ed9a9 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-349589392", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2eb2ddb5-b62b-4eca-9539-fbdd229ed9a9 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 1265 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-349589392", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0a2ac087-19c4-4d83-8d50-14e6b0887610"}]}} Oct 02 01:18:28.012527 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-349589392', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0a2ac087-19c4-4d83-8d50-14e6b0887610'}]}}} Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.015424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:18:28.018190 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:18:28.020640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 02 01:18:28.020640 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.023228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2eb2ddb5-b62b-4eca-9539-fbdd229ed9a9 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:28.034066 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2eb2ddb5-b62b-4eca-9539-fbdd229ed9a9 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.036445 Oct 02 01:18:28.040470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2094/4047] 10.222.0.23 () {60 vars in 1148 bytes} [Sun Oct 2 01:18:27 2022] POST /compute/v2.1/servers => generated 2221 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 02 01:18:28.054477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0d8c37b-6760-41db-89f5-8bebf55bf49f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:28.055432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0d8c37b-6760-41db-89f5-8bebf55bf49f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: 3ec1803d-4cc8-4170-bad8-eea656a4a2e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:28.065103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f0d8c37b-6760-41db-89f5-8bebf55bf49f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] HTTP exception thrown: Instance 3ec1803d-4cc8-4170-bad8-eea656a4a2e8 could not be found. Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0d8c37b-6760-41db-89f5-8bebf55bf49f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/3ec1803d-4cc8-4170-bad8-eea656a4a2e8/metadata/test2 HTTP/1.1 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3ec1803d-4cc8-4170-bad8-eea656a4a2e8 could not be found. Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '3ec1803d-4cc8-4170-bad8-eea656a4a2e8', 'id': 'test2'} Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec1803d-4cc8-4170-bad8-eea656a4a2e8 could not be found. Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec1803d-4cc8-4170-bad8-eea656a4a2e8 could not be found. Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:28.068721 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:28.075656 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:28.075656 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:28.075656 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec1803d-4cc8-4170-bad8-eea656a4a2e8 could not be found. Oct 02 01:18:28.075656 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.077148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0d8c37b-6760-41db-89f5-8bebf55bf49f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 404 to user: Instance 3ec1803d-4cc8-4170-bad8-eea656a4a2e8 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:28.078244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0d8c37b-6760-41db-89f5-8bebf55bf49f tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/3ec1803d-4cc8-4170-bad8-eea656a4a2e8/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.029119 Oct 02 01:18:28.080158 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1954/4048] 10.222.0.23 () {58 vars in 1281 bytes} [Sun Oct 2 01:18:28 2022] GET /compute/v2.1/servers/3ec1803d-4cc8-4170-bad8-eea656a4a2e8/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:28.106753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:28.108150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:28.118582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:28.119528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:28.120276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:28.121592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:28.122353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:28.123075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:28.146113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:28.146847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] [instance: 3b1536ba-614a-483e-9565-45379729caf1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:28.156827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:28.157958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:28.158468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:28.159405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:28.161269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:28.175057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:28.175626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:28.203945 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] HTTP exception thrown: Instance 3b1536ba-614a-483e-9565-45379729caf1 could not be found. Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Request method failure captured: Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 HTTP/1.1 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOaMAD4YkyWoUB-9KYHivJkwIJVsustmyWHskr6ijO25WfpO-otPNui2E55ga3BZy9adt4HxIKMh1SHcpyQMfIMGEJ06_Qx6Eh88Y_UnuKftlnOFaYOGrXS9YPgKuin14DnSRIPo3eAKPO1XHSiy11LYgaCXskzWoGZGpWLmkq10bno Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94224832aed24d2f83c72250cbfb4a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94224832aed24d2f83c72250cbfb4a4f"}]}] Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 94224832aed24d2f83c72250cbfb4a4f Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1141556354 Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e0eaf9b9e34b8d80e9ddadd09989fa Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-SecurityGroupsTestJSON-1141556354-project Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3b1536ba-614a-483e-9565-45379729caf1 could not be found. Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3b1536ba-614a-483e-9565-45379729caf1'} Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1536ba-614a-483e-9565-45379729caf1 could not be found. Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1536ba-614a-483e-9565-45379729caf1 could not be found. Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:28.212878 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1536ba-614a-483e-9565-45379729caf1 could not be found. Oct 02 01:18:28.218577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:28.224114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Returning 404 to user: Instance 3b1536ba-614a-483e-9565-45379729caf1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:28.227200 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f204f82-6e82-4221-954d-fb897dce767d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1" status: 404 len: 111 microversion: 2.1 time: 0.086551 Oct 02 01:18:28.231440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1955/4049] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:28 2022] GET /compute/v2.1/servers/3b1536ba-614a-483e-9565-45379729caf1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:28.245241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6a7ef37-2fd9-4175-8499-8b245106278d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb8808d2790>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:28.282816 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b5052bd-bf9c-489a-8ff8-cd2bdb674810 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 204 len: 0 microversion: 2.1 time: 0.191458 Oct 02 01:18:28.288834 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2095/4050] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:18:28 2022] DELETE /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:18:28.296663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:28.298292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:28.306261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:28.307230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:28.307966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:28.309441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:28.310028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:28.310774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:29.262701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:29.275048 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50d987f1-38d7-4199-a55a-a54be3785f16 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1524 microversion: 2.1 time: 0.984190 Oct 02 01:18:29.275654 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2096/4051] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:28 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1524 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:29.290562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:29.291226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:29.310869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:29.311579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:29.314544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:29.315715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:29.316477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:29.317156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:29.331899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6a7ef37-2fd9-4175-8499-8b245106278d tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/13f1f66f-bac1-496e-aea0-fa3ad5672447" status: 202 len: 0 microversion: 2.1 time: 1.095457 Oct 02 01:18:29.332928 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1956/4052] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:28 2022] DELETE /compute/v2.1/os-security-groups/13f1f66f-bac1-496e-aea0-fa3ad5672447 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:29.338582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:29.339327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:29.359240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:29.360150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:29.361263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:29.362201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:29.362887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:29.367278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:29.377515 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:30.726854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:30.740671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-66df9411-f563-47a5-896d-fdc942dd3865 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 1.403587 Oct 02 01:18:30.760910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1957/4053] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:29 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:30.778565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:30.779727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:30.797065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:30.798212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:30.798934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:30.802116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:30.804206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:30.806219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:31.091601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:31.108773 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-852df7ba-a904-43dc-9ef9-38378916dad0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1267 microversion: 2.1 time: 0.344383 Oct 02 01:18:31.111210 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1958/4054] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:30 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:31.124204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:31.128586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5830c20d-25c7-4a11-93d7-9fdd825ad309 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] Calling method '.version_select at 0x7fb88084b700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:31.150468 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4b69699-6ccc-429f-b6ae-eba8ee5be365 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1315 microversion: 2.1 time: 1.873399 Oct 02 01:18:31.152024 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2097/4055] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:29 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1315 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:31.189153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:31.191323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:31.209558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:31.211986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:31.212987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:31.216847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:31.217819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:31.218507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:32.086749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:32.109422 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf441052-2203-4a92-8d4c-15d16bb32a64 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1524 microversion: 2.1 time: 0.953151 Oct 02 01:18:32.118402 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2098/4056] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:31 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1524 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:32.137621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:32.139900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:32.156601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:32.158829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:32.159672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:32.162501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:32.163306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:32.164030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:32.171229 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:32.929877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:32.943741 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca6ae0cf-2731-4e9f-9610-7ef08824428b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.823764 Oct 02 01:18:32.945597 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2099/4057] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:32 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:32.964840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:32.987515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:33.013432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.014186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.014789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.015734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.027440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.027963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.028570 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:33.365489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5830c20d-25c7-4a11-93d7-9fdd825ad309 tempest-SecurityGroupsTestJSON-1141556354 tempest-SecurityGroupsTestJSON-1141556354-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0cb25545-4372-441e-9702-2e7ed9d59495" status: 202 len: 0 microversion: 2.1 time: 2.253080 Oct 02 01:18:33.368114 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1959/4058] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:18:31 2022] DELETE /compute/v2.1/os-security-groups/0cb25545-4372-441e-9702-2e7ed9d59495 => generated 0 bytes in 2256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:33.386230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:33.388982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:33.415933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.418969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.421314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.423855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.425457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.426070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.494250 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:33.504536 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3a3e0e20-a363-4b66-86f2-a69f5bb4fcc1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1267 microversion: 2.1 time: 0.556379 Oct 02 01:18:33.527499 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2100/4059] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:32 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1267 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:33.552640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-868251bc-8cc3-4118-9bc7-9fe57a5d2e78 req-7419d20e-1585-490a-825f-a699b97808e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6155aed-5beb-461d-b2a1-70b888fc0ebe", "tag": "c93c87cd-cda8-4c68-8841-28c6821e01f3"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:33.588486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-868251bc-8cc3-4118-9bc7-9fe57a5d2e78 req-7419d20e-1585-490a-825f-a699b97808e5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.589240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-868251bc-8cc3-4118-9bc7-9fe57a5d2e78 req-7419d20e-1585-490a-825f-a699b97808e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.589697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-868251bc-8cc3-4118-9bc7-9fe57a5d2e78 req-7419d20e-1585-490a-825f-a699b97808e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.630797 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-868251bc-8cc3-4118-9bc7-9fe57a5d2e78 req-7419d20e-1585-490a-825f-a699b97808e5 service nova] Creating event network-changed:c93c87cd-cda8-4c68-8841-28c6821e01f3 for instance b6155aed-5beb-461d-b2a1-70b888fc0ebe on n-h2-master-1 Oct 02 01:18:33.639803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-868251bc-8cc3-4118-9bc7-9fe57a5d2e78 req-7419d20e-1585-490a-825f-a699b97808e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111117 Oct 02 01:18:33.642116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2101/4060] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:33.650527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4974b2d1-5f9f-48d1-a664-36a62b517ea0 req-e831ff8f-2a39-49d6-a3bd-9986fdb7ddbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5cefe3-3202-46ef-b652-40206d39b7a7", "name": "network-vif-deleted", "tag": "93fffe62-8f4c-4259-ace2-d401024cd80b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:33.666011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4974b2d1-5f9f-48d1-a664-36a62b517ea0 req-e831ff8f-2a39-49d6-a3bd-9986fdb7ddbd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.666846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4974b2d1-5f9f-48d1-a664-36a62b517ea0 req-e831ff8f-2a39-49d6-a3bd-9986fdb7ddbd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.667682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4974b2d1-5f9f-48d1-a664-36a62b517ea0 req-e831ff8f-2a39-49d6-a3bd-9986fdb7ddbd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.689746 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:33.692902 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4974b2d1-5f9f-48d1-a664-36a62b517ea0 req-e831ff8f-2a39-49d6-a3bd-9986fdb7ddbd service nova] Creating event network-vif-deleted:93fffe62-8f4c-4259-ace2-d401024cd80b for instance ac5cefe3-3202-46ef-b652-40206d39b7a7 on n-h1-master-1 Oct 02 01:18:33.699758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4974b2d1-5f9f-48d1-a664-36a62b517ea0 req-e831ff8f-2a39-49d6-a3bd-9986fdb7ddbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054172 Oct 02 01:18:33.701048 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2102/4061] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:33.710341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:33.711307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:33.721906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.723178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.724421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.726796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.727471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.728109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.798498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:33.799529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:33.800336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:33.800966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lazy-loading 'fault' on Instance uuid ac5cefe3-3202-46ef-b652-40206d39b7a7 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:34.074640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '039f66a7c47b47e39672b8a49683f6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55ff3938f914b23a0a911b78d9da173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:34.088652 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bba505ca-3d13-4c3d-8566-ceabfaa1a0e8 tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 200 len: 1314 microversion: 2.1 time: 0.386179 Oct 02 01:18:34.101293 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2103/4062] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:33 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:34.119193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:34.119823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:34.149720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:34.150233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:34.150716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:34.151461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:34.152012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:34.152656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:34.584127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:34.592583 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f22ecf5c-08c1-4f88-b3b4-fdb1d52fa5c3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1315 microversion: 2.1 time: 1.217865 Oct 02 01:18:34.596763 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1960/4063] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:33 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1315 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:34.614545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:34.615822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:34.624480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:34.637028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:34.637899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:34.643538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:34.644426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:34.645132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:34.645861 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:34.889755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:34.918779 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7af30d2-940b-45c8-a8ca-1ef227e33380 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1267 microversion: 2.1 time: 0.315370 Oct 02 01:18:34.920063 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1961/4064] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:34 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:35.115538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:35.116147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] [instance: ac5cefe3-3202-46ef-b652-40206d39b7a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:35.126047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:35.129070 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:35.130635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:35.131134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:35.131578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:35.132426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:35.132903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:35.133417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:35.141729 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87eaace5-2d89-49cf-b833-a956e56ea46a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 1.039165 Oct 02 01:18:35.144257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2104/4065] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:34 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] HTTP exception thrown: Instance ac5cefe3-3202-46ef-b652-40206d39b7a7 could not be found. Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Request method failure captured: Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 HTTP/1.1 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOObMQsLs1qs2Q8LdWKqqqqagHQhj1hoKshc72nM3qjkUB_qV9Z83B8jzOOlQk2-ToUjy7zbvbSVnZnQ-1TJYCdnDoxXd8RHKan6eTE2trj4OyYrTa6hVQGqcD-ifSY_aH5cnFZc-9RcAa9vfAhM1ib8s9z4gWAIlo527CHnldKLcnR4 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b55ff3938f914b23a0a911b78d9da173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b55ff3938f914b23a0a911b78d9da173"}]}] Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b55ff3938f914b23a0a911b78d9da173 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-434961388 Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 039f66a7c47b47e39672b8a49683f6ab Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-434961388-project Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: exception: Instance ac5cefe3-3202-46ef-b652-40206d39b7a7 could not be found. Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'ac5cefe3-3202-46ef-b652-40206d39b7a7'} Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5cefe3-3202-46ef-b652-40206d39b7a7 could not be found. Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:35.175218 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5cefe3-3202-46ef-b652-40206d39b7a7 could not be found. Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5cefe3-3202-46ef-b652-40206d39b7a7 could not be found. Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] Returning 404 to user: Instance ac5cefe3-3202-46ef-b652-40206d39b7a7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e6c07da-f43a-4f0a-a812-79800e6b7fba tempest-ServerMetadataNegativeTestJSON-434961388 tempest-ServerMetadataNegativeTestJSON-434961388-project] 10.222.0.23 "GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7" status: 404 len: 111 microversion: 2.1 time: 0.064991 Oct 02 01:18:35.184752 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1962/4066] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:35 2022] GET /compute/v2.1/servers/ac5cefe3-3202-46ef-b652-40206d39b7a7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:35.418425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-466496796", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "bf9315b1-8bd8-4ce6-9db9-66a829623c4c"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:35.534492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] validate_networks() for [('bf9315b1-8bd8-4ce6-9db9-66a829623c4c', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:18:35.623488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:35.624125 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:35.638842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:35.639342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:35.639784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:35.641029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:35.650971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:35.651566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:36.198412 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:36.729202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:36.738808 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-41519398-e607-4a69-8e6b-ed2a54f5ff57 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1315 microversion: 2.1 time: 1.120641 Oct 02 01:18:36.762108 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1963/4067] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:35 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:36.777210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:36.777833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:36.793173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:36.794019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:36.794749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:36.796061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:36.797774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:36.798394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:37.418171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:37.427172 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba9b3963-2902-49da-8f8c-eec34ee4d3fc tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.663498 Oct 02 01:18:37.439002 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1964/4068] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:36 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:37.446494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:37.446494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:37.464906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:37.465701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:37.466186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:37.468347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:37.469085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:37.469846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:38.384849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:38.395032 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec34213e-e665-4fec-be1d-90ddf8584f7d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.954761 Oct 02 01:18:38.407498 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1965/4069] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:37 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:38.412439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:38.432013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:38.445112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:38.445909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:38.450082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:38.451787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:38.454011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:38.457333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:39.241677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:39.242236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:39.244722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:39.245199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:39.245642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:39.283286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:39.283918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:39.284366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:39.286151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:39.288682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:39.290420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:39.324917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Getting quotas for project 13ce5884d5b34274951f43381af6fa31. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:39.340220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Getting quotas for user 98dee3ab3afb4e68a3e720db8e70f045 and project 13ce5884d5b34274951f43381af6fa31. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:39.375559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:18:39.385409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:18:39.504794 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b54431f-590a-4b8d-b25e-7f72d6155ddc tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.359108 Oct 02 01:18:39.515005 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2105/4070] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:18:39.520034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:39.520657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:39.542719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:39.543230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:39.543683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:39.544427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:39.544885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:39.545312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:40.615038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:40.643100 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ccadf3c-a1bf-48bb-b4e7-4451718ad323 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1315 microversion: 2.1 time: 2.230271 Oct 02 01:18:40.644127 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1966/4071] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:38 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1315 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:40.658420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:40.666268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:40.679519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:40.680568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:40.682146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:40.683122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:40.683934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:40.684941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:40.942019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:40.959406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-21bd9961-324a-4d5b-8d14-b672451d4db1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 1.442872 Oct 02 01:18:40.980190 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2106/4072] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:39 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:41.001483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:41.002147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:41.025745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.026169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.026637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:41.043796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.044462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.044936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:41.342567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:41.352240 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09f4945f-0f85-41ba-8f49-d4ccdf28a970 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1211 microversion: 2.1 time: 0.370612 Oct 02 01:18:41.363392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2107/4073] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:40 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1211 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:41.374194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6f92f583-59ef-4503-878b-f08866cf9b9c req-f3523540-8c4b-49ce-8d15-65dd540577ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6155aed-5beb-461d-b2a1-70b888fc0ebe", "name": "network-vif-plugged", "status": "completed", "tag": "c93c87cd-cda8-4c68-8841-28c6821e01f3"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:41.423442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f92f583-59ef-4503-878b-f08866cf9b9c req-f3523540-8c4b-49ce-8d15-65dd540577ba service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.431082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f92f583-59ef-4503-878b-f08866cf9b9c req-f3523540-8c4b-49ce-8d15-65dd540577ba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.431948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f92f583-59ef-4503-878b-f08866cf9b9c req-f3523540-8c4b-49ce-8d15-65dd540577ba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:41.481241 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6f92f583-59ef-4503-878b-f08866cf9b9c req-f3523540-8c4b-49ce-8d15-65dd540577ba service nova] Creating event network-vif-plugged:c93c87cd-cda8-4c68-8841-28c6821e01f3 for instance b6155aed-5beb-461d-b2a1-70b888fc0ebe on n-h2-master-1 Oct 02 01:18:41.500478 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6f92f583-59ef-4503-878b-f08866cf9b9c req-f3523540-8c4b-49ce-8d15-65dd540577ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135498 Oct 02 01:18:41.511315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2108/4074] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:41.775486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:41.785045 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0319127-f9aa-4b49-a995-b878d466f7c1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 1.139652 Oct 02 01:18:41.805600 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1967/4075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:40 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:41.805823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:41.809911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:41.836286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.836921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.838436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:41.839332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.848366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.848947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:41.875984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:41.876922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:41.899603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.900516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.903662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:41.912263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:41.913149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:41.915667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:42.063252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:42.288079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e64a475e-2626-4ffe-84b8-a489950d5f74 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 204 len: 0 microversion: 2.32 time: 0.772699 Oct 02 01:18:42.289769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2109/4076] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:18:41 2022] DELETE /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 0 bytes in 776 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:18:42.298269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:42.299496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:42.307884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:42.308586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:42.309633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:42.310714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:42.311342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:42.311937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:42.833743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:42.841523 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0fd9d144-fec4-45a6-9851-c4fde2e26ac6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1315 microversion: 2.1 time: 1.039692 Oct 02 01:18:42.852161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:42.861117 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1968/4077] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:41 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:42.864464 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be469c71-6e5f-4ea6-98f3-4b5f9893dfa8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.573090 Oct 02 01:18:42.866045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:42.866702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:42.866828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2110/4078] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:42 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:42.871400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:42.879167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:42.889320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:42.889526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:42.890268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:42.890785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:42.891209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:42.891344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:42.892041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:42.892539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:42.893216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:42.893636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:42.893762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:42.894444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.006552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:43.024618 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95bc87ef-96e2-495b-8c62-0b3873610d22 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1273 microversion: 2.1 time: 0.156705 Oct 02 01:18:43.026237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2111/4079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:42 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:43.034650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8a694daf-c353-447f-8691-28786e672861 req-a95b230e-bf07-484a-9cad-7029fe857b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c586c5-c2c3-49c9-a11e-3685e8423b38", "tag": "acdcf40f-adda-404c-8fd3-4065aa09eee7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:43.056903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8a694daf-c353-447f-8691-28786e672861 req-a95b230e-bf07-484a-9cad-7029fe857b56 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.058308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8a694daf-c353-447f-8691-28786e672861 req-a95b230e-bf07-484a-9cad-7029fe857b56 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.059210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8a694daf-c353-447f-8691-28786e672861 req-a95b230e-bf07-484a-9cad-7029fe857b56 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.098549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8a694daf-c353-447f-8691-28786e672861 req-a95b230e-bf07-484a-9cad-7029fe857b56 service nova] Creating event network-changed:acdcf40f-adda-404c-8fd3-4065aa09eee7 for instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 on n-h2-master-1 Oct 02 01:18:43.110388 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8a694daf-c353-447f-8691-28786e672861 req-a95b230e-bf07-484a-9cad-7029fe857b56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080157 Oct 02 01:18:43.111495 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2112/4080] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:43.118877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:43.120631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:43.128964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.129846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.131126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.132997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.133992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.134678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.392092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:43.408757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:43.411516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:43.413671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fab9189b-8e4e-40ed-9534-e6f4451a8b86 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2954 microversion: 2.32 time: 0.551499 Oct 02 01:18:43.415013 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1969/4081] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:42 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2954 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:43.676114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:43.686060 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-117d10e3-3232-44a8-8dca-a8bad478647d tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.572190 Oct 02 01:18:43.695545 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2113/4082] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:43 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:43.873585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:43.874322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:43.893600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:43.893923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:43.907036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.911853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.912372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.912798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.913573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.914044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.914454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.914896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.918169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:43.919002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:43.919992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:43.920435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:44.443665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:44.449174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:44.457159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f4c555e7-bf44-4305-96a2-46a3183d6c95 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1503 microversion: 2.1 time: 0.592341 Oct 02 01:18:44.472559 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1970/4083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:43 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1503 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:44.476079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4046162c-9743-4892-b6a1-1b548d59e23a tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.586207 Oct 02 01:18:44.493177 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2114/4084] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:43 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:44.500095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:44.500870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:44.509196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:44.509821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:44.517117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:44.517632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:44.518065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:44.518862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:44.519329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:44.519752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:44.526155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:44.526688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:44.527133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:44.527846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:44.528296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:44.528718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:44.979866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.023573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.025022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.026305 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ffab287e-6c9d-42a8-8dcb-e059b481e1d4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2954 microversion: 2.32 time: 0.531773 Oct 02 01:18:45.026835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.027548 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2115/4085] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:44 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2954 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:45.052082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:45.052753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:45.059334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.059826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.059976 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1988be4-8f85-410f-9a33-568ce682fff2 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.585815 Oct 02 01:18:45.060510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1971/4086] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:44 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:45.060767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.061431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.061894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.062331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.068676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:45.069758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:45.078056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.078997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.079476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.081221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.081738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.082649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.127282 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:45.169107 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82025c28-dd3a-4cbd-b341-a2d75eeb6c30 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.140876 Oct 02 01:18:45.170946 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2116/4087] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:45 2022] POST /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:45.296189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.311702 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7aa325b-f263-4fda-8932-6442f417e81c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.244296 Oct 02 01:18:45.313177 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1972/4088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:45 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:45.319442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:45.320686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:45.332572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.334389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.335218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.337867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.339480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.340019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.412517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1530284950", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:45.493520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:45.496519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:45.497313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:45.498623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:45.502668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:45.520398 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:45.530315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.531229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.531895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.533029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.533907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.534536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.569433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Getting quotas for project 77d8d4b0db154ba6acce7c0639e44530. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:45.596708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Getting quotas for user 16e7a0f9d35f40dc855b14b9977b6e73 and project 77d8d4b0db154ba6acce7c0639e44530. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:45.598385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.613084 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-818f986c-026f-4635-b65f-34a335e1b424 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1508 microversion: 2.1 time: 0.298230 Oct 02 01:18:45.627374 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1973/4089] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:45 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:45.632962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:18:45.638363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:18:45.638734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:45.639253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:45.651041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.651531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.651962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.652660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:45.653291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:45.654406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:45.748262 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d5c279f-dab4-458c-a727-d053eddc47dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.574947 Oct 02 01:18:45.760888 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2117/4090] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:18:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:18:45.777877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42fac7d1-4584-4fbc-b4cb-23989b03d0c7 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:45.779214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-42fac7d1-4584-4fbc-b4cb-23989b03d0c7 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:45.961158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42fac7d1-4584-4fbc-b4cb-23989b03d0c7 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.971388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42fac7d1-4584-4fbc-b4cb-23989b03d0c7 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.973423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42fac7d1-4584-4fbc-b4cb-23989b03d0c7 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:45.975062 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-42fac7d1-4584-4fbc-b4cb-23989b03d0c7 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1278 microversion: 2.54 time: 0.212533 Oct 02 01:18:45.976212 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2118/4091] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:45 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:46.027386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:46.039177 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50572ba5-a798-4a64-9261-bc45c8005225 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.410297 Oct 02 01:18:46.055007 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1974/4092] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:45 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:46.058273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:46.059372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:46.085075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:46.085572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:46.086066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:46.088851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:46.091276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:46.091654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:46.093506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:46.094140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:46.101722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:46.103395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:46.105600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:46.107883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:46.114353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:46.115045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:46.161236 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:47.219909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:47.230243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:47.232769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:47.234626 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c7eeba7-86b3-4303-8fcf-7653ecd36658 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2954 microversion: 2.32 time: 1.181885 Oct 02 01:18:47.247257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2119/4093] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:46 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2954 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:47.263191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:47.264574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:47.272055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:47.273152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:47.274075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:47.275773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:47.276224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:47.276876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:47.371201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:47.383787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1fdfc6db-6d28-4da7-9036-4c979e7fe9a3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 1.301790 Oct 02 01:18:47.389755 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1975/4094] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:46 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:47.416357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:47.419331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:47.432321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:47.433137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:47.433841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:47.436453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:47.436931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:47.438325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.030730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.043057 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ad701d6-2084-4827-9eb1-6562d8650a81 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1488 microversion: 2.1 time: 0.651088 Oct 02 01:18:48.044513 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1976/4095] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:47 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1488 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:48.063572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:48.064445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:48.071697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.073035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.073642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.077240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.078359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.079022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.089026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.103055 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40d803fe-9a80-4ad1-a21c-d024e31be51c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1504 microversion: 2.1 time: 0.852663 Oct 02 01:18:48.109496 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2120/4096] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:47 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1504 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:48.126883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:48.127784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:48.140454 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.141676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.142347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.143548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.144190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.144814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.292618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.311505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.312817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.314319 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ff5a1a2-c82b-48d7-aab9-cd2fb2ca5119 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1336 microversion: 2.54 time: 0.268386 Oct 02 01:18:48.315001 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1977/4097] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:48 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1336 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:48.321143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ab6d2cf3-1883-4505-b639-cc878e527550 req-3461e63b-e8c6-4631-872e-7bf8af79c223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0a5371-3d22-4d82-a5fc-d976e7d3eacc", "tag": "80d12db2-5e30-4df1-bbf8-e5f66751e844"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:48.349804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ab6d2cf3-1883-4505-b639-cc878e527550 req-3461e63b-e8c6-4631-872e-7bf8af79c223 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.351968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ab6d2cf3-1883-4505-b639-cc878e527550 req-3461e63b-e8c6-4631-872e-7bf8af79c223 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.352716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ab6d2cf3-1883-4505-b639-cc878e527550 req-3461e63b-e8c6-4631-872e-7bf8af79c223 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.385959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ab6d2cf3-1883-4505-b639-cc878e527550 req-3461e63b-e8c6-4631-872e-7bf8af79c223 service nova] Creating event network-changed:80d12db2-5e30-4df1-bbf8-e5f66751e844 for instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc on n-h1-master-1 Oct 02 01:18:48.393436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ab6d2cf3-1883-4505-b639-cc878e527550 req-3461e63b-e8c6-4631-872e-7bf8af79c223 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076876 Oct 02 01:18:48.394185 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1978/4098] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:48.400080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:48.400791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:48.407631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.408472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.409218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.410152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.410894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.411546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.473813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:18:48.518501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.530958 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58020cdd-b74e-4bae-b090-ec7c118406e8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.417314 Oct 02 01:18:48.533513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2121/4099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:48 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:48.550968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:48.554582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:48.580386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.582313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.583836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.585116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.585980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.587439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.681737 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4544dc98-e11b-4b28-be25-1dd5ee9b18ef tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 204 len: 0 microversion: 2.1 time: 0.285008 Oct 02 01:18:48.682479 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1979/4100] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:18:48 2022] DELETE /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:18:48.694247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:48.696187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:48.703286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.704775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.705340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.706218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:48.706903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:48.707749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:48.959621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.970410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.971806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:48.973223 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d061f5b-ae21-4bc0-9abb-9a70f3cf48cf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2912 microversion: 2.32 time: 0.438582 Oct 02 01:18:48.973641 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2122/4101] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:48 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2912 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:48.995713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:48.996616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:49.005876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.006395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.006860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.016624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.017384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.017949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.048509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.062059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3f49553-c95a-407b-a1db-0347e62434b3 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.378348 Oct 02 01:18:49.062893 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1980/4102] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:48 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:49.079427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ad355430-cfd7-44d8-84fb-054e84534efb req-95173f4b-fc3e-43a4-86b8-596ae7b74fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-unplugged", "status": "completed", "tag": "cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:49.089668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ad355430-cfd7-44d8-84fb-054e84534efb req-95173f4b-fc3e-43a4-86b8-596ae7b74fac service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.090427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ad355430-cfd7-44d8-84fb-054e84534efb req-95173f4b-fc3e-43a4-86b8-596ae7b74fac service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.091664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ad355430-cfd7-44d8-84fb-054e84534efb req-95173f4b-fc3e-43a4-86b8-596ae7b74fac service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.108699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ad355430-cfd7-44d8-84fb-054e84534efb req-95173f4b-fc3e-43a4-86b8-596ae7b74fac service nova] Creating event network-vif-unplugged:cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:49.114927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ad355430-cfd7-44d8-84fb-054e84534efb req-95173f4b-fc3e-43a4-86b8-596ae7b74fac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050467 Oct 02 01:18:49.115799 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1981/4103] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:49.141487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:49.142635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:49.151449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.152215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.152790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.154589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.155410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.156441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.439964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.455053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b2b8c9c-8f59-4a59-b67c-42a6b01155f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1494 microversion: 2.1 time: 0.462842 Oct 02 01:18:49.455836 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2123/4104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:48 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1494 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:49.474789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:49.476187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:49.486525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.487214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.489229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.490548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.491750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.492384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.526196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.537857 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c6ccc31-a297-430b-9cef-ea88a0b222de tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1504 microversion: 2.1 time: 0.405089 Oct 02 01:18:49.544452 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1982/4105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:49 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:49.558096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:49.559667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:49.572241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.572651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.573264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.574235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:49.577288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:49.577787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:49.634589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.648942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.650635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.652639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-14f0aa68-2aa3-4ccc-9acb-7997bfd7a454 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1336 microversion: 2.54 time: 0.193400 Oct 02 01:18:49.657529 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2124/4106] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:49 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1336 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:49.894723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:49.906852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-414e3262-af35-4396-bdde-56855bbe33ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.356669 Oct 02 01:18:49.907909 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1983/4107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:49 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:50.010828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:50.011832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:50.024775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.035058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.040653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.048417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.049130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.049718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.087973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:50.089446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:50.102389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.107017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.108332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.110339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.110844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.113902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.814275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:50.824909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:50.827641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:50.829288 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff94b32b-9d15-41bc-9ca6-a0912082ca9a tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2912 microversion: 2.32 time: 0.823104 Oct 02 01:18:50.830479 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2125/4108] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:50 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2912 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:50.838331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:50.854188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:50.855549 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88877c73-d3c9-4fe6-91fe-e5139f4c9b1b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.771755 Oct 02 01:18:50.857978 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1984/4109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:50 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:50.858845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:50.869793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:50.871882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:50.873458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.873959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.874405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.875153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.875621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.876058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.882072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.882915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.883557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:50.884492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:50.885165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:50.886395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.296614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:51.306342 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8803d522-797b-4ad7-bfee-a1a6627c646b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1494 microversion: 2.1 time: 0.474195 Oct 02 01:18:51.320605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:51.324883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2126/4110] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:50 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1494 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:51.329293 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac2c3d05-a21e-4f29-851e-201fa4418afa tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1504 microversion: 2.1 time: 0.469191 Oct 02 01:18:51.329802 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1985/4111] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:50 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:51.331415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:51.332645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:51.342494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.343033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.343696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-669859a6-07a7-48d5-8fbd-1e4ea32aaf59 req-0d1bbba4-b69b-49f7-b7ba-67ca4360f55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-deleted", "tag": "47217643-f743-4e05-9b81-726cd2a59e92"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:51.344098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.346377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.347335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.347993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.369225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-669859a6-07a7-48d5-8fbd-1e4ea32aaf59 req-0d1bbba4-b69b-49f7-b7ba-67ca4360f55d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.369739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-669859a6-07a7-48d5-8fbd-1e4ea32aaf59 req-0d1bbba4-b69b-49f7-b7ba-67ca4360f55d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.370250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-669859a6-07a7-48d5-8fbd-1e4ea32aaf59 req-0d1bbba4-b69b-49f7-b7ba-67ca4360f55d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.398943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-669859a6-07a7-48d5-8fbd-1e4ea32aaf59 req-0d1bbba4-b69b-49f7-b7ba-67ca4360f55d service nova] Creating event network-vif-deleted:47217643-f743-4e05-9b81-726cd2a59e92 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:51.408343 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-669859a6-07a7-48d5-8fbd-1e4ea32aaf59 req-0d1bbba4-b69b-49f7-b7ba-67ca4360f55d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073329 Oct 02 01:18:51.409498 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1986/4112] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:51.416962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:51.418093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:51.428142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.428923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.429549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.430723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.431314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.432224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.491371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:51.508569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:51.510475 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:51.512522 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cee16d0b-9469-4709-8d29-ec213e80740d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1336 microversion: 2.54 time: 0.185879 Oct 02 01:18:51.514085 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2127/4113] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:51 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1336 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:51.519334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-unplugged", "status": "completed", "tag": "47217643-f743-4e05-9b81-726cd2a59e92"}, {"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-unplugged", "status": "completed", "tag": "905b6b15-1615-469e-b334-8a1fb6e075a5"}, {"server_uuid": "05c586c5-c2c3-49c9-a11e-3685e8423b38", "name": "network-vif-plugged", "status": "completed", "tag": "acdcf40f-adda-404c-8fd3-4065aa09eee7"}, {"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-unplugged", "status": "completed", "tag": "b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8"}, {"server_uuid": "a7bf04e1-aaac-453a-8736-7187abe3084e", "name": "network-vif-unplugged", "status": "completed", "tag": "0943776c-7aa0-4058-af11-9cb5231e2457"}, {"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-unplugged", "status": "completed", "tag": "02b6b599-4c10-4fd0-8cd7-c5881f8a4780"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:51.535321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.537586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.538468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.582966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Creating event network-vif-unplugged:47217643-f743-4e05-9b81-726cd2a59e92 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:51.583781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Creating event network-vif-unplugged:905b6b15-1615-469e-b334-8a1fb6e075a5 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:51.588366 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Creating event network-vif-plugged:acdcf40f-adda-404c-8fd3-4065aa09eee7 for instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 on n-h2-master-1 Oct 02 01:18:51.593930 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Creating event network-vif-unplugged:b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:51.595471 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Creating event network-vif-unplugged:0943776c-7aa0-4058-af11-9cb5231e2457 for instance a7bf04e1-aaac-453a-8736-7187abe3084e on n-h2-master-1 Oct 02 01:18:51.596268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] Creating event network-vif-unplugged:02b6b599-4c10-4fd0-8cd7-c5881f8a4780 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:51.623460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-dd2b2797-16be-41dd-a6d1-f14126f39f4f req-659f23d9-f88c-4f24-bc7c-9ce5c4f10dee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.105764 Oct 02 01:18:51.624319 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2128/4114] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:51.701847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:51.711572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-665cd3e3-0103-4341-9da4-a62106dd871d tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.300085 Oct 02 01:18:51.725259 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1987/4115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:51 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:51.870748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:51.873137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:51.880332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:51.880951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:51.888438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.889176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.889822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.890728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.891317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.891461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.891852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.892183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.906249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:51.907069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:51.907551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:51.912673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.382173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:52.390784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6d43f98-5722-4327-8233-4fb0ab81dafe tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.514308 Oct 02 01:18:52.391393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:52.392247 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1988/4116] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:51 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:52.398457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:52.399524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:52.409289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:52.410105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:52.410235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:52.410898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.413128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:52.413676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:52.413996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:52.414382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.416499 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e94a2bd-6ae8-4892-a0eb-f3f511728510 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2866 microversion: 2.32 time: 0.553196 Oct 02 01:18:52.420440 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2129/4117] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:51 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2866 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:52.434264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:52.435659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:52.451027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:52.451778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:52.452382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.453862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:52.454492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:52.455074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.922526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:52.934747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14e68ef7-e3a9-4b2a-82ea-eab123b3c490 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1494 microversion: 2.1 time: 0.541129 Oct 02 01:18:52.936348 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1989/4118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:52 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1494 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:52.941288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:52.942206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:52.949677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:52.950497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:52.951162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.952409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:52.953061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:52.953698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:52.982402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:52.997137 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-caba770a-c68d-486d-bac8-54cc27dbd71b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 200 len: 1507 microversion: 2.1 time: 0.573572 Oct 02 01:18:52.998673 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2130/4119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:52 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 1507 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:53.019365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:53.019989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:53.031945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.033102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.033546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.034258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.034899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.035461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.101232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:53.114959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:53.116993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:53.118677 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ef89928-bb8f-4d42-b589-4562843b2006 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1336 microversion: 2.54 time: 0.181033 Oct 02 01:18:53.119665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1990/4120] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:52 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1336 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:53.126682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:53.127566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:53.138715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.139602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.143058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.143969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.144568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.145681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.487842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:53.508395 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ad9880f-bb4e-4ec3-9c9f-c4fa37d579a0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1309 microversion: 2.1 time: 0.505737 Oct 02 01:18:53.509480 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2131/4121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:52 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:53.515307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-25a56627-cb5e-4cbc-9420-b60b0d619a0a req-67c4908d-c9a3-4ad9-ba59-448b605370b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6155aed-5beb-461d-b2a1-70b888fc0ebe", "name": "network-vif-deleted", "tag": "c93c87cd-cda8-4c68-8841-28c6821e01f3"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:53.534741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-25a56627-cb5e-4cbc-9420-b60b0d619a0a req-67c4908d-c9a3-4ad9-ba59-448b605370b8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.535495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-25a56627-cb5e-4cbc-9420-b60b0d619a0a req-67c4908d-c9a3-4ad9-ba59-448b605370b8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.536078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-25a56627-cb5e-4cbc-9420-b60b0d619a0a req-67c4908d-c9a3-4ad9-ba59-448b605370b8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.572921 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-25a56627-cb5e-4cbc-9420-b60b0d619a0a req-67c4908d-c9a3-4ad9-ba59-448b605370b8 service nova] Creating event network-vif-deleted:c93c87cd-cda8-4c68-8841-28c6821e01f3 for instance b6155aed-5beb-461d-b2a1-70b888fc0ebe on n-h2-master-1 Oct 02 01:18:53.588575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-25a56627-cb5e-4cbc-9420-b60b0d619a0a req-67c4908d-c9a3-4ad9-ba59-448b605370b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077637 Oct 02 01:18:53.589219 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2132/4122] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:53.595829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:53.596547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:53.611513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:53.619559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e894e7e7-cfd2-40aa-8689-1e36876a8339 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.498573 Oct 02 01:18:53.620151 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1991/4123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:53 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:53.625859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.626557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.627153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.628009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.628596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.629863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.635418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:53.639265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:53.648809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.649515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.649950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.652734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:53.655208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:53.655658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:53.707928 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:54.106780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.118431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-01efedbc-2914-4e0d-8661-cebba912d74b tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.527385 Oct 02 01:18:54.119733 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2133/4124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:53 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:54.126563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:54.127496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:54.151400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.157135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.159249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.160857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.163351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.164106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.164751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.172607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.174693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.176477 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e5b4bef-1ab4-4164-9845-6db1b9fd3f91 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2706 microversion: 2.32 time: 0.552464 Oct 02 01:18:54.189410 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1992/4125] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:53 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2706 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:54.205104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-14def16d-6ef1-48de-80fc-48f6cdb0f081 req-af6c9e8b-7212-497a-aa8c-9d9eef6fe694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-deleted", "tag": "b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:54.229674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-14def16d-6ef1-48de-80fc-48f6cdb0f081 req-af6c9e8b-7212-497a-aa8c-9d9eef6fe694 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.230952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-14def16d-6ef1-48de-80fc-48f6cdb0f081 req-af6c9e8b-7212-497a-aa8c-9d9eef6fe694 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.231526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-14def16d-6ef1-48de-80fc-48f6cdb0f081 req-af6c9e8b-7212-497a-aa8c-9d9eef6fe694 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.245400 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-14def16d-6ef1-48de-80fc-48f6cdb0f081 req-af6c9e8b-7212-497a-aa8c-9d9eef6fe694 service nova] Creating event network-vif-deleted:b9faa0d9-1d2c-490a-a6ee-3fc8f61ddae8 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:54.258011 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-14def16d-6ef1-48de-80fc-48f6cdb0f081 req-af6c9e8b-7212-497a-aa8c-9d9eef6fe694 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064533 Oct 02 01:18:54.259046 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1993/4126] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:54.271511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:54.272502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:54.279269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.280081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.280898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.286091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.286920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.287583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.355481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.356606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.357281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.357840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lazy-loading 'fault' on Instance uuid b6155aed-5beb-461d-b2a1-70b888fc0ebe {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:18:54.423929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.434556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0504e51-6e3d-4243-acbe-dd7785353b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 200 len: 1305 microversion: 2.1 time: 0.173965 Oct 02 01:18:54.441978 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1994/4127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:54 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:54.455539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:54.456287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:54.463143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.463836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.464654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.465627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.466097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.466530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.497731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.507812 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7a1a8dc-117d-417d-9926-f5bde59d802a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.385818 Oct 02 01:18:54.526057 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2134/4128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:54 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:54.537796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:54.538507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:54.549463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.549954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.550393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.551144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.551622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.552050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.584497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.594086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.596881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.598241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18d4f55d-a593-48ed-b84b-78434df19889 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1357 microversion: 2.54 time: 0.154220 Oct 02 01:18:54.618381 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1995/4129] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:54 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:54.629278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:54.632808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:54.660608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.662184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.662753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.663566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.664106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.664627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.871558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.874347 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:54.883605 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b5ef6e2-df19-45e4-b26e-0ee627a20a93 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1490 microversion: 2.1 time: 0.350081 Oct 02 01:18:54.905219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:54.905534 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2135/4130] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:54 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1490 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:54.912063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-37104886-59ba-4104-a8ea-dc4154a15425 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Action: 'create', calling method: .version_select at 0x7fb8804db4c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-120800034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDWt1Ug4fzU7M3wUQJcuQfIDWzFc1sp3hQ4o8HKG/Cw7lVwTRIKUXGtbv8+ONwH/Vhqan0TxSRbyjhfqDKSRRgDAaMxKU6zg0jv9Kv1F2J4AwTYxMbeiRVwOM2Dp3O/qA=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:54.914941 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0f16df6b-2b03-4afc-9d26-8b622abdd662 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.294202 Oct 02 01:18:54.928402 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1996/4131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:54 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:54.945777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1854051591"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:54.949869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-37104886-59ba-4104-a8ea-dc4154a15425 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Getting quotas for project 77d8d4b0db154ba6acce7c0639e44530. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:54.951210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:54.957879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-37104886-59ba-4104-a8ea-dc4154a15425 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Getting quotas for user 16e7a0f9d35f40dc855b14b9977b6e73 and project 77d8d4b0db154ba6acce7c0639e44530. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:54.960437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.961145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.961786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:54.963855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:54.965446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:54.966315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.009250 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-37104886-59ba-4104-a8ea-dc4154a15425 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.102089 Oct 02 01:18:55.010237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2136/4132] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:18:54 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:18:55.016382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:55.017038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:55.023950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.026028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.029269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.030199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.030766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.031264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.062052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44a2b909-c0f2-4370-a537-970435d32336 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "PUT /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1075 microversion: 2.1 time: 0.131924 Oct 02 01:18:55.063899 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1997/4133] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:18:54 2022] PUT /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1075 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:55.069593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-120800034", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:55.074827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:55.083357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.084216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.084857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.085980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.088316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.088971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.279292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:55.280795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:55.282131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:55.284183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:55.285094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:55.376292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:55.425532 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6661827c-02c6-41a9-9982-0e1f29184fbd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.413247 Oct 02 01:18:55.428992 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2137/4134] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:55 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:55.451953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:55.453228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:55.462566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.463364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.466075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.467258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.468190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.468768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.479575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:55.496815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.497468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.498094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.499557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.503298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.503894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.562118 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa00ba64-bb5f-463e-8dd5-c5ba19bebd9a tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "POST /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2/action" status: 202 len: 1139 microversion: 2.54 time: 0.495994 Oct 02 01:18:55.563811 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1998/4135] 10.222.0.23 () {62 vars in 1320 bytes} [Sun Oct 2 01:18:55 2022] POST /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2/action => generated 1139 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 02 01:18:55.568001 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:55.571944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:55.575382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:55.594424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.596706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.598172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.600052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:55.602503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:55.603081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:55.998123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.002565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.016268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b206c9a-be9a-4471-bbd1-800c3959e260 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1501 microversion: 2.1 time: 0.585532 Oct 02 01:18:56.019698 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2138/4136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:55 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1501 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:56.036842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:56.036842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:56.038696 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed589f62-5820-4efe-ae36-8b72ba7e9168 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.472007 Oct 02 01:18:56.039465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 1999/4137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:55 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:56.061252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1f44f91-de01-406d-9025-c86d0c6a321a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:56.066802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.068677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1f44f91-de01-406d-9025-c86d0c6a321a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.069343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1f44f91-de01-406d-9025-c86d0c6a321a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.069923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1f44f91-de01-406d-9025-c86d0c6a321a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.086106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.086614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.088901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.089887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.090353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.102684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1f44f91-de01-406d-9025-c86d0c6a321a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Going to try to stop instance {{(pid=122354) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:18:56.172586 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1f44f91-de01-406d-9025-c86d0c6a321a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.131705 Oct 02 01:18:56.173513 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2000/4138] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:56 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:56.181388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:56.182104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:56.195771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.196195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.196644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.197361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.199006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.199680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.231119 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe HTTP/1.1 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: exception: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b6155aed-5beb-461d-b2a1-70b888fc0ebe'} Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:18:56.233650 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:18:56.237691 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:18:56.239960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:18:56.241747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bbf0328b-1ea2-4f99-8910-7142bf750dd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 404 len: 111 microversion: 2.1 time: 0.066862 Oct 02 01:18:56.243182 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2001/4139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:56 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:56.253362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:56.254247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:56.265296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.266195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.267480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.268949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.270845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.271953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.349742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.359930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.361369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.362666 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-94ee8462-899e-4bfa-913d-60ca35601dad tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2502 microversion: 2.32 time: 0.341552 Oct 02 01:18:56.379570 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2139/4140] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:56 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2502 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:56.384590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:56.385213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:56.409238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.409979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.410455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.411230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.412982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.415720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.416497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.419317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.420764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.421961 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afc6b8ff-6cee-4222-8bd1-95e3bcfe34ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.177191 Oct 02 01:18:56.444926 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2002/4141] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:56 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:56.446576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:56.447166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:56.461971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.462471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.462947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.463661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.464664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.465099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.765516 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.773891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b6775b82-ba61-4d4f-b0ce-d6308075262e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1501 microversion: 2.1 time: 0.393138 Oct 02 01:18:56.788895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:56.795707 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2140/4142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:56 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:56.800142 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a75cd3c-4eec-46e2-8b3d-57c1b75ceadf tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.358196 Oct 02 01:18:56.801786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-694722971", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:56.818469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2003/4143] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:56 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:56.826004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-460250c7-3a9d-46f4-b54f-0a1504e27309 req-a97200dc-1ae8-43b3-a657-9e5e982785bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-deleted", "tag": "cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:56.841749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-460250c7-3a9d-46f4-b54f-0a1504e27309 req-a97200dc-1ae8-43b3-a657-9e5e982785bb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.842329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-460250c7-3a9d-46f4-b54f-0a1504e27309 req-a97200dc-1ae8-43b3-a657-9e5e982785bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.842879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-460250c7-3a9d-46f4-b54f-0a1504e27309 req-a97200dc-1ae8-43b3-a657-9e5e982785bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.860177 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-460250c7-3a9d-46f4-b54f-0a1504e27309 req-a97200dc-1ae8-43b3-a657-9e5e982785bb service nova] Creating event network-vif-deleted:cca4c544-4a3a-48fa-87f1-c9bbf0ebd6d4 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:56.864253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:18:56.865853 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-460250c7-3a9d-46f4-b54f-0a1504e27309 req-a97200dc-1ae8-43b3-a657-9e5e982785bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045867 Oct 02 01:18:56.866910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2004/4144] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:56.873993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-71e691ba-86d0-478c-98c0-b8661836309e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:56.883013 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:56.896311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71e691ba-86d0-478c-98c0-b8661836309e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:56.899440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71e691ba-86d0-478c-98c0-b8661836309e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:56.902827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71e691ba-86d0-478c-98c0-b8661836309e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:56.944155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-71e691ba-86d0-478c-98c0-b8661836309e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Going to try to stop instance {{(pid=122354) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:18:57.003153 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:57.024103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-71e691ba-86d0-478c-98c0-b8661836309e tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "POST /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38/action" status: 202 len: 0 microversion: 2.1 time: 0.153959 Oct 02 01:18:57.025100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2005/4145] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:18:56 2022] POST /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:18:57.059674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:57.061228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:57.070962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.072090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.073003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.074240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.074912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.075696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.323026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:57.338401 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03e9207f-ce7d-4218-a450-50907e9c3293 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.291173 Oct 02 01:18:57.339798 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2006/4146] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:57 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:57.344585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:57.345355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:57.352470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.362561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.364338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.365911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.367820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.369603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.540239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:18:57.541345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:18:57.542826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:18:57.543482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:18:57.544076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:18:57.562334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.565440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.570935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.573833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.579086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.579701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.616754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:18:57.623585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:18:57.648369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:18:57.651035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:18:57.687673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:57.700398 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0eb23fbf-dae0-4948-9ac2-684f6516fa39 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.359173 Oct 02 01:18:57.705470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2007/4147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:57 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:57.725387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:57.728285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:57.738488 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a528e1b-146a-48e7-9f42-d9ffabcd1ac1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938906 Oct 02 01:18:57.748736 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2141/4148] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:18:57.749046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.749633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.751041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.752923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.755942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.756463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.758565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:57.763913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:57.779665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.780997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.781632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.782537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:57.783325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:57.783957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:57.899430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:57.921976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:57.927020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:57.928837 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba536b60-90ab-49b4-81c2-679af11b61ba tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.177180 Oct 02 01:18:57.933961 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2142/4149] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:57 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:57.954875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d17b22ad-7809-45c7-8352-70f06abdb5ca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:57.956819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d17b22ad-7809-45c7-8352-70f06abdb5ca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:58.102388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d17b22ad-7809-45c7-8352-70f06abdb5ca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:58.124147 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d17b22ad-7809-45c7-8352-70f06abdb5ca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1214 microversion: 2.1 time: 0.187881 Oct 02 01:18:58.128435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2143/4150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:57 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:58.134429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:58.136529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:58.147762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.148804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.149055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.149879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.150467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.151008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.228555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:58.240665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:58.242975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:58.244384 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20561545-bc44-4c42-bb96-03a7d3b52423 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2343 microversion: 2.32 time: 0.537580 Oct 02 01:18:58.247650 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2008/4151] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:57 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2343 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:58.347910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7dfe7255-929a-4e2f-add1-a53375e011f2 req-17357cdc-9ff5-4b02-b3cd-070615f58981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0a5371-3d22-4d82-a5fc-d976e7d3eacc", "name": "network-vif-plugged", "status": "completed", "tag": "80d12db2-5e30-4df1-bbf8-e5f66751e844"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:58.367641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:58.372893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7dfe7255-929a-4e2f-add1-a53375e011f2 req-17357cdc-9ff5-4b02-b3cd-070615f58981 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.373407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7dfe7255-929a-4e2f-add1-a53375e011f2 req-17357cdc-9ff5-4b02-b3cd-070615f58981 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.374090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7dfe7255-929a-4e2f-add1-a53375e011f2 req-17357cdc-9ff5-4b02-b3cd-070615f58981 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.378698 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12e8fc92-11da-4fd8-a645-485ddfae79ad tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.247893 Oct 02 01:18:58.381598 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2144/4152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:58 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:58.393268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:58.395349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:58.409346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.409849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.412208 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7dfe7255-929a-4e2f-add1-a53375e011f2 req-17357cdc-9ff5-4b02-b3cd-070615f58981 service nova] Creating event network-vif-plugged:80d12db2-5e30-4df1-bbf8-e5f66751e844 for instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc on n-h1-master-1 Oct 02 01:18:58.415389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.416989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.417950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.418411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.437892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7dfe7255-929a-4e2f-add1-a53375e011f2 req-17357cdc-9ff5-4b02-b3cd-070615f58981 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095011 Oct 02 01:18:58.438550 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2009/4153] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:18:58.730665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:58.732088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:58.737364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:58.744433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.745299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.748845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.749612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:58.750470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:58.750942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:58.752379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7b148f49-cdfb-4de2-a28e-ccc95828cd51 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.367490 Oct 02 01:18:58.753373 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2145/4154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:58 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:58.965460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-faaa9a6b-f93e-4fa2-b976-9127d2d3bbb9 req-7260b9a4-250d-46cf-916a-87eb857200bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-deleted", "tag": "02b6b599-4c10-4fd0-8cd7-c5881f8a4780"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:18:58.999719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-faaa9a6b-f93e-4fa2-b976-9127d2d3bbb9 req-7260b9a4-250d-46cf-916a-87eb857200bc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.000995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-faaa9a6b-f93e-4fa2-b976-9127d2d3bbb9 req-7260b9a4-250d-46cf-916a-87eb857200bc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.001539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-faaa9a6b-f93e-4fa2-b976-9127d2d3bbb9 req-7260b9a4-250d-46cf-916a-87eb857200bc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.041123 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-faaa9a6b-f93e-4fa2-b976-9127d2d3bbb9 req-7260b9a4-250d-46cf-916a-87eb857200bc service nova] Creating event network-vif-deleted:02b6b599-4c10-4fd0-8cd7-c5881f8a4780 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:18:59.054646 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-faaa9a6b-f93e-4fa2-b976-9127d2d3bbb9 req-7260b9a4-250d-46cf-916a-87eb857200bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104635 Oct 02 01:18:59.057066 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2146/4155] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:18:59.063419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.071747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76800aa6-7afd-4b8c-943b-1447cfb70819 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.346774 Oct 02 01:18:59.076612 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2010/4156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:58 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:59.079340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:59.080203 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:59.082841 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:59.097502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.098790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.100404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.101256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.102101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.102274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.152223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:59.153081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:59.175699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.179383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.179860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.183712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.184596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.185192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.217901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.228457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.234504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.239984 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6abd971f-0dfd-4b80-8eb6-f0d1c828462f tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.181106 Oct 02 01:18:59.240577 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2147/4157] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:59 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:18:59.273929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:59.275022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:59.283549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.284797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.285428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.287253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.287914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.288492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.339912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.351465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4dd8c96e-52ae-47e6-a7d1-b4da2ac36099 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1266 microversion: 2.1 time: 0.204497 Oct 02 01:18:59.352426 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2011/4158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:59 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:18:59.410868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:59.411488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:59.422644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.423516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.425156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.428240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.428882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.429460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.513484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.525503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.527968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.529526 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a04fb01f-d8cc-4f87-9f37-974fb20ffa98 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 2229 microversion: 2.32 time: 0.261653 Oct 02 01:18:59.542632 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2148/4159] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:18:59 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 2229 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:18:59.592786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:18:59.600605 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93aea8c4-24d3-4509-ad2e-86c1b0554d6e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.193677 Oct 02 01:18:59.613516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2012/4160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:59 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:18:59.776453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:18:59.777123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:18:59.785665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.786158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.786704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:18:59.787564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:18:59.788021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:18:59.788451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:00.122988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:00.124529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:00.141048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:00.142201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:00.143368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:00.145754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:00.146632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:00.151814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:00.920926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:00.929480 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d4635c62-cd6b-4cb9-960a-ccf2a51759f8 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1315 microversion: 2.1 time: 0.817319 Oct 02 01:19:00.930345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2013/4161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:00 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:00.936250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:00.937110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:00.943843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:00.944540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:00.945204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:00.946106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:00.946811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:00.947594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.085051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.105259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-01b2075a-2d14-4ca0-b875-df6ee4b5a6d8 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 1.332906 Oct 02 01:19:01.123908 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2149/4162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:18:59 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:01.140688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:01.141581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:01.161561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.164728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.165651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.169827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.171331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.171991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.192110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.222351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.228411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.230688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42a7e330-4a59-47b1-8341-4e222f4018fb tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.299097 Oct 02 01:19:01.234987 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2014/4163] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:00 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:01.246092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:01.247526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:01.267931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.270212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.276311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.278693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.279332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.281453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.403828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.407192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.423546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.425004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.426240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccba8396-3aad-422d-b327-09bef6d283c7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.189289 Oct 02 01:19:01.430317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbb05788-96eb-4ae4-80c0-e2d6906e7217 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1272 microversion: 2.1 time: 0.305015 Oct 02 01:19:01.442627 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2150/4164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:01 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:01.442932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2015/4165] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:01 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:01.443053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:01.443053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:01.451602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0a01b85e-5e51-485b-af03-13daf3553d13 req-00cf1fe1-11be-47fc-976a-22d9f1ae991e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cd890b-e50e-49ae-af39-ed160238166b", "name": "network-vif-deleted", "tag": "905b6b15-1615-469e-b334-8a1fb6e075a5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:01.456640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.457153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.457592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.458316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.461622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.462117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.472540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a01b85e-5e51-485b-af03-13daf3553d13 req-00cf1fe1-11be-47fc-976a-22d9f1ae991e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.473029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a01b85e-5e51-485b-af03-13daf3553d13 req-00cf1fe1-11be-47fc-976a-22d9f1ae991e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.473453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a01b85e-5e51-485b-af03-13daf3553d13 req-00cf1fe1-11be-47fc-976a-22d9f1ae991e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.502900 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0a01b85e-5e51-485b-af03-13daf3553d13 req-00cf1fe1-11be-47fc-976a-22d9f1ae991e service nova] Creating event network-vif-deleted:905b6b15-1615-469e-b334-8a1fb6e075a5 for instance 74cd890b-e50e-49ae-af39-ed160238166b on n-h1-master-1 Oct 02 01:19:01.516347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0a01b85e-5e51-485b-af03-13daf3553d13 req-00cf1fe1-11be-47fc-976a-22d9f1ae991e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076428 Oct 02 01:19:01.521436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2016/4166] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:01.753747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:01.770648 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-abf0a5c3-d0ba-4b45-a697-c358af993f84 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.337418 Oct 02 01:19:01.771514 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2151/4167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:01 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:01.964455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:01.965166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:01.982140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.984714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.985206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:01.985931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:01.987018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:01.987018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.139281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:02.140018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:02.151689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.154737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.155344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.156235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.160943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.161542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.288841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:02.299047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3c3579a-a516-459f-994c-91e24034434f tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1503 microversion: 2.1 time: 0.340582 Oct 02 01:19:02.299978 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2017/4168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:01 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:02.305004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:02.306247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:02.328015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.328828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.329595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.330770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.331388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.331966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.686881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:02.689057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:02.704258 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cfb48937-4a53-4554-b5f2-4425ef7923c0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.570089 Oct 02 01:19:02.706166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:02.708542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:02.712643 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2152/4169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:02 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:02.715591 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2bb752ad-3bdb-45ac-892f-95ccb6d091b5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.411977 Oct 02 01:19:02.716849 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2018/4170] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:02 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:02.719129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:02.722631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:02.728101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:02.730277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:02.741302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.741822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.742277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.750859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.751709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.753086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.761234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.764652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.772936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.776429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.779208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.781263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.967780 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8d5c2e6c-76b2-4e9d-a3bd-8d06ddcae246 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.251529 Oct 02 01:19:02.970392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2153/4171] 10.222.0.23 () {58 vars in 1296 bytes} [Sun Oct 2 01:19:02 2022] DELETE /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc/os-server-password => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:02.982872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:02.983533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:02.996289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.996806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.997233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:02.998400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:02.999036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:02.999538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.018830 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:03.452280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:03.469982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:03.475382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:03.479581 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5824364b-3d01-4391-957c-18a51ce93aaf tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.502885 Oct 02 01:19:03.482526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2154/4172] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:02 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:03.504964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:03.506987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:03.515646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.516153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.516603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.517381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.517919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.518352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.610574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:03.633258 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3bdbc888-0eac-49e5-ba33-b8e075877737 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1314 microversion: 2.1 time: 0.913359 Oct 02 01:19:03.637374 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2019/4173] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:02 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:03.653548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:03.654546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:03.677146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.677678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.678122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.678853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.679471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.680042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.712123 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-382bcab9-20b7-46a1-aa03-3d6ce53d9f9c tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.068299 Oct 02 01:19:03.714184 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2020/4174] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:19:03 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc/os-server-password => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:19:03.724963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:03.725832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:03.733757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.734815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.735512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.736444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.737265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.737901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.778318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:03.919888 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1347b6d9-97b1-4b2a-95f3-e92f05cd5ae6 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 204 len: 0 microversion: 2.1 time: 0.198777 Oct 02 01:19:03.921276 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2021/4175] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:03 2022] DELETE /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:19:03.928066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:03.928964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:03.937462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.938235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.938817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.939662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:03.940286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:03.940818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:03.985121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:03.985513 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:04.000877 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-593c6787-b1d5-4606-a703-a5a29ba0997f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.514880 Oct 02 01:19:04.006499 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2155/4176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:03 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:04.029894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:04.034533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:04.060561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.061307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.066564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.068016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.070003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.070627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.226960 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.239002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.241198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.242892 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b31a3906-7fbe-43f7-8931-4a661ef0d1c3 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.234952 Oct 02 01:19:04.245033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2156/4177] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:04 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:04.251381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:04.252282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:04.259659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.260868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.261506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.262517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.263211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.263849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.448690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.458870 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea528270-32fc-4d4e-b8ff-0b05e2d56d70 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.535943 Oct 02 01:19:04.466092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2022/4178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:03 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:04.512018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.520047 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4e3ed2f-d187-4d9d-87f9-1be65933b0c4 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1509 microversion: 2.1 time: 0.273555 Oct 02 01:19:04.520568 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2157/4179] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:04 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:04.542729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:04.543631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:04.552190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.552713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.553160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.553879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.554337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.559284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.686127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe05b9d8-6c92-4c77-a381-58a736bfdd16 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Action: 'create', calling method: .version_select at 0x7fb8808abb80>, body: {"keypair": {"name": "tempest-keypair-2104444025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBwYjPr2r7YOJQPukBODGwe1L+LP+Z5tQRQBDw9ooLVmQF+bqDM4xzeAayTO2iIaq3MJMTQqIBpcpiKtWV/3Nggs1YxfI+Li50qSxyFT2Y5ZneNSvdgKndYInGNeTD8Jg=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:04.698707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.709340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.719666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:04.721017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1237d8ea-9f84-436c-a860-047caeef326c tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.199465 Oct 02 01:19:04.727876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2158/4180] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:04 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:04.740343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-fe05b9d8-6c92-4c77-a381-58a736bfdd16 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Getting quotas for project 030545ae9fe8466887a79a55199dbe1e. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:19:04.745851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:04.756113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:04.760993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-fe05b9d8-6c92-4c77-a381-58a736bfdd16 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Getting quotas for user c503b01d3a53481c9ded936a0a3f6c9f and project 030545ae9fe8466887a79a55199dbe1e. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:19:04.778747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.779227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.779682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.780392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:04.780816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:04.781244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:04.824175 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe05b9d8-6c92-4c77-a381-58a736bfdd16 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.355318 Oct 02 01:19:04.826003 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2023/4181] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:19:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:05.034036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:05.035849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:05.052814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.053551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.054075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.054939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.055509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.056072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.557948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:05.575614 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41014ab8-9aac-4e0d-91a7-7d7f7cffffc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1314 microversion: 2.1 time: 0.838404 Oct 02 01:19:05.576426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2159/4182] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:04 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:05.592214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d3d9f14a-2cf2-47ad-87dc-dbb59bba2696 req-8982a05e-53ec-48cf-abd5-89ce08b9c7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f3d770d-5fec-4f82-a338-dccca2220efd", "tag": "ce30d689-65d4-47bf-97e7-da530c835660"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:05.610432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d3d9f14a-2cf2-47ad-87dc-dbb59bba2696 req-8982a05e-53ec-48cf-abd5-89ce08b9c7b9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.610966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d3d9f14a-2cf2-47ad-87dc-dbb59bba2696 req-8982a05e-53ec-48cf-abd5-89ce08b9c7b9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.611413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d3d9f14a-2cf2-47ad-87dc-dbb59bba2696 req-8982a05e-53ec-48cf-abd5-89ce08b9c7b9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.648556 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d3d9f14a-2cf2-47ad-87dc-dbb59bba2696 req-8982a05e-53ec-48cf-abd5-89ce08b9c7b9 service nova] Creating event network-changed:ce30d689-65d4-47bf-97e7-da530c835660 for instance 9f3d770d-5fec-4f82-a338-dccca2220efd on n-h2-master-1 Oct 02 01:19:05.660707 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d3d9f14a-2cf2-47ad-87dc-dbb59bba2696 req-8982a05e-53ec-48cf-abd5-89ce08b9c7b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082738 Oct 02 01:19:05.663502 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2160/4183] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:05.670322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:05.677136 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:05.695079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.695523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.695967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.697657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.702247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.702912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.805790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:05.825743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f3fa0a3-125e-45fe-8fcc-cf743b7064d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1677 microversion: 2.1 time: 0.799670 Oct 02 01:19:05.830753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2024/4184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:05 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1677 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:05.840434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:05.842082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:05.851751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.853943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.868079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.871039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.874867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.876253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.921853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:05.932392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:05.935184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:05.940015 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c8aee32-9e66-48a8-8086-42c8dfda4ce2 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.273681 Oct 02 01:19:05.941787 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2161/4185] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:05 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:05.973100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:05.974230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:05.991197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.991699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.992149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:05.992930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:05.993985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:05.994423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:06.316429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:06.328455 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4fd0691-b6ad-4fcb-9938-bd5f3998af42 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1509 microversion: 2.1 time: 0.384684 Oct 02 01:19:06.329081 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2162/4186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:05 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:06.349953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:06.350577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:06.361152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:06.361661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:06.362099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:06.362839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:06.363301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:06.363731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:06.414472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:06.425689 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b4f4486-4593-4a9f-ac3b-e64321fa3743 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.592830 Oct 02 01:19:06.427332 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2025/4187] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:05 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:06.471169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:06.487740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:06.489447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:06.492335 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ad2e721-be09-4533-a6cc-b2146291e5bc tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.145089 Oct 02 01:19:06.507220 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2163/4188] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:06 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:06.600350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:06.601345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:06.616745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:06.617738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:06.619814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:06.621689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:06.622377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:06.623101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:06.857645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:06.859153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:06.875344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:06.876079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:06.876679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:06.877570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:06.878582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:06.879926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.471187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:07.488497 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18595a34-16be-4b48-9aff-749eb7ec446e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1314 microversion: 2.1 time: 0.893069 Oct 02 01:19:07.492963 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2026/4189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:06 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:07.504568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:07.505851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:07.513861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:07.516468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:07.517462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.518556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:07.519310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:07.520436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.589573 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:07.635162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:07.643203 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9353a586-e235-45b9-9009-6c852d8f4bf7 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1654 microversion: 2.1 time: 0.797715 Oct 02 01:19:07.643796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2164/4190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:06 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1654 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:07.648223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-cba8ef1c-b12a-46c6-9b30-c1a6f7a41e3b req-39bb2877-99f6-4c26-85ba-34161221d302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0a5371-3d22-4d82-a5fc-d976e7d3eacc", "name": "network-vif-deleted", "tag": "80d12db2-5e30-4df1-bbf8-e5f66751e844"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:07.657111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:07.668187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:07.671583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:07.673190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e773e2b8-b713-4b5b-a2ca-5a6cc7fd43bc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.177592 Oct 02 01:19:07.674390 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2027/4191] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:07 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:07.688379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cba8ef1c-b12a-46c6-9b30-c1a6f7a41e3b req-39bb2877-99f6-4c26-85ba-34161221d302 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:07.689358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cba8ef1c-b12a-46c6-9b30-c1a6f7a41e3b req-39bb2877-99f6-4c26-85ba-34161221d302 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:07.691336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-cba8ef1c-b12a-46c6-9b30-c1a6f7a41e3b req-39bb2877-99f6-4c26-85ba-34161221d302 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.693018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:07.693727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:07.704886 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-cba8ef1c-b12a-46c6-9b30-c1a6f7a41e3b req-39bb2877-99f6-4c26-85ba-34161221d302 service nova] Creating event network-vif-deleted:80d12db2-5e30-4df1-bbf8-e5f66751e844 for instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc on n-h1-master-1 Oct 02 01:19:07.706791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:07.707468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:07.707977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.708766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:07.709327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:07.709963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.711752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-cba8ef1c-b12a-46c6-9b30-c1a6f7a41e3b req-39bb2877-99f6-4c26-85ba-34161221d302 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066776 Oct 02 01:19:07.713459 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2165/4192] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:07.720495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-350819576", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "05fad672-9c5b-4e84-a4bf-0545ef8ea850"}], "security_groups": [{"name": "tempest-securitygroup--752811597"}], "key_name": "tempest-keypair-2104444025", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:07.754095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:07.754927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:07.755510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:07.756142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lazy-loading 'fault' on Instance uuid ab0a5371-3d22-4d82-a5fc-d976e7d3eacc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:08.121609 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=26 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:08.156504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dee3ab3afb4e68a3e720db8e70f045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce5884d5b34274951f43381af6fa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:08.165387 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ee7c4a2-9485-4045-bf5a-b54a43426e33 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 200 len: 1305 microversion: 2.1 time: 0.489414 Oct 02 01:19:08.166808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2028/4193] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:07 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 1305 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:08.171913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:08.172848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:08.182631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.183188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.183553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:08.184357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.184809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.185242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:08.292220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] validate_networks() for [('05fad672-9c5b-4e84-a4bf-0545ef8ea850', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:19:08.636784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:08.646216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4fee086d-f9f0-44d1-a91e-6c5ee2d59b69 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.478136 Oct 02 01:19:08.647203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2029/4194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:08 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:08.652946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:08.653817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:08.661703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.662670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.663280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:08.664064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.664532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.665157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:08.815147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:08.827210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:08.828995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:08.830724 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2dd3cae-fc30-47ae-b604-732c95b269f2 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.182219 Oct 02 01:19:08.831531 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2030/4195] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:08 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:08.836443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a7afca2-2427-4510-b858-ea51593be696 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:08.844042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7afca2-2427-4510-b858-ea51593be696 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.844834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7afca2-2427-4510-b858-ea51593be696 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.845593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7afca2-2427-4510-b858-ea51593be696 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:08.872204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a7afca2-2427-4510-b858-ea51593be696 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Going to try to start instance {{(pid=122354) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 01:19:08.927058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a7afca2-2427-4510-b858-ea51593be696 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.094048 Oct 02 01:19:08.928452 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2031/4196] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:19:08 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:19:08.934450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:08.935444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:08.942197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.942933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.943524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:08.944379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:08.945092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:08.945669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.464732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:09.483820 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ecb3de3d-8cf0-4b40-b91e-a3015f74c70f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1314 microversion: 2.1 time: 0.553932 Oct 02 01:19:09.485014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2032/4197] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:08 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:09.491882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:09.493591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:09.502279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:09.503735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:09.505342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.506366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:09.507188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:09.507819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.659173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:09.670303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:09.672035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:09.673120 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-907cf408-f799-492f-96a3-bc373384ac4c tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.186774 Oct 02 01:19:09.673852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2033/4198] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:09 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:09.678405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:09.679301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:09.685987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:09.686488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:09.687077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.688056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:09.689464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:09.690111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.863902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Getting quotas for project 030545ae9fe8466887a79a55199dbe1e. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:19:09.871742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Getting quotas for user c503b01d3a53481c9ded936a0a3f6c9f and project 030545ae9fe8466887a79a55199dbe1e. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:19:09.889291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:19:09.889985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:19:09.890668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:19:09.892039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:19:09.892863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:19:09.904297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:09.905212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:09.905798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.906902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:09.907579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:09.908228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:09.938768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Getting quotas for project 030545ae9fe8466887a79a55199dbe1e. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:19:09.944873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Getting quotas for user c503b01d3a53481c9ded936a0a3f6c9f and project 030545ae9fe8466887a79a55199dbe1e. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:19:09.961895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:19:09.964638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:19:10.056497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:10.062787 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c55d8961-7d36-477b-ae05-3ae09f910c1f tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.347836 Oct 02 01:19:10.063681 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2166/4199] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:19:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:19:10.068573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:10.069110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] [instance: ab0a5371-3d22-4d82-a5fc-d976e7d3eacc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:10.075088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cab60e87-f49e-4f84-8515-ea65dfc8b126 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1663 microversion: 2.1 time: 0.399817 Oct 02 01:19:10.088050 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2034/4200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:09 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1663 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:10.095857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.096369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.097074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.097547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.097977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.098423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.101671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:10.102842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:10.115095 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] HTTP exception thrown: Instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc could not be found. Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Request method failure captured: Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc HTTP/1.1 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOObqDFoTxcnTKKwxNi-DZz58u_uKZXf5rudPKctnk7D0ZdWjSd4AxdpPKnLg-6iq5OEG8qtXi0eZMbpMedblxai-p20LuxebwVhId3StUxrL_ukCB_VD_pcWKU1lshkuM-bwMEZFYhEk35KRbt5uQKKRG9-0VZyBMgdSVZ9Ky9FhrT0 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 13ce5884d5b34274951f43381af6fa31 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerPasswordTestJSON-1369300273 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/13ce5884d5b34274951f43381af6fa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/13ce5884d5b34274951f43381af6fa31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/13ce5884d5b34274951f43381af6fa31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_13ce5884d5b34274951f43381af6fa31"}]}] Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerPasswordTestJSON-1369300273 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 13ce5884d5b34274951f43381af6fa31 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1369300273 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerPasswordTestJSON-1369300273-project Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 98dee3ab3afb4e68a3e720db8e70f045 Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerPasswordTestJSON-1369300273-project Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: exception: Instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc could not be found. Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'ab0a5371-3d22-4d82-a5fc-d976e7d3eacc'} Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc could not be found. Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc could not be found. Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:10.116783 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc could not be found. Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] Returning 404 to user: Instance ab0a5371-3d22-4d82-a5fc-d976e7d3eacc could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ebdce39-8d3a-4805-8133-b36f9659d264 tempest-ServerPasswordTestJSON-1369300273 tempest-ServerPasswordTestJSON-1369300273-project] 10.222.0.23 "GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc" status: 404 len: 111 microversion: 2.1 time: 0.053661 Oct 02 01:19:10.121199 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2167/4201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:10 2022] GET /compute/v2.1/servers/ab0a5371-3d22-4d82-a5fc-d976e7d3eacc => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:10.124394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.124394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.124394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.124394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.124394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.125202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.125359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:10.125504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:10.131609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.134027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.134027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.134027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.135534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.135988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.671328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:10.688817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:10.699496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:10.705070 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b1f16e1-e429-4d69-a8f9-83444446863e tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.583976 Oct 02 01:19:10.721345 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2168/4202] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:10 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:10.745571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99c7935d-8520-4387-9bd7-02ccdae7b386 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:10.746541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99c7935d-8520-4387-9bd7-02ccdae7b386 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:10.799938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:10.810257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e486777f-b880-4bf6-ad50-42e06d61e8fa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.720927 Oct 02 01:19:10.824516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2035/4203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:10 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:10.837779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:10.839204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:10.849597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.850395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.851112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.853270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.854962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.856878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.905289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99c7935d-8520-4387-9bd7-02ccdae7b386 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:10.918262 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99c7935d-8520-4387-9bd7-02ccdae7b386 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1277 microversion: 2.1 time: 0.194080 Oct 02 01:19:10.920616 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2169/4204] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:10 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:10.927128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:10.927945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:10.974213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.975073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.978358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:10.983152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:10.984978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:10.986907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.208632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.223388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.227079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.232502 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e6c58b85-8882-4fbe-bf5d-7a9fdbce9148 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.309409 Oct 02 01:19:11.236589 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2170/4205] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:10 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:11.241593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:11.250612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:11.268977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.269835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.270470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.271465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.272215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.273431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.391381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.401612 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebef50e2-a697-454a-99fc-4bc7572d252d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1314 microversion: 2.1 time: 0.575663 Oct 02 01:19:11.419260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2036/4206] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:10 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:11.686192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.724140 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31a7db91-c003-4ed7-a8a9-22176b70b95a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1663 microversion: 2.1 time: 0.470059 Oct 02 01:19:11.725930 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2171/4207] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:11 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1663 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:11.742584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:11.745385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:11.753919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.754627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.757207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.758651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.763350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.764012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.844832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:11.846146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:11.854174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.855302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.856286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.857981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.858714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.859560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.868077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.883813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.885945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:11.888268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d0c2c7f-f143-477b-87e0-9b748d1584c4 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.153329 Oct 02 01:19:11.904506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2037/4208] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:11 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:11.920907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e2616970-41d6-4bd8-b069-305c71349823 req-8b63500b-5927-4eeb-b594-b5ad1a2935d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3d770d-5fec-4f82-a338-dccca2220efd", "name": "network-vif-plugged", "status": "completed", "tag": "ce30d689-65d4-47bf-97e7-da530c835660"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:11.948241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e2616970-41d6-4bd8-b069-305c71349823 req-8b63500b-5927-4eeb-b594-b5ad1a2935d2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:11.949431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e2616970-41d6-4bd8-b069-305c71349823 req-8b63500b-5927-4eeb-b594-b5ad1a2935d2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:11.950112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e2616970-41d6-4bd8-b069-305c71349823 req-8b63500b-5927-4eeb-b594-b5ad1a2935d2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:11.996629 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e2616970-41d6-4bd8-b069-305c71349823 req-8b63500b-5927-4eeb-b594-b5ad1a2935d2 service nova] Creating event network-vif-plugged:ce30d689-65d4-47bf-97e7-da530c835660 for instance 9f3d770d-5fec-4f82-a338-dccca2220efd on n-h2-master-1 Oct 02 01:19:12.012054 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e2616970-41d6-4bd8-b069-305c71349823 req-8b63500b-5927-4eeb-b594-b5ad1a2935d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105881 Oct 02 01:19:12.015707 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2038/4209] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:12.028951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:12.029903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:12.043154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.046246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.048194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.051754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.052449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.057459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.114277 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:12.184069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.193912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2580783b-8a32-45eb-9171-9635b2e3dcb0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.357847 Oct 02 01:19:12.215799 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2172/4210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:11 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:12.266652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:12.267644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:12.279867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.280744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.281393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.282322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.283018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.284951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.287311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.300404 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-69a09651-9238-470a-95a8-78365a905305 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1329 microversion: 2.1 time: 0.280856 Oct 02 01:19:12.301031 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2039/4211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:12 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1329 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:12.419109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.429628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.431718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:12.432110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.432360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:12.433730 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-39291349-277c-4109-a877-18714b1e4e06 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.172197 Oct 02 01:19:12.444401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.444896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.447373 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2173/4212] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:12 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:19:12.447649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.454174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.454879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.455514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.686174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.695777 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-019505c4-2b44-4938-98d8-42ad393dd830 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1314 microversion: 2.1 time: 0.268803 Oct 02 01:19:12.697119 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2040/4213] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:12 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:12.753400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:12.754393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:12.761810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.762634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.763540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.764459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.765225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.765861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.922375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:12.923579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:12.934388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.936328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.938801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.939779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:12.942234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:12.942936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:12.980741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:12.983041 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:12.990425 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99df6b27-e996-413d-8710-cd102a794a7b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.240770 Oct 02 01:19:13.007705 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2174/4214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:12 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:13.018114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.019139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.028050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.028874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.029549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.030495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.031969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.032627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.069235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.085139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.088942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.101318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab552f33-6067-4ce0-ab72-e816bfa48927 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.183242 Oct 02 01:19:13.103294 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2041/4215] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:12 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:19:13.223650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.232882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.233513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.234931 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-acaaba0d-58ad-498e-9592-0713d57c25e6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.221314 Oct 02 01:19:13.236311 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2175/4216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:13.244988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.245728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.246428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.251168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.251839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.252423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.263279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.265453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.276994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.278144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.278794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.279772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.280500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.281178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.529002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.540432 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8b112a38-bc4f-4913-b99c-5e923246c278 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.281471 Oct 02 01:19:13.543565 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2176/4217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:13.557735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.560737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.583784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.589196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.590219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.593616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.595523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.596296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.604360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.616063 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0794f163-6a81-44c2-b851-c6327782a1a6 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.387714 Oct 02 01:19:13.632602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2042/4218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:13.641710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.642885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.651941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.652677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.654728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.655619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.656238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.656811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.755834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.770589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.772254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.774387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:13.775522 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b1cf233-cf50-46a7-932f-1d6f5537a2fe tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.139222 Oct 02 01:19:13.776604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2043/4219] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:13.784408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.785592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.793808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.794448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.795816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.798209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.798873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.799470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.822109 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d826a733-be53-407d-86fe-83d8358f52bb tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1335 microversion: 2.1 time: 0.274647 Oct 02 01:19:13.830075 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2177/4220] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1335 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:13.841191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:13.841978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:13.860522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.861016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.861464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:13.862178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:13.865697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:13.866329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.048900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.057881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f1d98ea-e449-4c55-b553-4f2c20196114 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.279393 Oct 02 01:19:14.065637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2044/4221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:14.081074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:14.081692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.088485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.089183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.089766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.090661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.091261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.091829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.150234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.159087 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83859909-8c9f-4e09-8ceb-102750df519a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1502 microversion: 2.1 time: 0.324519 Oct 02 01:19:14.159687 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2178/4222] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:13 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:14.175602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:14.176307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.189738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.190457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.191115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.192162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.192771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.193342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.290647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.300241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.301954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.303398 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-df52a8d5-ddd9-442e-bb2b-3f33cd2261dd tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.142777 Oct 02 01:19:14.305515 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2179/4223] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:14 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:14.307341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.311454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:14.312151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.318849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.322883 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6aea1b5-b5fb-4cff-bb61-a7217e05676c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.245434 Oct 02 01:19:14.323717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2045/4224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:14 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:14.331028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.331785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.332669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.333405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.333944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.350092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:14.352008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.358700 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:14.360785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.361442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.362037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.362942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lazy-loading 'flavor' on Instance uuid 9f3d770d-5fec-4f82-a338-dccca2220efd {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:14.363147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.363770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.364520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.420956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lazy-loading 'flavor' on Instance uuid dd51543d-0b1d-4fad-b37e-d19599b55292 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:14.574500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b72d457-e7c3-46f0-9565-737b9f6697cd tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.227383 Oct 02 01:19:14.576679 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2046/4225] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:19:14 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:19:14.593838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:14.596164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.622282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.623096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.623715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.625103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.625715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.626559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.673292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2666bb75-5971-43b2-9fc2-f86b28e9f87b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd/action" status: 202 len: 0 microversion: 2.1 time: 0.366168 Oct 02 01:19:14.675366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2180/4226] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:19:14 2022] POST /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:19:14.709822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:14.711619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.727829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.729081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.729595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.730341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.730851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.731401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.790259 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:14.891910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:14.901142 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02d2b2b4-4ee7-411f-8d12-b05ba9b8e4d3 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1675 microversion: 2.1 time: 0.319208 Oct 02 01:19:14.909648 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2047/4227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:14 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1675 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:14.915777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:14.918303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:14.932864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.933300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.933752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:14.937819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:14.940532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:14.941888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.032915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.042193 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56da3d6c-ddc9-449e-a8d8-2cb3cd9ce481 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.363725 Oct 02 01:19:15.044513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2181/4228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:14 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:15.050445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:15.050694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:15.059795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.060289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.060733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.061438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.061895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.062680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.180250 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.199818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.220295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.222712 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24a1cc75-f8d1-40f9-802c-696250042298 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.177180 Oct 02 01:19:15.230535 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2182/4229] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:15 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:15.237443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:15.238404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:15.248780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.249439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.252031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.253222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.253222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.253501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.261484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.270874 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-085f19fd-3391-47ab-b6e0-68fd7307a6b4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.359753 Oct 02 01:19:15.271816 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2048/4230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:14 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:15.335333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:15.338736 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:15.354406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.355090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.355581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.357293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.358011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.358452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.487388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.505467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.509474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.509474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24515cda-b9dc-43ef-b593-72519bb87c76 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.179635 Oct 02 01:19:15.513731 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2049/4231] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:15 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:15.536727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:15.547625 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e3e6eb9-c3b1-490b-b299-dcdef4910b31 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.315555 Oct 02 01:19:15.548668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2183/4232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:15 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:15.938241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:15.938960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:15.952794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.953301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.954973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:15.956632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:15.957932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:15.958799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.070205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:16.071599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:16.087332 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:16.093122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.094802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.095437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.097391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.097391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.099513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.467718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:16.477986 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c794db75-99fb-4376-8afa-b767eab9d4d1 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1658 microversion: 2.1 time: 0.545331 Oct 02 01:19:16.483336 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2050/4233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:15 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1658 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:16.488322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:16.495118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:16.505578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:16.509932 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f78f77e7-50d0-41b9-a342-0e9ec1888d79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.438987 Oct 02 01:19:16.527362 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2184/4234] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:16 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:16.535888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.539955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.540596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.541473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.542105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.542957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:16.543862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.546413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:16.559953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.560714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.561299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.563725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.564340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.566534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.794738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:16.805408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:16.810394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:16.811762 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ece63d99-b536-4065-b803-c1eb10bdf969 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.327158 Oct 02 01:19:16.814242 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2051/4235] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:16 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:16.844266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:16.845008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:16.864901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.865254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.867264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.868268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:16.868759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:16.869205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:16.950922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:16.977101 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9714908-1793-47bd-bf65-a7533662a988 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.445514 Oct 02 01:19:16.980942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2185/4236] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:16 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:16.987460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-379a9a73-3722-4dfb-8495-d09a967cc098 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action" status: 202 len: 0 microversion: 2.1 time: 0.159313 Oct 02 01:19:16.988999 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2052/4237] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:19:16 2022] POST /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:19:16.998440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:17.002835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:17.003723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:17.010635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:17.018384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.018974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.019422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.020148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.022954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.024104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.024545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.024681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.025051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.025781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.026247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.026720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.095059 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:17.262407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:17.277423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:17.280074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:17.282447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c567d77-0c8d-40a3-a901-6732a80f8b1b tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.299114 Oct 02 01:19:17.283677 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2186/4238] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:16 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:17.292775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:17.293395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:17.314184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.314703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.315154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.316039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.316299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.316727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.368057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:17.378499 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38f46b3f-e1d0-4b85-80cb-981b41ac1ad6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.388122 Oct 02 01:19:17.398195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2053/4239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:16 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:17.543116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:17.544422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:17.558406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.559284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.560322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.561478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.562288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.564784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:17.901536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:17.930368 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4d0a7298-f73f-4ba5-9fda-c9ccdbb6eb40 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1664 microversion: 2.1 time: 0.631468 Oct 02 01:19:17.932285 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2187/4240] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:17 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1664 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:17.938039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b66275f1-3791-4c3a-b0f6-77642a05be4d req-006c3d0c-004a-4c72-9fa5-abb9e3d9cef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55f567a-3701-414a-a4ba-95fa023bb856", "tag": "3d974c97-e964-45ca-a3f6-da6e3ac0ac9c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:17.960528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b66275f1-3791-4c3a-b0f6-77642a05be4d req-006c3d0c-004a-4c72-9fa5-abb9e3d9cef6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:17.961888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b66275f1-3791-4c3a-b0f6-77642a05be4d req-006c3d0c-004a-4c72-9fa5-abb9e3d9cef6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:17.964985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b66275f1-3791-4c3a-b0f6-77642a05be4d req-006c3d0c-004a-4c72-9fa5-abb9e3d9cef6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.010406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b66275f1-3791-4c3a-b0f6-77642a05be4d req-006c3d0c-004a-4c72-9fa5-abb9e3d9cef6 service nova] Creating event network-changed:3d974c97-e964-45ca-a3f6-da6e3ac0ac9c for instance f55f567a-3701-414a-a4ba-95fa023bb856 on n-h1-master-1 Oct 02 01:19:18.025152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b66275f1-3791-4c3a-b0f6-77642a05be4d req-006c3d0c-004a-4c72-9fa5-abb9e3d9cef6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090777 Oct 02 01:19:18.030456 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2188/4241] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:18.041531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:18.047135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:18.061268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.061781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.066904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.067670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.068302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.069022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.097219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.107015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-376ef9ec-80a3-4cf7-a612-3dadb9e35920 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.569288 Oct 02 01:19:18.110382 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2054/4242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:17 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:18.118564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:18.120155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:18.142239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.143108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.143773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.145464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.146142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.146823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.264859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.276894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.278357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.291108 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd3e33d8-977d-4878-9149-b24c685bbb9b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.247759 Oct 02 01:19:18.306702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2189/4243] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:18 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:18.314059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:18.314059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:18.321187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.321659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.323962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.324951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.334936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.336371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.340931 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:18.540369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.554586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.560732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.562274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-00226c20-6d9c-47b3-aa26-b9396e9f8a30 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.255261 Oct 02 01:19:18.566726 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2190/4244] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:18 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:19:18.576900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:18.583518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:18.594289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.595063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.595674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.596582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.600034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.601390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.629662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:18.650114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bc5a3bc-a46e-4ab8-a80d-0f7baf1c5c70 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.536078 Oct 02 01:19:18.650845 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2055/4245] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:18 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:18.958109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:18.958753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:18.965925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.975309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.976446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:18.977339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:18.977946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:18.987407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.047283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.059417 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-937ab3af-04fd-48c5-94ea-833f93c1ca8e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.490966 Oct 02 01:19:19.068366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2191/4246] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:18 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:19.140690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:19.141524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:19.159490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.160006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.160455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.162833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.164436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.164436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.719085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.720756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.733182 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-19ca4d1d-982f-47af-8fec-03d0de558416 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1664 microversion: 2.1 time: 0.779198 Oct 02 01:19:19.735097 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2056/4247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:18 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1664 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:19.737984 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0cdaf894-d671-43e8-9460-3b847f18fbca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.602727 Oct 02 01:19:19.738574 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2192/4248] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:19 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:19.748318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:19.752331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:19.759448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.760179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.760762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.761613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.762215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.762818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.766223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:19.767032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:19.789538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.790313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.791016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.792508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.793211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.794777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.907535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.921062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.927569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.931091 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80d4992e-e16e-4740-9d63-09be48d6d089 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.186374 Oct 02 01:19:19.936678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.939562 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2193/4249] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:19 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:19.953351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:19.955424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:19.959704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.965209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:19.966264 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:19.969687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.970499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.971095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:19.972155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:19.972809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:19.974303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-32f8f920-3967-48cd-831c-3dd54339b135 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.234759 Oct 02 01:19:19.976161 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2057/4250] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:19 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:19.977243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.101750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:20.102611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:20.110131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:20.110903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:20.111457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.112537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:20.117779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:20.118470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.341304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:20.349216 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2d8b856-f670-4626-a3dc-8c8f6c3cba31 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.408263 Oct 02 01:19:20.351034 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2194/4251] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:19 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:20.420752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:20.428720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20b3a96c-4243-431a-8080-0c46141a2bb1 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.337144 Oct 02 01:19:20.429514 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2058/4252] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:20 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:20.765023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:20.765652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:20.768576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:20.769199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:20.776767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:20.777606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:20.778338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.779412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:20.780070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:20.780739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.781418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:20.782140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:20.782622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.783335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:20.783875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:20.784276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:20.915130 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:21.041739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.051452 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3725980-9547-4a39-8e63-9229b9e5eb63 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.290168 Oct 02 01:19:21.066625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.066967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b3267cf-768c-4d79-a6c8-3f13c0686a62 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.308394 Oct 02 01:19:21.067346 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2059/4253] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:20 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:21.072877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:21.073882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:21.080525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.081103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.081613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.082319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.082860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.083291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.088734 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2195/4254] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:20 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:21.094082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:21.096532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:21.105374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.105881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.106510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.107405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.107939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.108386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.157052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.168634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.170171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.172509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38419298-72c0-4bc7-8934-45b1e450a6e6 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1605 microversion: 2.32 time: 0.103510 Oct 02 01:19:21.173189 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2060/4255] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:21 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:21.179140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:21.179812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:21.186974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.187517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.187961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.188671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.189333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.189770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.191340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.204879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.206699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.208110 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea68e48b-f768-47a8-a463-75a0e318883d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1408 microversion: 2.54 time: 0.118332 Oct 02 01:19:21.210082 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2196/4256] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:21 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:21.373712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:21.374388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:21.381974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.382467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.383117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.383980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.384616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.385199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.417044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.429417 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7faf212-381e-43e2-a3da-aced99d83291 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1667 microversion: 2.1 time: 0.255071 Oct 02 01:19:21.443209 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2061/4257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:21 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1667 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:21.461915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:21.462622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:21.470278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.471011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.471992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.472876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.473339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.473832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.613059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.622680 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47d9f244-4e40-420e-a9ec-5b043ee9f0bd tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.253142 Oct 02 01:19:21.623634 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2197/4258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:21 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:21.644255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:21.644762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:21.658418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.659457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.660054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.660992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:21.661462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:21.661898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:21.682400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:21.690294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e57194a-a480-4d62-9abe-69cc236d32f2 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.242153 Oct 02 01:19:21.692912 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2062/4259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:21 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:21.705846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:21.713852 n-d-master-1 devstack@n-api.service[122355]: INFO nova.compute.api [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Working on deleting snapshot 265b274b-4d00-450f-825d-92cbae029029 from shelved instance... Oct 02 01:19:22.079734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:22.080432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:22.087582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.088226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.088930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.089735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.090264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.090801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.411007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.426936 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14930e85-ec95-4906-911b-b7692af8fd46 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1511 microversion: 2.1 time: 0.351457 Oct 02 01:19:22.428852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2063/4260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:22 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:22.434843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:22.436343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:22.443352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.446073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.446738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.447614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.448385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.448968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.488165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Doing local delete in cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=122355) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 02 01:19:22.489495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.490111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.491196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.493545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.493683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.compute.api [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 02 01:19:22.494169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.494693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.495214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lazy-loading 'fault' on Instance uuid 74cd890b-e50e-49ae-af39-ed160238166b {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:22.500911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] deallocate_for_instance() {{(pid=122355) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 02 01:19:22.622990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.633350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.634871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef737c7d2aa247388c88fc2ad7ea5748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447cbc915a47450c8bc98a83e919310a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.637034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-272834ae-1341-4539-90ec-4863751ff48d tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 200 len: 1610 microversion: 2.32 time: 0.206529 Oct 02 01:19:22.638170 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2064/4261] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:22 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 1610 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:22.643132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:22.644023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:22.652048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.652785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.653452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.654392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:22.655261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:22.655980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:22.779535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.788443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.789898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:22.791196 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c64320f2-2f9f-47da-a0c4-8a593021f4d0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1426 microversion: 2.54 time: 0.151841 Oct 02 01:19:22.791763 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2065/4262] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:22 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1426 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:22.941883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12235892-09a1-46d0-90cf-0e485e5f9a85 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Calling method '.version_select at 0x7fb885608a60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:23.016449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12235892-09a1-46d0-90cf-0e485e5f9a85 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43/defaults" status: 200 len: 371 microversion: 2.1 time: 0.223408 Oct 02 01:19:23.017051 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2066/4263] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:19:22 2022] GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43/defaults => generated 371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:23.022089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:23.022727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:23.029276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:23.029838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:23.030341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:23.031072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:23.031525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:23.031949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:23.315113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:23.329830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2a17555-bb5a-4ed2-86ca-ebc968679f2d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.311467 Oct 02 01:19:23.330672 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2067/4264] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:23 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:23.336738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:23.337492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:23.343479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:23.344012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:23.344455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:23.345162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:23.345624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:23.346055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:23.632653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Updating instance_info_cache with network_info: [] {{(pid=122355) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:19:23.661977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:23.670788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2dc1ba88-a7d3-43ee-b4b6-804fff8483a6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.339001 Oct 02 01:19:23.671639 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2068/4265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:23 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:23.696303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5a9ff75-7e86-4415-b66c-85e5d82a35c4 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Calling method '.version_select at 0x7fb88566e9d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:23.833059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5a9ff75-7e86-4415-b66c-85e5d82a35c4 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43" status: 200 len: 371 microversion: 2.1 time: 0.160167 Oct 02 01:19:23.833671 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2069/4266] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:19:23 2022] GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43 => generated 371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:23.847768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:23.848879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:23.855983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:23.856567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:23.857384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:23.858323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:23.859028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:23.859662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.015853 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0f6ae8f-f3fc-4c14-af8e-a8eacfb709c2 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 204 len: 0 microversion: 2.1 time: 2.375384 Oct 02 01:19:24.017255 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2198/4267] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:21 2022] DELETE /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 0 bytes in 2393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:24.025226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-da9f243d-4c80-4a45-bb42-43a8ca2a1eb6 req-54d0910e-9134-48a1-80d6-458ceb0d12bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bf04e1-aaac-453a-8736-7187abe3084e", "name": "network-vif-deleted", "tag": "0943776c-7aa0-4058-af11-9cb5231e2457"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:24.037929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-da9f243d-4c80-4a45-bb42-43a8ca2a1eb6 req-54d0910e-9134-48a1-80d6-458ceb0d12bf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.038527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:24.038896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-da9f243d-4c80-4a45-bb42-43a8ca2a1eb6 req-54d0910e-9134-48a1-80d6-458ceb0d12bf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.039532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-da9f243d-4c80-4a45-bb42-43a8ca2a1eb6 req-54d0910e-9134-48a1-80d6-458ceb0d12bf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.047350 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7caed17-01b9-4126-9f1b-9ee1b9ea4b12 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1488 microversion: 2.1 time: 0.212492 Oct 02 01:19:24.050238 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2070/4268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:23 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1488 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:24.057441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_external_events [req-da9f243d-4c80-4a45-bb42-43a8ca2a1eb6 req-54d0910e-9134-48a1-80d6-458ceb0d12bf service nova] Unable to find a host for instance a7bf04e1-aaac-453a-8736-7187abe3084e. Dropping event network-vif-deleted {{(pid=122355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 01:19:24.058671 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-da9f243d-4c80-4a45-bb42-43a8ca2a1eb6 req-54d0910e-9134-48a1-80d6-458ceb0d12bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.040193 Oct 02 01:19:24.059786 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2199/4269] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 02 01:19:24.061201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.063093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.065783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.066674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.074965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.075505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.076080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.076484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.076631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.077467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.077614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.078101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.078535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.078844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.079497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.080072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.105234 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] HTTP exception thrown: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Request method failure captured: Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b HTTP/1.1 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOV76DCiXmiU7rAVJVZiu3DY4PLMO_MG8ORaMVla4tt5BTGfUDSrI5zCd_yOek5Z860JfXTjm0NgtOOx6fYQmywzxmu3c_QA8IyFTqJgaAM0W3YDlCJSIacejqY-dQnrzs_AejP-ejG56oSZE4860BYZ6vCmwgc_qtodY_Q4FtqGJBg Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.32 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 447cbc915a47450c8bc98a83e919310a Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_447cbc915a47450c8bc98a83e919310a"}]}] Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 447cbc915a47450c8bc98a83e919310a Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TaggedBootDevicesTest-1564974578-project Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: ef737c7d2aa247388c88fc2ad7ea5748 Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TaggedBootDevicesTest-1564974578-project Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '74cd890b-e50e-49ae-af39-ed160238166b'} Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.107115 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Returning 404 to user: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be03fa97-1575-47ae-a9ca-cf18640ad616 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 404 len: 111 microversion: 2.32 time: 0.052945 Oct 02 01:19:24.110701 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2071/4270] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:19:24.116049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd8710c2-5e8e-467b-8455-4f1620833c35 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Calling method '.version_select at 0x7fb88566ed30>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.174922 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd8710c2-5e8e-467b-8455-4f1620833c35 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43/defaults" status: 200 len: 371 microversion: 2.1 time: 0.063530 Oct 02 01:19:24.175588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2072/4271] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43/defaults => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:24.180939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.181625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: a7bf04e1-aaac-453a-8736-7187abe3084e] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.187927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.188488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.189077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.189936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.190462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.190980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.205814 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] HTTP exception thrown: Instance a7bf04e1-aaac-453a-8736-7187abe3084e could not be found. Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Request method failure captured: Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e HTTP/1.1 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOT6gW7rlIk-9rX_5-b5ogCPdC94Eyl0z_CXfm7qjUJgyqXdBk9mBUdttaS2TdoFE_maRTEu5RRM8w8xTEQHiUzzNyvele3PYsNuSEFaOQ3TMcDW01hxRS9txDCZGCvJELjw4ZjwbGv5I0UZHc3bk6PZIu6-rfQ2OPZwH17Q5bkhC1U Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c94ca45e7684b3c818871e232e08342"}]}] Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66a9d6a142d444be90b2101f23603522 Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a7bf04e1-aaac-453a-8736-7187abe3084e could not be found. Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a7bf04e1-aaac-453a-8736-7187abe3084e'} Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7bf04e1-aaac-453a-8736-7187abe3084e could not be found. Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7bf04e1-aaac-453a-8736-7187abe3084e could not be found. Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:24.207462 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7bf04e1-aaac-453a-8736-7187abe3084e could not be found. Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Returning 404 to user: Instance a7bf04e1-aaac-453a-8736-7187abe3084e could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d78ad982-ad97-4aa8-b6b4-55699289091c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e" status: 404 len: 111 microversion: 2.1 time: 0.032693 Oct 02 01:19:24.214012 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2073/4272] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/servers/a7bf04e1-aaac-453a-8736-7187abe3084e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:24.214544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1507672787"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:24.217080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.221158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:24.223230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.223359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.223788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.225030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.225560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.226145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.231027 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:24.232426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:24.233938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:24.235332 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a823dcb-4dbe-4440-9598-1dbda2d199dc tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1414 microversion: 2.54 time: 0.174387 Oct 02 01:19:24.253975 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2200/4273] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1414 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:24.258850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25db4cd7-181a-4879-b4e0-96dbb7847409 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '.version_select at 0x7fb881607820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.281221 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-25db4cd7-181a-4879-b4e0-96dbb7847409 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545194574" status: 204 len: 0 microversion: 2.32 time: 0.031976 Oct 02 01:19:24.282238 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2201/4274] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545194574 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:19:24.291939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fbd7c607-3a57-4532-abbd-5c033b4f5500 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Calling method '.version_select at 0x7fb8855d3670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.313618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57a5ce6e-32b6-41d3-8969-6a0ff1e8cd7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "PUT /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1061 microversion: 2.1 time: 0.102657 Oct 02 01:19:24.314972 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2074/4275] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:19:24 2022] PUT /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1061 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:24.321862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.322715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.329612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.330221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.330706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.331420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.331886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.332479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.363497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:24.415755 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fbd7c607-3a57-4532-abbd-5c033b4f5500 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43" status: 200 len: 371 microversion: 2.1 time: 0.132107 Oct 02 01:19:24.417063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2202/4276] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43 => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:24.421981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.422860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.430119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.430910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.431535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.432430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.433096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.434146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.439387 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:24.471449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95079dcf-5cda-4487-98b5-ddb00ab41128 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 204 len: 0 microversion: 2.1 time: 0.154239 Oct 02 01:19:24.472295 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2075/4277] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:24 2022] DELETE /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:24.479926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:24.480670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:24.492523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.493036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.493484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.494202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:24.494849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:24.495309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:24.984848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:24.995549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:24.997280 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-938e2c30-9136-45ac-90ef-0ed089f171bf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.523675 Oct 02 01:19:25.007153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2076/4278] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:25.007153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c98ef47-060b-49f2-8c25-30f74de06bae tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Calling method '.version_select at 0x7fb880bde310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.019789 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-498c5355-9ac3-42ec-88ff-2d92451a1aca tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1488 microversion: 2.1 time: 0.601520 Oct 02 01:19:25.020497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2203/4279] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1488 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:25.025913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.026573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:25.045155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.045921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.046581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.047434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.047997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.048581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.109625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c98ef47-060b-49f2-8c25-30f74de06bae tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43?user_id=395b575106154bb3a3590e5c299bcc4e" status: 200 len: 371 microversion: 2.1 time: 0.108129 Oct 02 01:19:25.110814 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2077/4280] 10.222.0.23 () {58 vars in 1323 bytes} [Sun Oct 2 01:19:24 2022] GET /compute/v2.1/os-quota-sets/1df47be5d8964fd9aca46b06b9abec43?user_id=395b575106154bb3a3590e5c299bcc4e => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:25.116257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.118421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:25.126292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.126920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.127262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.127968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.128517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.128910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.226331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:25.236593 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d3cc66c-848a-4342-b4c9-9a5854732cee tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1466 microversion: 2.1 time: 0.215005 Oct 02 01:19:25.246654 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2204/4281] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:25 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1466 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:25.256648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.259486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:25.270286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.271248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.272663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.273730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.274397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.275628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.376400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:25.386905 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b83a56ac-2d79-43d1-8eed-6faf3cd25c4b tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.274490 Oct 02 01:19:25.396102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2078/4282] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:25 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:25.413002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.413002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:25.421640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.422407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.423062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.424249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.424870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.426131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.520954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:25.530992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:25.532431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:25.533793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd743c03-ffa1-43e9-97eb-074b158b2d9d tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1414 microversion: 2.54 time: 0.135860 Oct 02 01:19:25.535029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2079/4283] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:25 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:25.633565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:25.648566 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8350f803-8b6e-405e-924a-61f9e60651d4 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1488 microversion: 2.1 time: 0.408821 Oct 02 01:19:25.654632 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2205/4284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:25 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1488 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:25.675910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.676744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:25.684388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.685067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.685651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.686494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.687154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.687579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.738566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:25.862950 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7e42113-c43a-49df-9500-f47f481c06a2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 204 len: 0 microversion: 2.1 time: 0.190579 Oct 02 01:19:25.863729 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2080/4285] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:25 2022] DELETE /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:25.873193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:25.873919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:25.887467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a3714621-edc0-4801-89fc-457dd379deb5 req-3cef091c-b24b-4721-ba8a-00539f68bf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55f567a-3701-414a-a4ba-95fa023bb856", "name": "network-vif-plugged", "status": "completed", "tag": "3d974c97-e964-45ca-a3f6-da6e3ac0ac9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:25.892570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.893047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.893487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.894192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.894670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.895099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.905325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a3714621-edc0-4801-89fc-457dd379deb5 req-3cef091c-b24b-4721-ba8a-00539f68bf96 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:25.906292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a3714621-edc0-4801-89fc-457dd379deb5 req-3cef091c-b24b-4721-ba8a-00539f68bf96 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:25.907059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a3714621-edc0-4801-89fc-457dd379deb5 req-3cef091c-b24b-4721-ba8a-00539f68bf96 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:25.925284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a3714621-edc0-4801-89fc-457dd379deb5 req-3cef091c-b24b-4721-ba8a-00539f68bf96 service nova] Creating event network-vif-plugged:3d974c97-e964-45ca-a3f6-da6e3ac0ac9c for instance f55f567a-3701-414a-a4ba-95fa023bb856 on n-h1-master-1 Oct 02 01:19:25.932802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a3714621-edc0-4801-89fc-457dd379deb5 req-3cef091c-b24b-4721-ba8a-00539f68bf96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052474 Oct 02 01:19:25.934080 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2081/4286] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:26.025871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:26.026639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:26.034149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.034720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.035223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.036160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.036912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.037406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.235674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.246027 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90cf6bdd-a0a7-46d4-bf2f-10234295f284 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1494 microversion: 2.1 time: 0.376926 Oct 02 01:19:26.248008 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2206/4287] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:25 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1494 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:26.271621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:26.272469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:26.279474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.280221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.281009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.281931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.282645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.283430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.310316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.328798 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a5509e7-f846-494d-82ea-fc1e956830e1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.309011 Oct 02 01:19:26.329811 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2082/4288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:26 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:26.410368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:26.412729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:26.422455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.425485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.426151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.427861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.429859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.435126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.485410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.505161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-739ff3c2-daa2-47e7-ad91-b6e7eac50d09 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1466 microversion: 2.1 time: 0.238970 Oct 02 01:19:26.523544 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2207/4289] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:26 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1466 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:26.567463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:26.568616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:26.586293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.590400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.594777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.595550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:26.596709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:26.597301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:26.705671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.710007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.716191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.718279 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffe0c236-9a8b-4ec9-84bb-289ed8c9d348 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.312004 Oct 02 01:19:26.719214 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2083/4290] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:26 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:26.719723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:26.720959 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1414 microversion: 2.54 time: 0.162488 Oct 02 01:19:26.721522 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2208/4291] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:26 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:27.277793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.278420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:27.288539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.289496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.289952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.291411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.291905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.292341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.299126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.300133 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001399 Oct 02 01:19:27.300633 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2209/4292] 10.222.0.23 () {56 vars in 886 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 02 01:19:27.308977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.310071 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001538 Oct 02 01:19:27.310856 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2210/4293] 10.222.0.23 () {54 vars in 1035 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 02 01:19:27.317549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.319343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002172 Oct 02 01:19:27.319875 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2211/4294] 10.222.0.23 () {54 vars in 1041 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:19:27.328230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.329270 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5f46d6c-7827-43ad-a92c-0dc2ea39a83b tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001228 Oct 02 01:19:27.329871 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2212/4295] 10.222.0.23 () {56 vars in 886 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 02 01:19:27.355119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.355789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:27.374990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.375492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.375939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.376658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.377117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.377551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.852455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:27.865682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb4c21ee-022b-43dd-b673-b18916b00b17 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.511779 Oct 02 01:19:27.867149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:27.879796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2213/4296] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:27.888305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-703834c0-0dac-4262-9a71-633fc1f16817 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1494 microversion: 2.1 time: 0.614026 Oct 02 01:19:27.889031 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2084/4297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1494 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:27.894959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.895602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:27.907327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:27.907949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:27.913402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.913908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.914345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.915409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.916091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.916827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.935124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.936160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.942176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:27.942176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:27.942176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:27.945000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.220956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:28.229257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc103537-e59f-4b9a-97e2-54f0f658ae43 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1466 microversion: 2.1 time: 0.347592 Oct 02 01:19:28.229845 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2214/4298] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:28.252736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:28.253590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:28.260551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.261367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.262184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.263155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.263952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.264801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.408313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:28.427330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:28.429564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:28.430782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:28.432546 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1aba3dd-fb66-43f8-ad0d-dae2b2c3e654 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1414 microversion: 2.54 time: 0.186923 Oct 02 01:19:28.434814 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2215/4299] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:28 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1414 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:28.449456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a13f3342-dffa-48aa-8ca8-14f09ed52ca8 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1402 microversion: 2.1 time: 0.559186 Oct 02 01:19:28.450365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2085/4300] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:27 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1402 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:28.849843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-945ee3c2-6162-41fe-948e-117b5e62e352 req-4cc62959-37db-4a58-a171-e052ded2fc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c586c5-c2c3-49c9-a11e-3685e8423b38", "name": "network-vif-deleted", "tag": "acdcf40f-adda-404c-8fd3-4065aa09eee7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:28.869979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-945ee3c2-6162-41fe-948e-117b5e62e352 req-4cc62959-37db-4a58-a171-e052ded2fc12 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.871119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-945ee3c2-6162-41fe-948e-117b5e62e352 req-4cc62959-37db-4a58-a171-e052ded2fc12 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.872328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-945ee3c2-6162-41fe-948e-117b5e62e352 req-4cc62959-37db-4a58-a171-e052ded2fc12 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.893303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:28.894776 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-945ee3c2-6162-41fe-948e-117b5e62e352 req-4cc62959-37db-4a58-a171-e052ded2fc12 service nova] Creating event network-vif-deleted:acdcf40f-adda-404c-8fd3-4065aa09eee7 for instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 on n-h2-master-1 Oct 02 01:19:28.894924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:28.915160 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-945ee3c2-6162-41fe-948e-117b5e62e352 req-4cc62959-37db-4a58-a171-e052ded2fc12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070027 Oct 02 01:19:28.916262 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2216/4301] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:28.923753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:28.924709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:28.927046 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:28.929971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.932450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.933190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.934345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.934767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.935920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.937425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.941809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.942271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:28.953060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:28.953606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:28.954060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:29.270282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:29.309001 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72dac37a-b6cd-4d61-a774-00eed9404faa tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 200 len: 1292 microversion: 2.1 time: 0.383095 Oct 02 01:19:29.317558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2217/4302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:28 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 1292 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:29.341297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:29.344355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:29.375254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:29.382405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:29.387140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:29.392286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:29.392982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:29.394248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:29.710551 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:29.735995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:29.736968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18c2597d-0d5d-4a56-af8c-6ce9e1685940 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1466 microversion: 2.1 time: 0.417531 Oct 02 01:19:29.745033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2218/4303] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:29 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1466 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:29.759089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:29.760944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:29.762291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f91b4f4a-3462-4b80-9d51-9edbfaa4d079 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.873710 Oct 02 01:19:29.762921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2086/4304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:28 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:29.776767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:29.777826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:29.784187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:29.785609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:29.786094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:29.787717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:29.788194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:29.788639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:29.790657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:29.794664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:29.795360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:29.796342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:29.797035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:29.797674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.268630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.279884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.281350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.282536 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7dcf4f41-8471-46d3-aa8f-cb33e94893f0 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1399 microversion: 2.54 time: 0.536344 Oct 02 01:19:30.289205 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2219/4305] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:29 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1399 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:30.289570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.289885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.298846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.299737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.300739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.301609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.302684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.303504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.321103 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] HTTP exception thrown: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Request method failure captured: Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b HTTP/1.1 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOV76DCiXmiU7rAVJVZiu3DY4PLMO_MG8ORaMVla4tt5BTGfUDSrI5zCd_yOek5Z860JfXTjm0NgtOOx6fYQmywzxmu3c_QA8IyFTqJgaAM0W3YDlCJSIacejqY-dQnrzs_AejP-ejG56oSZE4860BYZ6vCmwgc_qtodY_Q4FtqGJBg Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.32 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 447cbc915a47450c8bc98a83e919310a Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_447cbc915a47450c8bc98a83e919310a"}]}] Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 447cbc915a47450c8bc98a83e919310a Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TaggedBootDevicesTest-1564974578-project Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: ef737c7d2aa247388c88fc2ad7ea5748 Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TaggedBootDevicesTest-1564974578-project Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '74cd890b-e50e-49ae-af39-ed160238166b'} Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:30.323251 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.328449 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.332105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Returning 404 to user: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:30.334501 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f27f75df-c577-4aa6-8b29-cc3edbb7b01f tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 404 len: 111 microversion: 2.32 time: 0.049388 Oct 02 01:19:30.336041 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2220/4306] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:19:30 2022] DELETE /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:19:30.341910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3e675ade-5ccf-4019-8a47-04b3ee132443 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '.version_select at 0x7fb88184ddc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.378937 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3e675ade-5ccf-4019-8a47-04b3ee132443 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-120800034" status: 204 len: 0 microversion: 2.54 time: 0.029404 Oct 02 01:19:30.378937 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2221/4307] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-120800034 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:19:30.378937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.378937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.388939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.389433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.389870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.390571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.396494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.396987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.414459 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 HTTP/1.1 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '05c586c5-c2c3-49c9-a11e-3685e8423b38'} Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.416117 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9aaef6af-a108-4541-9d11-cb88bf11f55f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 404 len: 111 microversion: 2.1 time: 0.048687 Oct 02 01:19:30.421138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2222/4308] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:30 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:30.431254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.432193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] [instance: 74cd890b-e50e-49ae-af39-ed160238166b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.438921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.439691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.440311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.441265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.441941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.443139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.445568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.460745 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] HTTP exception thrown: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Request method failure captured: Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b HTTP/1.1 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOV76DCiXmiU7rAVJVZiu3DY4PLMO_MG8ORaMVla4tt5BTGfUDSrI5zCd_yOek5Z860JfXTjm0NgtOOx6fYQmywzxmu3c_QA8IyFTqJgaAM0W3YDlCJSIacejqY-dQnrzs_AejP-ejG56oSZE4860BYZ6vCmwgc_qtodY_Q4FtqGJBg Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.32 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 447cbc915a47450c8bc98a83e919310a Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/447cbc915a47450c8bc98a83e919310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_447cbc915a47450c8bc98a83e919310a"}]}] Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 447cbc915a47450c8bc98a83e919310a Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1564974578 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TaggedBootDevicesTest-1564974578-project Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: ef737c7d2aa247388c88fc2ad7ea5748 Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TaggedBootDevicesTest-1564974578-project Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '74cd890b-e50e-49ae-af39-ed160238166b'} Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.462722 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. Oct 02 01:19:30.466514 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.469323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8f542b8-6dd2-45ab-94e4-d854b1c64380 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1588 microversion: 2.1 time: 0.698661 Oct 02 01:19:30.469323 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2087/4309] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:29 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1588 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:30.469453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] Returning 404 to user: Instance 74cd890b-e50e-49ae-af39-ed160238166b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:30.469453 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ad97208-30df-4021-bb46-8515030c04e7 tempest-TaggedBootDevicesTest-1564974578 tempest-TaggedBootDevicesTest-1564974578-project] 10.222.0.23 "GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b" status: 404 len: 111 microversion: 2.32 time: 0.049628 Oct 02 01:19:30.470784 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2223/4310] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:30 2022] GET /compute/v2.1/servers/74cd890b-e50e-49ae-af39-ed160238166b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:19:30.471291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.474236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.491832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.492710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.493394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.494063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.494573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.495057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.495788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.496449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.513598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.514106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.514543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.515295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.515760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.516163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.539040 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:30.546546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:30.556263 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 HTTP/1.1 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '05c586c5-c2c3-49c9-a11e-3685e8423b38'} Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:30.557842 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d5c3353-cc1a-411f-b081-a8dbe9e8d0eb tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 404 len: 111 microversion: 2.1 time: 0.086898 Oct 02 01:19:30.563535 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2224/4311] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:30 2022] DELETE /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:30.575502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.575870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.598838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.599284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.599739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.600483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.600948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.601375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.710845 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af4b2f02-53e5-4f4d-bff2-a52e72351079 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 204 len: 0 microversion: 2.54 time: 0.244312 Oct 02 01:19:30.713113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2088/4312] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:19:30 2022] DELETE /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:19:30.728908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.730058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 05c586c5-c2c3-49c9-a11e-3685e8423b38] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.743665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.745322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.747053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.749551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.750114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.750828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.770450 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 HTTP/1.1 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '05c586c5-c2c3-49c9-a11e-3685e8423b38'} Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:30.772593 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. Oct 02 01:19:30.776450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:30.778218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 05c586c5-c2c3-49c9-a11e-3685e8423b38 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:30.779484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e4738e1-b316-4021-a5ac-92d14760625c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38" status: 404 len: 111 microversion: 2.1 time: 0.063836 Oct 02 01:19:30.782365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2089/4313] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:30 2022] GET /compute/v2.1/servers/05c586c5-c2c3-49c9-a11e-3685e8423b38 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:30.789029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.790130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.799590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.800555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.801300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.802998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.803849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.804533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.853039 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-728bb7d2-37c9-46d4-82d0-c4bac2077a1e tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.292158 Oct 02 01:19:30.853647 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2225/4314] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:19:30 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:30.858351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:30.858988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:30.872608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.873042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.873478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.882587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:30.883375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:30.884005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:30.961881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.995816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.998025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:30.999492 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60d1166f-a7ef-48a2-9583-16f83ae36657 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1405 microversion: 2.54 time: 0.215773 Oct 02 01:19:31.014629 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2090/4315] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:30 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:19:31.014629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.014629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.037843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.038438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.038925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.039678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.040233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.040667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.201555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:31.213480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d1bf9d6-5740-4e22-bffc-505ad2df888e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1300 microversion: 2.1 time: 0.358776 Oct 02 01:19:31.214302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2226/4316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:30 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:31.244729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.247095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.262565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.263255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.263768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.264823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.265548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.277615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.303035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e HTTP/1.1 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: exception: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'bfca093a-b241-4946-9093-15c7ec39042e'} Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.304919 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.309304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-15460ee2-3411-4b71-bb36-9ce8434b70a3 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 404 len: 111 microversion: 2.1 time: 0.065644 Oct 02 01:19:31.311079 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2227/4317] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:31 2022] DELETE /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.319164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5879fab1-93c4-4436-b2a6-c5dcbd29eaea req-d968160d-2cd4-40bd-9fec-941d2f50b6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e8b7de-9bd5-4ad8-8082-92453a8e584d", "name": "network-vif-deleted", "tag": "c910a0d3-67b0-4c03-859b-64f56ae4c159"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:31.330220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5879fab1-93c4-4436-b2a6-c5dcbd29eaea req-d968160d-2cd4-40bd-9fec-941d2f50b6de service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.331215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5879fab1-93c4-4436-b2a6-c5dcbd29eaea req-d968160d-2cd4-40bd-9fec-941d2f50b6de service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.331793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5879fab1-93c4-4436-b2a6-c5dcbd29eaea req-d968160d-2cd4-40bd-9fec-941d2f50b6de service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.345337 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5879fab1-93c4-4436-b2a6-c5dcbd29eaea req-d968160d-2cd4-40bd-9fec-941d2f50b6de service nova] Creating event network-vif-deleted:c910a0d3-67b0-4c03-859b-64f56ae4c159 for instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d on n-h1-master-1 Oct 02 01:19:31.351331 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5879fab1-93c4-4436-b2a6-c5dcbd29eaea req-d968160d-2cd4-40bd-9fec-941d2f50b6de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038469 Oct 02 01:19:31.352476 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2228/4318] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:31.358382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.359503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: bfca093a-b241-4946-9093-15c7ec39042e] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.367927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.368865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.369518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.370365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.370989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.371799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.388905 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e HTTP/1.1 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: exception: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'bfca093a-b241-4946-9093-15c7ec39042e'} Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.390850 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. Oct 02 01:19:31.394225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.397995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance bfca093a-b241-4946-9093-15c7ec39042e could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.399269 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-281caa8b-7c6c-4804-a31c-c16b9358ef7f tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e" status: 404 len: 111 microversion: 2.1 time: 0.045332 Oct 02 01:19:31.400103 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2229/4319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/bfca093a-b241-4946-9093-15c7ec39042e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.415878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.416440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.424162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.424728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.425174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.426041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.427446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.429715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.446442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 HTTP/1.1 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7b17f445-1e8e-4f9e-b327-b481f300bbb7'} Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.448333 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4cd4bf9c-cc87-418c-98fb-706dc2bae954 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 404 len: 111 microversion: 2.1 time: 0.044568 Oct 02 01:19:31.451894 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2230/4320] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:31 2022] DELETE /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.459762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.460553 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 7b17f445-1e8e-4f9e-b327-b481f300bbb7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.462614 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:31.469315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.470336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.470818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.471535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.471992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.472421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.477250 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:31.494713 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 HTTP/1.1 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7b17f445-1e8e-4f9e-b327-b481f300bbb7'} Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.496198 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. Oct 02 01:19:31.500088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.501749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 7b17f445-1e8e-4f9e-b327-b481f300bbb7 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.502803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4675c334-de15-4c58-8942-5ff09fc22446 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7" status: 404 len: 111 microversion: 2.1 time: 0.047676 Oct 02 01:19:31.503521 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2231/4321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/7b17f445-1e8e-4f9e-b327-b481f300bbb7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:19:31.514639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.516172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.524828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.526362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.527525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.528438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.529311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.529886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.552891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 HTTP/1.1 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '85611874-af48-48e1-9ff7-9bc74ee0d658'} Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.554912 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.558966 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.566247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.568915 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-043e1daf-90b5-4ba6-aa03-93cd4884109c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 404 len: 111 microversion: 2.1 time: 0.059624 Oct 02 01:19:31.584335 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2232/4322] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:31 2022] DELETE /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:19:31.590055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.594355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 85611874-af48-48e1-9ff7-9bc74ee0d658] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.603699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.616586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.617382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.619615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.621528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.623700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.644410 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 HTTP/1.1 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '85611874-af48-48e1-9ff7-9bc74ee0d658'} Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.648444 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 85611874-af48-48e1-9ff7-9bc74ee0d658 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c3b9818b-68a2-453b-9c4e-84eff765da71 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658" status: 404 len: 111 microversion: 2.1 time: 0.063911 Oct 02 01:19:31.652861 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2233/4323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/85611874-af48-48e1-9ff7-9bc74ee0d658 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.667853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.668600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.675641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.677353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.678018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.679282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.679937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.680543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.700992 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 HTTP/1.1 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '3049e07a-5840-473e-8046-e9820c95f991'} Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.703063 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.707007 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.710292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.711393 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa0f6da2-5622-4045-902c-6656cfc1194b tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 404 len: 111 microversion: 2.1 time: 0.048087 Oct 02 01:19:31.712625 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2234/4324] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:31 2022] DELETE /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.722087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.723376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 3049e07a-5840-473e-8046-e9820c95f991] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.730892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.731691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.732292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.733327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.733938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.734518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.753892 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 HTTP/1.1 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '3049e07a-5840-473e-8046-e9820c95f991'} Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.756351 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. Oct 02 01:19:31.760766 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.762379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 3049e07a-5840-473e-8046-e9820c95f991 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.763633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9f4d3e4-d743-4092-a142-ef60cce98c53 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991" status: 404 len: 111 microversion: 2.1 time: 0.046296 Oct 02 01:19:31.764702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2235/4325] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/3049e07a-5840-473e-8046-e9820c95f991 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.776909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.781272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.796911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.801278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.802007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.803531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.804182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.804622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.839360 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 HTTP/1.1 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '20a044d2-dc3a-4f9e-adf0-d6bf84390331'} Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.843046 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.847031 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.849791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.850875 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-54bb5e00-56d6-4198-bfdd-51a48e330b0c tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 404 len: 111 microversion: 2.1 time: 0.080941 Oct 02 01:19:31.853242 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2236/4326] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:31 2022] DELETE /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.862248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.863050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 20a044d2-dc3a-4f9e-adf0-d6bf84390331] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.870810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.872046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.872046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.872502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.873126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.873970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.892066 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 HTTP/1.1 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '20a044d2-dc3a-4f9e-adf0-d6bf84390331'} Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.894232 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. Oct 02 01:19:31.898319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.900925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 20a044d2-dc3a-4f9e-adf0-d6bf84390331 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.902012 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e9362cc-9c48-4aee-ac1b-c1e141f4f3f1 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331" status: 404 len: 111 microversion: 2.1 time: 0.044716 Oct 02 01:19:31.906721 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2237/4327] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/20a044d2-dc3a-4f9e-adf0-d6bf84390331 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.913400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.914789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 0b07024a-e029-45b9-b85a-1fb7f1751584] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.923578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.924318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.924974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.925090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:31.926565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.927697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.928288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.933625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14e44a6d-8570-4078-87df-ceb869a99c18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.931170 Oct 02 01:19:31.934218 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2091/4328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:31.947650 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 HTTP/1.1 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0b07024a-e029-45b9-b85a-1fb7f1751584'} Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:31.949487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:31.953789 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:31.955470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:31.956683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a5bdf58-dd67-4521-b4da-774e10281e97 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584" status: 404 len: 111 microversion: 2.1 time: 0.048197 Oct 02 01:19:31.957772 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2238/4329] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:31 2022] DELETE /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:31.968411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:31.969533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 0b07024a-e029-45b9-b85a-1fb7f1751584] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:31.978831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.979610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.980976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:31.982090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:31.982831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:31.983460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.017639 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 HTTP/1.1 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0b07024a-e029-45b9-b85a-1fb7f1751584'} Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:32.021516 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:32.027434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 0b07024a-e029-45b9-b85a-1fb7f1751584 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:32.030713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:32.031344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:32.037501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7eddbb4f-570b-42c9-864e-7d61c21162c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584" status: 404 len: 111 microversion: 2.1 time: 0.071790 Oct 02 01:19:32.042819 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2092/4330] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:31 2022] GET /compute/v2.1/servers/0b07024a-e029-45b9-b85a-1fb7f1751584 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:32.053933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.057132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.057852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.058761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.061153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:32.061384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.062003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.063299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:32.081030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.083822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.085238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.088688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.089685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.091980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.170181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:32.300046 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f04494ae-e8de-494c-ae42-ac36a9e660ec tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 204 len: 0 microversion: 2.1 time: 0.254403 Oct 02 01:19:32.301219 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2093/4331] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:32 2022] DELETE /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:32.307363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:32.308089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:32.311331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:32.320324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:32.322584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.323116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.323572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.324282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.324748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.325186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.327444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:32.328796 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a00d2154-dfc7-49e6-8323-d3d50747cd69 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1405 microversion: 2.54 time: 0.302722 Oct 02 01:19:32.335438 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2239/4332] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:32 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:19:32.346910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:32.346910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:32.356977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.357573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.358108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.358963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.371159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.371745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.403831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:32.404332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:32.404776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:32.405595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lazy-loading 'fault' on Instance uuid 95e8b7de-9bd5-4ad8-8082-92453a8e584d {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:32.570234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:32.580751 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-454f3d9e-5174-4b16-ba6c-e9f622b1d0a6 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1305 microversion: 2.1 time: 0.277478 Oct 02 01:19:32.596917 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2094/4333] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:32 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:32.763696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:32.779414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-51790936-9d55-480e-974d-e6941c08ae79 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1480 microversion: 2.1 time: 0.442856 Oct 02 01:19:32.780442 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2240/4334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:32 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1480 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:32.985898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:32.987361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:32.997149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.003311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.004793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.009053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.009674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.010253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.365255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:33.365871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:33.375419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.378263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.379048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.383551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.384054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.384507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.522879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:33.543182 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97283fca-8337-43c9-afef-d837cd7c4c5a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.585592 Oct 02 01:19:33.546104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2095/4335] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:32 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:33.607142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:33.616113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:33.616612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:33.617104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:33.618476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16e7a0f9d35f40dc855b14b9977b6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d8d4b0db154ba6acce7c0639e44530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:33.619877 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a20b0dc9-4675-467a-9699-de30392fc9e5 tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 200 len: 1405 microversion: 2.54 time: 0.259187 Oct 02 01:19:33.626842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.628065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.628760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.631365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.632513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.633296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.634992 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2241/4336] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:33 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:19:33.705396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.711024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.711820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.712819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lazy-loading 'fault' on Instance uuid 95e8b7de-9bd5-4ad8-8082-92453a8e584d {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:33.809615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:33.810481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:33.825181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.826301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.829246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.830238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.831379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.832041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.847517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:33.857786 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-71964043-fc8c-40bb-b546-8297f4943b5c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 200 len: 1305 microversion: 2.1 time: 0.249017 Oct 02 01:19:33.864208 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2096/4337] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:33 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 1305 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:33.882159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:33.883750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:33.899461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.899975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.900432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:33.901158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:33.901625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:33.902062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:34.352359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:34.368182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1a03c6b-108a-4be7-8844-ae73dfa895c2 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1480 microversion: 2.1 time: 0.563350 Oct 02 01:19:34.372239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2242/4338] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:33 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1480 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:34.378682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-098ecafc-ef91-4787-b5b7-f266c8f8689f req-e8f82c67-9170-40fe-b52d-f1013d01db12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55f567a-3701-414a-a4ba-95fa023bb856", "tag": "3d974c97-e964-45ca-a3f6-da6e3ac0ac9c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:34.401600 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:34.413845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-098ecafc-ef91-4787-b5b7-f266c8f8689f req-e8f82c67-9170-40fe-b52d-f1013d01db12 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:34.418801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-098ecafc-ef91-4787-b5b7-f266c8f8689f req-e8f82c67-9170-40fe-b52d-f1013d01db12 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:34.419397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-098ecafc-ef91-4787-b5b7-f266c8f8689f req-e8f82c67-9170-40fe-b52d-f1013d01db12 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:34.446797 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-098ecafc-ef91-4787-b5b7-f266c8f8689f req-e8f82c67-9170-40fe-b52d-f1013d01db12 service nova] Creating event network-changed:3d974c97-e964-45ca-a3f6-da6e3ac0ac9c for instance f55f567a-3701-414a-a4ba-95fa023bb856 on n-h1-master-1 Oct 02 01:19:34.460833 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-098ecafc-ef91-4787-b5b7-f266c8f8689f req-e8f82c67-9170-40fe-b52d-f1013d01db12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082610 Oct 02 01:19:34.462061 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2243/4339] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:34.576379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:34.579423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:34.590656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:34.595531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:34.596599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:34.598128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:34.601018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:34.601701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.106770 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:35.431917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:35.440342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5e80753-f4cf-4cfb-9fd1-db73c85286d3 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1588 microversion: 2.1 time: 1.574146 Oct 02 01:19:35.442709 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2097/4340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:33 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1588 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:35.453925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:35.454860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] [instance: 5b0164e5-7eaf-414d-8aee-40c16fb146c2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:35.467872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.468629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.473354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.474508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.475150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.475751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.536580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] HTTP exception thrown: Instance 5b0164e5-7eaf-414d-8aee-40c16fb146c2 could not be found. Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Request method failure captured: Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 HTTP/1.1 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOb0W-kAMTG8PUz0v6WsVENcqllfb5Cd_aMtjnss5cUIb9oZbK3bCAVurgvWDCkt-W-o-qnz91-DSFfMuZFqsTPnQ0-smD5_lBz__1XNME665YTtCzzk8oHfpa5B1MbRNhHQJvGv_ehLpdtCwbkm5f9EfVr8eRWW8R9UzFrMQ_9m33o Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.54 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 77d8d4b0db154ba6acce7c0639e44530 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerShowV254Test-1403398416 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/77d8d4b0db154ba6acce7c0639e44530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/77d8d4b0db154ba6acce7c0639e44530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/77d8d4b0db154ba6acce7c0639e44530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_77d8d4b0db154ba6acce7c0639e44530"}]}] Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerShowV254Test-1403398416 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 77d8d4b0db154ba6acce7c0639e44530 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerShowV254Test-1403398416 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerShowV254Test-1403398416-project Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 16e7a0f9d35f40dc855b14b9977b6e73 Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerShowV254Test-1403398416-project Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5b0164e5-7eaf-414d-8aee-40c16fb146c2 could not be found. Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5b0164e5-7eaf-414d-8aee-40c16fb146c2'} Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0164e5-7eaf-414d-8aee-40c16fb146c2 could not be found. Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0164e5-7eaf-414d-8aee-40c16fb146c2 could not be found. Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:35.542577 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0164e5-7eaf-414d-8aee-40c16fb146c2 could not be found. Oct 02 01:19:35.546280 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.548704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] Returning 404 to user: Instance 5b0164e5-7eaf-414d-8aee-40c16fb146c2 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:35.549798 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24eb7cd0-ce86-40c2-b284-00de6d1b04cf tempest-ServerShowV254Test-1403398416 tempest-ServerShowV254Test-1403398416-project] 10.222.0.23 "GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2" status: 404 len: 111 microversion: 2.54 time: 0.105973 Oct 02 01:19:35.551443 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2098/4341] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:19:35 2022] GET /compute/v2.1/servers/5b0164e5-7eaf-414d-8aee-40c16fb146c2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:19:35.563744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:35.564804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 95e8b7de-9bd5-4ad8-8082-92453a8e584d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:35.576081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.576889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.577509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.578402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.579207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.579813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.608325 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] HTTP exception thrown: Instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d could not be found. Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Request method failure captured: Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d HTTP/1.1 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOT6gW7rlIk-9rX_5-b5ogCPdC94Eyl0z_CXfm7qjUJgyqXdBk9mBUdttaS2TdoFE_maRTEu5RRM8w8xTEQHiUzzNyvele3PYsNuSEFaOQ3TMcDW01hxRS9txDCZGCvJELjw4ZjwbGv5I0UZHc3bk6PZIu6-rfQ2OPZwH17Q5bkhC1U Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c94ca45e7684b3c818871e232e08342"}]}] Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66a9d6a142d444be90b2101f23603522 Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d could not be found. Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '95e8b7de-9bd5-4ad8-8082-92453a8e584d'} Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d could not be found. Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d could not be found. Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:35.611697 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d could not be found. Oct 02 01:19:35.615491 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:35.617534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Returning 404 to user: Instance 95e8b7de-9bd5-4ad8-8082-92453a8e584d could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:35.623757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e23cc61-d6ec-409c-946d-c85116ca2354 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d" status: 404 len: 111 microversion: 2.1 time: 0.064498 Oct 02 01:19:35.624806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2099/4342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:35 2022] GET /compute/v2.1/servers/95e8b7de-9bd5-4ad8-8082-92453a8e584d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:35.644179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:35.645250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:35.660658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.664555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.667463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.668387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.669060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.673548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.707672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:35.724264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d1bcde8-5524-4e9a-81e9-da80d6a1f900 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 1.152748 Oct 02 01:19:35.725459 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2244/4343] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:34 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:35.732747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:35.747612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:35.779765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.780266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.780707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.781420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:35.781879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:35.782305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:35.854429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:36.033873 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c4d09e9-056d-4f2f-8b29-2f208dd9ae45 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 204 len: 0 microversion: 2.1 time: 0.304615 Oct 02 01:19:36.034514 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2245/4344] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:35 2022] DELETE /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:36.044132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:36.044602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:36.055833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:36.056331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:36.056770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:36.057484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:36.057988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:36.071335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:36.088890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5104bda5de774e93bd494d64a8f11faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44feebec98b4cd49f7a80597f47be35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:36.100911 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-100c7db3-9562-4a57-b72d-446e42604e43 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 200 len: 1438 microversion: 2.1 time: 0.471838 Oct 02 01:19:36.104567 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2100/4345] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:35 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 1438 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:36.261349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ca7f0ef3-73cf-469f-8818-a8900f729fee req-ecb76491-b4c3-4053-aa5f-6389bafd8e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f", "name": "network-vif-deleted", "tag": "69297fdd-319c-4a70-9879-5ed633c66c9f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:36.298245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ca7f0ef3-73cf-469f-8818-a8900f729fee req-ecb76491-b4c3-4053-aa5f-6389bafd8e74 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:36.299056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ca7f0ef3-73cf-469f-8818-a8900f729fee req-ecb76491-b4c3-4053-aa5f-6389bafd8e74 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:36.299714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ca7f0ef3-73cf-469f-8818-a8900f729fee req-ecb76491-b4c3-4053-aa5f-6389bafd8e74 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:36.352891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ca7f0ef3-73cf-469f-8818-a8900f729fee req-ecb76491-b4c3-4053-aa5f-6389bafd8e74 service nova] Creating event network-vif-deleted:69297fdd-319c-4a70-9879-5ed633c66c9f for instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f on n-h1-master-1 Oct 02 01:19:36.374830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ca7f0ef3-73cf-469f-8818-a8900f729fee req-ecb76491-b4c3-4053-aa5f-6389bafd8e74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122068 Oct 02 01:19:36.381788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2101/4346] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:36.749116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:36.750907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:36.762591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:36.769797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:36.770861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:36.771834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:36.772519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:36.773179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:36.830263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:36.854420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-12fc7d3f-e69f-4a2c-84e4-9e173b79e5a0 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1507 microversion: 2.1 time: 0.810387 Oct 02 01:19:36.856288 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2246/4347] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:36 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1507 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:37.126483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:37.127441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] [instance: 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:37.144324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:37.148292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:37.151230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:37.155154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:37.156178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:37.159269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:37.217335 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] HTTP exception thrown: Instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f could not be found. Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Request method failure captured: Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f HTTP/1.1 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOYZWBshhCuwcVpt5B-uZdKzLU4h__pt9XGYE19aOWiPyfY6IaJMI_oxKh73TlWd7R5CWPTxiTeFp-OdW4R4Z2nxwyVx0Yl8c-wtyDSMkudxyLC_RGs7egTfMprby0Olo8wLOuGXg9IhY-yDdmcOQCi3boEGcM_us3vVHwqVqXzXpm4 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e44feebec98b4cd49f7a80597f47be35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e44feebec98b4cd49f7a80597f47be35"}]}] Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestJSON-1357226397 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e44feebec98b4cd49f7a80597f47be35 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestJSON-1357226397 Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5104bda5de774e93bd494d64a8f11faf Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestJSON-1357226397-project Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f could not be found. Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f'} Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f could not be found. Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f could not be found. Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:37.223376 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f could not be found. Oct 02 01:19:37.226905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:37.229370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] Returning 404 to user: Instance 9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:37.231848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a943854-ddac-49aa-8698-23b8f24fb2d0 tempest-ServersTestJSON-1357226397 tempest-ServersTestJSON-1357226397-project] 10.222.0.23 "GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f" status: 404 len: 111 microversion: 2.1 time: 0.110168 Oct 02 01:19:37.233074 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2247/4348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:37 2022] GET /compute/v2.1/servers/9dade4a1-8ce2-48fd-9a16-df4cbb2bac4f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:37.563356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:37.594520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-276a1d6d-0a36-45f5-a850-dd574d2a78fe tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.849695 Oct 02 01:19:37.615299 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2102/4349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:36 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:37.886102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:37.886942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:37.902040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:37.902736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:37.903185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:37.906317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:37.907127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:37.909390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:38.280686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:38.292405 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a10a09e-48c7-4bd9-b9aa-6b81ebf6e810 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1507 microversion: 2.1 time: 0.409224 Oct 02 01:19:38.293138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2248/4350] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:37 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1507 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:38.627601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:38.630508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:38.649681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:38.651195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:38.653562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:38.655621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:38.656385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:38.661160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:38.973021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-559cc741-f74d-4ed2-9519-e26104f90a32 req-b0c5e5f0-26e7-4604-a993-f334e216409c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2594e2a1-02b5-403c-8989-4dd1f40bc4eb", "name": "network-vif-deleted", "tag": "97738f33-8fc1-4251-a80f-e4056133fa4b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:39.000725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-559cc741-f74d-4ed2-9519-e26104f90a32 req-b0c5e5f0-26e7-4604-a993-f334e216409c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:39.001440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-559cc741-f74d-4ed2-9519-e26104f90a32 req-b0c5e5f0-26e7-4604-a993-f334e216409c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:39.002649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-559cc741-f74d-4ed2-9519-e26104f90a32 req-b0c5e5f0-26e7-4604-a993-f334e216409c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:39.043801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:39.059830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccf443c8-2518-49b6-bc27-c981407a0c6c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.439940 Oct 02 01:19:39.074700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-559cc741-f74d-4ed2-9519-e26104f90a32 req-b0c5e5f0-26e7-4604-a993-f334e216409c service nova] Creating event network-vif-deleted:97738f33-8fc1-4251-a80f-e4056133fa4b for instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb on n-h2-master-1 Oct 02 01:19:39.080744 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2103/4351] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:38 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:39.094178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-559cc741-f74d-4ed2-9519-e26104f90a32 req-b0c5e5f0-26e7-4604-a993-f334e216409c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162002 Oct 02 01:19:39.103880 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2249/4352] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:39.330898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:39.331807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:39.371362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:39.372154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:39.372806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:39.387583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:39.388419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:39.389068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:39.439828 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:39.469275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:39.470873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:39.471640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:39.473107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lazy-loading 'fault' on Instance uuid 2594e2a1-02b5-403c-8989-4dd1f40bc4eb {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:19:39.533657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:39.546276 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-490a73dc-bb66-49a8-baa9-bb080b47d97c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 200 len: 1304 microversion: 2.1 time: 0.227317 Oct 02 01:19:39.558646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2104/4353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:39 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:40.085802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:40.086510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:40.100568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.101077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.101515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.102274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.107215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.107931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.452008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:40.466202 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97fc7ffe-aebe-4caa-b6db-3b750deb25a5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.385243 Oct 02 01:19:40.468337 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2250/4354] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:40 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:40.573078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:40.574424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 2594e2a1-02b5-403c-8989-4dd1f40bc4eb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:40.587226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.590898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.591527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.593132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.595190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.596847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.624700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] HTTP exception thrown: Instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb could not be found. Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Request method failure captured: Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb HTTP/1.1 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOT6gW7rlIk-9rX_5-b5ogCPdC94Eyl0z_CXfm7qjUJgyqXdBk9mBUdttaS2TdoFE_maRTEu5RRM8w8xTEQHiUzzNyvele3PYsNuSEFaOQ3TMcDW01hxRS9txDCZGCvJELjw4ZjwbGv5I0UZHc3bk6PZIu6-rfQ2OPZwH17Q5bkhC1U Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c94ca45e7684b3c818871e232e08342"}]}] Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66a9d6a142d444be90b2101f23603522 Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb could not be found. Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '2594e2a1-02b5-403c-8989-4dd1f40bc4eb'} Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb could not be found. Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb could not be found. Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:40.629019 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb could not be found. Oct 02 01:19:40.633632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:40.636215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Returning 404 to user: Instance 2594e2a1-02b5-403c-8989-4dd1f40bc4eb could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:40.637299 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-117f7d38-99a2-43e1-bc0c-461f47d47d65 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb" status: 404 len: 111 microversion: 2.1 time: 0.068928 Oct 02 01:19:40.641266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2105/4355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:40 2022] GET /compute/v2.1/servers/2594e2a1-02b5-403c-8989-4dd1f40bc4eb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:40.648462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:40.649279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:40.661785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.662525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.663135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.664000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.664602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.665201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.708166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:40.785671 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:40.885735 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4fb43006-92b4-47ff-a019-8d08d79ada73 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 204 len: 0 microversion: 2.1 time: 0.242758 Oct 02 01:19:40.887234 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2251/4356] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:40 2022] DELETE /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:40.895593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:40.896224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:40.907158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.907670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.908115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.908825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.910581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.911232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:41.270211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:41.281815 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef0c2d84-7980-4f3c-8f0a-a5bedfeffe1f tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1493 microversion: 2.1 time: 0.390522 Oct 02 01:19:41.288048 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2106/4357] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:40 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1493 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:41.490348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:41.491086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:41.500624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:41.501117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:41.501555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:41.502263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:41.511200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:41.511793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:41.809631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:41.820797 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0aaf165f-dab0-4c2f-9806-4e80774722f4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.335024 Oct 02 01:19:41.839016 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2252/4358] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:41 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:42.313942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:42.314574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:42.329569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:42.330075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:42.330523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:42.331554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:42.347604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:42.348376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:42.845673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:42.847689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:42.856574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:42.857481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:42.858147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:42.859101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:42.859759 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:42.860387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:42.928216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:42.938436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-330db3c2-e246-4b72-b93a-1ca019080c01 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1493 microversion: 2.1 time: 0.627990 Oct 02 01:19:42.939730 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2107/4359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:42 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1493 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:43.166994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:43.180131 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2d67b5e-d792-4ec4-a2bf-51330a326eca tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.338315 Oct 02 01:19:43.181324 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2253/4360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:42 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:43.978519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:43.979159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:43.988469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:43.989245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:43.989973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:43.990920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:43.991527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:43.992100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:44.154336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-71e7574f-597a-4e1f-b142-b49c81727ac6 req-74e86ff0-461a-4afa-b622-4b67a446d7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19dbd236-4878-4e8f-876b-4bb16c9b85b0", "name": "network-vif-deleted", "tag": "05552769-9647-44a3-b4b1-cc20d94caa6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:44.192306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-71e7574f-597a-4e1f-b142-b49c81727ac6 req-74e86ff0-461a-4afa-b622-4b67a446d7ef service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:44.214244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-71e7574f-597a-4e1f-b142-b49c81727ac6 req-74e86ff0-461a-4afa-b622-4b67a446d7ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:44.214725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-71e7574f-597a-4e1f-b142-b49c81727ac6 req-74e86ff0-461a-4afa-b622-4b67a446d7ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:44.263604 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-71e7574f-597a-4e1f-b142-b49c81727ac6 req-74e86ff0-461a-4afa-b622-4b67a446d7ef service nova] Creating event network-vif-deleted:05552769-9647-44a3-b4b1-cc20d94caa6a for instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 on n-h1-master-1 Oct 02 01:19:44.275926 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-71e7574f-597a-4e1f-b142-b49c81727ac6 req-74e86ff0-461a-4afa-b622-4b67a446d7ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133356 Oct 02 01:19:44.276471 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2254/4361] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:44.287599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:44.288711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:44.312136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:44.312928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:44.313570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:44.314611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:44.315530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:44.317975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:44.607177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:44.624978 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-986b508b-2498-412b-a328-b01e83f03764 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 200 len: 1451 microversion: 2.1 time: 0.662077 Oct 02 01:19:44.627206 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2108/4362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:43 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 1451 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:44.905681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:44.915683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b52ae355-ebd1-4fa8-9a9e-8a4a77e38aed tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1508 microversion: 2.1 time: 0.637583 Oct 02 01:19:44.933123 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2255/4363] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:44 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:45.655042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:45.656361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: 19dbd236-4878-4e8f-876b-4bb16c9b85b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:45.677297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.678158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.678872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.679804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.681312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.682013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.725791 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] HTTP exception thrown: Instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 could not be found. Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Request method failure captured: Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 HTTP/1.1 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOT6gW7rlIk-9rX_5-b5ogCPdC94Eyl0z_CXfm7qjUJgyqXdBk9mBUdttaS2TdoFE_maRTEu5RRM8w8xTEQHiUzzNyvele3PYsNuSEFaOQ3TMcDW01hxRS9txDCZGCvJELjw4ZjwbGv5I0UZHc3bk6PZIu6-rfQ2OPZwH17Q5bkhC1U Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c94ca45e7684b3c818871e232e08342"}]}] Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66a9d6a142d444be90b2101f23603522 Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 could not be found. Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '19dbd236-4878-4e8f-876b-4bb16c9b85b0'} Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 could not be found. Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 could not be found. Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:45.727766 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 could not be found. Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Returning 404 to user: Instance 19dbd236-4878-4e8f-876b-4bb16c9b85b0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2a7d239-03b3-4f2a-9efb-58c11c58bc8e tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0" status: 404 len: 111 microversion: 2.1 time: 0.079343 Oct 02 01:19:45.731409 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2109/4364] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:45 2022] GET /compute/v2.1/servers/19dbd236-4878-4e8f-876b-4bb16c9b85b0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:45.740794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:45.741703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:45.766765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.772216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.773072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.774924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.775599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.778405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.888487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:45.944160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:45.945286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:45.957732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.979603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.980147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.983840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.984332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.984804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:46.130882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ead93be4-f159-440a-a4cd-9da1feae8738 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 204 len: 0 microversion: 2.1 time: 0.396170 Oct 02 01:19:46.135344 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2256/4365] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:45 2022] DELETE /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:19:46.148532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:46.152257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:46.167055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:46.170940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:46.171723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:46.172662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:46.175535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:46.176515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:46.712344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:46.738551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-19af76e3-73c3-49fe-8095-6453dcad59ae tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1529 microversion: 2.1 time: 0.798575 Oct 02 01:19:46.739823 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2110/4366] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:45 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1529 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:46.913979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:46.930042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96508644-53e4-40f6-b54d-2ab0c503d873 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1673 microversion: 2.1 time: 0.792158 Oct 02 01:19:46.930901 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2257/4367] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:46 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1673 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:47.124455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3fdfc26-cc96-4251-bb69-3c5194052776 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: .version_select at 0x7fb88142fc10>, body: {"keypair": {"name": "tempest-keypair-294640462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmT19ApjcLo279jMr9PsqCLEPd9jsAkMqsVYs7vDS/jvQAnNjM8G2TdsFsHvwu4nCmB8MXVv1k0u3Xb9iJUTR+2wr0J7gnQXYIkiQlvHkl4NNOUkFUAns6Bu7TbGMffgg=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:47.178810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-c3fdfc26-cc96-4251-bb69-3c5194052776 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for project e8ab6dbed6cd4a09989164757910b06b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:19:47.192586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-c3fdfc26-cc96-4251-bb69-3c5194052776 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for user fe1fa0967b8444279e5bad164b635df5 and project e8ab6dbed6cd4a09989164757910b06b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:19:47.248190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3fdfc26-cc96-4251-bb69-3c5194052776 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.379545 Oct 02 01:19:47.249310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2111/4368] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:19:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:19:47.770112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:47.771140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:47.798100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:47.800943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:47.806900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:47.808412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:47.809431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:47.810025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:47.965003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:47.966368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:47.988580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:47.993091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:47.993675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:47.994457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:47.994956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:47.997429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:48.623577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:48.641463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a15a8898-9ed1-40aa-bf13-4b7c4cd63198 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1673 microversion: 2.1 time: 0.683022 Oct 02 01:19:48.645373 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2112/4369] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:47 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1673 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:49.069179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:49.089698 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7e72840-494c-434e-8b04-65d088d0461f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1529 microversion: 2.1 time: 1.319217 Oct 02 01:19:49.091264 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2258/4370] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:47 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1529 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:49.668820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:49.670114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:49.682399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:49.687833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:49.688765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:49.690347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:49.691242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:49.695286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:50.131558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:50.136676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:50.154285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:50.155128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:50.155757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:50.158135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:50.159266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:50.159913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:51.467073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:51.479816 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17f6f501-8b58-4ddb-9ce6-e6a39b46d3a9 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1673 microversion: 2.1 time: 1.815394 Oct 02 01:19:51.483590 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2113/4371] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:49 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1673 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:51.494325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-08e9f39f-cffa-4a1d-8cc8-c55310b46d4d req-a23f2c4f-21fd-4057-8791-e85df3dde2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3d770d-5fec-4f82-a338-dccca2220efd", "name": "network-vif-plugged", "status": "completed", "tag": "ce30d689-65d4-47bf-97e7-da530c835660"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:51.529262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-08e9f39f-cffa-4a1d-8cc8-c55310b46d4d req-a23f2c4f-21fd-4057-8791-e85df3dde2c1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:51.529929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-08e9f39f-cffa-4a1d-8cc8-c55310b46d4d req-a23f2c4f-21fd-4057-8791-e85df3dde2c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:51.532483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-08e9f39f-cffa-4a1d-8cc8-c55310b46d4d req-a23f2c4f-21fd-4057-8791-e85df3dde2c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:51.560803 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-08e9f39f-cffa-4a1d-8cc8-c55310b46d4d req-a23f2c4f-21fd-4057-8791-e85df3dde2c1 service nova] Creating event network-vif-plugged:ce30d689-65d4-47bf-97e7-da530c835660 for instance 9f3d770d-5fec-4f82-a338-dccca2220efd on n-h2-master-1 Oct 02 01:19:51.578430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-08e9f39f-cffa-4a1d-8cc8-c55310b46d4d req-a23f2c4f-21fd-4057-8791-e85df3dde2c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093190 Oct 02 01:19:51.584803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2114/4372] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:51.657867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:51.668436 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9683e09f-c3c7-49d7-829f-6382de998010 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 1.552307 Oct 02 01:19:51.696271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2259/4373] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:50 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:51.759417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-286aa52d-3f09-4702-b04c-bccb298c2685 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: .version_select at 0x7fb88566e790>, body: {"keypair": {"name": "tempest-keypair-1408936052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4TEAPKl18r3QfY+zzIQPCljrzLek9FX/X3E/UCHfNHEPUwyQ9HhiRpQPJi81cR8E4jnrH9tmN2fbh1mU6EHzTamz699Cjonie9gKk4ISw/lhbnkvUu04LoolDf2ZLqTA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:51.795134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-286aa52d-3f09-4702-b04c-bccb298c2685 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:19:51.812010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-286aa52d-3f09-4702-b04c-bccb298c2685 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:19:51.867177 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-286aa52d-3f09-4702-b04c-bccb298c2685 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276904 Oct 02 01:19:51.868281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2115/4374] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:19:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:52.515381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:52.516448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:52.531695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:52.532777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:52.534400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:52.535732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:52.536435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:52.537036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:52.708237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:52.709823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:52.740655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:52.742481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:52.743227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:52.747213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:52.749851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:52.752634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:52.805853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:52.820867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-975848ca-3585-40a0-8681-a1bac9ae4aff tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1607 microversion: 2.1 time: 0.311003 Oct 02 01:19:52.826041 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2260/4375] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:52 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1607 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:53.136936 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1950631466", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f231159f-832c-40c6-b7e8-23936037e5a1"}], "security_groups": [{"name": "tempest-securitygroup--1946071294"}], "key_name": "tempest-keypair-294640462", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:53.353921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:53.364012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c22bed9-288b-4327-be6a-cc150a076d06 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.662574 Oct 02 01:19:53.368906 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2116/4376] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:52 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:53.857745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:53.859128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:53.879335 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:53.883099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:53.885977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:53.886424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:53.887176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:53.887634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:53.888057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:54.069884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:54.080351 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-31f9c838-5306-4989-8e39-a0488af73f9b tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1607 microversion: 2.1 time: 0.230633 Oct 02 01:19:54.085057 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2117/4377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:53 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1607 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:54.394419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:54.394990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:54.406248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:54.408784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:54.409499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:54.410548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:54.415452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:54.417055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:54.466428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] validate_networks() for [('f231159f-832c-40c6-b7e8-23936037e5a1', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:19:55.598779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:55.608878 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2316fcd2-77a3-4585-9b1e-cdc57bdb10b0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 1.219703 Oct 02 01:19:55.611591 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2118/4378] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:54 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:19:55.622159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:55.625361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:55.638588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:55.641429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:55.644361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:55.645465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:55.647715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:55.648337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:55.926335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a9d6a142d444be90b2101f23603522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94ca45e7684b3c818871e232e08342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:55.956112 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6fc6e830-4ebe-4800-8319-9b31c005d92c tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 200 len: 1607 microversion: 2.1 time: 0.341000 Oct 02 01:19:55.959099 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2119/4379] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:55 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 1607 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:55.984330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-46a496cb-9169-430e-987d-9cafb620b3f5 req-d8a96c3e-160a-4daf-bacd-309047370e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd51543d-0b1d-4fad-b37e-d19599b55292", "name": "network-vif-deleted", "tag": "2e82a448-5f10-493e-ade0-7576a1a2a518"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:56.045707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-46a496cb-9169-430e-987d-9cafb620b3f5 req-d8a96c3e-160a-4daf-bacd-309047370e03 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.047183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-46a496cb-9169-430e-987d-9cafb620b3f5 req-d8a96c3e-160a-4daf-bacd-309047370e03 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.048289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-46a496cb-9169-430e-987d-9cafb620b3f5 req-d8a96c3e-160a-4daf-bacd-309047370e03 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.065250 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-46a496cb-9169-430e-987d-9cafb620b3f5 req-d8a96c3e-160a-4daf-bacd-309047370e03 service nova] Creating event network-vif-deleted:2e82a448-5f10-493e-ade0-7576a1a2a518 for instance dd51543d-0b1d-4fad-b37e-d19599b55292 on n-h2-master-1 Oct 02 01:19:56.073197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-46a496cb-9169-430e-987d-9cafb620b3f5 req-d8a96c3e-160a-4daf-bacd-309047370e03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110335 Oct 02 01:19:56.074493 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2120/4380] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:56.276273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:19:56.276724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:19:56.277395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:19:56.277838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:19:56.278451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:19:56.321452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.323964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.324358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.333737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.334281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.353910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.507235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for project e8ab6dbed6cd4a09989164757910b06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:19:56.544381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for user fe1fa0967b8444279e5bad164b635df5 and project e8ab6dbed6cd4a09989164757910b06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:19:56.634113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:56.635708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:56.664684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.675665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.676261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.680987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:19:56.685280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:19:56.686309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.691637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.695838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.965825 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc4674f3-b744-44db-b5f2-7118e2dc3df3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.834403 Oct 02 01:19:56.975573 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2261/4381] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:19:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:19:56.998667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:57.005330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] [instance: dd51543d-0b1d-4fad-b37e-d19599b55292] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:57.023443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:57.023558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:57.023907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:57.024928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:57.025406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:57.025837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:57.065332 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] HTTP exception thrown: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 could not be found. Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Request method failure captured: Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 HTTP/1.1 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOT6gW7rlIk-9rX_5-b5ogCPdC94Eyl0z_CXfm7qjUJgyqXdBk9mBUdttaS2TdoFE_maRTEu5RRM8w8xTEQHiUzzNyvele3PYsNuSEFaOQ3TMcDW01hxRS9txDCZGCvJELjw4ZjwbGv5I0UZHc3bk6PZIu6-rfQ2OPZwH17Q5bkhC1U Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c94ca45e7684b3c818871e232e08342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c94ca45e7684b3c818871e232e08342"}]}] Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 3c94ca45e7684b3c818871e232e08342 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerActionsTestJSON-1980976748 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 66a9d6a142d444be90b2101f23603522 Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerActionsTestJSON-1980976748-project Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: exception: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 could not be found. Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'dd51543d-0b1d-4fad-b37e-d19599b55292'} Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 could not be found. Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 could not be found. Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:19:57.067047 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 could not be found. Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Returning 404 to user: Instance dd51543d-0b1d-4fad-b37e-d19599b55292 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:19:57.070724 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ee587779-bcd1-4977-a343-2562f0a3048a tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292" status: 404 len: 111 microversion: 2.1 time: 0.085695 Oct 02 01:19:57.074171 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2262/4382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:56 2022] GET /compute/v2.1/servers/dd51543d-0b1d-4fad-b37e-d19599b55292 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:57.085466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13cad5e6-8b01-46ec-a690-be96e3151dc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:57.085980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13cad5e6-8b01-46ec-a690-be96e3151dc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:57.115672 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:57.872265 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13cad5e6-8b01-46ec-a690-be96e3151dc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:57.884878 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13cad5e6-8b01-46ec-a690-be96e3151dc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1237 microversion: 2.1 time: 0.809429 Oct 02 01:19:57.894660 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2263/4383] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:57 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1237 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:57.906159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-270f0db0-e495-41cf-9568-2e8fc1b2bd92 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] Calling method '.version_select at 0x7fb8812044c0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:58.019366 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-270f0db0-e495-41cf-9568-2e8fc1b2bd92 tempest-ServerActionsTestJSON-1980976748 tempest-ServerActionsTestJSON-1980976748-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315291376" status: 202 len: 0 microversion: 2.1 time: 0.121996 Oct 02 01:19:58.022429 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2264/4384] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:19:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315291376 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:19:58.554378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a6b796bd-b798-489c-b3e8-418eea79f9df tempest-ComputeTenantNetworksTest-1736371029 tempest-ComputeTenantNetworksTest-1736371029-project] Calling method '.version_select at 0x7fb8807dba60>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:58.950397 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a6b796bd-b798-489c-b3e8-418eea79f9df tempest-ComputeTenantNetworksTest-1736371029 tempest-ComputeTenantNetworksTest-1736371029-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.836851 Oct 02 01:19:58.951030 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2265/4385] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:19:58 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:58.957035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-621848498", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d59648e8-d54a-41ca-842c-4437e3a4d0f9"}], "security_groups": [{"name": "tempest-securitygroup--1758079732"}], "key_name": "tempest-keypair-1408936052", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:59.624786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] validate_networks() for [('d59648e8-d54a-41ca-842c-4437e3a4d0f9', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:19:59.729204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:59.740728 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70bf43d1-266c-4a4e-8dd9-7e7d2ac09466 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 3.110850 Oct 02 01:19:59.743472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2121/4386] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:56 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 3114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:59.763565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:59.764454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:59.778346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:59.780512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:59.782726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:59.784626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:59.785265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:59.786876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:59.998456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:00.026048 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-34b77d00-a66a-45c6-81ab-a0f12b4db28d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1295 microversion: 2.1 time: 0.278334 Oct 02 01:20:00.026689 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2122/4387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:59 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1295 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:00.112155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1827ec3c-0741-4739-9a1b-3ecb2d1361d6 tempest-ComputeTenantNetworksTest-1736371029 tempest-ComputeTenantNetworksTest-1736371029-project] Calling method '.version_select at 0x7fb8816d5ee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:00.306901 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1827ec3c-0741-4739-9a1b-3ecb2d1361d6 tempest-ComputeTenantNetworksTest-1736371029 tempest-ComputeTenantNetworksTest-1736371029-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/ba481800-a4d8-47de-9c15-d157f6d2cf9e" status: 200 len: 140 microversion: 2.1 time: 0.248848 Oct 02 01:20:00.308115 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2123/4388] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:20:00 2022] GET /compute/v2.1/os-tenant-networks/ba481800-a4d8-47de-9c15-d157f6d2cf9e => generated 140 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:00.769649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:00.771145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:00.778907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:00.779650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:00.780269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:00.782320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:00.782988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:00.783573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.180269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:01.209576 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdaf923a-5d35-4ce1-9a86-9c976eb8dbd5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.447250 Oct 02 01:20:01.236602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2124/4389] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:00 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:01.253403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:01.254044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:01.276370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:01.279001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:01.283444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.284374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:01.285002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:01.285589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.430844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:01.444628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e5544570-7bcc-4a47-8d1e-47401783ff9c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1295 microversion: 2.1 time: 0.206683 Oct 02 01:20:01.445686 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2125/4390] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:01 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1295 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:01.634686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:20:01.635174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:20:01.635961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:20:01.636446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:20:01.636875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:20:01.654864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:01.655379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:01.660640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.661463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:01.661946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:01.662383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.717761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:20:01.729989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:20:01.766743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:20:01.771769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:20:01.876706 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9a307bc-9807-4b42-995c-8fdde1192742 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.924216 Oct 02 01:20:01.878084 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2266/4391] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:19:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:20:01.889447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58f7b624-312f-41b8-a8f3-837bc23fa6c6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:01.894666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58f7b624-312f-41b8-a8f3-837bc23fa6c6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:01.901747 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:02.244236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:02.245246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:02.251333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58f7b624-312f-41b8-a8f3-837bc23fa6c6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:02.264102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58f7b624-312f-41b8-a8f3-837bc23fa6c6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1241 microversion: 2.1 time: 0.378913 Oct 02 01:20:02.264818 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2126/4392] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:01 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1241 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:02.279856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:02.282163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:02.284396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:02.286713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:02.294644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:02.295504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:02.475913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:02.478087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:02.497059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:02.497809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:02.502198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:02.504207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:02.508913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:02.513990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:02.574475 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:02.907308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:02.928808 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e68277c4-d9fc-47f1-93ec-803ce766f872 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.688876 Oct 02 01:20:02.943393 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2267/4393] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:02 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:03.075336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:03.089787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b7f8cb7-e738-4b98-9fbd-84fa41840ff4 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 0.618659 Oct 02 01:20:03.099308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2127/4394] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:02 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:03.288422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:03.289054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:03.307730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:03.308127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:03.308814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:03.309837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:03.310522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:03.311186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:03.444674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:03.456125 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5b188239-7caf-4e00-ab0b-2183ed13d0f5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1237 microversion: 2.1 time: 0.171700 Oct 02 01:20:03.457975 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2268/4395] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:03 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1237 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:03.999350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:04.002188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:04.020976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:04.022235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:04.022948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:04.024074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:04.025097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:04.025896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:04.123538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:04.124375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:04.142434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:04.144062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:04.144527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:04.149211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:04.149738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:04.151255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:05.064787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:05.107742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de566d17-8955-4c1f-9891-17f9698f6328 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 1.139904 Oct 02 01:20:05.112432 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2128/4396] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:03 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:05.122815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:05.126621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:05.146964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:05.147743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:05.148461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:05.149586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:05.150235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:05.153885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:05.329743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:05.357276 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d94a8d85-d104-4412-8be7-8f2764254937 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1299 microversion: 2.1 time: 0.243112 Oct 02 01:20:05.391829 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2129/4397] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:05 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1299 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:05.479729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:05.490649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9605f710-b643-4e02-9364-9a1c828ac1f2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 1.371057 Oct 02 01:20:05.496185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2269/4398] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:04 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:05.812580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48313d2d-b937-44a1-bb43-b908e94a038d tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Action: 'create', calling method: .version_select at 0x7fb8811839d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-356032624"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:06.135170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:06.135971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:06.154679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.155495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.156124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.157007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.157617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.158198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.532097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:06.548222 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc356283-9ce6-4fc9-afa0-54811a4f1b5f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.416584 Oct 02 01:20:06.567358 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2270/4399] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:06 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:06.572562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:06.573180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:06.590933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.594156 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48313d2d-b937-44a1-bb43-b908e94a038d tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.145548 Oct 02 01:20:06.597690 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2130/4400] 10.222.0.23 () {60 vars in 1155 bytes} [Sun Oct 2 01:20:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1151 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 02 01:20:06.598786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.599269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.600020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.600486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.600922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.611038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:06.611675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:06.634927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.635351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.635794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.636508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.647353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.647816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:07.638742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:07.653489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-120046ec-e186-4365-a256-f22eb3bab07d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 1.051008 Oct 02 01:20:07.654556 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2131/4401] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:06 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:07.665212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11042710-9163-477b-a81f-9dc2b8f628d7 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb88083d3a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:07.720875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:07.765451 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d9e4433-b15a-441c-b42f-c5daa7d3475d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 1.196656 Oct 02 01:20:07.769929 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2271/4402] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:06 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:07.784933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a921d82d-3521-47a3-9c8a-404e66b5c67b req-7fffb242-e978-407f-9e78-cb1e34dbab4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fcb084b-b447-445b-8204-c2fd6ccb1a51", "tag": "7693d4a5-e295-4578-b67a-11e78e1e1e87"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:07.820953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a921d82d-3521-47a3-9c8a-404e66b5c67b req-7fffb242-e978-407f-9e78-cb1e34dbab4e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:07.822461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a921d82d-3521-47a3-9c8a-404e66b5c67b req-7fffb242-e978-407f-9e78-cb1e34dbab4e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:07.823244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a921d82d-3521-47a3-9c8a-404e66b5c67b req-7fffb242-e978-407f-9e78-cb1e34dbab4e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:07.823528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11042710-9163-477b-a81f-9dc2b8f628d7 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 200 len: 344 microversion: 2.1 time: 0.164894 Oct 02 01:20:07.833447 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2132/4403] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:07 2022] GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:07.838045 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a921d82d-3521-47a3-9c8a-404e66b5c67b req-7fffb242-e978-407f-9e78-cb1e34dbab4e service nova] Creating event network-changed:7693d4a5-e295-4578-b67a-11e78e1e1e87 for instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 on n-h1-master-1 Oct 02 01:20:07.841025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:07.842956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:07.847373 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a921d82d-3521-47a3-9c8a-404e66b5c67b req-7fffb242-e978-407f-9e78-cb1e34dbab4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075846 Oct 02 01:20:07.848678 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2272/4404] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:07.864328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:07.865255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:07.865849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:07.866809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:07.867429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:07.868012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:08.523502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:08.533637 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85216d85-730e-4e0f-a18d-aef483068eeb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.698829 Oct 02 01:20:08.552861 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2133/4405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:07 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:08.679491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:08.680434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:08.697530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:08.698331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:08.699954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:08.700693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:08.701312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:08.704992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:08.766225 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:08.800570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:08.801186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:08.814418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:08.815421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:08.816041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:08.816914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:08.817523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:08.818102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:09.290291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:09.305082 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-437c5a5d-4be0-479b-965f-a58873319474 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.509597 Oct 02 01:20:09.305702 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2134/4406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:08 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:09.330307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9d2121b-a359-4da7-aa2b-05035001eb4c tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881183430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:09.347858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:09.358706 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e81c9484-2cb7-4824-88b9-7318bf962ca5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 0.684079 Oct 02 01:20:09.362895 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2273/4407] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:08 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:09.413367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9d2121b-a359-4da7-aa2b-05035001eb4c tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 200 len: 345 microversion: 2.1 time: 0.086623 Oct 02 01:20:09.418760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2135/4408] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:09 2022] GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:09.434075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cf3b1daa-1ae6-443c-a7af-06667aab1b57 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Action: 'create', calling method: .version_select at 0x7fb881129310>, body: {"snapshot": {"volume_id": "02e7ac33-6d67-4bfb-bb84-8dc039b1aded", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-337284467"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:09.565268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:09.566227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:09.579086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:09.581746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:09.582394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:09.583359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:09.586181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:09.586969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:09.848661 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cf3b1daa-1ae6-443c-a7af-06667aab1b57 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.421946 Oct 02 01:20:09.849922 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2274/4409] 10.222.0.23 () {60 vars in 1162 bytes} [Sun Oct 2 01:20:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:09.861916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac8e47d8-85cb-4148-ab7b-c39c983e0fa4 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb88150e790>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:10.027798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac8e47d8-85cb-4148-ab7b-c39c983e0fa4 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 286 microversion: 2.1 time: 0.170744 Oct 02 01:20:10.028660 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2275/4410] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:09 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:20:10.040642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dd60c72d-0d29-44c0-9dd4-81a3c8394080 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881353670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:10.149934 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dd60c72d-0d29-44c0-9dd4-81a3c8394080 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.113455 Oct 02 01:20:10.150916 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2276/4411] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 2 01:20:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:10.164097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd362f18-6662-4188-969e-2fd532543bdc tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb8816ce310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:10.239532 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd362f18-6662-4188-969e-2fd532543bdc tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 286 microversion: 2.1 time: 0.079251 Oct 02 01:20:10.240136 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2277/4412] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:10 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:20:10.329367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:10.330274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:10.338523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:10.338972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:10.339414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:10.340120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:10.340581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:10.341014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:10.700946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:10.709143 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f90600e-abf5-424f-be31-855fd7bf25d2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 1.149089 Oct 02 01:20:10.709735 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2136/4413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:09 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:10.723978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:10.724587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:10.737750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:10.738256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:10.738748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:10.739462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:10.739917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:10.740343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:10.949014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:10.966108 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d7ac7cd3-8e85-4ffa-8e54-9e8c2b5cd349 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.641175 Oct 02 01:20:10.967085 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2278/4414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:10 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:11.144404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:11.153755 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67c0c0b4-646d-483f-80fe-c75945fedc26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 0.442949 Oct 02 01:20:11.154352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2137/4415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:10 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:11.254509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c893f5d-02f7-4a58-ab76-513eb9ff6a34 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb88166baf0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:11.308340 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c893f5d-02f7-4a58-ab76-513eb9ff6a34 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 286 microversion: 2.1 time: 0.057992 Oct 02 01:20:11.317257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2279/4416] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:11 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:11.485993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-62401609-43bc-4d99-a9ea-cb623265962c req-a6d65ed2-9780-4693-901d-eec28ab0663a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7689d920-d346-41ba-8221-5fc1b39eb664", "tag": "5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:11.511286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-62401609-43bc-4d99-a9ea-cb623265962c req-a6d65ed2-9780-4693-901d-eec28ab0663a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:11.512094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-62401609-43bc-4d99-a9ea-cb623265962c req-a6d65ed2-9780-4693-901d-eec28ab0663a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:11.512691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-62401609-43bc-4d99-a9ea-cb623265962c req-a6d65ed2-9780-4693-901d-eec28ab0663a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:11.534304 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-62401609-43bc-4d99-a9ea-cb623265962c req-a6d65ed2-9780-4693-901d-eec28ab0663a service nova] Creating event network-changed:5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d for instance 7689d920-d346-41ba-8221-5fc1b39eb664 on n-h2-master-1 Oct 02 01:20:11.543261 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-62401609-43bc-4d99-a9ea-cb623265962c req-a6d65ed2-9780-4693-901d-eec28ab0663a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061449 Oct 02 01:20:11.550680 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2138/4417] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:20:11.733691 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:11.738118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:11.738771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:11.750917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:11.751417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:11.751862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:11.766877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:11.767486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:11.768113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:11.768760 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:12.011841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:12.012659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:12.041315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:12.044848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:12.046144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:12.055900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:12.059271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:12.060020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:12.259587 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:12.570026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:12.582962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8644f397-f744-4ed5-a3b6-8507c0fd8f52 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.851213 Oct 02 01:20:12.598659 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2280/4418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:11 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:12.600995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:12.602253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:12.616467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:12.618427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:12.620898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:12.623055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:12.624618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:12.625382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:12.771378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:12.783602 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39f8b4c8-d154-4c3c-a0fb-46a27a606884 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.785079 Oct 02 01:20:12.786922 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2139/4419] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:11 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:12.792546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91aacd62-bf49-485b-b784-bed72e7d83db tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb885566280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:12.839370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-91aacd62-bf49-485b-b784-bed72e7d83db tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 287 microversion: 2.1 time: 0.051059 Oct 02 01:20:12.840582 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2140/4420] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:12 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:12.854666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f9f364e-f1b1-40f8-a921-513edd022e4a tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb88113d940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:12.993881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f9f364e-f1b1-40f8-a921-513edd022e4a tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 202 len: 0 microversion: 2.1 time: 0.144754 Oct 02 01:20:12.994482 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2141/4421] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:20:12 2022] DELETE /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:20:13.004928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5766bf32-541f-4478-8729-17ffcca771bd tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881525820>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:13.059064 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5766bf32-541f-4478-8729-17ffcca771bd tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 286 microversion: 2.1 time: 0.057773 Oct 02 01:20:13.066071 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2142/4422] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:13 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:13.279010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:13.290747 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0832d61e-b119-4aa9-94b6-409af6e58c77 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 0.702327 Oct 02 01:20:13.315054 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2281/4423] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:12 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:13.614708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:13.615338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:13.627437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:13.627945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:13.628687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:13.629453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:13.629926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:13.630457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:13.812434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:13.813120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:13.828003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:13.828507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:13.832195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:13.832920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:13.833411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:13.833856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:14.068544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:14.083389 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b1cc446-f3c2-4984-82fe-065ee0a11704 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1524 microversion: 2.1 time: 0.472620 Oct 02 01:20:14.085421 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2143/4424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:13 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1524 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:14.094569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81cb1d57-1191-45c3-823c-d00d52240089 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb88111bc10>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:14.146000 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81cb1d57-1191-45c3-823c-d00d52240089 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 286 microversion: 2.1 time: 0.055681 Oct 02 01:20:14.147342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2144/4425] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:14 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:14.167480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:14.180007 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae5febd7-937a-4d0c-b703-22f28811e319 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.370340 Oct 02 01:20:14.180773 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2282/4426] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:13 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:14.320619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:14.321740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:14.331891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:14.333691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:14.335834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:14.338437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:14.339150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:14.339749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:14.912565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:14.950274 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81836920-2803-4146-b4b6-3fae52fdeb93 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 0.633415 Oct 02 01:20:14.953358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2145/4427] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:14 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:15.107055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:15.108366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:15.126764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.127267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.127705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.129514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.130146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.130584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.159556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2dc9bf2d-7543-4228-b384-73d992f6060e tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881496310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:15.232402 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2dc9bf2d-7543-4228-b384-73d992f6060e tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 200 len: 286 microversion: 2.1 time: 0.077081 Oct 02 01:20:15.233035 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2146/4428] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:15 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:15.241922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:15.243042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:15.259990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.264247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.265339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.269017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.269681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.270678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.803460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:15.815913 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80a55cf7-8c1b-4f52-b433-54be16dd003b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1506 microversion: 2.1 time: 0.712839 Oct 02 01:20:15.817612 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2283/4429] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:15 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1506 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:15.903609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:15.918881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-03192fea-2106-4f87-8f02-f530c363b3ff tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.684486 Oct 02 01:20:15.919498 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2147/4430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:15 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:15.979618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:15.980357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:15.989246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.990097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.990792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.992081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.993006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.993643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:16.160174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-70efe165-126e-486d-ba01-6466f88a54eb req-e24a968a-0e52-41e7-9fc4-3fa527390086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fcb084b-b447-445b-8204-c2fd6ccb1a51", "name": "network-vif-plugged", "status": "completed", "tag": "7693d4a5-e295-4578-b67a-11e78e1e1e87"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:16.183390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-70efe165-126e-486d-ba01-6466f88a54eb req-e24a968a-0e52-41e7-9fc4-3fa527390086 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:16.184361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-70efe165-126e-486d-ba01-6466f88a54eb req-e24a968a-0e52-41e7-9fc4-3fa527390086 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:16.186069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-70efe165-126e-486d-ba01-6466f88a54eb req-e24a968a-0e52-41e7-9fc4-3fa527390086 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:16.216320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-70efe165-126e-486d-ba01-6466f88a54eb req-e24a968a-0e52-41e7-9fc4-3fa527390086 service nova] Creating event network-vif-plugged:7693d4a5-e295-4578-b67a-11e78e1e1e87 for instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 on n-h1-master-1 Oct 02 01:20:16.222189 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-70efe165-126e-486d-ba01-6466f88a54eb req-e24a968a-0e52-41e7-9fc4-3fa527390086 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066633 Oct 02 01:20:16.229694 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2148/4431] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:16.246133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51be6135-c57f-4726-a228-b265fab5e6a2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb88234c1f0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:16.288399 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-51be6135-c57f-4726-a228-b265fab5e6a2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] HTTP exception thrown: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51be6135-c57f-4726-a228-b265fab5e6a2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Request method failure captured: Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 HTTP/1.1 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOdFT_qk1cvM5c5vEHzzabVD1PMIeBGnhDERqyP9jH1Mht74ule0fauhvSz_iuJv86W4aKxtokqVn7nggZ48U7LOIYjNsneOIjSTY17s3wUGwDxEzvs8DTwco63gp1ebIe4itUT0CF69UQuOdc4mw84IQJVG6km5TbYyu12X6SoFrRQ Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9d8ef80beda48cf95e02545177abc11"}]}] Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: d5d496f6ab8d4844908672038999257c Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: exception: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '34d34a9d-2696-4afe-b6a5-5201c3749a54'} Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. (HTTP 404) (Request-ID: req-4892c96b-64ef-4bdf-9e92-20f42718f0ba) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:20:16.295617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. Oct 02 01:20:16.299901 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:16.305000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51be6135-c57f-4726-a228-b265fab5e6a2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Returning 404 to user: Snapshot 34d34a9d-2696-4afe-b6a5-5201c3749a54 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:16.306111 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-51be6135-c57f-4726-a228-b265fab5e6a2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54" status: 404 len: 111 microversion: 2.1 time: 0.064535 Oct 02 01:20:16.311031 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2149/4432] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:20:16 2022] GET /compute/v2.1/os-snapshots/34d34a9d-2696-4afe-b6a5-5201c3749a54 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:20:16.324105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-30777bac-71d8-4d65-9081-6a761ed1784e tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881316430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:16.449504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-30777bac-71d8-4d65-9081-6a761ed1784e tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 202 len: 0 microversion: 2.1 time: 0.137189 Oct 02 01:20:16.451624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2150/4433] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:20:16 2022] DELETE /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:20:16.460136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ea891d6-124f-4bc9-a375-6eb71540dd5e tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb8817ce040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:16.585697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ea891d6-124f-4bc9-a375-6eb71540dd5e tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 200 len: 344 microversion: 2.1 time: 0.129976 Oct 02 01:20:16.587325 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2151/4434] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:16 2022] GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:16.843939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:16.845698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:16.860186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:16.861853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:16.863357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:16.865673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:16.868339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:16.868932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:17.127738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:17.144260 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36ae6888-97fe-4202-b508-390c1ae0fa09 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1363 microversion: 2.1 time: 1.171532 Oct 02 01:20:17.159419 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2284/4435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:15 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1363 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:17.167704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:17.168625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:17.178089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:17.179011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:17.181718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:17.183174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:17.185275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:17.186722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:17.763424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:17.771191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:17.774621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa1768db-057b-4092-a034-ae41ca771a25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.612172 Oct 02 01:20:17.776942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2285/4436] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:17 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:17.783667 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b93da840-2be9-4e19-aeac-d7073731a5c6 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1506 microversion: 2.1 time: 0.944883 Oct 02 01:20:17.784266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2152/4437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:16 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1506 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:17.807324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9df86416-943d-4374-a3f7-66969e16f261 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb880841310>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:17.951477 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9df86416-943d-4374-a3f7-66969e16f261 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 200 len: 344 microversion: 2.1 time: 0.172726 Oct 02 01:20:17.952435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2286/4438] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:17 2022] GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:18.172042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:18.172838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:18.180471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.181189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.182059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.184179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.185349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.185995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.413647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:18.432916 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-625a79c7-a871-4772-add0-972e074d26b5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1549 microversion: 2.1 time: 0.265510 Oct 02 01:20:18.433408 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2153/4439] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:18 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:18.462042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:18.462631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:18.478850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.482020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.482680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.484423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.487053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.487956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.679114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-86ddc2c7-19a9-424b-8564-665ca4cfd569 req-8e7c39d1-fa48-4e5f-96a2-f2bb62852766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7689d920-d346-41ba-8221-5fc1b39eb664", "name": "network-vif-plugged", "status": "completed", "tag": "5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:18.687507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1e0c5b9-aed2-425d-bba7-9873378bf97f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231542 Oct 02 01:20:18.689439 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2287/4440] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:20:18 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:18.706860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-86ddc2c7-19a9-424b-8564-665ca4cfd569 req-8e7c39d1-fa48-4e5f-96a2-f2bb62852766 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.707325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-86ddc2c7-19a9-424b-8564-665ca4cfd569 req-8e7c39d1-fa48-4e5f-96a2-f2bb62852766 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.709645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-86ddc2c7-19a9-424b-8564-665ca4cfd569 req-8e7c39d1-fa48-4e5f-96a2-f2bb62852766 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.750957 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-86ddc2c7-19a9-424b-8564-665ca4cfd569 req-8e7c39d1-fa48-4e5f-96a2-f2bb62852766 service nova] Creating event network-vif-plugged:5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d for instance 7689d920-d346-41ba-8221-5fc1b39eb664 on n-h2-master-1 Oct 02 01:20:18.779637 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-86ddc2c7-19a9-424b-8564-665ca4cfd569 req-8e7c39d1-fa48-4e5f-96a2-f2bb62852766 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114780 Oct 02 01:20:18.785613 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2154/4441] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:18.806513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:18.807381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:18.813991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:18.818776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:18.830946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.832220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.833553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.833676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.834303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.835398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.835576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.836150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.836425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.836622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.837060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.837559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:19.834109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:19.845768 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2c5ba07-8418-442b-ad63-716e304a3223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1506 microversion: 2.1 time: 1.039669 Oct 02 01:20:19.846401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2155/4442] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:18 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1506 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:19.851576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b11a37da-91ca-484a-b07c-5868e52091cf tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb8811513a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:19.917792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:19.963837 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9430efb4-c37a-49f8-a4cf-b10cd22e9077 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 1.161621 Oct 02 01:20:19.965394 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2288/4443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:18 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:19.981355 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b11a37da-91ca-484a-b07c-5868e52091cf tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] HTTP exception thrown: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b11a37da-91ca-484a-b07c-5868e52091cf tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Request method failure captured: Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded HTTP/1.1 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOdFT_qk1cvM5c5vEHzzabVD1PMIeBGnhDERqyP9jH1Mht74ule0fauhvSz_iuJv86W4aKxtokqVn7nggZ48U7LOIYjNsneOIjSTY17s3wUGwDxEzvs8DTwco63gp1ebIe4itUT0CF69UQuOdc4mw84IQJVG6km5TbYyu12X6SoFrRQ Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9d8ef80beda48cf95e02545177abc11"}]}] Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: d5d496f6ab8d4844908672038999257c Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: exception: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '02e7ac33-6d67-4bfb-bb84-8dc039b1aded'} Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. (HTTP 404) (Request-ID: req-57d9860e-1c31-402a-9d25-36737d76d1f4) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:20:19.986378 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b11a37da-91ca-484a-b07c-5868e52091cf tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Returning 404 to user: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:19.990737 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b11a37da-91ca-484a-b07c-5868e52091cf tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 404 len: 109 microversion: 2.1 time: 0.140333 Oct 02 01:20:20.000377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13188f42-5ef2-4793-9dee-74c1e54bda7f tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881129940>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:20.002958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2156/4444] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:19 2022] GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:20.055035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-13188f42-5ef2-4793-9dee-74c1e54bda7f tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] HTTP exception thrown: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13188f42-5ef2-4793-9dee-74c1e54bda7f tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Request method failure captured: Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded HTTP/1.1 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOdFT_qk1cvM5c5vEHzzabVD1PMIeBGnhDERqyP9jH1Mht74ule0fauhvSz_iuJv86W4aKxtokqVn7nggZ48U7LOIYjNsneOIjSTY17s3wUGwDxEzvs8DTwco63gp1ebIe4itUT0CF69UQuOdc4mw84IQJVG6km5TbYyu12X6SoFrRQ Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9d8ef80beda48cf95e02545177abc11"}]}] Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: d5d496f6ab8d4844908672038999257c Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: exception: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '02e7ac33-6d67-4bfb-bb84-8dc039b1aded'} Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. (HTTP 404) (Request-ID: req-3233b8c0-b1be-4330-bd1b-3402f97f440a) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:20:20.057958 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13188f42-5ef2-4793-9dee-74c1e54bda7f tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Returning 404 to user: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:20.063531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13188f42-5ef2-4793-9dee-74c1e54bda7f tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 404 len: 109 microversion: 2.1 time: 0.064569 Oct 02 01:20:20.073319 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2289/4445] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:20:19 2022] DELETE /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:20.076650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb9c8b80-fa3c-4c97-86d0-c85e64edffd2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Calling method '.version_select at 0x7fb881151160>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:20.134792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fb9c8b80-fa3c-4c97-86d0-c85e64edffd2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] HTTP exception thrown: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb9c8b80-fa3c-4c97-86d0-c85e64edffd2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Request method failure captured: Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded HTTP/1.1 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOdFT_qk1cvM5c5vEHzzabVD1PMIeBGnhDERqyP9jH1Mht74ule0fauhvSz_iuJv86W4aKxtokqVn7nggZ48U7LOIYjNsneOIjSTY17s3wUGwDxEzvs8DTwco63gp1ebIe4itUT0CF69UQuOdc4mw84IQJVG6km5TbYyu12X6SoFrRQ Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9d8ef80beda48cf95e02545177abc11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9d8ef80beda48cf95e02545177abc11"}]}] Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b9d8ef80beda48cf95e02545177abc11 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1218226145 Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: d5d496f6ab8d4844908672038999257c Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1218226145-project Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: exception: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '02e7ac33-6d67-4bfb-bb84-8dc039b1aded'} Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. (HTTP 404) (Request-ID: req-2a28a5be-a974-4a93-87f6-d60dc14d02aa) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:20:20.137244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. Oct 02 01:20:20.141286 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:20.145966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb9c8b80-fa3c-4c97-86d0-c85e64edffd2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] Returning 404 to user: Volume 02e7ac33-6d67-4bfb-bb84-8dc039b1aded could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:20.147095 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fb9c8b80-fa3c-4c97-86d0-c85e64edffd2 tempest-VolumesSnapshotsTestJSON-1218226145 tempest-VolumesSnapshotsTestJSON-1218226145-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded" status: 404 len: 109 microversion: 2.1 time: 0.079020 Oct 02 01:20:20.148290 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2157/4446] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:20 2022] GET /compute/v2.1/os-volumes/02e7ac33-6d67-4bfb-bb84-8dc039b1aded => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:20.848859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5cf8a05a-5db6-4bab-b9c9-d141fb9667b6 req-23874020-4bdb-47d4-b8a5-b4779d6cc17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3d770d-5fec-4f82-a338-dccca2220efd", "name": "network-vif-unplugged", "status": "completed", "tag": "ce30d689-65d4-47bf-97e7-da530c835660"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:20.873434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5cf8a05a-5db6-4bab-b9c9-d141fb9667b6 req-23874020-4bdb-47d4-b8a5-b4779d6cc17b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:20.874636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:20.875006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:20.878161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5cf8a05a-5db6-4bab-b9c9-d141fb9667b6 req-23874020-4bdb-47d4-b8a5-b4779d6cc17b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:20.879430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5cf8a05a-5db6-4bab-b9c9-d141fb9667b6 req-23874020-4bdb-47d4-b8a5-b4779d6cc17b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:20.891498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:20.892269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:20.892957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:20.893865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:20.897043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:20.897658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:20.904521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_external_events [req-5cf8a05a-5db6-4bab-b9c9-d141fb9667b6 req-23874020-4bdb-47d4-b8a5-b4779d6cc17b service nova] Unable to find a host for instance 9f3d770d-5fec-4f82-a338-dccca2220efd. Dropping event network-vif-unplugged {{(pid=122355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 01:20:20.910002 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5cf8a05a-5db6-4bab-b9c9-d141fb9667b6 req-23874020-4bdb-47d4-b8a5-b4779d6cc17b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.064598 Oct 02 01:20:20.911183 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2290/4447] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 02 01:20:20.994820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:20.995622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:21.006592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:21.007179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:21.007701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:21.008490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:21.009026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:21.009536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:21.776422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:21.790018 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dad013ea-62cb-4bb8-8811-ab3d3e8d3b3e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 200 len: 1449 microversion: 2.1 time: 0.921764 Oct 02 01:20:21.790907 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2158/4448] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:20 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 1449 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:21.816810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:21.817550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:21.829325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:21.830948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:21.833024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:21.833952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:21.837636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:21.838442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:21.849021 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:21.891152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:21.901677 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1185522b-d933-450a-ad32-bece441be9ae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1367 microversion: 2.1 time: 0.913217 Oct 02 01:20:21.908830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2291/4449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:20 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1367 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:21.926046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:20:21.945416 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Working on deleting snapshot 7b356c24-186b-44a0-bc66-5195010273f7 from shelved instance... Oct 02 01:20:22.759425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-04a35648-f23e-47d7-ad54-911ed2ad9189 req-0982fb68-5a4b-498a-8fe4-2c2ecf58ebdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fcb084b-b447-445b-8204-c2fd6ccb1a51", "tag": "7693d4a5-e295-4578-b67a-11e78e1e1e87"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:22.781059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-04a35648-f23e-47d7-ad54-911ed2ad9189 req-0982fb68-5a4b-498a-8fe4-2c2ecf58ebdd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:22.781873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-04a35648-f23e-47d7-ad54-911ed2ad9189 req-0982fb68-5a4b-498a-8fe4-2c2ecf58ebdd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:22.782540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-04a35648-f23e-47d7-ad54-911ed2ad9189 req-0982fb68-5a4b-498a-8fe4-2c2ecf58ebdd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:22.811586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-04a35648-f23e-47d7-ad54-911ed2ad9189 req-0982fb68-5a4b-498a-8fe4-2c2ecf58ebdd service nova] Creating event network-changed:7693d4a5-e295-4578-b67a-11e78e1e1e87 for instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 on n-h1-master-1 Oct 02 01:20:22.832557 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-04a35648-f23e-47d7-ad54-911ed2ad9189 req-0982fb68-5a4b-498a-8fe4-2c2ecf58ebdd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079179 Oct 02 01:20:22.833314 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2292/4450] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:22.930525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:22.932035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:22.950912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:22.952678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:22.955546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:22.956554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:22.957125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:22.957636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:23.260337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:23.289109 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc9f2ad3-8dae-4e44-851a-d5acb4bddc3d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1557 microversion: 2.1 time: 0.363550 Oct 02 01:20:23.291572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2293/4451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:22 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1557 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:23.295276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Doing local delete in cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) {{(pid=122354) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 02 01:20:23.297105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:23.297686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:23.298616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:23.299070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 02 01:20:23.306034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] deallocate_for_instance() {{(pid=122354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 02 01:20:23.316609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:23.317137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:23.332691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:23.334157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:23.334629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:23.335365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:23.337300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:23.337748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:23.532034 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-01931a45-bdfa-4c0f-a1b1-a0af2c698998 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.219503 Oct 02 01:20:23.532656 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2294/4452] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:20:23 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-interface => generated 285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:25.487613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4affc555-7c20-4ac1-8467-76c810d3b6e8 req-1c02f17c-20c8-42e0-8e59-681129303be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3d770d-5fec-4f82-a338-dccca2220efd", "name": "network-vif-deleted", "tag": "ce30d689-65d4-47bf-97e7-da530c835660"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:25.492080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Updating instance_info_cache with network_info: [] {{(pid=122354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:20:25.520264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4affc555-7c20-4ac1-8467-76c810d3b6e8 req-1c02f17c-20c8-42e0-8e59-681129303be3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:25.521166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4affc555-7c20-4ac1-8467-76c810d3b6e8 req-1c02f17c-20c8-42e0-8e59-681129303be3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:25.521809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4affc555-7c20-4ac1-8467-76c810d3b6e8 req-1c02f17c-20c8-42e0-8e59-681129303be3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:25.558363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_external_events [req-4affc555-7c20-4ac1-8467-76c810d3b6e8 req-1c02f17c-20c8-42e0-8e59-681129303be3 service nova] Unable to find a host for instance 9f3d770d-5fec-4f82-a338-dccca2220efd. Dropping event network-vif-deleted {{(pid=122355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 01:20:25.561249 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4affc555-7c20-4ac1-8467-76c810d3b6e8 req-1c02f17c-20c8-42e0-8e59-681129303be3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.080605 Oct 02 01:20:25.563999 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2295/4453] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 02 01:20:26.023302 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=62 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:26.223554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76e811a0-014a-4a09-b4c7-f34c80d835e2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 204 len: 0 microversion: 2.1 time: 4.410944 Oct 02 01:20:26.225117 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2159/4454] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:20:21 2022] DELETE /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 0 bytes in 4413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:20:26.233670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:26.234848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:26.245630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:26.246780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:26.247651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:26.248618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:26.249309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:26.249965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:26.267989 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd HTTP/1.1 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9f3d770d-5fec-4f82-a338-dccca2220efd'} Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:26.270226 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:20:26.274453 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:26.279693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:26.285752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0005eb79-f00f-4b73-8332-75f6c74128ec tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 404 len: 111 microversion: 2.1 time: 0.056357 Oct 02 01:20:26.286692 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2296/4455] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:26 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:26.492828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1836999842", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:26.513569 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-110a0686-b32d-4365-9445-4f345f084f68 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb8855989d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:26.623735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:20:26.803755 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-110a0686-b32d-4365-9445-4f345f084f68 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/41e6d9d2-6272-4b0b-b141-e1a09f1631b6" status: 200 len: 351 microversion: 2.1 time: 0.296032 Oct 02 01:20:26.806083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2297/4456] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:26 2022] GET /compute/v2.1/os-volumes/41e6d9d2-6272-4b0b-b141-e1a09f1631b6 => generated 351 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:27.789436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2115448733", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "a7b43e48-0f57-4250-abf4-61fae0df25d5"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:27.824020 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:27.940079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] validate_networks() for [('a7b43e48-0f57-4250-abf4-61fae0df25d5', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:20:28.304848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:20:28.305924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:20:28.306646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:20:28.307282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:20:28.307992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:20:28.323695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:28.325143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:28.325818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:28.327392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:28.328260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:28.329000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:28.382936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:20:28.395621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:20:28.432548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:20:28.436773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:20:28.551414 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9028ed3a-f320-4218-ad6a-7b06afd030c1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062538 Oct 02 01:20:28.554281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2160/4457] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:20:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:20:28.570262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9e722959-b2e3-440d-9469-dae525294009 req-14cd30a6-36d8-4631-9763-e373b6b3d7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7689d920-d346-41ba-8221-5fc1b39eb664", "tag": "5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:28.629513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9e722959-b2e3-440d-9469-dae525294009 req-14cd30a6-36d8-4631-9763-e373b6b3d7d6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:28.644096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9e722959-b2e3-440d-9469-dae525294009 req-14cd30a6-36d8-4631-9763-e373b6b3d7d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:28.644475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9e722959-b2e3-440d-9469-dae525294009 req-14cd30a6-36d8-4631-9763-e373b6b3d7d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:28.679704 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9e722959-b2e3-440d-9469-dae525294009 req-14cd30a6-36d8-4631-9763-e373b6b3d7d6 service nova] Creating event network-changed:5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d for instance 7689d920-d346-41ba-8221-5fc1b39eb664 on n-h2-master-1 Oct 02 01:20:28.698836 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9e722959-b2e3-440d-9469-dae525294009 req-14cd30a6-36d8-4631-9763-e373b6b3d7d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139317 Oct 02 01:20:28.700996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2161/4458] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:28.725043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-291638ba-0492-4eb6-aa46-f5c862fe3ef4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:28.728227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-291638ba-0492-4eb6-aa46-f5c862fe3ef4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:28.929638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-291638ba-0492-4eb6-aa46-f5c862fe3ef4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:28.938827 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-291638ba-0492-4eb6-aa46-f5c862fe3ef4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1215 microversion: 2.1 time: 0.233614 Oct 02 01:20:28.945444 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2162/4459] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:28 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:29.644534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-710eced1-d2a4-4b82-a5c8-e3629a1abbfb tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb8812a0280>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:29.684133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:20:29.684604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:20:29.685716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:20:29.686183 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:20:29.686973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:20:29.708668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:29.709495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:29.710116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:29.711087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:29.711696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:29.713906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:29.753638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Getting quotas for project b19b890a2ecc41439c8f44c11034441b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:20:29.779896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Getting quotas for user 567970d4c702481995721669932ce41e and project b19b890a2ecc41439c8f44c11034441b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:20:29.820904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:20:29.826056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:20:29.909982 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-029367c6-004e-4a37-82e9-98ee6b2e1ade tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.297240 Oct 02 01:20:29.913672 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2298/4460] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:20:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:20:29.926777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c9b05b1-004f-4190-9a5b-7630127bc7c3 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:29.927414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c9b05b1-004f-4190-9a5b-7630127bc7c3 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:29.980803 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-710eced1-d2a4-4b82-a5c8-e3629a1abbfb tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/942f34cd-507d-4eec-8d56-4daddd5ff60f" status: 200 len: 350 microversion: 2.1 time: 0.348641 Oct 02 01:20:29.981471 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2163/4461] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:29 2022] GET /compute/v2.1/os-volumes/942f34cd-507d-4eec-8d56-4daddd5ff60f => generated 350 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:20:29.989749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:29.991412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:30.027767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:30.028346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:30.028787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:30.029507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:30.030148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:30.039237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:31.251443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c9b05b1-004f-4190-9a5b-7630127bc7c3 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:31.283236 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c9b05b1-004f-4190-9a5b-7630127bc7c3 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1225 microversion: 2.1 time: 1.363554 Oct 02 01:20:31.284579 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2299/4462] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:29 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1225 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:31.295359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:31.307521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7c271738-349c-4d47-9210-8dbf215463b5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1267 microversion: 2.1 time: 1.324794 Oct 02 01:20:31.310392 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2164/4463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:29 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1267 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:32.323152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:32.325626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:32.336368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:32.337974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:32.356800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:32.357420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:32.357862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:32.358686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:32.359086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:32.360317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:32.361433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:32.363389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:32.364883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:32.366746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:32.367406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:32.371504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:32.591254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:32.594258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:32.603969 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e28092ff-74e9-43b8-b41c-06eef34c0632 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1285 microversion: 2.1 time: 0.298319 Oct 02 01:20:32.606016 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2300/4464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:32 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:32.613253 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-551f0d8e-a19b-4da9-bb47-7d2f8998ffd8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1273 microversion: 2.1 time: 0.280192 Oct 02 01:20:32.623512 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2165/4465] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:32 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:32.796364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6139418-b21b-48ca-a0cf-373ead41c1c9 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb880849550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:32.957274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6139418-b21b-48ca-a0cf-373ead41c1c9 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d9d5ce7f-92f0-46ad-8bed-957b5d327b1f" status: 200 len: 351 microversion: 2.1 time: 0.165087 Oct 02 01:20:32.968022 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2301/4466] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:20:32 2022] GET /compute/v2.1/os-volumes/d9d5ce7f-92f0-46ad-8bed-957b5d327b1f => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:32.976228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63999eb0-b2a6-4b6c-b8bd-a3e61c190e5c tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb881a46af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.133342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63999eb0-b2a6-4b6c-b8bd-a3e61c190e5c tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.161825 Oct 02 01:20:33.135392 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2166/4467] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:20:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:33.151784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b32198c6-b9fe-4dde-bf61-b35e03d608ac tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb88557f8b0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.256756 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b32198c6-b9fe-4dde-bf61-b35e03d608ac tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.109741 Oct 02 01:20:33.268510 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2302/4468] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:20:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:33.281714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffd2fb3f-2b0b-4bb5-adf1-4c58cea4644e tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb8812a0ca0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.447916 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffd2fb3f-2b0b-4bb5-adf1-4c58cea4644e tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179271 Oct 02 01:20:33.449469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2167/4469] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:20:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:33.466804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc93066f-0374-40cf-af61-a5bafc7c8bfc tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb8810603a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.599280 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc93066f-0374-40cf-af61-a5bafc7c8bfc tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.137395 Oct 02 01:20:33.613027 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2303/4470] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:20:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:33.615512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ff8db55-68eb-48fa-9d52-31ca96d2ca12 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb880b0ad30>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.629943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.630578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:33.659053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:33.665041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:33.665613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:33.666397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:33.666900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:33.672935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:33.800597 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ff8db55-68eb-48fa-9d52-31ca96d2ca12 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.190620 Oct 02 01:20:33.801508 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2168/4471] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:20:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:33.806296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:33.807187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:33.829800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:33.831350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:33.832269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:33.833233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:33.833909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:33.834551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:34.138198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:34.155337 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8cd4008b-c3e0-4187-87fc-935e398a102d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1283 microversion: 2.1 time: 0.529721 Oct 02 01:20:34.157846 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2304/4472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:33 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1283 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:34.168491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64da9e25-5111-47b4-b9ec-b3c2f9d38d19 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb8808499d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:34.360392 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64da9e25-5111-47b4-b9ec-b3c2f9d38d19 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.200780 Oct 02 01:20:34.363364 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2305/4473] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:20:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:34.377813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bb470148-a13c-4a24-aa0f-889d8ae5a131 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb88072ddc0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:34.578494 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bb470148-a13c-4a24-aa0f-889d8ae5a131 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205407 Oct 02 01:20:34.579284 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2306/4474] 10.222.0.23 () {58 vars in 1188 bytes} [Sun Oct 2 01:20:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:20:34.595650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eff4cf73-623d-488b-b4dc-cb3ba80b4d36 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] Calling method '.version_select at 0x7fb880849820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:34.691778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:34.708172 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-854f007d-cbe4-48fc-9d80-9e9920955d9c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.905374 Oct 02 01:20:34.709745 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2169/4475] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:33 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:34.743788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eff4cf73-623d-488b-b4dc-cb3ba80b4d36 tempest-VolumesTestJSON-1877751456 tempest-VolumesTestJSON-1877751456-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.154855 Oct 02 01:20:34.746575 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2307/4476] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:20:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:35.180570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:35.184781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:35.193167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:35.193926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:35.194946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:35.212199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:35.213212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:35.214374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:35.736835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:35.738104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:35.747002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:35.747755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:35.748415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:35.753965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:35.757261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:35.762127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:36.407495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:36.419403 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b4afc02-728b-4380-a363-18bbd5cc5ae0 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 1.242612 Oct 02 01:20:36.428631 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2170/4477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:35 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:36.851503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:36.854761 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:36.867173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5cfd4568-c443-46ae-b1ab-bb24e4fa293a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 1.135777 Oct 02 01:20:36.869901 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2308/4478] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:35 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:37.453052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:37.453963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:37.478018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:37.478824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:37.481444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:37.482753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:37.483334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:37.486503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:37.893216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:37.894384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:37.911730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:37.912868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:37.914236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:37.918772 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:37.923253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:37.924002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:38.021499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:38.035072 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4536c297-df40-4717-b1c8-be2dfaa2e1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.587023 Oct 02 01:20:38.038149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2171/4479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:37 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:38.360642 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:38.371235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-69553b4f-75b3-4a94-a206-6e96b34b5c33 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Action: 'create', calling method: .version_select at 0x7fb8809f68b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:38.414292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-69553b4f-75b3-4a94-a206-6e96b34b5c33 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Getting quotas for project 2cd0ce5cd5ab49599029053457a363d3. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:20:38.422587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-69553b4f-75b3-4a94-a206-6e96b34b5c33 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Getting quotas for user 6f49cac861bf459cae96a19cd099513b and project 2cd0ce5cd5ab49599029053457a363d3. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:20:38.536430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-69553b4f-75b3-4a94-a206-6e96b34b5c33 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Getting quotas for project 2cd0ce5cd5ab49599029053457a363d3. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:20:38.541128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:38.552831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8469396-440c-47fd-908c-906b55f17790 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.664456 Oct 02 01:20:38.554557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-69553b4f-75b3-4a94-a206-6e96b34b5c33 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Getting quotas for user 6f49cac861bf459cae96a19cd099513b and project 2cd0ce5cd5ab49599029053457a363d3. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:20:38.558793 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2309/4480] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:37 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:38.572231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b7f07b3e-6fdb-46b9-85cd-50c29cd8739a req-a9b2e560-3355-4d97-a78f-2663c94ba22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5", "tag": "e3e58de4-7d9e-4024-9ae6-b569da156e94"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:38.593441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7f07b3e-6fdb-46b9-85cd-50c29cd8739a req-a9b2e560-3355-4d97-a78f-2663c94ba22d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:38.594217 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-69553b4f-75b3-4a94-a206-6e96b34b5c33 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.364226 Oct 02 01:20:38.594344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7f07b3e-6fdb-46b9-85cd-50c29cd8739a req-a9b2e560-3355-4d97-a78f-2663c94ba22d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:38.594936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7f07b3e-6fdb-46b9-85cd-50c29cd8739a req-a9b2e560-3355-4d97-a78f-2663c94ba22d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:38.601231 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2172/4481] 10.222.0.23 () {62 vars in 1214 bytes} [Sun Oct 2 01:20:38 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:20:38.632178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b52ee80d-d94f-4b09-b25f-6d7bb0e6c88c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:38.635565 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b7f07b3e-6fdb-46b9-85cd-50c29cd8739a req-a9b2e560-3355-4d97-a78f-2663c94ba22d service nova] Creating event network-changed:e3e58de4-7d9e-4024-9ae6-b569da156e94 for instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 on n-h2-master-1 Oct 02 01:20:38.642939 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b7f07b3e-6fdb-46b9-85cd-50c29cd8739a req-a9b2e560-3355-4d97-a78f-2663c94ba22d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082474 Oct 02 01:20:38.647987 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2310/4482] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:38.674662 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b52ee80d-d94f-4b09-b25f-6d7bb0e6c88c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.047838 Oct 02 01:20:38.675138 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2173/4483] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 2 01:20:38 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:20:38.688291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-890e132b-ed9c-4b40-9516-99510b637c2f tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:38.700602 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-890e132b-ed9c-4b40-9516-99510b637c2f tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61" status: 200 len: 235 microversion: 2.64 time: 0.017223 Oct 02 01:20:38.707773 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2311/4484] 10.222.0.23 () {60 vars in 1304 bytes} [Sun Oct 2 01:20:38 2022] GET /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61 => generated 235 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:20:38.713364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b58eefbc-9f06-4143-a33f-4cccfcebf218 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:38.755836 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b58eefbc-9f06-4143-a33f-4cccfcebf218 tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61" status: 204 len: 0 microversion: 2.64 time: 0.043843 Oct 02 01:20:38.756678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2174/4485] 10.222.0.23 () {60 vars in 1307 bytes} [Sun Oct 2 01:20:38 2022] DELETE /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:20:38.767155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-819b5966-99d5-4fec-b54f-e76ee24c248c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:38.775219 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-819b5966-99d5-4fec-b54f-e76ee24c248c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] HTTP exception thrown: Instance group f756e18b-c370-43c1-bfb6-e2209931ea61 could not be found. Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-819b5966-99d5-4fec-b54f-e76ee24c248c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Request method failure captured: Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61 HTTP/1.1 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOdmFcrzw0rOcrWeLsHq4XIMLBPY8X1w-blS17joO4My_LFpAD1mFrmsHHJ4zgfWkf2330lPkwXdN3146sC6bHFc-6Tnkaqf7AEkHtyTGZxeCn3m5OibJ8Sm4PiZZCpCz_WhvIHV2qhIph75FgsO44QUaX57ceQSZTi_Up5okgQi37Y Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.64 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 2cd0ce5cd5ab49599029053457a363d3 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroup264TestJSON-279249242 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2cd0ce5cd5ab49599029053457a363d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2cd0ce5cd5ab49599029053457a363d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2cd0ce5cd5ab49599029053457a363d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2cd0ce5cd5ab49599029053457a363d3"}]}] Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroup264TestJSON-279249242 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 2cd0ce5cd5ab49599029053457a363d3 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroup264TestJSON-279249242 Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroup264TestJSON-279249242-project Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6f49cac861bf459cae96a19cd099513b Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroup264TestJSON-279249242-project Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: exception: Instance group f756e18b-c370-43c1-bfb6-e2209931ea61 could not be found. Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f756e18b-c370-43c1-bfb6-e2209931ea61'} Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f756e18b-c370-43c1-bfb6-e2209931ea61 could not be found. Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f756e18b-c370-43c1-bfb6-e2209931ea61 could not be found. Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:38.782731 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f756e18b-c370-43c1-bfb6-e2209931ea61 could not be found. Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-819b5966-99d5-4fec-b54f-e76ee24c248c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] Returning 404 to user: Instance group f756e18b-c370-43c1-bfb6-e2209931ea61 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-819b5966-99d5-4fec-b54f-e76ee24c248c tempest-ServerGroup264TestJSON-279249242 tempest-ServerGroup264TestJSON-279249242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61" status: 404 len: 117 microversion: 2.64 time: 0.021224 Oct 02 01:20:38.787911 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2312/4486] 10.222.0.23 () {60 vars in 1307 bytes} [Sun Oct 2 01:20:38 2022] DELETE /compute/v2.1/os-server-groups/f756e18b-c370-43c1-bfb6-e2209931ea61 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:20:39.065617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:39.066890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:39.089654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:39.099439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:39.100438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:39.101538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:39.102182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:39.102849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:39.581745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:39.583201 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:39.614583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:39.615352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:39.616682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:39.619229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:39.623737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:39.625977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:39.730623 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:40.015413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:40.040967 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b5f82c2-7429-46fb-8bbb-cca0633eedd5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.981996 Oct 02 01:20:40.047869 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2175/4487] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:39 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:40.235840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:40.257632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31d22e77-3071-4849-90c0-858f49561dc4 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.674157 Oct 02 01:20:40.258326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2313/4488] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:39 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:40.706768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b4307416-6b85-452f-98c5-bd0d0139bd8f req-cbe3fec6-3c81-412f-9e1e-ac1765690e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b508a9f-5031-4ef9-908b-94429213b4a0", "tag": "7389287d-3af8-4a40-b19a-c851dc68882b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:40.729594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b4307416-6b85-452f-98c5-bd0d0139bd8f req-cbe3fec6-3c81-412f-9e1e-ac1765690e4f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:40.730456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b4307416-6b85-452f-98c5-bd0d0139bd8f req-cbe3fec6-3c81-412f-9e1e-ac1765690e4f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:40.732890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b4307416-6b85-452f-98c5-bd0d0139bd8f req-cbe3fec6-3c81-412f-9e1e-ac1765690e4f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:40.756745 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b4307416-6b85-452f-98c5-bd0d0139bd8f req-cbe3fec6-3c81-412f-9e1e-ac1765690e4f service nova] Creating event network-changed:7389287d-3af8-4a40-b19a-c851dc68882b for instance 1b508a9f-5031-4ef9-908b-94429213b4a0 on n-h2-master-1 Oct 02 01:20:40.770564 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b4307416-6b85-452f-98c5-bd0d0139bd8f req-cbe3fec6-3c81-412f-9e1e-ac1765690e4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067483 Oct 02 01:20:40.775116 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2176/4489] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:41.073439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:41.074209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:41.084780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.088665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.089365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.091500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.092186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.095155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.260858 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:41.286289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:41.287026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:41.296114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.296603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.297037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.297744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.298210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.298634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.841030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:41.855624 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83294092-15a5-424c-a669-dca87c7a2a1e tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.786689 Oct 02 01:20:41.876023 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2314/4490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:41 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:41.884261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:41.894289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:41.898993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Searching by: {'deleted': False, 'project_id': '030545ae9fe8466887a79a55199dbe1e'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:20:41.900957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:41.909642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.910127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.912943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.914168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f89042b-ebfc-4e36-a5f3-b14e0369d07f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.632406 Oct 02 01:20:41.915140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.920121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.920828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.932251 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2177/4491] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:41 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:41.971880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:20:42.036076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6095d697-1857-4a3d-a754-8c77ab2a6496 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.157838 Oct 02 01:20:42.045078 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2315/4492] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:20:41 2022] GET /compute/v2.1/servers => generated 339 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:42.052176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:42.058074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:42.061806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Searching by: {'deleted': False, 'project_id': '030545ae9fe8466887a79a55199dbe1e'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:20:42.075443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.075871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.076322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.077074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.079443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.080224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.137982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:20:42.183350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:42.192892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.193899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.194539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.199238 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:42.439714 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43874515-3c66-43f5-98ea-4b1509a93d9d tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.393186 Oct 02 01:20:42.440349 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2178/4493] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:20:42 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:42.471206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a059822b-21f4-4eda-9fd6-1d6f692705d6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:42.484783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a059822b-21f4-4eda-9fd6-1d6f692705d6 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017770 Oct 02 01:20:42.485381 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2316/4494] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:20:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:42.889096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:42.889984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:42.903583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.916626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.917212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.918257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.918925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.919449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.937942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:42.939840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:42.951998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.954831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.956443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.975329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.978724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.979806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:43.489793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:43.502368 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed89fac3-10ca-46b5-9054-bc5471e2b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.564955 Oct 02 01:20:43.503038 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2317/4495] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:42 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:43.520864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:43.520864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:43.535327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:43.536113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:43.536670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:43.538853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:43.541588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:43.544295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:43.595465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:20:43.818081 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31f34eff-2116-49c7-8c88-cb9b4d90d793 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 204 len: 0 microversion: 2.1 time: 0.312750 Oct 02 01:20:43.819138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2318/4496] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:20:43 2022] DELETE /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:20:43.830644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:43.836327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:43.850174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:43.850701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:43.851156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:43.852264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:43.852383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:43.852777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:44.022992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:44.040108 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2cc314d8-5145-4b57-8f3c-8258a3884b03 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 1.159415 Oct 02 01:20:44.044115 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2179/4497] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:42 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:44.529193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:44.529834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:44.540381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:44.540936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:44.546240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:44.547095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:44.547653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:44.548090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:44.814937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:44.827597 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b616645f-d7e7-40fb-b177-adaea92388e0 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1713 microversion: 2.1 time: 1.003966 Oct 02 01:20:44.842655 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2319/4498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:43 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1713 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:45.074642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:45.075396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:45.113898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:45.114637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:45.115556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:45.116448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:45.117077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:45.117704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:45.536716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:45.545753 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe5e07d1-4e79-4bec-b8ec-672bb794f1aa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 1.021047 Oct 02 01:20:45.557605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2180/4499] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:44 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:45.719231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:45.735258 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ec5c44c-cac1-45ab-868f-8c16ce5abc94 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.671083 Oct 02 01:20:45.736160 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2320/4500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:45 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:45.859685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:45.860652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:45.876737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:45.880859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:45.881577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:45.885411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:45.886783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:45.887877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.268918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:46.283102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba263e08-1030-45b2-86d1-f7569acd651c tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1713 microversion: 2.1 time: 0.429177 Oct 02 01:20:46.284392 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2181/4501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:45 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1713 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:46.471618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1255139b-95c1-4717-8c4a-7c6e6e87600f req-b84e7b13-c27f-4222-ba7a-17a3f86d6f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5", "name": "network-vif-plugged", "status": "completed", "tag": "e3e58de4-7d9e-4024-9ae6-b569da156e94"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:46.496964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1255139b-95c1-4717-8c4a-7c6e6e87600f req-b84e7b13-c27f-4222-ba7a-17a3f86d6f32 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.497448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1255139b-95c1-4717-8c4a-7c6e6e87600f req-b84e7b13-c27f-4222-ba7a-17a3f86d6f32 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.499592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1255139b-95c1-4717-8c4a-7c6e6e87600f req-b84e7b13-c27f-4222-ba7a-17a3f86d6f32 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.520525 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1255139b-95c1-4717-8c4a-7c6e6e87600f req-b84e7b13-c27f-4222-ba7a-17a3f86d6f32 service nova] Creating event network-vif-plugged:e3e58de4-7d9e-4024-9ae6-b569da156e94 for instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 on n-h2-master-1 Oct 02 01:20:46.526168 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1255139b-95c1-4717-8c4a-7c6e6e87600f req-b84e7b13-c27f-4222-ba7a-17a3f86d6f32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058306 Oct 02 01:20:46.527616 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2321/4502] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:46.582665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:46.583504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:46.617494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.618172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.619966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.620826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.621538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.622076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.760533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:46.761410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:46.768655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.769664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.770369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.771330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.772080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.772726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:47.197288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:47.212057 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb300f89-3532-4bac-9e06-cffcb1a39bce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.632053 Oct 02 01:20:47.216823 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2182/4503] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:46 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:47.312777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:47.313400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:47.324151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:47.324662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:47.325108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:47.330170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:47.330693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:47.331294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:47.335245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:47.346997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36dc2408-56f8-4c8b-95d6-8ea80542366d tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.591305 Oct 02 01:20:47.347594 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2322/4504] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:46 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:47.606687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c503b01d3a53481c9ded936a0a3f6c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030545ae9fe8466887a79a55199dbe1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:47.631862 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c037cb0-4700-4e6f-af9d-9e9a4886c7b9 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 200 len: 1646 microversion: 2.1 time: 0.320234 Oct 02 01:20:47.632523 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2183/4505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:47 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 1646 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:47.866201 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f64f9a2e-6848-4d6f-a4e5-e282d956dc22 req-43181720-c453-4835-8c25-9d4fcc9335e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55f567a-3701-414a-a4ba-95fa023bb856", "name": "network-vif-deleted", "tag": "3d974c97-e964-45ca-a3f6-da6e3ac0ac9c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:47.908588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f64f9a2e-6848-4d6f-a4e5-e282d956dc22 req-43181720-c453-4835-8c25-9d4fcc9335e7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:47.913274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f64f9a2e-6848-4d6f-a4e5-e282d956dc22 req-43181720-c453-4835-8c25-9d4fcc9335e7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:47.916185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f64f9a2e-6848-4d6f-a4e5-e282d956dc22 req-43181720-c453-4835-8c25-9d4fcc9335e7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:47.948295 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f64f9a2e-6848-4d6f-a4e5-e282d956dc22 req-43181720-c453-4835-8c25-9d4fcc9335e7 service nova] Creating event network-vif-deleted:3d974c97-e964-45ca-a3f6-da6e3ac0ac9c for instance f55f567a-3701-414a-a4ba-95fa023bb856 on n-h1-master-1 Oct 02 01:20:47.968771 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f64f9a2e-6848-4d6f-a4e5-e282d956dc22 req-43181720-c453-4835-8c25-9d4fcc9335e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106016 Oct 02 01:20:47.970942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2323/4506] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:48.239139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:48.240032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:48.254809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.258895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.263310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.264447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.268226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.268981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.382340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:48.383283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:48.401410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.404010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.404745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.405648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.407950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.410323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.855247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:48.868247 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8818b1ad-da65-4a32-add3-eef22382fadb tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.491986 Oct 02 01:20:48.872019 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2324/4507] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:48 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:48.880789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:48.881418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] [instance: f55f567a-3701-414a-a4ba-95fa023bb856] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:48.911536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.913672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.916765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.918541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.922591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.923343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.956118 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] HTTP exception thrown: Instance f55f567a-3701-414a-a4ba-95fa023bb856 could not be found. Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Request method failure captured: Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 HTTP/1.1 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOcIzZDuC0DpXVIolRrM3x78Sjj4hdatHzbC4GPrHDIwX28ZUlL86XhN2GYX49xd9CLQowxM2g-lxBdy0HnubtPj5QeCkdUIcmFonRL13t4vGKdXnB5UzksgFyv64v08NY22qeWWmqgNbGeUVrPYnxEUru2FtkW7fzLCmfht6aJnItM Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 030545ae9fe8466887a79a55199dbe1e Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersTestManualDisk-1545965367 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/030545ae9fe8466887a79a55199dbe1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/030545ae9fe8466887a79a55199dbe1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/030545ae9fe8466887a79a55199dbe1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_030545ae9fe8466887a79a55199dbe1e"}]}] Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersTestManualDisk-1545965367 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 030545ae9fe8466887a79a55199dbe1e Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersTestManualDisk-1545965367 Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersTestManualDisk-1545965367-project Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: c503b01d3a53481c9ded936a0a3f6c9f Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersTestManualDisk-1545965367-project Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: exception: Instance f55f567a-3701-414a-a4ba-95fa023bb856 could not be found. Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f55f567a-3701-414a-a4ba-95fa023bb856'} Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f567a-3701-414a-a4ba-95fa023bb856 could not be found. Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f567a-3701-414a-a4ba-95fa023bb856 could not be found. Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:48.960456 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f567a-3701-414a-a4ba-95fa023bb856 could not be found. Oct 02 01:20:48.965098 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:48.969146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Returning 404 to user: Instance f55f567a-3701-414a-a4ba-95fa023bb856 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:48.970296 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-00e611ca-4d44-4959-b747-a6e228748f02 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856" status: 404 len: 111 microversion: 2.1 time: 0.097311 Oct 02 01:20:48.971891 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2325/4508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:48 2022] GET /compute/v2.1/servers/f55f567a-3701-414a-a4ba-95fa023bb856 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:48.983748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2ed99733-7a64-45c3-953e-6f4ca52ffbb6 req-50be67cb-4fe0-433c-987e-f04fe22db83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b508a9f-5031-4ef9-908b-94429213b4a0", "name": "network-vif-plugged", "status": "completed", "tag": "7389287d-3af8-4a40-b19a-c851dc68882b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:49.005753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2ed99733-7a64-45c3-953e-6f4ca52ffbb6 req-50be67cb-4fe0-433c-987e-f04fe22db83e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:49.012305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2ed99733-7a64-45c3-953e-6f4ca52ffbb6 req-50be67cb-4fe0-433c-987e-f04fe22db83e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:49.012767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2ed99733-7a64-45c3-953e-6f4ca52ffbb6 req-50be67cb-4fe0-433c-987e-f04fe22db83e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:49.028912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2ed99733-7a64-45c3-953e-6f4ca52ffbb6 req-50be67cb-4fe0-433c-987e-f04fe22db83e service nova] Creating event network-vif-plugged:7389287d-3af8-4a40-b19a-c851dc68882b for instance 1b508a9f-5031-4ef9-908b-94429213b4a0 on n-h2-master-1 Oct 02 01:20:49.034226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2ed99733-7a64-45c3-953e-6f4ca52ffbb6 req-50be67cb-4fe0-433c-987e-f04fe22db83e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054221 Oct 02 01:20:49.034814 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2326/4509] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:49.038166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:49.048013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4bf1f36-2b53-4c0a-be7f-6fb3d76c4f22 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] Calling method '.version_select at 0x7fb88072df70>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:49.056690 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10b594bf-9c10-451d-b816-8720a13c91e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1315 microversion: 2.1 time: 0.820974 Oct 02 01:20:49.057514 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2184/4510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:48 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:49.092452 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4bf1f36-2b53-4c0a-be7f-6fb3d76c4f22 tempest-ServersTestManualDisk-1545965367 tempest-ServersTestManualDisk-1545965367-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104444025" status: 202 len: 0 microversion: 2.1 time: 0.048648 Oct 02 01:20:49.093495 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2327/4511] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104444025 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:20:49.903729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:49.905241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:49.914657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:49.915233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:49.916322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:49.917536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:49.918376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:49.919033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:50.081955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:50.082966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:50.098924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:50.101464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:50.101988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:50.105966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:50.107135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:50.109548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:50.409042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:50.423115 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd78f10a-c1d1-41e5-92cc-9f31b6cc3919 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1325 microversion: 2.1 time: 0.525823 Oct 02 01:20:50.425782 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2185/4512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:49 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1325 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:50.753799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:50.767317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87b0e792-0171-44e9-9b9b-43001aff9115 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1502 microversion: 2.1 time: 0.690927 Oct 02 01:20:50.768547 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2328/4513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:50 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1502 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:50.794002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8011c770-6dd0-4b78-9e68-6b6a877cf839 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:50.799020 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:50.806570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8011c770-6dd0-4b78-9e68-6b6a877cf839 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:50.807496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8011c770-6dd0-4b78-9e68-6b6a877cf839 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:50.808231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8011c770-6dd0-4b78-9e68-6b6a877cf839 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:50.876702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8011c770-6dd0-4b78-9e68-6b6a877cf839 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Going to try to stop instance {{(pid=122354) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:20:50.972246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8011c770-6dd0-4b78-9e68-6b6a877cf839 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5/action" status: 202 len: 0 microversion: 2.1 time: 0.183339 Oct 02 01:20:50.973481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2186/4514] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:20:50 2022] POST /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:20:50.982883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:50.983684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:50.997001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.000064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.000912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.004158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.004868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.006156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.454543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:51.455474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:51.464372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.464866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.465297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.466518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.467498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.468109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.481035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:51.491935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27e24f43-4905-465f-b32e-d1544b3c654c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.514403 Oct 02 01:20:51.525870 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2329/4515] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:50 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:51.879422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:51.889431 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff3fc442-bdea-424d-bfd5-1359ae4fc02c tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1521 microversion: 2.1 time: 0.439826 Oct 02 01:20:51.890370 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2187/4516] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:51 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:51.917767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:51.917958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:51.924731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.925532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.926481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.927460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.928575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.929334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.960478 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:52.008615 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:52.028032 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] HTTP exception thrown: Action 999 not found Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Request method failure captured: Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0/os-instance-actions/999 HTTP/1.1 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOdb54PbXmhgVOIqXXZ57Zty2IhPkMNny_9UasXnrD7Dsp6DX-_ba30iVUL0vYbOdsD3Ack4zUqqL6VkfZmjVVSGtYFn2KjqCx6lq5cMGU7GE9NpCDOUMtXJzzw7dj1-2dEwSYV6tLzDHDLQtEOCAkMH8jr2THXftB4pr0LOuANbqP0 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b19b890a2ecc41439c8f44c11034441b Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b19b890a2ecc41439c8f44c11034441b"}]}] Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b19b890a2ecc41439c8f44c11034441b Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceActionsNegativeTestJSON-1456405011-project Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 567970d4c702481995721669932ce41e Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1456405011-project Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: exception: Action 999 not found Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '1b508a9f-5031-4ef9-908b-94429213b4a0', 'id': '999'} Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 02 01:20:52.036851 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.042220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Returning 404 to user: Action 999 not found {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:52.044089 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59f314b0-b4d2-459a-864f-2d6f1cb91dc7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.130968 Oct 02 01:20:52.045214 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2330/4517] 10.222.0.23 () {58 vars in 1308 bytes} [Sun Oct 2 01:20:51 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0/os-instance-actions/999 => generated 66 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:20:52.058074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbcf581b-53e4-4976-91e4-924fd1905448 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '.version_select at 0x7fb880b0b040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:52.058669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbcf581b-53e4-4976-91e4-924fd1905448 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: da5a9406-4b8b-4b12-8977-be751aa09aaa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:52.070078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fbcf581b-53e4-4976-91e4-924fd1905448 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] HTTP exception thrown: Instance da5a9406-4b8b-4b12-8977-be751aa09aaa could not be found. Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbcf581b-53e4-4976-91e4-924fd1905448 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Request method failure captured: Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/da5a9406-4b8b-4b12-8977-be751aa09aaa/os-instance-actions HTTP/1.1 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOdb54PbXmhgVOIqXXZ57Zty2IhPkMNny_9UasXnrD7Dsp6DX-_ba30iVUL0vYbOdsD3Ack4zUqqL6VkfZmjVVSGtYFn2KjqCx6lq5cMGU7GE9NpCDOUMtXJzzw7dj1-2dEwSYV6tLzDHDLQtEOCAkMH8jr2THXftB4pr0LOuANbqP0 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: b19b890a2ecc41439c8f44c11034441b Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b19b890a2ecc41439c8f44c11034441b"}]}] Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: b19b890a2ecc41439c8f44c11034441b Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-InstanceActionsNegativeTestJSON-1456405011-project Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 567970d4c702481995721669932ce41e Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1456405011-project Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: exception: Instance da5a9406-4b8b-4b12-8977-be751aa09aaa could not be found. Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': 'da5a9406-4b8b-4b12-8977-be751aa09aaa'} Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5a9406-4b8b-4b12-8977-be751aa09aaa could not be found. Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:20:52.074526 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5a9406-4b8b-4b12-8977-be751aa09aaa could not be found. Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5a9406-4b8b-4b12-8977-be751aa09aaa could not be found. Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:20:52.078240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbcf581b-53e4-4976-91e4-924fd1905448 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Returning 404 to user: Instance da5a9406-4b8b-4b12-8977-be751aa09aaa could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:52.079972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fbcf581b-53e4-4976-91e4-924fd1905448 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/da5a9406-4b8b-4b12-8977-be751aa09aaa/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.027899 Oct 02 01:20:52.083124 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2188/4518] 10.222.0.23 () {58 vars in 1296 bytes} [Sun Oct 2 01:20:52 2022] GET /compute/v2.1/servers/da5a9406-4b8b-4b12-8977-be751aa09aaa/os-instance-actions => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:52.091482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:52.092257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:52.116970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.117609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.118786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.121838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.127327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.127937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.213202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:20:52.458540 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fffab22a-5dd3-4db1-97a7-906342acb4f5 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 204 len: 0 microversion: 2.1 time: 0.372026 Oct 02 01:20:52.460342 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2331/4519] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:20:52 2022] DELETE /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:20:52.469224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:52.470918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:52.475706 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:52.484457 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=18 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:52.490651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.503890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.504745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.505736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.506403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.507070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.523090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:52.523867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:52.536062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.536586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.537037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.539251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.544051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.544596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:53.569691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:53.584231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:53.585853 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1fbfba1-60f5-45ba-bf03-1b3a0e9e9a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1527 microversion: 2.1 time: 1.120332 Oct 02 01:20:53.587351 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2189/4520] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:52 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1527 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:53.616491 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c01412d5-2967-4b02-b112-9b112b2d3196 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 1.102865 Oct 02 01:20:53.617712 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2332/4521] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:52 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:54.610773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:54.612019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:54.636570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:54.637059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:54.637690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:54.638705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:54.639379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:54.640022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:54.646030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:54.647349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:54.658959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:54.660865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:54.661699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:54.663455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:54.664250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:54.666143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:55.328472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:55.339021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0905559-0f8f-4e5b-8a2b-de3e51517a45 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1527 microversion: 2.1 time: 0.732297 Oct 02 01:20:55.339952 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2190/4522] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:54 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1527 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:55.577789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:55.608214 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a734e379-4c5d-4e01-bdbb-64c10e351b8e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.966552 Oct 02 01:20:55.613227 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2333/4523] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:54 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:56.110126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7ff7defb-a2b3-4d3c-887f-d659a8df0824 req-31f7d97d-0568-4a04-ac83-0b6e5d03714b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b508a9f-5031-4ef9-908b-94429213b4a0", "name": "network-vif-deleted", "tag": "7389287d-3af8-4a40-b19a-c851dc68882b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:20:56.136709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7ff7defb-a2b3-4d3c-887f-d659a8df0824 req-31f7d97d-0568-4a04-ac83-0b6e5d03714b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.137680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7ff7defb-a2b3-4d3c-887f-d659a8df0824 req-31f7d97d-0568-4a04-ac83-0b6e5d03714b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.141530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7ff7defb-a2b3-4d3c-887f-d659a8df0824 req-31f7d97d-0568-4a04-ac83-0b6e5d03714b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.178148 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7ff7defb-a2b3-4d3c-887f-d659a8df0824 req-31f7d97d-0568-4a04-ac83-0b6e5d03714b service nova] Creating event network-vif-deleted:7389287d-3af8-4a40-b19a-c851dc68882b for instance 1b508a9f-5031-4ef9-908b-94429213b4a0 on n-h2-master-1 Oct 02 01:20:56.198651 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7ff7defb-a2b3-4d3c-887f-d659a8df0824 req-31f7d97d-0568-4a04-ac83-0b6e5d03714b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089404 Oct 02 01:20:56.199632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2191/4524] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:20:56.364641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:56.366023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:56.375876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.384578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.391138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.392259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.392980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.394748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.446778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.447571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.448284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.449003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lazy-loading 'fault' on Instance uuid 1b508a9f-5031-4ef9-908b-94429213b4a0 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:20:56.634068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567970d4c702481995721669932ce41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19b890a2ecc41439c8f44c11034441b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:56.641670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:56.643030 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1b4770d-a833-4bf5-bdd5-192f8701a1a9 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 200 len: 1315 microversion: 2.1 time: 0.283199 Oct 02 01:20:56.643936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:56.646640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2334/4525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:56 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:56.669230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.669746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.670193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.670945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.671412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.671848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:57.548966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:57.559358 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c292329d-efba-41f0-8cf7-eaa885183627 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.929330 Oct 02 01:20:57.560189 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2192/4526] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:56 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:57.674797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:57.676072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] [instance: 1b508a9f-5031-4ef9-908b-94429213b4a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:57.686155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:57.687644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:57.688542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:57.689417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:57.690035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:57.690643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:57.706796 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] HTTP exception thrown: Instance 1b508a9f-5031-4ef9-908b-94429213b4a0 could not be found. Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Request method failure captured: Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 HTTP/1.1 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOdb54PbXmhgVOIqXXZ57Zty2IhPkMNny_9UasXnrD7Dsp6DX-_ba30iVUL0vYbOdsD3Ack4zUqqL6VkfZmjVVSGtYFn2KjqCx6lq5cMGU7GE9NpCDOUMtXJzzw7dj1-2dEwSYV6tLzDHDLQtEOCAkMH8jr2THXftB4pr0LOuANbqP0 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: b19b890a2ecc41439c8f44c11034441b Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b19b890a2ecc41439c8f44c11034441b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b19b890a2ecc41439c8f44c11034441b"}]}] Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: b19b890a2ecc41439c8f44c11034441b Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1456405011 Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-InstanceActionsNegativeTestJSON-1456405011-project Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 567970d4c702481995721669932ce41e Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1456405011-project Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 1b508a9f-5031-4ef9-908b-94429213b4a0 could not be found. Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '1b508a9f-5031-4ef9-908b-94429213b4a0'} Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b508a9f-5031-4ef9-908b-94429213b4a0 could not be found. Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b508a9f-5031-4ef9-908b-94429213b4a0 could not be found. Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:57.709017 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b508a9f-5031-4ef9-908b-94429213b4a0 could not be found. Oct 02 01:20:57.713441 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:20:57.715402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] Returning 404 to user: Instance 1b508a9f-5031-4ef9-908b-94429213b4a0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:20:57.716763 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b98e2a0-f651-4b37-b4d1-d9135c7680f7 tempest-InstanceActionsNegativeTestJSON-1456405011 tempest-InstanceActionsNegativeTestJSON-1456405011-project] 10.222.0.23 "GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0" status: 404 len: 111 microversion: 2.1 time: 0.045837 Oct 02 01:20:57.717547 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2335/4527] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:57 2022] GET /compute/v2.1/servers/1b508a9f-5031-4ef9-908b-94429213b4a0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:58.584009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:58.584588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:58.600826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:58.601357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:58.602462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:58.603310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:58.603755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:58.604331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:59.199163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:59.216861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5fd1017-0dbd-4bb8-b27b-ee51af77899f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.635311 Oct 02 01:20:59.218384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2193/4528] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:58 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:59.884510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:59.886477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:59.903708 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:59.909642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:59.910422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:59.911613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:59.913306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:59.914753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:59.915529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:59.964284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff1dbce9-d0a2-47b1-9240-3b95842dc44e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/ips" status: 200 len: 149 microversion: 2.1 time: 0.093819 Oct 02 01:20:59.965333 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2336/4529] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:20:59 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/ips => generated 149 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:00.248247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:00.249840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:00.267624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:00.274848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:00.275564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:00.276682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:00.278742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:00.280327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:00.948424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:00.984957 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a2af980-d78c-4976-8a25-c862d9386073 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.740666 Oct 02 01:21:00.998470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2194/4530] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:00 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:02.021829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:02.022446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:02.040592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:02.045841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:02.055840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:02.057945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:02.061299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:02.061987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:02.879619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:02.904479 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cef1e24f-1dbd-4e0e-98cf-099018bb33a9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.886540 Oct 02 01:21:02.906802 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2337/4531] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:02 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:03.047764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b5b39fc-07f0-46e0-8d06-2dcc01188e6b"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:03.051356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:03.063548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:03.064214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:03.064815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:03.065882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:03.066496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:03.067966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:03.263003 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:03.459040 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffcdbef5-620c-4a7d-b29c-fa3caabd3e62 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415105 Oct 02 01:21:03.460190 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2195/4532] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:21:03 2022] POST /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:03.934239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:03.935780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:03.949396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:03.954877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:03.955511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:03.956473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:03.958503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:03.975337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:04.723233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:04.732754 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca847406-13ed-4750-b575-2237abca6623 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.803084 Oct 02 01:21:04.733312 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2338/4533] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:03 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:05.774313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:05.775201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:05.814522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:05.815055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:05.815498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:05.816211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:05.816923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:05.817352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:06.811636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:06.825846 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b40db768-6cce-4224-ab0f-9095cc2ec91e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 1.067175 Oct 02 01:21:06.827638 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2196/4534] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:05 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:07.852051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:07.852706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:07.875743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:07.877078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:07.882221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:07.882221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:07.885100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:07.888462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:08.305887 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:08.314063 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99feb0e8-e89b-4e8d-b5e4-8d5df556d28a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.466639 Oct 02 01:21:08.334968 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2339/4535] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:07 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:09.349413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:09.351629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:09.366899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:09.367433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:09.367931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:09.370543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:09.371061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:09.371505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:10.919220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:10.927261 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1780f396-530f-4f2a-ade9-7b54b7bd1a07 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 1.582683 Oct 02 01:21:10.927852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2197/4536] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:09 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:11.955492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:11.956280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:11.991835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:11.998222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:12.000646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:12.001418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:12.001883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:12.007676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:13.152812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:13.180560 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d0fb7a52-9ebc-47cf-a55f-2692fad83eb5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 1.231089 Oct 02 01:21:13.186106 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2340/4537] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:11 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:14.207771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:14.209023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:14.224771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:14.225770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:14.226410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:14.228391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:14.230962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:14.231598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:14.671529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:14.682752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9603a7f-5833-4839-8472-098679e439c8 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.479432 Oct 02 01:21:14.699193 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2198/4538] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:14 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:15.431877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-830857493", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:15.518959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:21:15.519382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:21:15.520060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:21:15.520637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:21:15.521217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:21:15.543323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:15.544279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:15.544951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:15.546382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:15.549064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:15.551484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:15.587235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Getting quotas for project 43f430c55874406eabf551e14b955282. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:21:15.601971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Getting quotas for user cc4d3e3c7fe74e48be84c87ee70687cb and project 43f430c55874406eabf551e14b955282. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:21:15.623058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:21:15.626896 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:15.715567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:15.716202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:15.746839 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0a8cc060-7387-4882-9888-a28a124123c7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.803239 Oct 02 01:21:15.748761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:15.749310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:15.749757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:15.751683 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2341/4539] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:21:15.754445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:15.755122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:15.756605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:15.782315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be03d3bf-ecb8-4fab-ac93-9fdad01cf024 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:15.782967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be03d3bf-ecb8-4fab-ac93-9fdad01cf024 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:15.994634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be03d3bf-ecb8-4fab-ac93-9fdad01cf024 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:16.002821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be03d3bf-ecb8-4fab-ac93-9fdad01cf024 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:16.010410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be03d3bf-ecb8-4fab-ac93-9fdad01cf024 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:16.013196 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be03d3bf-ecb8-4fab-ac93-9fdad01cf024 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1280 microversion: 2.47 time: 0.254833 Oct 02 01:21:16.029994 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2342/4540] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:15 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:16.326946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:16.339268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-da8d6053-45e9-412b-b247-111f409a1baf tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1512 microversion: 2.1 time: 0.630072 Oct 02 01:21:16.359998 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2199/4541] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:15 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:17.071762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c904db99-f91e-499a-8951-8e1d4d398fc9 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:17.072980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c904db99-f91e-499a-8951-8e1d4d398fc9 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:17.366542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c904db99-f91e-499a-8951-8e1d4d398fc9 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:17.370879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:17.373724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:17.395586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:17.396081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:17.396593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c904db99-f91e-499a-8951-8e1d4d398fc9 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:17.398779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c904db99-f91e-499a-8951-8e1d4d398fc9 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:17.399453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:17.400735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:17.408277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:17.409174 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c904db99-f91e-499a-8951-8e1d4d398fc9 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1280 microversion: 2.47 time: 0.354805 Oct 02 01:21:17.409813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:17.415839 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2343/4542] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:17 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:17.892454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:17.907942 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-119f5b0a-46b8-4071-b854-434ed030d45d tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1489 microversion: 2.1 time: 0.543694 Oct 02 01:21:17.910709 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2200/4543] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:17 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1489 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:17.933263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:17.934125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:17.957088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:17.957928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:17.959913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:17.960934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:17.961641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:17.962296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.009347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:21:18.228919 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-446764a0-eeff-4d05-be5c-afe80e05b96a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 204 len: 0 microversion: 2.1 time: 0.298135 Oct 02 01:21:18.231001 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2344/4544] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:21:17 2022] DELETE /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:21:18.239610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:18.247891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:18.270392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:18.274454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:18.276499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.279542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:18.281748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:18.284905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.442673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:18.443640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:18.465758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:18.467243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:18.471538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.474161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:18.480184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:18.484218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.980101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:18.996261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:18.998194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:18.999503 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c74393ef-c131-4aef-8b34-e861e2b1f1bd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1350 microversion: 2.47 time: 0.561663 Oct 02 01:21:19.004444 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2345/4545] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:18 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1350 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:21:19.181790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:19.195676 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4fb4bab5-86d7-4c1f-ae55-efb6c2bdccd9 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1495 microversion: 2.1 time: 0.960020 Oct 02 01:21:19.196660 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2201/4546] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:18 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1495 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:20.033209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:20.033822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:20.041863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:20.047323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:20.047775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:20.048518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:20.048974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:20.049397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:20.226713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:20.227514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:20.243896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:20.244655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:20.252055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:20.253314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:20.253979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:20.256206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:20.295651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:20.311022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:20.313347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:20.315765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9db514f9-842e-429d-8474-73877ed3a65b tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1338 microversion: 2.47 time: 0.286158 Oct 02 01:21:20.320505 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2346/4547] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:20 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:20.867094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70fce32f-c116-4a79-9e25-c69c7beee8dc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: .version_select at 0x7fb885557040>, body: {"keypair": {"name": "tempest-keypair-2139151506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT1NLLpSWTpiRJLVE2SzMTrJwJH0iqvAmysWUdd7Pwfe+lc307I0RkbVVR+Q/e9O+/pEWyao43Z2MCUHcDfcWAFHfz8iMkqIuQvEXP1wu0f9FC2la00p4fxbryXUxsrBg=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:20.900385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-70fce32f-c116-4a79-9e25-c69c7beee8dc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:21:20.910465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-70fce32f-c116-4a79-9e25-c69c7beee8dc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:21:20.968673 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70fce32f-c116-4a79-9e25-c69c7beee8dc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102968 Oct 02 01:21:20.969936 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2347/4548] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:21:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:21:21.142358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:21.152277 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9d6c969-d14f-4e4a-a612-7fda1b6e6754 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1495 microversion: 2.1 time: 0.932142 Oct 02 01:21:21.163512 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2202/4549] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:20 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1495 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:21.351479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:21.352194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:21.374448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:21.375017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:21.375471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:21.376204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:21.382180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:21.386654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:21.431253 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:21.860426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:21.877583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:21.886050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:21.894431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-04190523-3cfe-4375-a74d-9f54bd217015 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1338 microversion: 2.47 time: 0.544591 Oct 02 01:21:21.895730 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2348/4550] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:21 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1338 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:22.176499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:22.178576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:22.190123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.202413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.202917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.203906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.204132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.215875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.319076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.322712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.323175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.324723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lazy-loading 'fault' on Instance uuid cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:21:22.484975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:22.508331 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1457898-5c6f-4095-aa9a-703313eceda5 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 200 len: 1305 microversion: 2.1 time: 0.336389 Oct 02 01:21:22.513875 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2349/4551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:22 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 1305 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:22.540989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-669c3c36-ab4c-469b-8e11-ba51207bdfa9 req-5b8af427-c8cd-449f-994a-4e3f7cfcd165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5", "name": "network-vif-deleted", "tag": "e3e58de4-7d9e-4024-9ae6-b569da156e94"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:22.555437 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=33 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:22.559603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-669c3c36-ab4c-469b-8e11-ba51207bdfa9 req-5b8af427-c8cd-449f-994a-4e3f7cfcd165 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.560092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-669c3c36-ab4c-469b-8e11-ba51207bdfa9 req-5b8af427-c8cd-449f-994a-4e3f7cfcd165 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.560536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-669c3c36-ab4c-469b-8e11-ba51207bdfa9 req-5b8af427-c8cd-449f-994a-4e3f7cfcd165 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.596468 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-669c3c36-ab4c-469b-8e11-ba51207bdfa9 req-5b8af427-c8cd-449f-994a-4e3f7cfcd165 service nova] Creating event network-vif-deleted:e3e58de4-7d9e-4024-9ae6-b569da156e94 for instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 on n-h2-master-1 Oct 02 01:21:22.604226 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-669c3c36-ab4c-469b-8e11-ba51207bdfa9 req-5b8af427-c8cd-449f-994a-4e3f7cfcd165 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.586210 Oct 02 01:21:22.609932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2203/4552] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:22.923817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:22.924603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:22.939421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.942244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.949901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.953385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.954419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.955063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:23.142834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:23.152722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:23.159464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:23.164793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c26d94d9-9b83-4d8b-bde9-61f783657fe7 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1338 microversion: 2.47 time: 0.245021 Oct 02 01:21:23.167194 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2350/4553] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:22 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1338 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:23.543170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:23.544471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:23.562166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:23.566213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:23.569463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:23.576586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:23.578041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:23.582170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:23.654139 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 HTTP/1.1 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: exception: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5'} Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:23.658248 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:23.662364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:21:23.665682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-295b527c-215c-47f6-840b-ab425365816b tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 404 len: 111 microversion: 2.1 time: 0.128080 Oct 02 01:21:23.670016 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2351/4554] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:23 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:21:23.695594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1693491298", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1e12117d-db3c-43bb-a89f-2a17183233e1"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:23.766584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] validate_networks() for [('1e12117d-db3c-43bb-a89f-2a17183233e1', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:21:23.815479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-345307877", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "eb68ef2f-a59c-4898-8f53-b76fbcb64bf6"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:23.947676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] validate_networks() for [('eb68ef2f-a59c-4898-8f53-b76fbcb64bf6', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:21:24.718343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:21:24.719854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:21:24.721196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:21:24.728658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:21:24.731999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:21:24.754118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:24.755917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:24.756828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:24.758029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:24.758928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:24.759562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:24.811017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Getting quotas for project 64858251a1ff4228adccb029de599d31. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:21:24.818957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Getting quotas for user 85d3ffda1a2247e891ef255f3f90ea15 and project 64858251a1ff4228adccb029de599d31. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:21:24.837552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:21:24.839102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:21:24.839789 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:21:24.841686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:21:24.843338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:21:24.922189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:24.927075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:24.928866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Going to run 3 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:21:24.937541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:24.941827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:24.944145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:24.944762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:24.946394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:25.011836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Getting quotas for project e1173034060443ac93a081ad71fb2629. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:21:25.018000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Getting quotas for user b890aa0529304095933195cea870279b and project e1173034060443ac93a081ad71fb2629. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:21:25.037649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=0ea99b17-270b-49d5-9373-f5c50fab9c07,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:25.053968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:21:25.056481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:25.111482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=a9da8979-b30e-416f-b666-25b8e3618e57,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:25.152969 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-74dafd56-8dd6-4f36-a35c-0268be7220b6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791404 Oct 02 01:21:25.157500 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2204/4555] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:21:25.167468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-189936495", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "81be0b42-87f2-4569-b512-d0825388c141"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:25.320765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41a1b174-2f23-4afc-bc27-d4727f328d9c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.651007 Oct 02 01:21:25.331347 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2352/4556] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:21:25.335147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] validate_networks() for [('81be0b42-87f2-4569-b512-d0825388c141', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:21:25.346370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:25.350505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:25.366231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:25.366231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:25.366231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:25.396756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:25.399460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:25.400801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:25.628801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:25.644760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:25.647865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:25.649985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3f8c59e-d82c-461a-9ee6-f6346b109828 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1359 microversion: 2.47 time: 0.315195 Oct 02 01:21:25.685630 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2353/4557] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:25 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1359 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:25.700885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6651ea44-f9b8-483c-b891-03ac36ef82d6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:25.703686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6651ea44-f9b8-483c-b891-03ac36ef82d6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:25.891582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6651ea44-f9b8-483c-b891-03ac36ef82d6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:25.902563 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6651ea44-f9b8-483c-b891-03ac36ef82d6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1228 microversion: 2.1 time: 0.212850 Oct 02 01:21:25.903206 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2354/4558] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:25 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1228 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:25.921769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:25.934081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:25.935306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:21:25.993408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:25.994582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:25.995235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:25.996198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:25.996663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:25.998639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.069316 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3af3dcc0-de51-4269-9cde-20df001cd76c tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.164717 Oct 02 01:21:26.069917 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2355/4559] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:21:25 2022] GET /compute/v2.1/servers => generated 1015 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:26.083328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-443432126"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:26.085730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:26.096008 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:26.100867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:26.101362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:26.101802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.102515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:26.103004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:26.103432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.462327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:21:26.463069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:21:26.463794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:21:26.464501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:21:26.465172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:21:26.482368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:26.492100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:26.493368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.494553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:26.495425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:26.496208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.521063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:21:26.528056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Getting quotas for user db9450c53d8944b88cfbbc541f585ba0 and project 1d8558d451aa4c17b359f4ae0274a371. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:21:26.561916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:21:26.564847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:26.629703 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1c8dfc0-99b3-4c3d-818d-8f92ddc662fd tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "POST /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd/action" status: 202 len: 52 microversion: 2.47 time: 0.550181 Oct 02 01:21:26.637064 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2356/4560] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:21:26 2022] POST /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd/action => generated 52 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:21:26.642301 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a0ef070-4f8e-4e9c-be6c-839b07485320 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.483193 Oct 02 01:21:26.643027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e6a5af1c-d2c7-41c9-b6b5-360170036f41 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:26.643310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2205/4561] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:21:26.644108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e6a5af1c-d2c7-41c9-b6b5-360170036f41 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:26.654954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:26.656758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:26.685048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:26.685889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:26.686567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.688594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:26.689624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:26.692268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:26.728476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:21:26.784606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6a5af1c-d2c7-41c9-b6b5-360170036f41 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:26.797154 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e6a5af1c-d2c7-41c9-b6b5-360170036f41 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1222 microversion: 2.1 time: 0.156051 Oct 02 01:21:26.804364 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2357/4562] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:26 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:26.828429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b75ee33b-5b2d-4e13-a3a7-3975d07410e7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:26.830194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b75ee33b-5b2d-4e13-a3a7-3975d07410e7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:26.932586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b75ee33b-5b2d-4e13-a3a7-3975d07410e7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:26.950880 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b75ee33b-5b2d-4e13-a3a7-3975d07410e7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1214 microversion: 2.1 time: 0.126257 Oct 02 01:21:26.963794 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2358/4563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:26 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:26.980348 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14904f72-7255-4184-a5a0-a51528e64437 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 204 len: 0 microversion: 2.47 time: 0.333712 Oct 02 01:21:26.983426 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2206/4564] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:21:26 2022] DELETE /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:21:27.003235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:27.006839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:27.010447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:27.012838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:27.020064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.023318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.026074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.028623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.029373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.032015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.032451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.034023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.035018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.039142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.039695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.040175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.219198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:27.238107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:27.259907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:27.268998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:27.269265 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af172c74-be9b-45bf-9c33-f303629f9b14 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1365 microversion: 2.47 time: 0.277491 Oct 02 01:21:27.271348 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2207/4565] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:26 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:27.288218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc4389a2-a116-444b-b23e-40d7e94caf35 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1280 microversion: 2.1 time: 0.310688 Oct 02 01:21:27.295799 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2359/4566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:26 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:27.831278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:27.833482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:27.853877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.855561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.860248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.862415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.865160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.866774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.980694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:27.981618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:28.014418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.017744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.018193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.018967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.019437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.019918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.276401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:28.284882 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7440a7e8-1458-4c20-a6d5-3d4ec0b796cd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1226 microversion: 2.1 time: 0.459752 Oct 02 01:21:28.285492 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2208/4567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:27 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1226 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:28.300461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-28699901", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d59648e8-d54a-41ca-842c-4437e3a4d0f9"}], "security_groups": [{"name": "tempest-securitygroup--1390628571"}], "key_name": "tempest-keypair-2139151506", "user_data": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:28.412793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:28.434319 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09b903f9-03fc-43af-bcda-3a5387250a18 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1218 microversion: 2.1 time: 0.461261 Oct 02 01:21:28.434968 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2360/4568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:27 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1218 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:28.459446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:28.460073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:28.493506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.496495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.496954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.497703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.498164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.498617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.619373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] validate_networks() for [('d59648e8-d54a-41ca-842c-4437e3a4d0f9', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:21:28.784702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:28.805101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:28.810291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:28.817869 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52156131-aff5-4eee-ab4c-4a648cf960ae tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1365 microversion: 2.47 time: 0.375976 Oct 02 01:21:28.820495 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2361/4569] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:28 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:28.838132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:28.840282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:28.850206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.850993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.852025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.853322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.855628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.856961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:29.292513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:29.321317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e5ae3947-8350-44bd-944f-ed87ca3dbaaa tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1286 microversion: 2.1 time: 0.498692 Oct 02 01:21:29.328774 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2362/4570] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:28 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1286 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:29.344383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:29.345011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:29.385006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:29.385427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:29.391246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:29.397340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:29.397929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:29.398390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:30.921244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:30.933942 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1fb7fbf-e083-4349-bbc0-f6ad2b59f347 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1274 microversion: 2.1 time: 1.599996 Oct 02 01:21:30.934661 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2363/4571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:29 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1274 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:31.674969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:31.675815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:31.700098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.708435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.712028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:31.716750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.717847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.720445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.093469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:32.109571 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c8697c0-5161-4b5c-b88b-c4eb1093742a tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1284 microversion: 2.1 time: 1.132818 Oct 02 01:21:32.124639 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2364/4572] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:30 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1284 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:32.141310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:32.141947 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:32.171210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.171959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.172556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.175385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.176289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.178869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.320366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.320869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.330724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.331399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lazy-loading 'fault' on Instance uuid f123da40-64bc-408b-89be-dd5092442ddd {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:21:32.452852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:32.477559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:32.479204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4d3e3c7fe74e48be84c87ee70687cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f430c55874406eabf551e14b955282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:32.480542 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9662b2f-8a0c-44db-98ff-79de259868a0 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 200 len: 1370 microversion: 2.47 time: 0.354848 Oct 02 01:21:32.483402 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2365/4573] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:32 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 1370 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:21:32.497969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:32.498998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:32.518279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.519884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.521197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.525422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.526444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.528893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.128496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:21:33.129053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:21:33.129733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:21:33.130352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:21:33.130955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:21:33.148822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.157881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.164219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.168013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.168611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.170032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.234053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:21:33.244816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:21:33.269272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:21:33.272711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:21:33.356841 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9baf3e3c-88c0-41af-8b1c-c03af803e477 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.070196 Oct 02 01:21:33.360786 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2209/4574] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 5075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:21:33.371391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:33.372021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:33.379102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.380059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.380710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.381723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.382431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.383237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.409835 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:33.489323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:33.502269 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0d9e72d-15b9-4144-845a-08fda679fcdd tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 1.017469 Oct 02 01:21:33.514629 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2366/4575] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:32 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:33.514629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:33.514629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:33.515273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:33.530048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.530552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.531031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.531206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae9d3908-3500-460a-8c8b-b04f933bebae tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1280 microversion: 2.1 time: 0.169228 Oct 02 01:21:33.531754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.532149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2210/4576] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:33 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:33.546794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.546794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.553422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a1a7e59-92f1-4b37-b4a4-41eac3a2fdc8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:33.554041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a1a7e59-92f1-4b37-b4a4-41eac3a2fdc8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:33.706816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a1a7e59-92f1-4b37-b4a4-41eac3a2fdc8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:33.723828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a1a7e59-92f1-4b37-b4a4-41eac3a2fdc8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1240 microversion: 2.1 time: 0.173926 Oct 02 01:21:33.724566 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2211/4577] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:33 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1240 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:33.735012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:33.735630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] [instance: f123da40-64bc-408b-89be-dd5092442ddd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:33.775901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.783097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.784897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.786516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.787782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.788361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.822585 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] HTTP exception thrown: Instance f123da40-64bc-408b-89be-dd5092442ddd could not be found. Oct 02 01:21:33.826834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Request method failure captured: Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd HTTP/1.1 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOeKCVIKiBOotXYEYphhsgj6Oz6iQj9DzeF4DH37Ij2jIpV7DkXd76CcIa7oZC2Wxh2pePAcWq3GXbM1sZaGx1irxypFgoxKSwX5Xnmb2wWlvGZ7atNzcbNj6h1odYy8t2S9F5pEsLUymLaguTLP1ik7CEve3WNts7czpLBWGid7aK8 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.47 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 43f430c55874406eabf551e14b955282 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAaction247Test-264466206 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/43f430c55874406eabf551e14b955282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43f430c55874406eabf551e14b955282"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43f430c55874406eabf551e14b955282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_43f430c55874406eabf551e14b955282"}]}] Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAaction247Test-264466206 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 43f430c55874406eabf551e14b955282 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAaction247Test-264466206 Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAaction247Test-264466206-project Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: cc4d3e3c7fe74e48be84c87ee70687cb Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAaction247Test-264466206-project Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: exception: Instance f123da40-64bc-408b-89be-dd5092442ddd could not be found. Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f123da40-64bc-408b-89be-dd5092442ddd'} Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f123da40-64bc-408b-89be-dd5092442ddd could not be found. Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f123da40-64bc-408b-89be-dd5092442ddd could not be found. Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:33.835276 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f123da40-64bc-408b-89be-dd5092442ddd could not be found. Oct 02 01:21:33.840527 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:21:33.841011 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8115f06-3589-4343-bca6-9c8eec00005c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1272 microversion: 2.1 time: 0.329976 Oct 02 01:21:33.842898 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2367/4578] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:33 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:33.851007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] Returning 404 to user: Instance f123da40-64bc-408b-89be-dd5092442ddd could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:21:33.852151 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3817373-3fab-4c93-bd5d-59d8a1b81a79 tempest-ServersAaction247Test-264466206 tempest-ServersAaction247Test-264466206-project] 10.222.0.23 "GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd" status: 404 len: 111 microversion: 2.47 time: 0.126414 Oct 02 01:21:33.853644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2212/4579] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:21:33 2022] GET /compute/v2.1/servers/f123da40-64bc-408b-89be-dd5092442ddd => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:21:34.539867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:34.540546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:34.562715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.563295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.566197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.568677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.570556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.571057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.573905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:34.574551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:34.587648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.588143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.609535 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:34.614911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.615685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.631771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.632416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.044067 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:36.414298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:36.423441 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5aa10acc-1e85-4e85-bca9-6ae63b4a4fd3 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 1.890375 Oct 02 01:21:36.427138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2368/4580] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:34 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:36.431895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:36.432387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:36.450189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.450725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.451168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.451870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.456095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:36.459400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.459858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.473866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4969a5aa-819a-427b-8ba2-fa62d40fd0d8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 1.912722 Oct 02 01:21:36.474690 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2213/4581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:34 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:36.496087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:36.496708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:36.511301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.514199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.514691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.515425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.515890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.517245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.524891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c89ea13d-d2dd-4961-8eaa-12704c1b16d6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/ips" status: 200 len: 146 microversion: 2.1 time: 0.096635 Oct 02 01:21:36.526260 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2369/4582] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:21:36 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/ips => generated 146 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:36.541620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:36.542473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:36.549817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.551220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.551877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.553081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.553534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.553962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.892096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:36.919386 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f76adb8-6308-45dc-98dc-df2ac3701fa9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1298 microversion: 2.1 time: 0.431292 Oct 02 01:21:36.919983 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2214/4583] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:36 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1298 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:36.945342 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=26 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:37.063317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:37.074834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c114b37e-b9e1-409a-bc8a-ab86f359ba35 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 0.547173 Oct 02 01:21:37.078310 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2370/4584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:36 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:37.451197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:37.451834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:37.477422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:37.478000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:37.478334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:37.479151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:37.479613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:37.481711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:37.502119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:37.502958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:37.525023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:37.527756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:37.529437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:37.531795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:37.535882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:37.538570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.405642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:39.418020 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ba916c18-1aba-41fe-a748-279458c15159 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 1.917088 Oct 02 01:21:39.418980 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2371/4585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:37 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:39.427750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5948515b-e6d6-4768-9cd7-f06549c49fe1 req-a6580273-a42d-4d85-a4f1-493863f59a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c17dafc6-32d2-40c4-910a-f7d1125bb007", "tag": "2ed6165b-0079-4db5-a073-2241bbc5fd5c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:39.455196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5948515b-e6d6-4768-9cd7-f06549c49fe1 req-a6580273-a42d-4d85-a4f1-493863f59a06 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.455750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5948515b-e6d6-4768-9cd7-f06549c49fe1 req-a6580273-a42d-4d85-a4f1-493863f59a06 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.456211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5948515b-e6d6-4768-9cd7-f06549c49fe1 req-a6580273-a42d-4d85-a4f1-493863f59a06 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.483350 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5948515b-e6d6-4768-9cd7-f06549c49fe1 req-a6580273-a42d-4d85-a4f1-493863f59a06 service nova] Creating event network-changed:2ed6165b-0079-4db5-a073-2241bbc5fd5c for instance c17dafc6-32d2-40c4-910a-f7d1125bb007 on n-h2-master-1 Oct 02 01:21:39.496372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5948515b-e6d6-4768-9cd7-f06549c49fe1 req-a6580273-a42d-4d85-a4f1-493863f59a06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075831 Oct 02 01:21:39.500695 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2372/4586] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:39.511412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:39.512062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:39.537652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.538152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.538593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.539332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.539791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.540220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.795289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:39.812802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1702c39a-6d67-4dfb-a99a-51b4a27b95f8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 2.365692 Oct 02 01:21:39.813672 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2215/4587] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:37 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:39.837626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:39.847441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:39.850119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:39.854803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91ea726d-0055-4fab-94a8-a0f88476a6f0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1298 microversion: 2.1 time: 0.352437 Oct 02 01:21:39.856429 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2373/4588] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:39 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1298 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:39.870369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.872642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.873112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.873852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.877055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.877510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.958939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cdc04bd-47d8-47be-acb1-a5bc865b872c"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:39.962467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:39.971704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.973212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.973681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.974501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.975061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.975606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:40.333941 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-847797bf-152f-47ce-8870-2e66bf01a93c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381812 Oct 02 01:21:40.334813 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2374/4589] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:21:39 2022] POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:21:40.445468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:40.447622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:40.455902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:40.456621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:40.458403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:40.459203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:40.459680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:40.460301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:41.327582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:41.342206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dee66c9b-bdce-45fe-836b-e3e17a20d184 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 1.508836 Oct 02 01:21:41.345428 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2216/4590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:39 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:41.350290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:41.353554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:41.354386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:41.365404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:41.365965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:41.366620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:41.367380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:41.368259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:41.368694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:41.368824 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-733823be-5ecb-4ddc-83e4-bfbee88edcca tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 0.929504 Oct 02 01:21:41.383071 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2375/4591] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:40 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:41.392278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:41.393316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:41.400817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:41.401728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:41.402426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:41.403428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:41.404125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:41.404808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.166447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:42.180682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:42.198841 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-801c2fbb-7a3b-4c2e-a9cc-8d1a565c2936 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 0.851185 Oct 02 01:21:42.200867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff305e23-9337-40d1-ac49-ee82d8424e0b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.812795 Oct 02 01:21:42.202149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2217/4592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:41 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:42.209101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cdd132c4-c19f-496c-8682-b67b1d4d3bd9 req-81227e7e-5802-46c1-9ea3-2bda77e2225e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146766b4-1961-448c-af37-b19e59cc7768", "tag": "53297ef6-d0c6-4748-b71a-a66c3ffc1815"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:42.233506 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2376/4593] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:41 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:42.235539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cdd132c4-c19f-496c-8682-b67b1d4d3bd9 req-81227e7e-5802-46c1-9ea3-2bda77e2225e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.236716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cdd132c4-c19f-496c-8682-b67b1d4d3bd9 req-81227e7e-5802-46c1-9ea3-2bda77e2225e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.240054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cdd132c4-c19f-496c-8682-b67b1d4d3bd9 req-81227e7e-5802-46c1-9ea3-2bda77e2225e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.247980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-76424b0b-0644-4856-ade8-fea7644404bb req-6f1dd883-233d-4e06-a6b7-caf51c23c265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9da8979-b30e-416f-b666-25b8e3618e57", "tag": "a15952f9-4b4c-4d4d-9df8-cbee0fa257e9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:42.272456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cdd132c4-c19f-496c-8682-b67b1d4d3bd9 req-81227e7e-5802-46c1-9ea3-2bda77e2225e service nova] Creating event network-changed:53297ef6-d0c6-4748-b71a-a66c3ffc1815 for instance 146766b4-1961-448c-af37-b19e59cc7768 on n-h2-master-1 Oct 02 01:21:42.279762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-76424b0b-0644-4856-ade8-fea7644404bb req-6f1dd883-233d-4e06-a6b7-caf51c23c265 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.280614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-76424b0b-0644-4856-ade8-fea7644404bb req-6f1dd883-233d-4e06-a6b7-caf51c23c265 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.281268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-76424b0b-0644-4856-ade8-fea7644404bb req-6f1dd883-233d-4e06-a6b7-caf51c23c265 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.282902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cdd132c4-c19f-496c-8682-b67b1d4d3bd9 req-81227e7e-5802-46c1-9ea3-2bda77e2225e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076844 Oct 02 01:21:42.283645 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2218/4594] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:42.309046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-76424b0b-0644-4856-ade8-fea7644404bb req-6f1dd883-233d-4e06-a6b7-caf51c23c265 service nova] Creating event network-changed:a15952f9-4b4c-4d4d-9df8-cbee0fa257e9 for instance a9da8979-b30e-416f-b666-25b8e3618e57 on n-h2-master-1 Oct 02 01:21:42.327439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-76424b0b-0644-4856-ade8-fea7644404bb req-6f1dd883-233d-4e06-a6b7-caf51c23c265 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090537 Oct 02 01:21:42.330430 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2377/4595] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:42.369823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:42.370695 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:42.383874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.386190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.387195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.390590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.390590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.390590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.403742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:42.404408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:42.422901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.424641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.425635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.432814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.433485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.433945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.206522 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:43.248355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:43.259381 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b40f1b6-0e46-4b25-a6d1-24e63ee9e822 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 0.896606 Oct 02 01:21:43.260673 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2219/4596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:42 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:43.275088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:43.275903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:43.286299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.291349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.292345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.293266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.303727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.304133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.410255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:43.424963 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-53d354db-1e06-4563-844b-63cfaf3706a8 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 1.030268 Oct 02 01:21:43.426389 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2378/4597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:42 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:43.449014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:43.452189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:43.480936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.482968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.487822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.488926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.489667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.490637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.712471 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=20 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:43.727183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:43.737834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c6ff507-1eff-43fb-bc64-4a2f588982fc tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 0.473986 Oct 02 01:21:43.739447 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2220/4598] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:43 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:44.290694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:44.292383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:44.303895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.304808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.307232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.308292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.310235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.311112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.355949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:44.367733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aab53126-8055-46a6-8b2b-bbc98550d04c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.938570 Oct 02 01:21:44.370419 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2379/4599] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:43 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:44.425662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ced2aacd-e473-4247-95fb-7567b907c163 req-4b79e8c9-6043-4efb-a8c4-f6746bb6ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1595c8-d050-4cb7-abab-32f549d090d1", "tag": "8ee645b7-b8e7-4b66-9548-c49f8f565d0a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:44.437858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ced2aacd-e473-4247-95fb-7567b907c163 req-4b79e8c9-6043-4efb-a8c4-f6746bb6ff32 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.439138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ced2aacd-e473-4247-95fb-7567b907c163 req-4b79e8c9-6043-4efb-a8c4-f6746bb6ff32 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.439896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ced2aacd-e473-4247-95fb-7567b907c163 req-4b79e8c9-6043-4efb-a8c4-f6746bb6ff32 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.453314 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ced2aacd-e473-4247-95fb-7567b907c163 req-4b79e8c9-6043-4efb-a8c4-f6746bb6ff32 service nova] Creating event network-changed:8ee645b7-b8e7-4b66-9548-c49f8f565d0a for instance 0d1595c8-d050-4cb7-abab-32f549d090d1 on n-h1-master-1 Oct 02 01:21:44.460078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ced2aacd-e473-4247-95fb-7567b907c163 req-4b79e8c9-6043-4efb-a8c4-f6746bb6ff32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042536 Oct 02 01:21:44.461340 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2380/4600] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:44.467760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:44.470024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:44.478793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.479737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.480702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.481800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.483645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.485337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.382476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:45.393146 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1027f6b-98be-4e13-8b6c-bdac72b7731f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 1.113554 Oct 02 01:21:45.402626 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2221/4601] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:44 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:45.552941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:45.569631 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ba4032f-0384-4d78-bf6d-8a8044921af2 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 1.106822 Oct 02 01:21:45.574555 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2381/4602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:44 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:45.594273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:45.599131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:45.625967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.627321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.629516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.632030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.632744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.633937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.838238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bd2577f6-f8c6-45bb-8086-ce94464ae33a req-62f8e9e9-9810-4ef3-9e26-2eb0177e1cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17dafc6-32d2-40c4-910a-f7d1125bb007", "name": "network-vif-plugged", "status": "completed", "tag": "2ed6165b-0079-4db5-a073-2241bbc5fd5c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:45.864398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bd2577f6-f8c6-45bb-8086-ce94464ae33a req-62f8e9e9-9810-4ef3-9e26-2eb0177e1cb1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.865188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bd2577f6-f8c6-45bb-8086-ce94464ae33a req-62f8e9e9-9810-4ef3-9e26-2eb0177e1cb1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.867322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bd2577f6-f8c6-45bb-8086-ce94464ae33a req-62f8e9e9-9810-4ef3-9e26-2eb0177e1cb1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.909860 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bd2577f6-f8c6-45bb-8086-ce94464ae33a req-62f8e9e9-9810-4ef3-9e26-2eb0177e1cb1 service nova] Creating event network-vif-plugged:2ed6165b-0079-4db5-a073-2241bbc5fd5c for instance c17dafc6-32d2-40c4-910a-f7d1125bb007 on n-h2-master-1 Oct 02 01:21:45.919478 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bd2577f6-f8c6-45bb-8086-ce94464ae33a req-62f8e9e9-9810-4ef3-9e26-2eb0177e1cb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.515273 Oct 02 01:21:45.921145 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2222/4603] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:45.944583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-82104c79-5cb3-48d4-a9bf-fd38df9ae7d8 req-bd70305d-b59a-4712-be40-72bb5805c30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea99b17-270b-49d5-9373-f5c50fab9c07", "tag": "4d908b94-00fe-42f0-a601-a53c9d626b56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:45.982844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-82104c79-5cb3-48d4-a9bf-fd38df9ae7d8 req-bd70305d-b59a-4712-be40-72bb5805c30a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.983557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-82104c79-5cb3-48d4-a9bf-fd38df9ae7d8 req-bd70305d-b59a-4712-be40-72bb5805c30a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.985075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-82104c79-5cb3-48d4-a9bf-fd38df9ae7d8 req-bd70305d-b59a-4712-be40-72bb5805c30a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.016130 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-82104c79-5cb3-48d4-a9bf-fd38df9ae7d8 req-bd70305d-b59a-4712-be40-72bb5805c30a service nova] Creating event network-changed:4d908b94-00fe-42f0-a601-a53c9d626b56 for instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 on n-h2-master-1 Oct 02 01:21:46.041368 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-82104c79-5cb3-48d4-a9bf-fd38df9ae7d8 req-bd70305d-b59a-4712-be40-72bb5805c30a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116476 Oct 02 01:21:46.042700 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2223/4604] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:46.061075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:46.062881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:46.092372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.094666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.097192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.098589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.100193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.103795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.340059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:46.355997 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80926bfb-33e5-4ecc-8bd2-cce07e5b0c70 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 0.779977 Oct 02 01:21:46.357183 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2382/4605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:45 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:46.419921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:46.420852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:46.436775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.437598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.438235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.439520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.440752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.441402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.997788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:47.011999 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-acc04479-6be1-484b-9d0a-df96da0753c8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.958147 Oct 02 01:21:47.014973 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2224/4606] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:46 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:47.026622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:47.035371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:47.070791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.072137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.072848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.076093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.076967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.077673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.483579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:47.497771 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10568374-e177-4b99-8e20-40fcde936d67 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 1.081661 Oct 02 01:21:47.504840 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2383/4607] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:46 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:47.517012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1970dd9e-1d32-46e7-9fe3-52df4ed98e81 req-bd59f08c-9117-4e6f-b00d-d92ce0f05084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d899a89c-af40-4200-bcf5-67168fb541af", "tag": "ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:47.544158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1970dd9e-1d32-46e7-9fe3-52df4ed98e81 req-bd59f08c-9117-4e6f-b00d-d92ce0f05084 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.552821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1970dd9e-1d32-46e7-9fe3-52df4ed98e81 req-bd59f08c-9117-4e6f-b00d-d92ce0f05084 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.553620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1970dd9e-1d32-46e7-9fe3-52df4ed98e81 req-bd59f08c-9117-4e6f-b00d-d92ce0f05084 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.572574 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1970dd9e-1d32-46e7-9fe3-52df4ed98e81 req-bd59f08c-9117-4e6f-b00d-d92ce0f05084 service nova] Creating event network-changed:ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2 for instance d899a89c-af40-4200-bcf5-67168fb541af on n-h1-master-1 Oct 02 01:21:47.584841 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1970dd9e-1d32-46e7-9fe3-52df4ed98e81 req-bd59f08c-9117-4e6f-b00d-d92ce0f05084 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077579 Oct 02 01:21:47.586278 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2384/4608] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:47.596903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:47.598047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:47.612995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.613788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.616457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.618996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.620205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.622795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.915654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:47.931047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-db5733e4-9f44-42bf-9be8-4fc833232ec3 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 0.914366 Oct 02 01:21:47.935278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2225/4609] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:47 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:48.036518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:48.037229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:48.048552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.050024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.054805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.055720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.056390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.057992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.327009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:48.373368 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b7fa959e-c9e9-463c-b8ee-75a2abb29c98 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1328 microversion: 2.1 time: 0.784237 Oct 02 01:21:48.402209 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2385/4610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:47 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1328 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:48.535975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:48.538786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:48.580283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.584397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.589386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.592426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.595252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.595890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.650083 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:48.759461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:48.775303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec2b3c03-bbec-450e-b2b5-0a12072706ee tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.743304 Oct 02 01:21:48.776632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2226/4611] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:48 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:48.959533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:48.960439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:48.974408 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:48.976664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.977495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.978270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.979264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.982386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.983095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:49.808114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:49.817512 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46d2a137-de70-4470-85c0-054144969add tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 1.292201 Oct 02 01:21:49.831332 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2386/4612] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:48 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:49.845578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:49.846536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:49.854244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:49.855001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:49.859749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:49.860801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:49.867354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:49.868100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.249579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:50.260121 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4520a397-9d18-41e7-aa40-629cc8db2aaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 1.305158 Oct 02 01:21:50.275446 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2227/4613] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:48 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:50.286580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8643f6d2-1c58-42db-aec4-7d59cdbf0641 req-667e7450-5a5d-4c58-a2b2-5ba3bfb67167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146766b4-1961-448c-af37-b19e59cc7768", "name": "network-vif-plugged", "status": "completed", "tag": "53297ef6-d0c6-4748-b71a-a66c3ffc1815"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:50.298878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8643f6d2-1c58-42db-aec4-7d59cdbf0641 req-667e7450-5a5d-4c58-a2b2-5ba3bfb67167 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.299848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8643f6d2-1c58-42db-aec4-7d59cdbf0641 req-667e7450-5a5d-4c58-a2b2-5ba3bfb67167 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.300544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8643f6d2-1c58-42db-aec4-7d59cdbf0641 req-667e7450-5a5d-4c58-a2b2-5ba3bfb67167 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.341784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8643f6d2-1c58-42db-aec4-7d59cdbf0641 req-667e7450-5a5d-4c58-a2b2-5ba3bfb67167 service nova] Creating event network-vif-plugged:53297ef6-d0c6-4748-b71a-a66c3ffc1815 for instance 146766b4-1961-448c-af37-b19e59cc7768 on n-h2-master-1 Oct 02 01:21:50.359520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8643f6d2-1c58-42db-aec4-7d59cdbf0641 req-667e7450-5a5d-4c58-a2b2-5ba3bfb67167 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082600 Oct 02 01:21:50.360523 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2228/4614] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:50.365898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:50.366626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:50.384747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.385119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.386429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.386429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.386747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.387348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.437636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:50.449608 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-33ae0331-79ad-4b2d-9437-856b73972ed6 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1526 microversion: 2.1 time: 0.616829 Oct 02 01:21:50.464726 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2387/4615] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:49 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1526 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:50.477416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:50.478372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:50.485433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.486314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.487520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.488509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.489193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.489830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.081058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:51.097618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27b0662b-3706-4a9b-ab10-4e555c87d99a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.731757 Oct 02 01:21:51.099315 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2229/4616] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:50 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:51.103978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:51.105639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:51.106858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:51.112303 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e370eb0f-c01e-419b-b669-010b4960dcaf tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1526 microversion: 2.1 time: 0.639226 Oct 02 01:21:51.117782 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2388/4617] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:50 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1526 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:51.121479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.122199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.122931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.123856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.124457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.125026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.543309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:51.543810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:51.560403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.560967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.561595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.562628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.563054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:51.565422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.566031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.573690 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88a695cb-5c7d-4a5d-8bfd-f2238c1971c2 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1314 microversion: 2.1 time: 0.472735 Oct 02 01:21:51.579630 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2230/4618] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:51 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:51.603020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:51.603187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] HTTP exception thrown: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Request method failure captured: Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 HTTP/1.1 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeSArG6Bi2XVPj1pS6KOyRmLAs_xSECIfhTGGvtzZuqLxdZyGXCyF2-GFoeHA2KppOzS5kvPYljOkTM5I52iVKu52YXiT6fapaYkjSJQiLuo-4t-6LKVATjC6QHM3sI5TlSmyBLJl0-WCT8ZZcUOpLycXzD_wk1GIoB0PHQn5nIkdY Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 29543a5108fa4988863e470031e37cc0 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-652917655 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29543a5108fa4988863e470031e37cc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29543a5108fa4988863e470031e37cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29543a5108fa4988863e470031e37cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29543a5108fa4988863e470031e37cc0"}]}] Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-652917655 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 29543a5108fa4988863e470031e37cc0 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-652917655 Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestMultiTenantJSON-652917655-project Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 1ea58206b2c744e5a153d56bacc5311f Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-652917655-project Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c17dafc6-32d2-40c4-910a-f7d1125bb007'} Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:21:51.604860 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:51.609430 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:51.610394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:51.613119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Returning 404 to user: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:21:51.615516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.615929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.616787 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3a4c6a2-9c12-4d5f-8d67-1c7abd83a8e3 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 404 len: 111 microversion: 2.1 time: 0.481045 Oct 02 01:21:51.617081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.618720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.619365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.619965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.625983 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2389/4619] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:21:51 2022] DELETE /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 111 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:21:51.637098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:51.637969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:51.655026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.656297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.657603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.659141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.659916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.660501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.707415 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:52.534247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:52.541905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:52.549946 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9be6db4-799e-4339-b45a-400305194336 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 0.964896 Oct 02 01:21:52.550535 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2231/4620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:51 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:52.554000 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d47d8f10-c81b-47e4-a009-c27b1d3ae150 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1526 microversion: 2.1 time: 0.924376 Oct 02 01:21:52.554818 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2390/4621] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:51 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1526 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:52.576074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:52.577697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:52.579524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Action: 'update', calling method: >, body: {"server": {"name": "c17dafc6-32d2-40c4-910a-f7d1125bb007_new"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:52.583678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:52.585299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.586026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.586652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.587834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.588456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.589194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.598500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.599346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.600327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.601346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.602529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.603733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.619421 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] HTTP exception thrown: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Request method failure captured: Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 HTTP/1.1 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 64 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeSArG6Bi2XVPj1pS6KOyRmLAs_xSECIfhTGGvtzZuqLxdZyGXCyF2-GFoeHA2KppOzS5kvPYljOkTM5I52iVKu52YXiT6fapaYkjSJQiLuo-4t-6LKVATjC6QHM3sI5TlSmyBLJl0-WCT8ZZcUOpLycXzD_wk1GIoB0PHQn5nIkdY Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 29543a5108fa4988863e470031e37cc0 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-652917655 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29543a5108fa4988863e470031e37cc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29543a5108fa4988863e470031e37cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29543a5108fa4988863e470031e37cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29543a5108fa4988863e470031e37cc0"}]}] Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-652917655 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 29543a5108fa4988863e470031e37cc0 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-652917655 Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestMultiTenantJSON-652917655-project Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 1ea58206b2c744e5a153d56bacc5311f Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-652917655-project Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "c17dafc6-32d2-40c4-910a-f7d1125bb007_new"}} Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c17dafc6-32d2-40c4-910a-f7d1125bb007', 'body': {'server': {'name': 'c17dafc6-32d2-40c4-910a-f7d1125bb007_new'}}} Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:21:52.621703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:21:52.626154 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:21:52.628787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] Returning 404 to user: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:21:52.629815 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa24ddef-0976-4e0b-99cf-d920508a6050 tempest-ServersNegativeTestMultiTenantJSON-652917655 tempest-ServersNegativeTestMultiTenantJSON-652917655-project] 10.222.0.23 "PUT /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 404 len: 111 microversion: 2.1 time: 0.054726 Oct 02 01:21:52.630935 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2391/4622] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:21:52 2022] PUT /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:21:52.643323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:52.645816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:52.653434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.654151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.655269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.655851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.656948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.658914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.035606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:53.048123 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5fc6b3a1-512f-43f7-bb34-51cc3b5117a1 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1502 microversion: 2.1 time: 0.415447 Oct 02 01:21:53.050776 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2392/4623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:52 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:53.057130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:53.057839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.058960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:53.067414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.069170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.069388 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d27306d9-3b2b-4b6b-8b3b-831fbc2a56e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.516157 Oct 02 01:21:53.075501 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2232/4624] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:52 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:53.077591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.078785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.082049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.086058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.088433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:53.093559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.107486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.111520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.112273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.113249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.116811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.117530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.156233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:21:53.176414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lazy-loading 'flavor' on Instance uuid 146766b4-1961-448c-af37-b19e59cc7768 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:21:53.290290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e867241-5270-4bc0-9ca0-994d266b36a2 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 204 len: 0 microversion: 2.1 time: 0.237890 Oct 02 01:21:53.291030 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2393/4625] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:21:53 2022] DELETE /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:21:53.300142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:53.306850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.315020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68c819fb-701d-44a2-93b1-409fd85257fb tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "POST /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768/action" status: 202 len: 0 microversion: 2.1 time: 0.241727 Oct 02 01:21:53.320800 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2233/4626] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:21:53 2022] POST /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:21:53.321464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.322145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.322807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.323701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.324316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.324905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.331533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:53.333260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.341714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.342946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.343702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.344860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.346114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.365596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.672554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:53.688021 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8970fd8a-2fde-471e-9c96-90c1f7a901b5 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1532 microversion: 2.1 time: 0.392078 Oct 02 01:21:53.689190 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2394/4627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:53 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1532 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:53.703077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:53.703716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.718394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.722247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.722749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.723457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.723915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.724341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.770929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:53.782856 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26e0c022-4c0b-4ab1-8576-52e0e28b0be3 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1510 microversion: 2.1 time: 0.459372 Oct 02 01:21:53.783547 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2234/4628] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:53 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:53.799522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-55a1d520-92d1-4f99-88b6-292251d468aa req-1f5c890c-b516-41bf-9980-a84b14a3afa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1595c8-d050-4cb7-abab-32f549d090d1", "name": "network-vif-plugged", "status": "completed", "tag": "8ee645b7-b8e7-4b66-9548-c49f8f565d0a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:53.839094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-55a1d520-92d1-4f99-88b6-292251d468aa req-1f5c890c-b516-41bf-9980-a84b14a3afa5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.840211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-55a1d520-92d1-4f99-88b6-292251d468aa req-1f5c890c-b516-41bf-9980-a84b14a3afa5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.840819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-55a1d520-92d1-4f99-88b6-292251d468aa req-1f5c890c-b516-41bf-9980-a84b14a3afa5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.864740 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-55a1d520-92d1-4f99-88b6-292251d468aa req-1f5c890c-b516-41bf-9980-a84b14a3afa5 service nova] Creating event network-vif-plugged:8ee645b7-b8e7-4b66-9548-c49f8f565d0a for instance 0d1595c8-d050-4cb7-abab-32f549d090d1 on n-h1-master-1 Oct 02 01:21:53.880799 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-55a1d520-92d1-4f99-88b6-292251d468aa req-1f5c890c-b516-41bf-9980-a84b14a3afa5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095646 Oct 02 01:21:53.881431 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2235/4629] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:54.086555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:54.102397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:54.103438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:54.105804 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-900dbe1e-6874-4ce1-82c7-b1feae4edce1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 0.414666 Oct 02 01:21:54.106797 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2395/4630] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:53 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:54.113751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.115133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.115869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.116728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.117321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.117880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.385462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:54.411585 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4879f33c-82cc-4346-b1bb-4f619af0f673 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.318112 Oct 02 01:21:54.414026 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2236/4631] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:54 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:54.716535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:54.717468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:54.730708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.735075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.735672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.737076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.737811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.738364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.827878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:54.829294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:54.848647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.849431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.850314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.851539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.853210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.853863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.579443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:55.636299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2dec230b-fc67-48e7-9ac0-c308a977d3e8 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1532 microversion: 2.1 time: 0.920444 Oct 02 01:21:55.638322 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2396/4632] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:54 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1532 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:55.652398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-438170bc-2bf8-456f-a02b-00f6b3520b71 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:55.669364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438170bc-2bf8-456f-a02b-00f6b3520b71 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.670290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438170bc-2bf8-456f-a02b-00f6b3520b71 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.671490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-438170bc-2bf8-456f-a02b-00f6b3520b71 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.683921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:55.716731 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6db42c8-d748-4577-a5f9-dd616f49c187 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1510 microversion: 2.1 time: 0.894489 Oct 02 01:21:55.723485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-438170bc-2bf8-456f-a02b-00f6b3520b71 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Going to try to stop instance {{(pid=122355) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:21:55.730879 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2237/4633] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:54 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1510 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:55.756502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:55.757371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:55.780710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.791806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.792301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.793066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.793545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.793977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.841087 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-438170bc-2bf8-456f-a02b-00f6b3520b71 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action" status: 202 len: 0 microversion: 2.1 time: 0.178244 Oct 02 01:21:55.842138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2397/4634] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:21:55 2022] POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:21:55.869348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:55.872046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:55.880755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.881679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.888450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.889956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.890773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.891451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.480911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:56.491495 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3ae9796-f5ed-47d5-86b7-2179e5e34754 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1322 microversion: 2.1 time: 0.755527 Oct 02 01:21:56.513476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2238/4635] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:55 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:56.515468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:56.527329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:56.534973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:56.542361 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d67f2bb2-6348-4f93-9b63-8ee0e4a09be7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.691076 Oct 02 01:21:56.543511 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2398/4636] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:55 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:56.545006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.545542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.545988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.546738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.547208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.547636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.550851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1a4850c3-81a9-41cd-8968-d16936a5ae4a req-3ec4a98b-dc21-4cfa-9c70-77c735a728c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da8979-b30e-416f-b666-25b8e3618e57", "name": "network-vif-plugged", "status": "completed", "tag": "a15952f9-4b4c-4d4d-9df8-cbee0fa257e9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:56.556591 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:56.567713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1a4850c3-81a9-41cd-8968-d16936a5ae4a req-3ec4a98b-dc21-4cfa-9c70-77c735a728c6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.568571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1a4850c3-81a9-41cd-8968-d16936a5ae4a req-3ec4a98b-dc21-4cfa-9c70-77c735a728c6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.569986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1a4850c3-81a9-41cd-8968-d16936a5ae4a req-3ec4a98b-dc21-4cfa-9c70-77c735a728c6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.596068 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1a4850c3-81a9-41cd-8968-d16936a5ae4a req-3ec4a98b-dc21-4cfa-9c70-77c735a728c6 service nova] Creating event network-vif-plugged:a15952f9-4b4c-4d4d-9df8-cbee0fa257e9 for instance a9da8979-b30e-416f-b666-25b8e3618e57 on n-h2-master-1 Oct 02 01:21:56.602510 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1a4850c3-81a9-41cd-8968-d16936a5ae4a req-3ec4a98b-dc21-4cfa-9c70-77c735a728c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057572 Oct 02 01:21:56.603511 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2399/4637] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:56.668497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:56.669632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:56.682320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.683353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.684697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.685996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.686900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.687877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.112653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:57.115014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:57.126242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5d4ccf3e-094d-4733-998e-5ef6097bdacc tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.618524 Oct 02 01:21:57.128449 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5723255-db5a-4bca-adb0-f6270d003d9b tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1490 microversion: 2.1 time: 0.466294 Oct 02 01:21:57.129697 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2400/4638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:56 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1490 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:57.133001 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2239/4639] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:56 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:57.140493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:57.141122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:57.146730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bcde61f0-8629-4973-a56c-96050251ce63 req-e4544fea-89bf-474c-abe4-c374c273454b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17dafc6-32d2-40c4-910a-f7d1125bb007", "name": "network-vif-deleted", "tag": "2ed6165b-0079-4db5-a073-2241bbc5fd5c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:57.159293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.162132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.164321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.165410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.166856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.167508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.173557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bcde61f0-8629-4973-a56c-96050251ce63 req-e4544fea-89bf-474c-abe4-c374c273454b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.174654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bcde61f0-8629-4973-a56c-96050251ce63 req-e4544fea-89bf-474c-abe4-c374c273454b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.175086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bcde61f0-8629-4973-a56c-96050251ce63 req-e4544fea-89bf-474c-abe4-c374c273454b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.212735 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bcde61f0-8629-4973-a56c-96050251ce63 req-e4544fea-89bf-474c-abe4-c374c273454b service nova] Creating event network-vif-deleted:2ed6165b-0079-4db5-a073-2241bbc5fd5c for instance c17dafc6-32d2-40c4-910a-f7d1125bb007 on n-h2-master-1 Oct 02 01:21:57.230029 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bcde61f0-8629-4973-a56c-96050251ce63 req-e4544fea-89bf-474c-abe4-c374c273454b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090374 Oct 02 01:21:57.237065 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2240/4640] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:57.383336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:57.393058 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be209c73-2959-474f-982f-9f945dbf53fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1493 microversion: 2.1 time: 0.261579 Oct 02 01:21:57.395913 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2401/4641] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:57 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1493 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:57.416828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:57.417428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:57.429598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.430104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.430540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.431292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.431749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.432177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.470552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:21:57.519573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:57.520393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:57.528006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.528497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.528937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.529640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.530095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.530529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.576027 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:57.636524 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-61059fe7-75b9-4a0f-8250-343c3d916658 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 204 len: 0 microversion: 2.1 time: 0.223105 Oct 02 01:21:57.651702 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2241/4642] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:21:57 2022] DELETE /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:21:57.663018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:57.667091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:57.683132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.683628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.684236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.686777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.687277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.687728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.005056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.036188 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c38cd6c-b756-4a42-9f23-addc66ddbcfb tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1515 microversion: 2.1 time: 0.521399 Oct 02 01:21:58.036965 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2402/4643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:57 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:58.064528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:58.065317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:58.083865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.084748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.085705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.087309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.088980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.089646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.161056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.200494 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0228a78-4e44-4372-81d5-c9c2863ac84a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.547058 Oct 02 01:21:58.216372 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2242/4644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:57 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:58.224179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:58.230305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:58.245444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.251309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.252474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.253437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.255714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.263016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.525212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.544403 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f2b69b0-66e3-4b49-ba67-09c4d93c599c tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1499 microversion: 2.1 time: 0.485484 Oct 02 01:21:58.545065 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2403/4645] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:58 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1499 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:58.550612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:58.551250 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:58.566434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.571280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.571894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.572880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.573366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.573851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.637118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.649303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96b6bcab-7cc5-4550-b9f7-8804150b1cb1 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 200 len: 1322 microversion: 2.1 time: 0.431685 Oct 02 01:21:58.669159 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2243/4646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:58 2022] GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:58.694704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:58.694938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.695368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.695809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.696261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lazy-loading 'fault' on Instance uuid c17dafc6-32d2-40c4-910a-f7d1125bb007 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:21:58.699803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:58.709602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.715319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.718499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.719533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.720411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.727406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.858944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b890aa0529304095933195cea870279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1173034060443ac93a081ad71fb2629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.872611 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bd256c8c-eebd-4289-9ec2-f7e03c93a919 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 200 len: 1318 microversion: 2.1 time: 0.326440 Oct 02 01:21:58.873549 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2404/4647] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:58 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:58.997851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2141704504", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "d9364441-04c5-4641-b900-7e13ac6c6ceb"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:59.074725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] validate_networks() for [('d9364441-04c5-4641-b900-7e13ac6c6ceb', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:21:59.328382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:59.341674 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f25bace-ba8e-4a0a-803d-da11d2bd170b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.671026 Oct 02 01:21:59.342852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2244/4648] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:58 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:59.383709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-93b4519d-55bb-41bd-ad2a-9478119f9529 req-3f67917f-fc26-4501-894e-66dde5a62a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea99b17-270b-49d5-9373-f5c50fab9c07", "name": "network-vif-plugged", "status": "completed", "tag": "4d908b94-00fe-42f0-a601-a53c9d626b56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:59.419061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-93b4519d-55bb-41bd-ad2a-9478119f9529 req-3f67917f-fc26-4501-894e-66dde5a62a2e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.422241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-93b4519d-55bb-41bd-ad2a-9478119f9529 req-3f67917f-fc26-4501-894e-66dde5a62a2e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.423567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-93b4519d-55bb-41bd-ad2a-9478119f9529 req-3f67917f-fc26-4501-894e-66dde5a62a2e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.453586 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-93b4519d-55bb-41bd-ad2a-9478119f9529 req-3f67917f-fc26-4501-894e-66dde5a62a2e service nova] Creating event network-vif-plugged:4d908b94-00fe-42f0-a601-a53c9d626b56 for instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 on n-h2-master-1 Oct 02 01:21:59.482385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-93b4519d-55bb-41bd-ad2a-9478119f9529 req-3f67917f-fc26-4501-894e-66dde5a62a2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135711 Oct 02 01:21:59.483335 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2245/4649] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:59.496196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:59.498821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:59.560512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.568082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.573624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.577663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.578795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.580493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.631838 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:00.210861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:00.221289 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0311ee96-2d35-47b0-affc-d437cd1205b2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.732989 Oct 02 01:22:00.222102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2246/4650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:59 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:00.248578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:00.249221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:00.269541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.270090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.270551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.272267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.272745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.274400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.627813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:22:00.629315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:22:00.630046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:22:00.631296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:22:00.632009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:22:00.653598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.656003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.659174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.660863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.662375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.664717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.710005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Getting quotas for project 22fb92463e1c4d17947550b9b5513d70. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:22:00.727716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Getting quotas for user 953559ae78e14bffa8ec7b866b498875 and project 22fb92463e1c4d17947550b9b5513d70. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:22:00.750880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:22:00.758843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:22:00.862923 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24f0224e-3085-40f6-9f31-06cd90d9bc3c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.987985 Oct 02 01:22:00.872444 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2405/4651] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:22:00.889313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:00.906266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:00.934828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.936513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.937210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.941209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.942137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.945408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.427149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:01.443318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fbbe3c09-4bdf-47c3-83ac-4ac3227d94fa tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1499 microversion: 2.1 time: 1.201856 Oct 02 01:22:01.446222 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2247/4652] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:00 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1499 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:01.451425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:01.452249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] [instance: c17dafc6-32d2-40c4-910a-f7d1125bb007] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:01.460662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.475641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.476421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.481851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.482584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.491361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.527801 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] HTTP exception thrown: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Request method failure captured: Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 HTTP/1.1 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOeDMEoERAdWRQyP1YAkzKEseM8Fmfw8M2oNVJXJjJmwrCK22msYRErkJWGnjlC0EQn_3TmGQDbJQ3aV6lwrlsldiLi9wOvQPosJcTYr5qt_4MZmlZ4hQoaFmfUNLR79pMPiki2Kf6FRqCtYaqqLVThToeL6jWtrcxpx0D4jBP4keIQ Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e1173034060443ac93a081ad71fb2629 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-493325514 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e1173034060443ac93a081ad71fb2629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1173034060443ac93a081ad71fb2629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1173034060443ac93a081ad71fb2629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e1173034060443ac93a081ad71fb2629"}]}] Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-493325514 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e1173034060443ac93a081ad71fb2629 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-493325514 Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestMultiTenantJSON-493325514-project Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: b890aa0529304095933195cea870279b Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-493325514-project Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c17dafc6-32d2-40c4-910a-f7d1125bb007'} Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:22:01.536259 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. Oct 02 01:22:01.540853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:01.542387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] Returning 404 to user: Instance c17dafc6-32d2-40c4-910a-f7d1125bb007 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:01.547694 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b6813b3-ff5f-4f20-80c2-ff52d86dbbc1 tempest-ServersNegativeTestMultiTenantJSON-493325514 tempest-ServersNegativeTestMultiTenantJSON-493325514-project] 10.222.0.23 "GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007" status: 404 len: 111 microversion: 2.1 time: 0.100125 Oct 02 01:22:01.552239 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2248/4653] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:01 2022] GET /compute/v2.1/servers/c17dafc6-32d2-40c4-910a-f7d1125bb007 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:01.566335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:01.569584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:01.583650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.590204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.590991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.592049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.592742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.593392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.116464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:02.134066 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eba1fac6-5746-4970-9de4-52e749062290 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 200 len: 1515 microversion: 2.1 time: 1.260374 Oct 02 01:22:02.143942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2406/4654] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:00 2022] GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 1515 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:02.153437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:02.154067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:02.165471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.167078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.169443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.170351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.171462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.172557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.429911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:02.449299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-33b2599d-3ba9-4e9b-8895-418a0e1012a4 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1229 microversion: 2.1 time: 0.296922 Oct 02 01:22:02.450214 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2407/4655] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:02 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1229 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:02.458564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:02.462468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:02.497268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.498638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.499369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.502277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.503099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.503708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.531896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:02.568464 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd5e2c93-99bc-493e-a72b-952e4e3312c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 1.014671 Oct 02 01:22:02.573711 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2249/4656] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:01 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:02.590139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7aaf97ec-2aad-4d22-b48c-4c944ac8187c req-0b7d9027-0ff8-45cf-b645-6a8787f18920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d899a89c-af40-4200-bcf5-67168fb541af", "name": "network-vif-plugged", "status": "completed", "tag": "ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:02.629376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7aaf97ec-2aad-4d22-b48c-4c944ac8187c req-0b7d9027-0ff8-45cf-b645-6a8787f18920 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.630066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7aaf97ec-2aad-4d22-b48c-4c944ac8187c req-0b7d9027-0ff8-45cf-b645-6a8787f18920 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.634359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7aaf97ec-2aad-4d22-b48c-4c944ac8187c req-0b7d9027-0ff8-45cf-b645-6a8787f18920 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.670429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7aaf97ec-2aad-4d22-b48c-4c944ac8187c req-0b7d9027-0ff8-45cf-b645-6a8787f18920 service nova] Creating event network-vif-plugged:ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2 for instance d899a89c-af40-4200-bcf5-67168fb541af on n-h1-master-1 Oct 02 01:22:02.681285 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7aaf97ec-2aad-4d22-b48c-4c944ac8187c req-0b7d9027-0ff8-45cf-b645-6a8787f18920 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104526 Oct 02 01:22:02.687634 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2250/4657] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:02.700680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:02.701837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:02.741739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.742612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.743872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.744950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.745501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.746023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.237909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:03.252098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e890e3c3-0496-4362-9c49-81ad9bad6e9e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.800500 Oct 02 01:22:03.260501 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2408/4658] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:02 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:03.265803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:03.267337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:03.287707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.288213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.288654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.289385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.289834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.290260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.743820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:03.757420 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e5ff8ab-da51-48ad-ae18-eb57156efac0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 200 len: 1516 microversion: 2.1 time: 1.067330 Oct 02 01:22:03.765782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9450c53d8944b88cfbbc541f585ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8558d451aa4c17b359f4ae0274a371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:03.773437 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2251/4659] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:02 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 1516 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:03.775885 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-03e81eaf-b803-42f0-a41a-0b65e326e592 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 200 len: 1290 microversion: 2.1 time: 0.513909 Oct 02 01:22:03.780590 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2409/4660] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:03 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 1290 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:03.790811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-998240a0-f80d-4cbc-a335-0d29545b98a0 req-069663d2-dd7c-4aac-bce4-772df920527b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146766b4-1961-448c-af37-b19e59cc7768", "name": "network-vif-deleted", "tag": "53297ef6-d0c6-4748-b71a-a66c3ffc1815"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:03.792750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:03.802808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:03.818410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.823356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.824656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-998240a0-f80d-4cbc-a335-0d29545b98a0 req-069663d2-dd7c-4aac-bce4-772df920527b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.824979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.826178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.827322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.828294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.828547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-998240a0-f80d-4cbc-a335-0d29545b98a0 req-069663d2-dd7c-4aac-bce4-772df920527b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.830005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-998240a0-f80d-4cbc-a335-0d29545b98a0 req-069663d2-dd7c-4aac-bce4-772df920527b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.896266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-998240a0-f80d-4cbc-a335-0d29545b98a0 req-069663d2-dd7c-4aac-bce4-772df920527b service nova] Creating event network-vif-deleted:53297ef6-d0c6-4748-b71a-a66c3ffc1815 for instance 146766b4-1961-448c-af37-b19e59cc7768 on n-h2-master-1 Oct 02 01:22:03.910717 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-998240a0-f80d-4cbc-a335-0d29545b98a0 req-069663d2-dd7c-4aac-bce4-772df920527b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131984 Oct 02 01:22:03.912930 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2252/4661] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:03.925064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:03.926927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:03.944774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.946125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.947522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.949186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.950702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.952641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.058384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:04.078478 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fdb5a689-ffbd-4ec8-8638-8192801e5261 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1295 microversion: 2.1 time: 0.290364 Oct 02 01:22:04.079628 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2410/4662] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:03 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1295 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:04.085209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:04.095265 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:04.107620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.108382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.109049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.109986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.111207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.111707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.176603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:22:04.613479 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e478bc53-376e-4306-9d42-7b372d18289f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 204 len: 0 microversion: 2.1 time: 0.531715 Oct 02 01:22:04.614392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2411/4663] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:04 2022] DELETE /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:22:04.619630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:04.630897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:04.637310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.638473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.638972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.639696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.640160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.649713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.199183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:05.209105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-271be8df-277e-4fd4-8a43-6de5803793ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 1.293883 Oct 02 01:22:05.213943 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2253/4664] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:03 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:05.223170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.224184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.265947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.266828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.267658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.268583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.272180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:05.280287 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64bb46ba-0377-40ac-8fca-68e6d2e8729e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1366 microversion: 2.1 time: 0.664623 Oct 02 01:22:05.284715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.285660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.295122 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2412/4665] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:04 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1366 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:05.331316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.333261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.354101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.358074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.358696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.361213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.361850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.362438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.381519 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 HTTP/1.1 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '146766b4-1961-448c-af37-b19e59cc7768'} Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.383474 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.387574 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.389494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:05.390561 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad5fa39e-5665-4f99-987a-33c5ab364d56 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 404 len: 111 microversion: 2.1 time: 0.089894 Oct 02 01:22:05.392294 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2413/4666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:05.397134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.398096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.406501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.415315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.421199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.422223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.423080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.423734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.539281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:05.552875 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b127a62-05e9-4028-9b4a-619d526d33f4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 200 len: 1522 microversion: 2.1 time: 0.336776 Oct 02 01:22:05.565956 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2254/4667] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:05.588688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.589453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.606985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.607798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.608398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.609232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.617865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.618325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.640883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:05.651014 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96e42ce7-d852-43d0-a0fd-6d338653583c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1283 microversion: 2.1 time: 0.257433 Oct 02 01:22:05.658214 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.659530 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2414/4668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1283 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 HTTP/1.1 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '146766b4-1961-448c-af37-b19e59cc7768'} Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:05.661576 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.665264 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.667409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:05.668580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56812ea9-e7e7-4a3d-adb7-67d70621d223 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 404 len: 111 microversion: 2.1 time: 0.101104 Oct 02 01:22:05.669698 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2255/4669] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:05 2022] DELETE /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:05.682489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.683566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 146766b4-1961-448c-af37-b19e59cc7768] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.692908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.695592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.696658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.698893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.699938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.700899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.724950 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 HTTP/1.1 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '146766b4-1961-448c-af37-b19e59cc7768'} Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.728385 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. Oct 02 01:22:05.733703 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.763411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 146766b4-1961-448c-af37-b19e59cc7768 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:05.764809 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-19a43f2b-0531-4b34-a169-0759329542ce tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768" status: 404 len: 111 microversion: 2.1 time: 0.086311 Oct 02 01:22:05.766525 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2415/4670] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/146766b4-1961-448c-af37-b19e59cc7768 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:22:05.777236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.778009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.792673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.793541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.794223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.795543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.796489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.797250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.820886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 HTTP/1.1 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: exception: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5'} Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:05.822893 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.826525 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.828878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:05.829985 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-19f957d2-4734-44ed-88a4-cffa50bfd705 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 404 len: 111 microversion: 2.1 time: 0.059086 Oct 02 01:22:05.830816 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2256/4671] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:05 2022] DELETE /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:05.840671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.841078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.849414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.850235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.851461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.852797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.853563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.854205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.886177 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 HTTP/1.1 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: exception: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5'} Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.893422 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. Oct 02 01:22:05.899471 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.901425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:05.906178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1a9971b-31eb-4633-af92-1a373985253f tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5" status: 404 len: 111 microversion: 2.1 time: 0.070376 Oct 02 01:22:05.910648 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2416/4672] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/cfbec6c8-5dc2-44ce-84bb-ed6cf91e75d5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:05.921019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.922093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.930396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.931177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.931951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.932982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.933625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.934381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.956672 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd HTTP/1.1 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '9f3d770d-5fec-4f82-a338-dccca2220efd'} Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:05.982922 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:05.988770 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:05.991865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:05.992999 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13b03f79-2e38-407f-bcbd-ab45b8b25efc tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 404 len: 111 microversion: 2.1 time: 0.078690 Oct 02 01:22:05.993669 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2257/4673] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:05 2022] DELETE /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:22:06.007557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.008378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 9f3d770d-5fec-4f82-a338-dccca2220efd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.021545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.025222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.026117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.027146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.029970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.030674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.066714 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd HTTP/1.1 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9f3d770d-5fec-4f82-a338-dccca2220efd'} Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.068319 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 9f3d770d-5fec-4f82-a338-dccca2220efd could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f2d9e0d-08f5-464c-bb0a-dbe5a1e54bb7 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd" status: 404 len: 111 microversion: 2.1 time: 0.068928 Oct 02 01:22:06.077302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2417/4674] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/9f3d770d-5fec-4f82-a338-dccca2220efd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:06.079777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.080282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.092674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.093346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.094031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.096797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.097191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.098168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.131019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe HTTP/1.1 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: exception: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b6155aed-5beb-461d-b2a1-70b888fc0ebe'} Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:06.140260 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.145557 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.147529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:06.149414 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fce075cf-ffc4-4468-8c70-78276fca8a76 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 404 len: 111 microversion: 2.1 time: 0.074793 Oct 02 01:22:06.152328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2258/4675] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:06 2022] DELETE /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:06.160844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.161711 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: b6155aed-5beb-461d-b2a1-70b888fc0ebe] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.172389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.173116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.173738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.176143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.176774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.180262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.213323 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe HTTP/1.1 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: exception: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'b6155aed-5beb-461d-b2a1-70b888fc0ebe'} Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.214971 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance b6155aed-5beb-461d-b2a1-70b888fc0ebe could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:06.219601 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b134d710-e159-482c-902f-1949028ec834 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe" status: 404 len: 111 microversion: 2.1 time: 0.060383 Oct 02 01:22:06.222796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2418/4676] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/b6155aed-5beb-461d-b2a1-70b888fc0ebe => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:06.231290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.231861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.246382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.247027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.258889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.259442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.260073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.261008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.262234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.262918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.263963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.265864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.267381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.275056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.275756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.278977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.319923 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 HTTP/1.1 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c8e4d6b8-53e5-4964-a874-14fafa5fb900'} Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:06.321486 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.326047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.338420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:06.340032 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9ace375-b190-4cc3-9c14-c0170931c38e tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 404 len: 111 microversion: 2.1 time: 0.113080 Oct 02 01:22:06.345934 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2259/4677] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:06 2022] DELETE /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:22:06.355918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.359447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.375228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.376552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.377150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.378113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.378850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.379543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.719790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:06.740644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c036b0f-4650-4d04-9c2e-c1a5a9edaf02 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.494043 Oct 02 01:22:06.741711 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2419/4678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:06.747862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.748468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c8e4d6b8-53e5-4964-a874-14fafa5fb900] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.762913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.764901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.765493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.766549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.770439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.771065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.794371 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 HTTP/1.1 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c8e4d6b8-53e5-4964-a874-14fafa5fb900'} Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:06.796016 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance c8e4d6b8-53e5-4964-a874-14fafa5fb900 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:06.801038 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2fff5760-4b5c-4414-9c59-89723058ab71 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900" status: 404 len: 111 microversion: 2.1 time: 0.054665 Oct 02 01:22:06.816783 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2420/4679] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/c8e4d6b8-53e5-4964-a874-14fafa5fb900 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:06.831135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.832304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.843787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.848241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.848893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.851280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.851923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.852748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.094082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:07.106478 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec913570-d553-4041-b06d-162251a3fce8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1555 microversion: 2.1 time: 0.758363 Oct 02 01:22:07.108260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2260/4680] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1555 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:07.147622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:07.148480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:07.158140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.159012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.159677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.162058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.162819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.163677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.304703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:07.318538 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-101acb3e-1829-4b39-9352-0ba7615b77dd tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1283 microversion: 2.1 time: 0.186696 Oct 02 01:22:07.324118 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2261/4681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:07 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:07.332409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:07.333098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:07.358424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.359150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.360156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.362491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.363573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.364589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.449184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:07.453331 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:07.464585 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1f353ddb-5a3a-46a5-bc4e-21f898a1d7fe tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 200 len: 1522 microversion: 2.1 time: 0.646210 Oct 02 01:22:07.491293 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2421/4682] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:07.577221 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-35c03ca2-1823-4609-82d7-f81f849f6308 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250733 Oct 02 01:22:07.578291 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2262/4683] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:22:07 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:07.789249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:07.793211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:07.816991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.817822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.818837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.819876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.820613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.821477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.353649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:08.354974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:08.362904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:08.369108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.374038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.375868 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc190ac4-75a6-41ef-8996-7b2f44155d67 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.610171 Oct 02 01:22:08.387486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.390060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.393284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.394286 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2422/4684] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:07 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:08.396498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.494520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:08.496913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:08.511021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.511606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.513180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.513180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.513380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.513667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.986570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:09.005885 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56f914d1-8460-4555-9d66-e641db5f8607 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 200 len: 1480 microversion: 2.1 time: 0.515212 Oct 02 01:22:09.006498 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2423/4685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:08 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 1480 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:09.090400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4c2ac325-cb38-4d0d-9139-becc3d4886b7 req-158663e9-b3a3-4b43-9d60-bcee9dc78933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea99b17-270b-49d5-9373-f5c50fab9c07", "name": "network-vif-deleted", "tag": "4d908b94-00fe-42f0-a601-a53c9d626b56"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:09.114547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4c2ac325-cb38-4d0d-9139-becc3d4886b7 req-158663e9-b3a3-4b43-9d60-bcee9dc78933 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.116564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4c2ac325-cb38-4d0d-9139-becc3d4886b7 req-158663e9-b3a3-4b43-9d60-bcee9dc78933 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.117692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4c2ac325-cb38-4d0d-9139-becc3d4886b7 req-158663e9-b3a3-4b43-9d60-bcee9dc78933 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.176317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4c2ac325-cb38-4d0d-9139-becc3d4886b7 req-158663e9-b3a3-4b43-9d60-bcee9dc78933 service nova] Creating event network-vif-deleted:4d908b94-00fe-42f0-a601-a53c9d626b56 for instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 on n-h2-master-1 Oct 02 01:22:09.192950 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4c2ac325-cb38-4d0d-9139-becc3d4886b7 req-158663e9-b3a3-4b43-9d60-bcee9dc78933 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107192 Oct 02 01:22:09.199343 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2424/4686] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:22:09.350854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:09.371181 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af7b5e40-65dc-479a-9b1d-b99aaa4931fe tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 1.028587 Oct 02 01:22:09.378297 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2263/4687] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:08 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:09.406461 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:09.407602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:09.425730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.427443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.429219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.430339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.434053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.434835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.859488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:09.878431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ec2c7e0-6b1a-4fa3-82fd-1975ea88ce4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.476553 Oct 02 01:22:09.879687 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2425/4688] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:09 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:10.034053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:10.034723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:10.046453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.046977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.048030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.048743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.049195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.049620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.136144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.136982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.137664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.138880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lazy-loading 'fault' on Instance uuid 0ea99b17-270b-49d5-9373-f5c50fab9c07 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:22:10.229802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:10.239296 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf15578c-bfae-47c4-90c4-867972e9222e tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 200 len: 1312 microversion: 2.1 time: 0.209713 Oct 02 01:22:10.259528 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2264/4689] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:10 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:10.397653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:10.399127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:10.410186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.410908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.419274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.420287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.420919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.421513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.689061 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:10.743866 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:10.832247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:10.841723 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-564f7444-20bb-4274-a4c9-082274b87d43 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.447989 Oct 02 01:22:10.850922 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2426/4690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:10 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:10.904913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:10.906208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:10.937611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.937611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.937611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.937611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.937611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.937611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.268984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.269604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:11.281301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.282842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.283458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.288603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.289348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.289960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.299480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:11.310575 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90859df1-0c64-4b00-b7d9-50f6e7a37f0c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.409719 Oct 02 01:22:11.316385 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2265/4691] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:10 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:11.334737 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] HTTP exception thrown: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 HTTP/1.1 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0ea99b17-270b-49d5-9373-f5c50fab9c07'} Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.336697 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:11.341296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.353490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-df3e728b-e4ec-423d-ae9a-1cd0825a428c req-92d15cf4-ddd1-4079-98e2-365348bc40a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d899a89c-af40-4200-bcf5-67168fb541af", "tag": "ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:11.359996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 404 to user: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:11.362785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e826c48-2533-4b2c-bc3f-0a6481e344ee tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 404 len: 111 microversion: 2.1 time: 0.097811 Oct 02 01:22:11.365797 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2427/4692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:11.368516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df3e728b-e4ec-423d-ae9a-1cd0825a428c req-92d15cf4-ddd1-4079-98e2-365348bc40a4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.374408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df3e728b-e4ec-423d-ae9a-1cd0825a428c req-92d15cf4-ddd1-4079-98e2-365348bc40a4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.375615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df3e728b-e4ec-423d-ae9a-1cd0825a428c req-92d15cf4-ddd1-4079-98e2-365348bc40a4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.388349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.413403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:11.415695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:11.424779 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-df3e728b-e4ec-423d-ae9a-1cd0825a428c req-92d15cf4-ddd1-4079-98e2-365348bc40a4 service nova] Creating event network-changed:ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2 for instance d899a89c-af40-4200-bcf5-67168fb541af on n-h1-master-1 Oct 02 01:22:11.431429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.434593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.438539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.448823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.449618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.450415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.453216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-df3e728b-e4ec-423d-ae9a-1cd0825a428c req-92d15cf4-ddd1-4079-98e2-365348bc40a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103460 Oct 02 01:22:11.461226 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2266/4693] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:22:11.654773 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80a9c442-eb59-45d6-b9bd-842128369191 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.284397 Oct 02 01:22:11.656023 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2428/4694] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:22:11.669910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5849ac91-8f51-448e-b418-3cc7dfcfa998 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5849ac91-8f51-448e-b418-3cc7dfcfa998 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: action_args: {} Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 02 01:22:11.686235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 02 01:22:11.691483 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:11.693632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5849ac91-8f51-448e-b418-3cc7dfcfa998 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:11.694696 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5849ac91-8f51-448e-b418-3cc7dfcfa998 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.029110 Oct 02 01:22:11.699493 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2267/4695] 10.222.0.23 () {58 vars in 1182 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:22:11.709131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.719838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:11.720757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:11.734685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.735405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.735924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.736672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.739450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.746042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.798051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:22:11.861633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7c7d613-3e48-4f5c-ae8a-5a2db2d23639 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.156246 Oct 02 01:22:11.865187 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2429/4696] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers => generated 681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:11.874247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.876096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:11.881539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.899579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.901969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.902786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.904741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:11.905814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.907895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.909322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.909990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.servers [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Removing options 'limit' from query {{(pid=122355) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 02 01:22:11.915643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:11.933940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.934382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.934886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.935621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.936086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.936517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.049864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:22:12.118796 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-523fef57-a149-454b-89dd-892d93656bbf tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.240298 Oct 02 01:22:12.119946 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2430/4697] 10.222.0.23 () {58 vars in 1144 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:12.135897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3726ffb4-2eee-4612-acce-0ef90f793d87 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3726ffb4-2eee-4612-acce-0ef90f793d87 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi '-1' Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 02 01:22:12.140787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 02 01:22:12.144884 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.150499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3726ffb4-2eee-4612-acce-0ef90f793d87 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:12.152216 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3726ffb4-2eee-4612-acce-0ef90f793d87 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021525 Oct 02 01:22:12.158582 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2431/4698] 10.222.0.23 () {58 vars in 1142 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:22:12.173015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9a80e42-bd21-4d24-a329-284995d8ad69 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9a80e42-bd21-4d24-a329-284995d8ad69 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: action_args: {} Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'testing' Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 02 01:22:12.179219 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 02 01:22:12.185746 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.195991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9a80e42-bd21-4d24-a329-284995d8ad69 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:12.198728 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9a80e42-bd21-4d24-a329-284995d8ad69 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.037188 Oct 02 01:22:12.205360 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2432/4699] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:22:12.212064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ee50f65-c5b3-43ca-9ca9-b53981b7c52b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.224906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ee50f65-c5b3-43ca-9ca9-b53981b7c52b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.226580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ee50f65-c5b3-43ca-9ca9-b53981b7c52b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:12.237533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.servers [None req-1ee50f65-c5b3-43ca-9ca9-b53981b7c52b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Flavor 'non_existing_flavor' could not be found {{(pid=122355) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 02 01:22:12.238975 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ee50f65-c5b3-43ca-9ca9-b53981b7c52b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.032288 Oct 02 01:22:12.240008 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2433/4700] 10.222.0.23 () {58 vars in 1178 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:22:12.256252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.272846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.273813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:12.279625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.283193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.284179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.285250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.286437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.287546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.288368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.292542 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e37c5a09-7fc3-4136-948b-b6fff61bd501 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.421117 Oct 02 01:22:12.304073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2268/4701] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:12.339457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.340085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.347305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.347903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.348353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.352547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.353038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.354914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.459465 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59762200-9892-4706-871d-3037f78f6b4f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.207875 Oct 02 01:22:12.466723 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2434/4702] 10.222.0.23 () {58 vars in 1174 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:22:12.476827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.498081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.499194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:12.511303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.512906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.514139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.515166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.517264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.518126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.657516 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3026f4f0-2d3c-482a-a213-4f3d2df90f13 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.183075 Oct 02 01:22:12.657516 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2435/4703] 10.222.0.23 () {58 vars in 1184 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:22:12.671778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.672951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.682953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.683673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.684179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.685185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.686165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.686733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.708148 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 HTTP/1.1 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '73b621df-a125-42a6-a9d9-2f65d0e618b1'} Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:12.711034 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.716663 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.721197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:12.722436 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c6dccac-3f1b-48ad-a05c-44b73a8f9935 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 404 len: 111 microversion: 2.1 time: 0.063884 Oct 02 01:22:12.724516 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2436/4704] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:12 2022] DELETE /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:12.738719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.746837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.748720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:12.751807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.756361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.757131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.757908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.758968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.759980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.760597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.764596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e1ebe5c-12d8-45d4-8a0f-b2fc71a22a1b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.429458 Oct 02 01:22:12.767462 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2269/4705] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:12.785133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.786301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: 73b621df-a125-42a6-a9d9-2f65d0e618b1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.796614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.798846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.799554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:22:12.800245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.803971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.804895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.805589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.819640 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:12.850408 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.852244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 HTTP/1.1 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '73b621df-a125-42a6-a9d9-2f65d0e618b1'} Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.854674 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. Oct 02 01:22:12.858451 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.861943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.862582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance 73b621df-a125-42a6-a9d9-2f65d0e618b1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:12.862719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.863933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.864626 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ddb1ee9-7bd5-4c37-a97f-1b83f6cdf131 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1" status: 404 len: 111 microversion: 2.1 time: 0.094971 Oct 02 01:22:12.867082 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2270/4706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers/73b621df-a125-42a6-a9d9-2f65d0e618b1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:12.878323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.880828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.902462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.903337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.904046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.904992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.905679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.906959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.933231 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 HTTP/1.1 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c3bb7393-ea02-4ff2-a222-2d0faa65f524'} Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:12.934990 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:12.940373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:12.942324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:12.953211 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e2a004d-d970-493e-affa-e780878e82e0 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 404 len: 111 microversion: 2.1 time: 0.081426 Oct 02 01:22:12.954307 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2271/4707] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:12 2022] DELETE /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:12.962876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.963636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] [instance: c3bb7393-ea02-4ff2-a222-2d0faa65f524] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.973104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.973774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.975070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.976373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.979931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.980518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.010753 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] HTTP exception thrown: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Request method failure captured: Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 HTTP/1.1 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOZtk5KNk7yh_nmcIWJwOpWVZwL5FaDH_FH_crekmT6pzDqe1KBHv6_vTkDOYEbf0kHCHGOAIQpXbYq7v0JQ20dGO8GtT0jyRJDpFjfVlzM6-XmBvuZF612SsU-5SlUahUz0mPBye9ayEBAocOZkAz1SCwnz1lH4pYMRD8CvFPnsUd0 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d8558d451aa4c17b359f4ae0274a371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d8558d451aa4c17b359f4ae0274a371"}]}] Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1d8558d451aa4c17b359f4ae0274a371 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1933676154 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: db9450c53d8944b88cfbbc541f585ba0 Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-1933676154-project Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c3bb7393-ea02-4ff2-a222-2d0faa65f524'} Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:13.018502 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. Oct 02 01:22:13.023047 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:13.024495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] Returning 404 to user: Instance c3bb7393-ea02-4ff2-a222-2d0faa65f524 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:13.025670 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63d31d1b-2728-4063-b82f-c16a60bf9c32 tempest-DeleteServersTestJSON-1933676154 tempest-DeleteServersTestJSON-1933676154-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524" status: 404 len: 111 microversion: 2.1 time: 0.067255 Oct 02 01:22:13.026767 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2272/4708] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers/c3bb7393-ea02-4ff2-a222-2d0faa65f524 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:22:13.322838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:13.324360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:13.335171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.336059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.337526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.338437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.339085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.339873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.802951 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a5f4aed-f699-4669-bdcf-c75246d284e4 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 1.076906 Oct 02 01:22:13.805132 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2437/4709] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:13.812892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e5e2d154-ab5d-4347-91b8-435f7ad8907a req-1ed2ee12-4b15-4801-97b2-c83edce08c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1754cbf2-c3a3-4e32-981c-8dcf96c201e5", "tag": "0e14a9ad-973f-4dab-9a96-fa5036611163"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:13.828616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e5e2d154-ab5d-4347-91b8-435f7ad8907a req-1ed2ee12-4b15-4801-97b2-c83edce08c2f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.830084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e5e2d154-ab5d-4347-91b8-435f7ad8907a req-1ed2ee12-4b15-4801-97b2-c83edce08c2f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.830711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e5e2d154-ab5d-4347-91b8-435f7ad8907a req-1ed2ee12-4b15-4801-97b2-c83edce08c2f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.848103 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e5e2d154-ab5d-4347-91b8-435f7ad8907a req-1ed2ee12-4b15-4801-97b2-c83edce08c2f service nova] Creating event network-changed:0e14a9ad-973f-4dab-9a96-fa5036611163 for instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 on n-h1-master-1 Oct 02 01:22:13.862033 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e5e2d154-ab5d-4347-91b8-435f7ad8907a req-1ed2ee12-4b15-4801-97b2-c83edce08c2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053298 Oct 02 01:22:13.864299 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2438/4710] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:13.872414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:13.873803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:13.881466 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:13.884599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.885592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.886343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.887649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.889717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.890436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.893257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:13.902830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0066c4e1-c095-4780-a85b-b605a83f38b5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.586602 Oct 02 01:22:13.903459 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2273/4711] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:13 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:13.933468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45c91a83-4359-4c19-a80f-20726863689a tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:13.951926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45c91a83-4359-4c19-a80f-20726863689a tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:13.953825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45c91a83-4359-4c19-a80f-20726863689a tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.028700 Oct 02 01:22:13.955096 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2274/4712] 10.222.0.23 () {58 vars in 1178 bytes} [Sun Oct 2 01:22:13 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:22:13.974591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:13.981319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:13.982240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Searching by: {'deleted': False, 'project_id': '64858251a1ff4228adccb029de599d31'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:22:13.987413 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:13.989770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.990442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.991040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.991996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.992796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.993367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.027463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:22:14.059979 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-80598645-45c4-4cc1-9ced-825b7f047d55 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.096723 Oct 02 01:22:14.070022 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2275/4713] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:22:13 2022] GET /compute/v2.1/servers => generated 681 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:14.075205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.076264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.089485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.089996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.090438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.091199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.091732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.092156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.116499 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] HTTP exception thrown: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 HTTP/1.1 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0ea99b17-270b-49d5-9373-f5c50fab9c07'} Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:14.118506 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.123621 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.125182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 404 to user: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:14.126275 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b9a3c4c-95db-4fcc-961a-e951a53f834d tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 404 len: 111 microversion: 2.1 time: 0.055053 Oct 02 01:22:14.129386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2276/4714] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:14 2022] DELETE /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:14.136503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.137010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.143802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.144517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.145261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.146165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.147237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.147836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.182305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:22:14.313977 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-770483ba-3077-418b-aeee-2d41dba5bde0 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 204 len: 0 microversion: 2.1 time: 0.181316 Oct 02 01:22:14.319691 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2277/4715] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:14 2022] DELETE /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:22:14.335962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:14.337221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.338401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.354304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.356461 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61afe81d-e48b-4441-9ca1-a1ce09e10081 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.490024 Oct 02 01:22:14.357065 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2439/4716] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:13 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:14.357462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.357971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.358772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.359323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.362712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.413337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:22:14.551095 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-615d56de-c2b8-45d2-a01a-c6b8839470bd tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 204 len: 0 microversion: 2.1 time: 0.223042 Oct 02 01:22:14.552833 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2278/4717] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:14 2022] DELETE /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:22:14.572546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.573179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0ea99b17-270b-49d5-9373-f5c50fab9c07] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.583150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.583715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.584066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.585543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.586821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.587476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.608489 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] HTTP exception thrown: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 HTTP/1.1 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0ea99b17-270b-49d5-9373-f5c50fab9c07'} Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.611025 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 404 to user: Instance 0ea99b17-270b-49d5-9373-f5c50fab9c07 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:14.615612 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6909570-c129-4c62-b09e-38d7277bef7b tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07" status: 404 len: 111 microversion: 2.1 time: 0.054812 Oct 02 01:22:14.617302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2440/4718] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:14 2022] GET /compute/v2.1/servers/0ea99b17-270b-49d5-9373-f5c50fab9c07 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:14.625616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.626852 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.637951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.638986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.648600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.650570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.652221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.652851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.940670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.942985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.949718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.950205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.950673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.951627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.952075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.952496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.137166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:15.147436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1527298-77d6-4316-87f8-14d76a6ae4c6 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 200 len: 1521 microversion: 2.1 time: 0.528844 Oct 02 01:22:15.148029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2279/4719] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:14 2022] GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:15.384678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:15.385783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:15.396516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:15.397657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:15.398257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.399362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:15.400195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:15.400786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.439187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:15.447031 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06e1e731-665a-46c1-8b28-49bad82ac9ca tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.519969 Oct 02 01:22:15.455108 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2441/4720] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:14 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:15.761252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:15.771878 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7559c3e6-30ef-4eec-9ca7-9914f9352d46 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.391951 Oct 02 01:22:15.787688 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2280/4721] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:15 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:16.174654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:16.175846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:16.182992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.183762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.184380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.185459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.185673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.186099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.474459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:16.475327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:16.483307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.484092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.485233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.486018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.486584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.486584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.834359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:16.843983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e92f96ed-30f4-46b6-b7f0-1a07146f399f tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 200 len: 1521 microversion: 2.1 time: 0.673942 Oct 02 01:22:16.845380 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2442/4722] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:16 2022] GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 1521 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:16.851317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:16.852132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:16.869182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.869691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.870175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.870935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.871771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.872193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:17.023392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:17.031470 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c810df3-64fe-4537-b4cc-f6bb7201fb05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.561145 Oct 02 01:22:17.032321 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2281/4723] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:16 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:17.346639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:17.365942 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5bfa2899-ca39-4285-bc14-1c8aed25ece0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.518569 Oct 02 01:22:17.366542 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2443/4724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:16 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:17.869429 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:17.870762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:17.883978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:17.884471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:17.884907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:17.885619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:17.886077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:17.886523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:17.993323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e1776297-293a-4de9-9a8d-e1de2d41578d req-076b211a-4a5b-40a3-98ee-e847e5a813df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da8979-b30e-416f-b666-25b8e3618e57", "name": "network-vif-deleted", "tag": "a15952f9-4b4c-4d4d-9df8-cbee0fa257e9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:18.009081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e1776297-293a-4de9-9a8d-e1de2d41578d req-076b211a-4a5b-40a3-98ee-e847e5a813df service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.009562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e1776297-293a-4de9-9a8d-e1de2d41578d req-076b211a-4a5b-40a3-98ee-e847e5a813df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.009994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e1776297-293a-4de9-9a8d-e1de2d41578d req-076b211a-4a5b-40a3-98ee-e847e5a813df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.023781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e1776297-293a-4de9-9a8d-e1de2d41578d req-076b211a-4a5b-40a3-98ee-e847e5a813df service nova] Creating event network-vif-deleted:a15952f9-4b4c-4d4d-9df8-cbee0fa257e9 for instance a9da8979-b30e-416f-b666-25b8e3618e57 on n-h2-master-1 Oct 02 01:22:18.031708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:18.042966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e1776297-293a-4de9-9a8d-e1de2d41578d req-076b211a-4a5b-40a3-98ee-e847e5a813df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054939 Oct 02 01:22:18.044102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7bdbeea0-371d-4ddc-a168-e8eb18a20acc tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 200 len: 1479 microversion: 2.1 time: 0.178558 Oct 02 01:22:18.044705 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2282/4725] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:17 2022] GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 1479 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:18.045727 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2444/4726] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:22:18.063059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:18.063741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:18.071761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.072265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.073115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.073834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.074289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.074852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.395687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:18.396403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:18.405250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.405857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.406301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.408036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.408902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.409501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.623930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:18.647016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-464e7a8c-72b2-48f7-9dbc-c69c6b03bd4a tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.588755 Oct 02 01:22:18.650216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2283/4727] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:18 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:18.772241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:18.791473 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa34e5f1-97dc-4329-b88e-36b683c62d7a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1724 microversion: 2.1 time: 0.402033 Oct 02 01:22:18.793002 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2445/4728] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:18 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:19.073053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:19.073744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: a9da8979-b30e-416f-b666-25b8e3618e57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:19.090328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.091105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.091807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.092703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.093505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.094185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.120600 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] HTTP exception thrown: Instance a9da8979-b30e-416f-b666-25b8e3618e57 could not be found. Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 HTTP/1.1 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a9da8979-b30e-416f-b666-25b8e3618e57 could not be found. Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a9da8979-b30e-416f-b666-25b8e3618e57'} Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9da8979-b30e-416f-b666-25b8e3618e57 could not be found. Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9da8979-b30e-416f-b666-25b8e3618e57 could not be found. Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:19.122626 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9da8979-b30e-416f-b666-25b8e3618e57 could not be found. Oct 02 01:22:19.127568 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:19.139566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 404 to user: Instance a9da8979-b30e-416f-b666-25b8e3618e57 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:19.141015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b05f23f0-3df8-48f2-ad6e-0f572e22de16 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57" status: 404 len: 111 microversion: 2.1 time: 0.072759 Oct 02 01:22:19.141603 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2284/4729] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:19 2022] GET /compute/v2.1/servers/a9da8979-b30e-416f-b666-25b8e3618e57 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:19.150032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:19.150880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:19.164274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.167417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.167987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.168846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.169734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.173901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.201503 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:19.672118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:19.672870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:19.689101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.694480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.695145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.698200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.698839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.699296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.757981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:19.784299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8391f82-a169-4ec4-96cf-b7d636a3fcaa tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1521 microversion: 2.1 time: 0.635430 Oct 02 01:22:19.787864 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2446/4730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:19 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:19.819379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:19.820943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:19.835162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.837833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.840694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.846825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.848235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.849197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.317704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:20.336320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d0717b2-7fb6-416e-88f1-c035c03d52ea tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.669291 Oct 02 01:22:20.352187 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2285/4731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:19 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:20.517172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:20.534161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96f6b438-ae22-48f3-8398-c09e893e81ed tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1701 microversion: 2.1 time: 0.720770 Oct 02 01:22:20.534788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2447/4732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:19 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1701 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:20.584310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c92556bf-19fb-4b28-8592-37e4004f5a26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:20.596188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92556bf-19fb-4b28-8592-37e4004f5a26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.597079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92556bf-19fb-4b28-8592-37e4004f5a26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.597699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c92556bf-19fb-4b28-8592-37e4004f5a26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.607694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7a6609a9-c43a-4e7b-b159-32bb3fd2a000 req-851869e1-b006-471a-a64a-7c79a036d536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1595c8-d050-4cb7-abab-32f549d090d1", "name": "network-vif-deleted", "tag": "8ee645b7-b8e7-4b66-9548-c49f8f565d0a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:20.633565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7a6609a9-c43a-4e7b-b159-32bb3fd2a000 req-851869e1-b006-471a-a64a-7c79a036d536 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.634101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7a6609a9-c43a-4e7b-b159-32bb3fd2a000 req-851869e1-b006-471a-a64a-7c79a036d536 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.634550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7a6609a9-c43a-4e7b-b159-32bb3fd2a000 req-851869e1-b006-471a-a64a-7c79a036d536 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.637997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c92556bf-19fb-4b28-8592-37e4004f5a26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Going to try to start instance {{(pid=122354) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 01:22:20.665923 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7a6609a9-c43a-4e7b-b159-32bb3fd2a000 req-851869e1-b006-471a-a64a-7c79a036d536 service nova] Creating event network-vif-deleted:8ee645b7-b8e7-4b66-9548-c49f8f565d0a for instance 0d1595c8-d050-4cb7-abab-32f549d090d1 on n-h1-master-1 Oct 02 01:22:20.679243 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7a6609a9-c43a-4e7b-b159-32bb3fd2a000 req-851869e1-b006-471a-a64a-7c79a036d536 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074554 Oct 02 01:22:20.680256 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2448/4733] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:22:20.713167 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:20.806999 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c92556bf-19fb-4b28-8592-37e4004f5a26 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action" status: 202 len: 0 microversion: 2.1 time: 0.244982 Oct 02 01:22:20.816012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:20.817419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:20.824266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2286/4734] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:22:20 2022] POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:22:20.839467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.839972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.844869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.845357 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:20.846299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.850410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:20.853554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.854530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.872200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.875330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.876040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.876789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.877252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.877683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.941990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.945477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.945944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.946412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lazy-loading 'fault' on Instance uuid 0d1595c8-d050-4cb7-abab-32f549d090d1 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:22:21.115937 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d3ffda1a2247e891ef255f3f90ea15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64858251a1ff4228adccb029de599d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:21.133798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0186ade-cf1f-4965-b5bf-dfa1f55d67d5 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 200 len: 1312 microversion: 2.1 time: 0.323594 Oct 02 01:22:21.134470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2449/4735] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:20 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:21.364398 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:21.365266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:21.390738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.394776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.397691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:21.399836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.401433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.401982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:21.450765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:21.465060 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c694776-2d1b-4a11-867b-f8233584569a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1710 microversion: 2.1 time: 0.639114 Oct 02 01:22:21.465949 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2287/4736] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:20 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1710 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:21.800410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:21.813929 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a007015-1476-4c2d-8e8b-c48a4749c6c5 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.453335 Oct 02 01:22:21.818552 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2450/4737] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:21 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:21.950303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2e0147a4-7311-4390-9713-0b0d0bf51a36 req-34b599d3-f1cf-45f0-9c0b-d82b0800c220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1754cbf2-c3a3-4e32-981c-8dcf96c201e5", "name": "network-vif-plugged", "status": "completed", "tag": "0e14a9ad-973f-4dab-9a96-fa5036611163"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:21.976731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2e0147a4-7311-4390-9713-0b0d0bf51a36 req-34b599d3-f1cf-45f0-9c0b-d82b0800c220 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.977227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2e0147a4-7311-4390-9713-0b0d0bf51a36 req-34b599d3-f1cf-45f0-9c0b-d82b0800c220 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.977664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2e0147a4-7311-4390-9713-0b0d0bf51a36 req-34b599d3-f1cf-45f0-9c0b-d82b0800c220 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.012843 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2e0147a4-7311-4390-9713-0b0d0bf51a36 req-34b599d3-f1cf-45f0-9c0b-d82b0800c220 service nova] Creating event network-vif-plugged:0e14a9ad-973f-4dab-9a96-fa5036611163 for instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 on n-h1-master-1 Oct 02 01:22:22.020733 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2e0147a4-7311-4390-9713-0b0d0bf51a36 req-34b599d3-f1cf-45f0-9c0b-d82b0800c220 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074548 Oct 02 01:22:22.021511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2288/4738] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:22.157943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:22.158542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] [instance: 0d1595c8-d050-4cb7-abab-32f549d090d1] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:22.168947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.169711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.170159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.170907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.172174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.172647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.205967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] HTTP exception thrown: Instance 0d1595c8-d050-4cb7-abab-32f549d090d1 could not be found. Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Request method failure captured: Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 HTTP/1.1 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOeTL50SO4qvbC46MjfBDFM0HjFD_lNLKXzLhCDXI80SPVdy0frzlm-7ImkH1DrcbsfXNZUynIZ08x4X9zHTedg1AKqCv4dWgaifrxb6y4dz9BrBonEWQzi20F93i11sB25VGPTlc-CRphvAzclpQUvvrl83r0qEmrCWI0fFcAYKKDI Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64858251a1ff4228adccb029de599d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64858251a1ff4228adccb029de599d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64858251a1ff4228adccb029de599d31"}]}] Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 64858251a1ff4228adccb029de599d31 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1309530630 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 85d3ffda1a2247e891ef255f3f90ea15 Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServersNegativeTestJSON-1309530630-project Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0d1595c8-d050-4cb7-abab-32f549d090d1 could not be found. Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0d1595c8-d050-4cb7-abab-32f549d090d1'} Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1595c8-d050-4cb7-abab-32f549d090d1 could not be found. Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1595c8-d050-4cb7-abab-32f549d090d1 could not be found. Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:22.207686 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1595c8-d050-4cb7-abab-32f549d090d1 could not be found. Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:22.212801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] Returning 404 to user: Instance 0d1595c8-d050-4cb7-abab-32f549d090d1 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:22.214116 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a739bf6-ee79-4b53-a856-92ff2c974841 tempest-ListServersNegativeTestJSON-1309530630 tempest-ListServersNegativeTestJSON-1309530630-project] 10.222.0.23 "GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1" status: 404 len: 111 microversion: 2.1 time: 0.060729 Oct 02 01:22:22.214941 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2451/4739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:22 2022] GET /compute/v2.1/servers/0d1595c8-d050-4cb7-abab-32f549d090d1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:22:22.494077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:22.494851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:22.507331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.507834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.512370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.521294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.521294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.521294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.840385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:22.841604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:22.850332 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:22.853410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.854755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.856476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.857459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.858087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.859301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.862159 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:23.211560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:23.220647 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24a4233b-430e-451f-a89b-73aab21025b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1710 microversion: 2.1 time: 0.730865 Oct 02 01:22:23.221243 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2289/4740] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:22 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1710 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:23.317699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:23.326115 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47be9b4b-88cf-4ed2-8721-cce0f824037d tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1325 microversion: 2.1 time: 0.489546 Oct 02 01:22:23.326717 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2452/4741] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:22 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1325 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:24.248422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.249165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:24.261853 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:24.278914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.284041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.284674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.285907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.290765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.291430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.355568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.357226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:24.369789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.370525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.372000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.372949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.373621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.374943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.685129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:24.701630 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d00b6b33-f683-4723-b12a-25717e526bf7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1710 microversion: 2.1 time: 0.458848 Oct 02 01:22:24.705725 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2290/4742] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:24 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1710 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:24.753482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:24.764684 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8992d19c-6937-4352-9815-0839d89389fc tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1522 microversion: 2.1 time: 0.416269 Oct 02 01:22:24.766073 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2453/4743] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:24 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:24.794122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.795353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:24.809718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.811043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.812941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.813746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.814292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.814851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.847540 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] HTTP exception thrown: Instance is not a member of specified network Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Request method failure captured: Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5/ips/invalid HTTP/1.1 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOe2RctVKVnCWOBdJgocMFjHrVRlMs2MFxU5UX7EpNvI-m81FVtE3y2dQk6l4lezZCDcHEBH5m51B26tRgon5vqv-ZE_KCFxKcrgMtsREsmhRVk_zp-q7snNZseNJ3GvH7CzKm5g4kM_wYdZdKZntjiwdkbqY6vIsVyTe3WrYvcF6TE Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 22fb92463e1c4d17947550b9b5513d70 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22fb92463e1c4d17947550b9b5513d70"}]}] Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 22fb92463e1c4d17947550b9b5513d70 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerAddressesNegativeTestJSON-59979487-project Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 953559ae78e14bffa8ec7b866b498875 Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-59979487-project Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: exception: Instance is not a member of specified network Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '1754cbf2-c3a3-4e32-981c-8dcf96c201e5', 'id': 'invalid'} Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 02 01:22:24.855176 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.860498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:24.860498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c78dfa41-5411-4ece-951e-daddab09887e tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.067854 Oct 02 01:22:24.860498 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2291/4744] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:22:24 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5/ips/invalid => generated 91 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:22:24.870176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa5246bc-ffdb-4c07-b1ce-c252dfb572c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.870741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa5246bc-ffdb-4c07-b1ce-c252dfb572c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Failed to fetch instance by id 999 {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:22:24.871249 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-fa5246bc-ffdb-4c07-b1ce-c252dfb572c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] HTTP exception thrown: Instance 999 could not be found. Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa5246bc-ffdb-4c07-b1ce-c252dfb572c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Request method failure captured: Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOe2RctVKVnCWOBdJgocMFjHrVRlMs2MFxU5UX7EpNvI-m81FVtE3y2dQk6l4lezZCDcHEBH5m51B26tRgon5vqv-ZE_KCFxKcrgMtsREsmhRVk_zp-q7snNZseNJ3GvH7CzKm5g4kM_wYdZdKZntjiwdkbqY6vIsVyTe3WrYvcF6TE Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 22fb92463e1c4d17947550b9b5513d70 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22fb92463e1c4d17947550b9b5513d70"}]}] Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 22fb92463e1c4d17947550b9b5513d70 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerAddressesNegativeTestJSON-59979487-project Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 953559ae78e14bffa8ec7b866b498875 Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-59979487-project Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 999 could not be found. Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '999'} Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 02 01:22:24.872854 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:24.881099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa5246bc-ffdb-4c07-b1ce-c252dfb572c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:24.881099 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa5246bc-ffdb-4c07-b1ce-c252dfb572c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007834 Oct 02 01:22:24.884446 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2454/4745] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:22:24 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:22:24.895906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.896436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:24.906465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.907177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.907701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.908812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.909617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.910639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.951488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:22:25.114167 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d1066aff-796a-45a7-8e84-59bf301976ae tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 204 len: 0 microversion: 2.1 time: 0.227517 Oct 02 01:22:25.115375 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2292/4746] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:22:24 2022] DELETE /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:22:25.127043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:25.127938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:25.140125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:25.141088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:25.141991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:25.143167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:25.143907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:25.144626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:25.500012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:25.511458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-48db2530-640e-488d-af9f-38f3a5d21775 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1528 microversion: 2.1 time: 0.391879 Oct 02 01:22:25.512358 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2455/4747] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:25 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1528 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:25.749638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:25.754287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:25.772572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:25.773391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:25.774054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:25.775148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:25.775835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:25.778188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.034566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:26.052563 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40487510-32da-42aa-ae65-77be4b2d66ce tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1714 microversion: 2.1 time: 0.329049 Oct 02 01:22:26.055742 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2293/4748] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:25 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1714 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:26.541220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:26.542860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:26.568230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:26.569271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:26.569786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.571648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:26.573181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:26.574708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.832040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:26.841834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b7baac50-6481-406b-9f53-c11160645c05 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1528 microversion: 2.1 time: 0.307428 Oct 02 01:22:26.843251 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2456/4749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:26 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:27.865291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:27.866507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:27.877382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:27.878051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:27.891316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:27.892357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:27.892996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:27.893593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:28.099593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:28.115236 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54c193f6-5c22-4015-b193-bfe39dd6500c tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1528 microversion: 2.1 time: 0.253870 Oct 02 01:22:28.116040 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2294/4750] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:27 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1528 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:28.590163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1245463814", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "957037e6-e1ad-4a16-96d6-70c4a643a13e"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:28.712358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] validate_networks() for [('957037e6-e1ad-4a16-96d6-70c4a643a13e', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:22:29.113104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4998bd7d-5777-4850-8938-c20a34e3585b req-9ba1249d-8368-4d08-bc94-86ddb56649df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1754cbf2-c3a3-4e32-981c-8dcf96c201e5", "name": "network-vif-deleted", "tag": "0e14a9ad-973f-4dab-9a96-fa5036611163"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:29.147842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4998bd7d-5777-4850-8938-c20a34e3585b req-9ba1249d-8368-4d08-bc94-86ddb56649df service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:29.149056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4998bd7d-5777-4850-8938-c20a34e3585b req-9ba1249d-8368-4d08-bc94-86ddb56649df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:29.149642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4998bd7d-5777-4850-8938-c20a34e3585b req-9ba1249d-8368-4d08-bc94-86ddb56649df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.165909 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4998bd7d-5777-4850-8938-c20a34e3585b req-9ba1249d-8368-4d08-bc94-86ddb56649df service nova] Creating event network-vif-deleted:0e14a9ad-973f-4dab-9a96-fa5036611163 for instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 on n-h1-master-1 Oct 02 01:22:29.183482 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4998bd7d-5777-4850-8938-c20a34e3585b req-9ba1249d-8368-4d08-bc94-86ddb56649df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383312 Oct 02 01:22:29.186835 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2295/4751] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:29.196816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:29.206349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:29.219971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:29.222513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:29.225861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.232512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:29.233910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:29.234514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.319778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:29.322771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:29.323236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.323712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lazy-loading 'fault' on Instance uuid 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:22:29.855983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953559ae78e14bffa8ec7b866b498875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22fb92463e1c4d17947550b9b5513d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:29.868358 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-71c68f70-b994-4cc1-a7a5-c4224c0189c0 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 200 len: 1315 microversion: 2.1 time: 0.676389 Oct 02 01:22:29.869625 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2296/4752] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:29 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:30.284876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:22:30.286490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:22:30.288043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:22:30.289209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:22:30.289886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:22:30.306871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.309195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.309679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.310478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.311065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.311824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.368179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Getting quotas for project cd04da83ed96424998ce30378767d820. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:22:30.382909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Getting quotas for user 99a3a1761393475fa6f7c95e95b8136b and project cd04da83ed96424998ce30378767d820. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:22:30.407592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:22:30.410318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:22:30.534962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b7b0666d-7556-4cb0-a8de-5126b8a8b4d4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.357059 Oct 02 01:22:30.538046 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2457/4753] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:22:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:22:30.793628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1820153423", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "957037e6-e1ad-4a16-96d6-70c4a643a13e"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:30.897563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:30.898187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] [instance: 1754cbf2-c3a3-4e32-981c-8dcf96c201e5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:30.906674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.907104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] validate_networks() for [('957037e6-e1ad-4a16-96d6-70c4a643a13e', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:22:30.911337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.914527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.915491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.916119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.920436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.980096 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] HTTP exception thrown: Instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 could not be found. Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Request method failure captured: Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 HTTP/1.1 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOe2RctVKVnCWOBdJgocMFjHrVRlMs2MFxU5UX7EpNvI-m81FVtE3y2dQk6l4lezZCDcHEBH5m51B26tRgon5vqv-ZE_KCFxKcrgMtsREsmhRVk_zp-q7snNZseNJ3GvH7CzKm5g4kM_wYdZdKZntjiwdkbqY6vIsVyTe3WrYvcF6TE Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 22fb92463e1c4d17947550b9b5513d70 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22fb92463e1c4d17947550b9b5513d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22fb92463e1c4d17947550b9b5513d70"}]}] Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 22fb92463e1c4d17947550b9b5513d70 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-59979487 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerAddressesNegativeTestJSON-59979487-project Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 953559ae78e14bffa8ec7b866b498875 Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-59979487-project Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 could not be found. Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '1754cbf2-c3a3-4e32-981c-8dcf96c201e5'} Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 could not be found. Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 could not be found. Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:30.981861 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 could not be found. Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] Returning 404 to user: Instance 1754cbf2-c3a3-4e32-981c-8dcf96c201e5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:22:30.986464 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae7fc2a6-74a6-4ff7-889d-149c5c6c9e38 tempest-ServerAddressesNegativeTestJSON-59979487 tempest-ServerAddressesNegativeTestJSON-59979487-project] 10.222.0.23 "GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5" status: 404 len: 111 microversion: 2.1 time: 0.091850 Oct 02 01:22:30.988447 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2458/4754] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:30 2022] GET /compute/v2.1/servers/1754cbf2-c3a3-4e32-981c-8dcf96c201e5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:22:32.185656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:22:32.187533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:22:32.187786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:22:32.188188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:22:32.188613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:22:32.202217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:32.207513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:32.207513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:32.207513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:32.207760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:32.208506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:32.257743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Getting quotas for project cd04da83ed96424998ce30378767d820. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:22:32.272333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Getting quotas for user 99a3a1761393475fa6f7c95e95b8136b and project cd04da83ed96424998ce30378767d820. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:22:32.294236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:22:32.295044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:22:32.379752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82b22bcd-9900-43a2-892c-c4176c7bc7bd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589878 Oct 02 01:22:32.380726 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2297/4755] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:22:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:22:32.574013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1820524143", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "451", "networks": [{"uuid": "957037e6-e1ad-4a16-96d6-70c4a643a13e"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:32.735718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] validate_networks() for [('957037e6-e1ad-4a16-96d6-70c4a643a13e', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:22:34.635125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:22:34.635830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:22:34.636414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:22:34.636928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:22:34.638272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:22:34.653701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:34.655206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:34.655868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:34.656746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:34.657310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:34.658446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:34.678641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Getting quotas for project cd04da83ed96424998ce30378767d820. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:22:34.685370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Getting quotas for user 99a3a1761393475fa6f7c95e95b8136b and project cd04da83ed96424998ce30378767d820. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:22:34.702002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:22:34.704972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:22:34.775801 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a70f469-b151-4825-89d1-1ca7e654b8fc tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207732 Oct 02 01:22:34.777468 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2459/4756] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:22:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:22:34.798814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6360c40-0eb1-4209-a73d-89646795cfe2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:34.801388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6360c40-0eb1-4209-a73d-89646795cfe2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:34.938668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6360c40-0eb1-4209-a73d-89646795cfe2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:34.980929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6360c40-0eb1-4209-a73d-89646795cfe2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1221 microversion: 2.1 time: 0.193464 Oct 02 01:22:34.981636 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2298/4757] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:34 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:36.010179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:36.010973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:36.028859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:36.029649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:36.030486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:36.031391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:36.036765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:36.037633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:36.517331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:36.530969 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8094b55d-f8da-4587-83bb-8284e33b010a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1273 microversion: 2.1 time: 0.525702 Oct 02 01:22:36.553069 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2460/4758] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:36 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1273 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:37.559371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:37.559985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:37.573854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:37.579002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:37.579705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:37.580722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:37.581417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:37.582498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:37.821974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:37.833459 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf183a09-9ec4-4865-a5f5-920878257f79 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1279 microversion: 2.1 time: 0.277821 Oct 02 01:22:37.835005 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2299/4759] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:37 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:38.857445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:38.858722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:38.871949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.873782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.874470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.875499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.876253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.876922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.953045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0a8c746e-43f6-480f-8159-befe82810b29 req-19307b93-93a2-4198-806c-4e6c2a05a220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9929aeb1-e801-4cfe-8869-5139f02b0024", "tag": "b771997b-9356-494f-a962-4d5ead7c74f5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:38.965488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a8c746e-43f6-480f-8159-befe82810b29 req-19307b93-93a2-4198-806c-4e6c2a05a220 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.966244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a8c746e-43f6-480f-8159-befe82810b29 req-19307b93-93a2-4198-806c-4e6c2a05a220 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.967977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0a8c746e-43f6-480f-8159-befe82810b29 req-19307b93-93a2-4198-806c-4e6c2a05a220 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.984528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0a8c746e-43f6-480f-8159-befe82810b29 req-19307b93-93a2-4198-806c-4e6c2a05a220 service nova] Creating event network-changed:b771997b-9356-494f-a962-4d5ead7c74f5 for instance 9929aeb1-e801-4cfe-8869-5139f02b0024 on n-h2-master-1 Oct 02 01:22:38.991103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0a8c746e-43f6-480f-8159-befe82810b29 req-19307b93-93a2-4198-806c-4e6c2a05a220 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042327 Oct 02 01:22:38.992319 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2300/4760] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:39.168196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:39.181268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cee9d0cf-faf8-4c86-986f-160158a37b14 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1279 microversion: 2.1 time: 0.327847 Oct 02 01:22:39.182158 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2461/4761] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:38 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:40.216020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:40.221147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:40.233628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:40.234763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:40.236086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:40.237176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:40.237938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:40.239083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:40.449339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:40.467266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-41e49b05-dbb4-4c41-84af-f4877c16ae19 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1279 microversion: 2.1 time: 0.260499 Oct 02 01:22:40.477983 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2301/4762] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:40 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1279 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:41.049104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6fdcbfc4-7f07-4b81-91d0-46cf69aa8a8d req-f3208b0e-a408-4f43-b0ba-8cb7ed018619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f66ab8d-7d19-4141-981a-7a55d14cb236", "tag": "54b1172d-db13-4950-886a-b83bc89b37f9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:41.086128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6fdcbfc4-7f07-4b81-91d0-46cf69aa8a8d req-f3208b0e-a408-4f43-b0ba-8cb7ed018619 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.086733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6fdcbfc4-7f07-4b81-91d0-46cf69aa8a8d req-f3208b0e-a408-4f43-b0ba-8cb7ed018619 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.087209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6fdcbfc4-7f07-4b81-91d0-46cf69aa8a8d req-f3208b0e-a408-4f43-b0ba-8cb7ed018619 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:41.110660 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6fdcbfc4-7f07-4b81-91d0-46cf69aa8a8d req-f3208b0e-a408-4f43-b0ba-8cb7ed018619 service nova] Creating event network-changed:54b1172d-db13-4950-886a-b83bc89b37f9 for instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 on n-h2-master-1 Oct 02 01:22:41.132358 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6fdcbfc4-7f07-4b81-91d0-46cf69aa8a8d req-f3208b0e-a408-4f43-b0ba-8cb7ed018619 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083828 Oct 02 01:22:41.135616 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2462/4763] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:41.493519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:41.494758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:41.512110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.526229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.530579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:41.538277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.539564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.540675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:42.233969 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:42.352148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:42.367015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99995b9a-bbf0-4f55-8135-6fc209c3dd32 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.875912 Oct 02 01:22:42.382674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2302/4764] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:41 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:43.397261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:43.398572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:43.419328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:43.423061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:43.423807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:43.424760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:43.431933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:43.432724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:44.140678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:44.167644 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de5fc121-708d-4198-a12a-297c418d8477 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.778799 Oct 02 01:22:44.181171 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2463/4765] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:43 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:44.619915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-15e8825b-e7eb-4e4c-88d3-782df3c9b3b9 req-4bed1c6c-9776-4494-9ee9-f0dcad5df47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c837bb75-f1b2-4521-b7a1-a8a5a9788556", "tag": "c6fe57bb-b036-4f5f-85a3-97d5c9db4957"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:44.639737 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:44.647931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15e8825b-e7eb-4e4c-88d3-782df3c9b3b9 req-4bed1c6c-9776-4494-9ee9-f0dcad5df47b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:44.648542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15e8825b-e7eb-4e4c-88d3-782df3c9b3b9 req-4bed1c6c-9776-4494-9ee9-f0dcad5df47b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:44.648987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-15e8825b-e7eb-4e4c-88d3-782df3c9b3b9 req-4bed1c6c-9776-4494-9ee9-f0dcad5df47b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:44.694904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-15e8825b-e7eb-4e4c-88d3-782df3c9b3b9 req-4bed1c6c-9776-4494-9ee9-f0dcad5df47b service nova] Creating event network-changed:c6fe57bb-b036-4f5f-85a3-97d5c9db4957 for instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 on n-h1-master-1 Oct 02 01:22:44.702939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-15e8825b-e7eb-4e4c-88d3-782df3c9b3b9 req-4bed1c6c-9776-4494-9ee9-f0dcad5df47b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087144 Oct 02 01:22:44.704160 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2303/4766] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:45.205368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:45.205979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:45.220851 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:45.224409 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:45.228680 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:45.231125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:45.234170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:45.235656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:45.237603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:45.240186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:45.243019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:46.165500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:46.193049 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cdb91c2a-08b1-4194-a1ea-fa6db7b1a505 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.989273 Oct 02 01:22:46.195091 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2464/4767] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:45 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:47.219946 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:47.225315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:47.226038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:47.238010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:47.242301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:47.243349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:47.244247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:47.247896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:47.251731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:47.689050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:47.698250 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3bc73a1e-1922-4745-b673-05bba4fc3466 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.479191 Oct 02 01:22:47.702296 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2304/4768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:47 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:48.393640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-66dc5255-719f-4bb4-8d93-36658d689baa req-132f751c-230d-459c-ac9d-59a32bf093df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9929aeb1-e801-4cfe-8869-5139f02b0024", "name": "network-vif-plugged", "status": "completed", "tag": "b771997b-9356-494f-a962-4d5ead7c74f5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:48.458320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-66dc5255-719f-4bb4-8d93-36658d689baa req-132f751c-230d-459c-ac9d-59a32bf093df service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.461292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-66dc5255-719f-4bb4-8d93-36658d689baa req-132f751c-230d-459c-ac9d-59a32bf093df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.461746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-66dc5255-719f-4bb4-8d93-36658d689baa req-132f751c-230d-459c-ac9d-59a32bf093df service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:48.508612 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-66dc5255-719f-4bb4-8d93-36658d689baa req-132f751c-230d-459c-ac9d-59a32bf093df service nova] Creating event network-vif-plugged:b771997b-9356-494f-a962-4d5ead7c74f5 for instance 9929aeb1-e801-4cfe-8869-5139f02b0024 on n-h2-master-1 Oct 02 01:22:48.523251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-66dc5255-719f-4bb4-8d93-36658d689baa req-132f751c-230d-459c-ac9d-59a32bf093df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133753 Oct 02 01:22:48.527112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2465/4769] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:48.728311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:48.728917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:48.746767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.752895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.754437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:48.758586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.760047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.762372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:49.321243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:49.323982 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:49.334703 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8fef74bf-8172-4457-9932-03db85b905e2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.610416 Oct 02 01:22:49.337980 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2305/4770] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:48 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:50.366156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:50.368907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:50.400644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:50.401544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:50.402294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:50.405441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:50.406427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:50.407156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:50.412896 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=88 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:51.078583 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:51.095730 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c46a29e0-9017-40e6-a31a-11f3416be649 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.736739 Oct 02 01:22:51.096331 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2466/4771] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:50 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:52.082186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1552142333", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "2b1b75aa-5147-4dd4-8c08-db2432883e50"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:52.130795 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:52.135279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:52.151814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:52.154207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:52.155303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:52.157969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:52.158720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:52.160673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:52.190304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] validate_networks() for [('2b1b75aa-5147-4dd4-8c08-db2432883e50', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:22:53.088212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:53.111609 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d50202a4-f195-4de9-a78b-1133bbb780d2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.994391 Oct 02 01:22:53.113623 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2467/4772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:52 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:53.119763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c25d1bd8-670c-43af-871d-a772de40a55f req-8236ab63-c61f-4d06-acc9-c0424cf9ddc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f66ab8d-7d19-4141-981a-7a55d14cb236", "name": "network-vif-plugged", "status": "completed", "tag": "54b1172d-db13-4950-886a-b83bc89b37f9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:53.131739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c25d1bd8-670c-43af-871d-a772de40a55f req-8236ab63-c61f-4d06-acc9-c0424cf9ddc5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:53.133107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c25d1bd8-670c-43af-871d-a772de40a55f req-8236ab63-c61f-4d06-acc9-c0424cf9ddc5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:53.133708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c25d1bd8-670c-43af-871d-a772de40a55f req-8236ab63-c61f-4d06-acc9-c0424cf9ddc5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:53.159386 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c25d1bd8-670c-43af-871d-a772de40a55f req-8236ab63-c61f-4d06-acc9-c0424cf9ddc5 service nova] Creating event network-vif-plugged:54b1172d-db13-4950-886a-b83bc89b37f9 for instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 on n-h2-master-1 Oct 02 01:22:53.169248 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c25d1bd8-670c-43af-871d-a772de40a55f req-8236ab63-c61f-4d06-acc9-c0424cf9ddc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054102 Oct 02 01:22:53.170426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2468/4773] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:54.142204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:54.143953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:54.157262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:22:54.158298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:22:54.158916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:22:54.159506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:22:54.160086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:22:54.167653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.168496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.169076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.170020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.171955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.172614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.172790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.173506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.174059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.174630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.175160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.175601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.198757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Getting quotas for project 4426feaf511c44568616f844a3c657f0. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:22:54.205655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Getting quotas for user a4ba5c1008c3439689b252d70a0b3f2c and project 4426feaf511c44568616f844a3c657f0. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:22:54.243154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:22:54.252840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:22:54.351623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d28186d1-3b31-4fad-942e-6d2cc24e9378 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.907368 Oct 02 01:22:54.355402 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2306/4774] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:22:54.371808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec65b54c-4806-4651-b7b1-27f97ae0e8c6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:54.373784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec65b54c-4806-4651-b7b1-27f97ae0e8c6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:54.483135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec65b54c-4806-4651-b7b1-27f97ae0e8c6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:54.493502 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec65b54c-4806-4651-b7b1-27f97ae0e8c6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1217 microversion: 2.1 time: 0.129254 Oct 02 01:22:54.495202 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2307/4775] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:54 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:54.563276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:54.572888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ab4ce131-b81d-4447-affa-3a6fa9baefd0 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.437310 Oct 02 01:22:54.578286 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2469/4776] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:54 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:55.230175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f4f6b136-70c2-43db-bd33-34a3222001f6 req-f425680a-7fea-465d-89cf-665685b1236f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c837bb75-f1b2-4521-b7a1-a8a5a9788556", "name": "network-vif-plugged", "status": "completed", "tag": "c6fe57bb-b036-4f5f-85a3-97d5c9db4957"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:22:55.270095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f4f6b136-70c2-43db-bd33-34a3222001f6 req-f425680a-7fea-465d-89cf-665685b1236f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.277238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f4f6b136-70c2-43db-bd33-34a3222001f6 req-f425680a-7fea-465d-89cf-665685b1236f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.283828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f4f6b136-70c2-43db-bd33-34a3222001f6 req-f425680a-7fea-465d-89cf-665685b1236f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.301052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f4f6b136-70c2-43db-bd33-34a3222001f6 req-f425680a-7fea-465d-89cf-665685b1236f service nova] Creating event network-vif-plugged:c6fe57bb-b036-4f5f-85a3-97d5c9db4957 for instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 on n-h1-master-1 Oct 02 01:22:55.319216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f4f6b136-70c2-43db-bd33-34a3222001f6 req-f425680a-7fea-465d-89cf-665685b1236f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085714 Oct 02 01:22:55.322264 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2308/4777] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:22:55.532047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:55.533586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:55.560765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.567121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.568109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.571847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.572471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.573849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.604803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:55.605522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:55.648259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.649727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.650174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.650991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.651481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.651914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.701379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:55.731569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6849ad93-ae9f-4a3a-acec-8437a685f409 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1213 microversion: 2.1 time: 0.201022 Oct 02 01:22:55.732475 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2470/4778] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:55 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:56.097185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:56.110688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-148b5ba9-1812-4600-a554-e3031957aaec tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 0.513796 Oct 02 01:22:56.111276 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2309/4779] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:55 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:56.759872 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:56.761118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:56.769367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:56.771016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:56.775435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:56.776420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:56.777059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:56.780313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:57.139997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:57.140778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:57.187098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:57.189007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:57.189646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:57.192133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:57.195751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:57.197631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:57.600579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:57.627753 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e13b2893-82e9-4dc5-9780-6c42f41a3459 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1269 microversion: 2.1 time: 0.872044 Oct 02 01:22:57.629939 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2471/4780] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:56 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1269 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:58.284742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:58.292735 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fbec16e5-55f7-47e6-92b8-788d1d9dc34e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1321 microversion: 2.1 time: 1.162568 Oct 02 01:22:58.315229 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2310/4781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:57 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1321 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:58.656328 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:58.657645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:58.675312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:58.676331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:58.677252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:58.680117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:58.680804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:58.683064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:58.924746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:58.935439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4ff1d423-12df-432b-9548-a4c68c5a5bf8 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1275 microversion: 2.1 time: 0.284002 Oct 02 01:22:58.954966 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2472/4782] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:58 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:59.323676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:59.325665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:59.338386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.344641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.345808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.346576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.347207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.347649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.878541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:59.891613 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5cefb711-dcb7-4e60-8b5a-8796e4a9542b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1512 microversion: 2.1 time: 0.571881 Oct 02 01:22:59.892904 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2311/4783] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:59 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1512 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:59.915104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:59.916476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:59.924024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.924568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.925261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.926070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.926660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.927314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.965738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:59.969061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:59.979166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.980134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.980883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.982150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.983287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.990463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:00.629222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:00.639679 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-73e5418a-e0b3-422f-9cae-7659f0385a2f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1512 microversion: 2.1 time: 0.728301 Oct 02 01:23:00.655049 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2473/4784] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:59 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:00.655492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:00.670523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:00.671294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5edd67c2-210d-470b-b77b-6a0b574309b2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.710347 Oct 02 01:23:00.672345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:00.674962 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2312/4785] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:59 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:00.686725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:00.687480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:00.690953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:00.691912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:00.692552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:00.693150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.078714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:01.094839 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ed08df14-2dd9-4974-b1b2-57c806efd265 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 200 len: 1512 microversion: 2.1 time: 0.422153 Oct 02 01:23:01.111001 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2474/4786] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:00 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:01.128261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:01.139923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:01.143559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:01.186429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.188851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.191231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.206197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.207092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.213713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.407511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:01.576143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:01.595122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.596512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.601932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.700196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:01.700835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:01.736909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.738630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.741134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.744028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.745446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.748694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.112770 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1da11684-c9e8-4053-9141-683f6a57c62a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.994306 Oct 02 01:23:02.113788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2313/4787] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:23:01 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:02.118766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a519e857-dd54-4f5c-8c1f-8f62a3d424c3 req-52aad74e-2ba8-412f-bf5e-8c5e52d3d284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a2a405-c654-4910-b6bf-9daaece3d115", "tag": "63205272-4b1d-4180-b7b4-0c2876fe1ae3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:02.144281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a519e857-dd54-4f5c-8c1f-8f62a3d424c3 req-52aad74e-2ba8-412f-bf5e-8c5e52d3d284 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.148142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a519e857-dd54-4f5c-8c1f-8f62a3d424c3 req-52aad74e-2ba8-412f-bf5e-8c5e52d3d284 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.148885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a519e857-dd54-4f5c-8c1f-8f62a3d424c3 req-52aad74e-2ba8-412f-bf5e-8c5e52d3d284 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.174641 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a519e857-dd54-4f5c-8c1f-8f62a3d424c3 req-52aad74e-2ba8-412f-bf5e-8c5e52d3d284 service nova] Creating event network-changed:63205272-4b1d-4180-b7b4-0c2876fe1ae3 for instance 82a2a405-c654-4910-b6bf-9daaece3d115 on n-h1-master-1 Oct 02 01:23:02.193536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a519e857-dd54-4f5c-8c1f-8f62a3d424c3 req-52aad74e-2ba8-412f-bf5e-8c5e52d3d284 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078243 Oct 02 01:23:02.194706 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2314/4788] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:02.200511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:02.217069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:02.218293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1245463814', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:02.224209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.224690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.225121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.235618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.236335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.236776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.314923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:02.323616 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc382e16-a7ff-41ac-a277-b6f6c7d6b1c3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.628275 Oct 02 01:23:02.327554 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2475/4789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:01 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:02.597807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:02.742115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:02.755756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.755756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.756172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.025498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54bba89b-26c1-41ac-99e0-c3dfc73e94b4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1245463814" status: 200 len: 1515 microversion: 2.1 time: 0.829074 Oct 02 01:23:03.026910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2315/4790] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:23:02 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1245463814 => generated 1515 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:03.051780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:03.057166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:03.059801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:03.072551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.073912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.077496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.079030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.083525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.086270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.285279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:03.406830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:03.415917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-523431049", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:03.438947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.440400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.442252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.517451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] validate_networks() for [('b0e6d21e-9250-461d-9069-14c0a0969fd1', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:23:03.917093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-628ea073-6c52-4ee3-995f-6c1787bd5362 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.869773 Oct 02 01:23:03.917852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2316/4791] 10.222.0.23 () {58 vars in 1173 bytes} [Sun Oct 2 01:23:03 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:03.947425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:03.948452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:03.954880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.955612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.956208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.957148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.957765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.958539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.292162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.305122 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-918fb42a-ee50-4482-81cd-642e0f5d0e4e tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.372353 Oct 02 01:23:04.305721 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2317/4792] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:03 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:04.320610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:04.326448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.326955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.compute.servers [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Removing options 'limit' from query {{(pid=122354) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 02 01:23:04.327733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:04.338951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.339445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.340192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.341113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.341734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.342319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.385708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.393413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.394131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.394861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.505281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:23:04.506763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:23:04.508286 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:23:04.508903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:23:04.509527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:23:04.528767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.530179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.533089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.540979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.542997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.544375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.547595 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d15f1b9a-db24-4125-84d3-99666f7f6bfa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.240554 Oct 02 01:23:04.561157 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2318/4793] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:23:04 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:04.590212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:04.597232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.598403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:04.605452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.606696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.607453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.608798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.609536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.610581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.613339 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Getting quotas for project 621bdb6aad704cf9b2f31f9e1e653d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:04.639747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Getting quotas for user 4701f06a10ad4f89984132f8ec72b955 and project 621bdb6aad704cf9b2f31f9e1e653d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:04.657362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:23:04.671849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:23:04.738124 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d659f90-ebde-4f73-9606-686c0f841864 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.875920 Oct 02 01:23:04.744085 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2476/4794] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:23:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:23:04.758322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3a96ee40-5165-4079-85c4-f4fc00073126 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:04.764968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a96ee40-5165-4079-85c4-f4fc00073126 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:04.869248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a96ee40-5165-4079-85c4-f4fc00073126 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.882520 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3a96ee40-5165-4079-85c4-f4fc00073126 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1222 microversion: 2.1 time: 0.131093 Oct 02 01:23:04.888991 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2477/4795] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:04 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:05.304747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:05.332707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.333680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:05.342686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.343426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.344027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.345592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.346220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.346851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.435176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eb1b66d5-5cd5-43b4-ba2e-c5965ca0c2b3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.859538 Oct 02 01:23:05.449902 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2319/4796] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:04 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:05.462955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.474190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:05.474814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.compute.servers [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Removing options 'limit' from query {{(pid=122354) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 02 01:23:05.475541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:05.490195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.490411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.493057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.494048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.498284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.498792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.550664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:05.562987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:05.563413 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8711f7b-1810-4f0c-8d3c-0f511f2fb70a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.234709 Oct 02 01:23:05.566011 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2478/4797] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:05.620716 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6785dfc0-4291-4b40-bc34-6862c37169fd tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.161525 Oct 02 01:23:05.621438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2320/4798] 10.222.0.23 () {58 vars in 1150 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:05.634731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.641776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:05.644793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:05.654145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.654819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.655417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.656323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.656944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.657562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.716186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:05.753680 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ac804f7-6b92-4209-9989-e570b2a173e6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.123408 Oct 02 01:23:05.754634 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2479/4799] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers => generated 1012 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:05.770256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.776164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:05.781070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:05.816490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.819249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.820683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.821949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.822949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.824845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.909236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.909867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:05.923206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.924119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.927614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.928971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.929175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.929430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.005553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:06.076864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:06.090111 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-610f457a-8d11-4ac7-abba-725eb22a6258 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1218 microversion: 2.1 time: 0.183086 Oct 02 01:23:06.091146 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2480/4800] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:06.099371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-89a57398-3113-40b5-ab31-7662b09abfa2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.333111 Oct 02 01:23:06.100470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2321/4801] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:06.115900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:06.125917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:06.126492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.servers [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Removing options 'limit' from query {{(pid=122355) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 02 01:23:06.127259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:06.134660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.135122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.135564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.136369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.137509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.137942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.186931 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dafa7ee6-e245-4508-b95b-26a26143e3c8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.076277 Oct 02 01:23:06.187776 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2481/4802] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 2 01:23:06 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:06.209691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:06.244997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:06.245327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1245463814', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:06.260005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.267069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.267965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.269027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.269566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.270007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.395695 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:06.400383 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:06.497650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e561a4b-921e-4e81-b9b9-0f51c9f61fb9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1245463814" status: 200 len: 346 microversion: 2.1 time: 0.299663 Oct 02 01:23:06.498436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2322/4803] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:23:06 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1245463814 => generated 346 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:06.512390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46ead9d0-5f4d-45f1-a905-53ea36ad277a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:06.527470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ead9d0-5f4d-45f1-a905-53ea36ad277a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.528597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ead9d0-5f4d-45f1-a905-53ea36ad277a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.529235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46ead9d0-5f4d-45f1-a905-53ea36ad277a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.560841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46ead9d0-5f4d-45f1-a905-53ea36ad277a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Going to try to stop instance {{(pid=122355) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:23:06.593598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:06.594972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:06.607657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.608246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.608760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.617841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.618739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.619486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.626139 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46ead9d0-5f4d-45f1-a905-53ea36ad277a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "POST /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024/action" status: 202 len: 0 microversion: 2.1 time: 0.117851 Oct 02 01:23:06.633660 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2482/4804] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:06 2022] POST /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:06.641305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:06.642964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:06.652488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.653242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.654535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.655890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.661077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.662425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:07.020731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:07.065637 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5410d1c0-1d63-4e4a-83c9-430d4932412a tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.480018 Oct 02 01:23:07.082748 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2323/4805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:06 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:07.127673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:07.128621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:07.143526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:07.144468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:07.145331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:07.146336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:07.147118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:07.149149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:07.186645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:07.202050 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-170c0f6a-b824-4d57-9507-26240eef3d22 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1522 microversion: 2.1 time: 0.566202 Oct 02 01:23:07.219394 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2483/4806] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:06 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:07.288270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:07.299133 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9366364-5af0-4780-8f51-a5ddddbcc255 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1280 microversion: 2.1 time: 0.177428 Oct 02 01:23:07.321750 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2324/4807] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:07 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:08.094337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:08.095031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:08.113209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.117277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.117756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.118504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.118994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.119425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.180307 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:08.227680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:08.228306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:08.248040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.248549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.249333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.250592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.251372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.251995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.427615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:08.441604 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4502f35b-3b68-4981-8a87-ee8b97cf58e3 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.351837 Oct 02 01:23:08.442448 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2484/4808] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:08 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:08.472923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:08.473909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:08.490061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.492545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.493005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.493730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.494872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.498983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.076196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:09.086391 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a99431d7-f1b1-4427-b5da-d4fefd325af0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 0.628685 Oct 02 01:23:09.087248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2485/4809] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:08 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:09.094177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-72195bf5-bfd0-4356-9d06-03c2cc0391ef req-a18ced1a-d8ff-4e4e-9b39-65a16229fec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a2a405-c654-4910-b6bf-9daaece3d115", "name": "network-vif-plugged", "status": "completed", "tag": "63205272-4b1d-4180-b7b4-0c2876fe1ae3"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:09.110181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:09.110797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-72195bf5-bfd0-4356-9d06-03c2cc0391ef req-a18ced1a-d8ff-4e4e-9b39-65a16229fec7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.112032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-72195bf5-bfd0-4356-9d06-03c2cc0391ef req-a18ced1a-d8ff-4e4e-9b39-65a16229fec7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.112786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-72195bf5-bfd0-4356-9d06-03c2cc0391ef req-a18ced1a-d8ff-4e4e-9b39-65a16229fec7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.120081 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-142539fb-f6ec-45c6-9b54-41e0cd2d9a27 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1522 microversion: 2.1 time: 0.897565 Oct 02 01:23:09.122106 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2325/4810] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:08 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1522 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:09.131334 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-72195bf5-bfd0-4356-9d06-03c2cc0391ef req-a18ced1a-d8ff-4e4e-9b39-65a16229fec7 service nova] Creating event network-vif-plugged:63205272-4b1d-4180-b7b4-0c2876fe1ae3 for instance 82a2a405-c654-4910-b6bf-9daaece3d115 on n-h1-master-1 Oct 02 01:23:09.137758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-72195bf5-bfd0-4356-9d06-03c2cc0391ef req-a18ced1a-d8ff-4e4e-9b39-65a16229fec7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049168 Oct 02 01:23:09.138524 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2486/4811] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:09.468312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:09.468947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:09.476304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.477174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.478738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.481170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.482665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.483337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.774073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:09.792284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05a72fa1-c2b2-4b76-9bd7-f707cf434775 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.326853 Oct 02 01:23:09.794340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2326/4812] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:09 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:10.117082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:10.118376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:10.127527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.128568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.129240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:10.130560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.131334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.132010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:10.148188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:10.149113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:10.163685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.164406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.165032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:10.166126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.170005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.170816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.099930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:11.112160 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1680ec78-9ae3-4b56-aef5-b1a11bab4a71 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1522 microversion: 2.1 time: 0.968959 Oct 02 01:23:11.113820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:11.136226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6d8818c4-c8ad-421a-96d4-d6ca04322528 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 1.023928 Oct 02 01:23:11.137618 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2487/4813] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:10 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:11.145347 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2327/4814] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:10 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1522 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:11.148074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:11.148947 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:11.157048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:11.157976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:11.158590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.159382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:11.159813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:11.160214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.360036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-710fd343-a272-4f8e-972e-39183426476a req-8aea8986-ce10-4f1b-9937-6ce0830aad6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:11.369606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-710fd343-a272-4f8e-972e-39183426476a req-8aea8986-ce10-4f1b-9937-6ce0830aad6e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:11.370084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-710fd343-a272-4f8e-972e-39183426476a req-8aea8986-ce10-4f1b-9937-6ce0830aad6e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:11.371270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-710fd343-a272-4f8e-972e-39183426476a req-8aea8986-ce10-4f1b-9937-6ce0830aad6e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.393236 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-710fd343-a272-4f8e-972e-39183426476a req-8aea8986-ce10-4f1b-9937-6ce0830aad6e service nova] Creating event network-changed:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:23:11.398880 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-710fd343-a272-4f8e-972e-39183426476a req-8aea8986-ce10-4f1b-9937-6ce0830aad6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042261 Oct 02 01:23:11.399775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2328/4815] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:23:11.675098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:11.688793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-39d63cf7-f4b9-4be7-bc70-9b148d31a8ef tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1317 microversion: 2.1 time: 0.549618 Oct 02 01:23:11.702706 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2488/4816] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:11 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:12.143701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:12.144796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:12.162519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:12.166249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:12.175308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.176061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.179564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.180135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.180595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.181237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.181593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.181711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.182483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.185369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.188474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.189200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.742996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:12.755978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:12.764373 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-34bf2007-feb5-439b-83fa-ca60a4376247 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1499 microversion: 2.1 time: 0.630615 Oct 02 01:23:12.766099 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-def6ea08-e214-40ce-8f1f-b7022d598c32 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 0.608037 Oct 02 01:23:12.768368 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2489/4817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:12 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:12.770671 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2329/4818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:12 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1499 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:12.789710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:12.792209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:12.792996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:12.799664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:12.809206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:12.814021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.816029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.816529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.817315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.817893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.818141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.818381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.818850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.822071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.825547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.826656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.827614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.889928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:12.927618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-216b990d-c63a-4efe-b72d-1f8185672e8e tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.138308 Oct 02 01:23:12.928449 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2330/4819] 10.222.0.23 () {58 vars in 1154 bytes} [Sun Oct 2 01:23:12 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:12.942780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1452069e-8359-4545-be08-5416d360c81f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:12.950526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1452069e-8359-4545-be08-5416d360c81f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.951314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1452069e-8359-4545-be08-5416d360c81f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.952050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1452069e-8359-4545-be08-5416d360c81f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.007327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1452069e-8359-4545-be08-5416d360c81f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Going to try to start instance {{(pid=122354) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 01:23:13.071532 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1452069e-8359-4545-be08-5416d360c81f tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "POST /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024/action" status: 202 len: 0 microversion: 2.1 time: 0.133121 Oct 02 01:23:13.072639 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2331/4820] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:12 2022] POST /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:23:13.080926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.081946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.088433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.088977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.089394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.090114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.090564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.091184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.519883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:13.528886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3c3de2c-c696-45e8-a41e-d73dc5394137 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1508 microversion: 2.1 time: 0.452121 Oct 02 01:23:13.543172 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2332/4821] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1508 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:13.574523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:13.583132 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d61cc7d0-c953-429c-a481-4aca9ee2b827 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1506 microversion: 2.1 time: 0.813416 Oct 02 01:23:13.583725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2490/4822] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:12 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:13.611846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.612364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.628777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.630196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.630705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.633339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.633833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.634280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.689287 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a131912-3cf7-44d8-b5af-9b427d772c53 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115/ips" status: 200 len: 109 microversion: 2.1 time: 0.083195 Oct 02 01:23:13.691885 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2333/4823] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115/ips => generated 109 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:13.704845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.705356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.712990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.713502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.714147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.715602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.716079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.716683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.763943 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-df82c3cc-106d-40c6-9cc2-1dd61d8e77e2 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115/ips" status: 200 len: 109 microversion: 2.1 time: 0.062136 Oct 02 01:23:13.764895 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2491/4824] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115/ips => generated 109 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:13.778885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.779550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.786369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.791750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.794208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.794959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.798117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.798464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.800399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.801096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.815289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.817233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.821057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.822377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.823039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.825085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.860486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed5c775a-620e-426f-aa7e-45cdb51598ed tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115/ips/tempest-ServerAddressesTestJSON-1590431934-network" status: 200 len: 94 microversion: 2.1 time: 0.087949 Oct 02 01:23:13.868537 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2334/4825] 10.222.0.23 () {58 vars in 1401 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115/ips/tempest-ServerAddressesTestJSON-1590431934-network => generated 94 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:23:13.874510 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.875565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.882436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.883231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.883870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.884762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.885406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.886794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.919233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:23:14.084308 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ac2217b-e546-43f9-90d9-e172eef09b45 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "DELETE /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 204 len: 0 microversion: 2.1 time: 0.213933 Oct 02 01:23:14.084984 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2335/4826] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:23:13 2022] DELETE /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:14.095941 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:14.102968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:14.105086 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:14.124765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.125272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.125714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.126428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.129573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.130100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.383553 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:14.401825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:14.419454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9290865c-0f0f-48a8-836e-d3bd9ed2be8f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 0.631224 Oct 02 01:23:14.420192 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2492/4827] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:14.553222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:14.553749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:14.566541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.567252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.567888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.568814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.570325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.571497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.592523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:14.604044 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ee24465-6018-4306-b338-98c04bc10c79 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1512 microversion: 2.1 time: 0.512793 Oct 02 01:23:14.606719 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2336/4828] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:14 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1512 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:14.880001 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:15.130988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:15.139617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e610c4f5-414d-40af-9427-7cb099364fdf tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1508 microversion: 2.1 time: 0.590451 Oct 02 01:23:15.155320 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2493/4829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:14 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:15.444236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:15.444902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:15.454857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.455355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.455794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.459123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.459950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.460583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.486290 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:15.633246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:15.634130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:15.644132 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:15.652453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.657204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.661972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.663003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.663774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.663901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.864553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:15.879855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e998727d-5b54-4a69-8b92-040d3fbaf3c0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 0.441128 Oct 02 01:23:15.885328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2337/4830] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:15 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:15.918056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:15.927152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c69ad666-7092-401d-be2b-1f65c35478b6 tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1512 microversion: 2.1 time: 0.297582 Oct 02 01:23:15.935409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2494/4831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:15 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:16.164590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:16.165420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:16.180105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.182928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.187202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.188575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.191938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.193770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.515303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:16.526753 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-32ce629b-2f56-421e-b35e-c397386f656b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1512 microversion: 2.1 time: 0.365430 Oct 02 01:23:16.530322 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2338/4832] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:16 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:16.557164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:16.563143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:16.563594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.servers [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Removing options 'limit' from query {{(pid=122355) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 02 01:23:16.564371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:16.565533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.566014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.566449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.567204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.567657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.568087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.568555 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:16.583555 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4de90ff3-06a9-4caa-9024-9da6623508c4 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030089 Oct 02 01:23:16.598002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:16.598930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:16.603792 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2495/4833] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 2 01:23:16 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:23:16.605838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.606561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.607270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.608196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.608864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.609540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.846837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:16.855904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24dccb95-c48a-4151-b776-692741cbd049 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1512 microversion: 2.1 time: 0.260989 Oct 02 01:23:16.877556 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2339/4834] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:16 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:16.886946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:16.888436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:16.898960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.899643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.900669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.901659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.902509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.903535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.909608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:16.910265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:16.922752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.923269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.923716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.924469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.927987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.929581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.293478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.301559 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4add4cf-1d64-429c-bd5b-61b088adc216 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 200 len: 1512 microversion: 2.1 time: 0.422740 Oct 02 01:23:17.302161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2496/4835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:16 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:17.317642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:17.320028 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:17.329773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.330371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.330947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.331736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.332327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.333271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.433740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.456021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f96a2a2-4494-4a51-9cf1-49f6324e570b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 0.550740 Oct 02 01:23:17.470696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2340/4836] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:16 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:17.476396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-03484dbe-568d-41fd-b750-ccdecc3602f0 req-e0c0f519-4b0c-435a-9b8f-a389dc57d202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a2a405-c654-4910-b6bf-9daaece3d115", "name": "network-vif-deleted", "tag": "63205272-4b1d-4180-b7b4-0c2876fe1ae3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:17.490130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03484dbe-568d-41fd-b750-ccdecc3602f0 req-e0c0f519-4b0c-435a-9b8f-a389dc57d202 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.491297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03484dbe-568d-41fd-b750-ccdecc3602f0 req-e0c0f519-4b0c-435a-9b8f-a389dc57d202 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.491963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03484dbe-568d-41fd-b750-ccdecc3602f0 req-e0c0f519-4b0c-435a-9b8f-a389dc57d202 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.505716 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-03484dbe-568d-41fd-b750-ccdecc3602f0 req-e0c0f519-4b0c-435a-9b8f-a389dc57d202 service nova] Creating event network-vif-deleted:63205272-4b1d-4180-b7b4-0c2876fe1ae3 for instance 82a2a405-c654-4910-b6bf-9daaece3d115 on n-h1-master-1 Oct 02 01:23:17.514575 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-03484dbe-568d-41fd-b750-ccdecc3602f0 req-e0c0f519-4b0c-435a-9b8f-a389dc57d202 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042366 Oct 02 01:23:17.515835 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2341/4837] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:17.530936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:17.532643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4ba5c1008c3439689b252d70a0b3f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4426feaf511c44568616f844a3c657f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.541216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:17.550193 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-48c0cfe9-9ee7-4746-ab71-e12bf4c54f9b tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 200 len: 1302 microversion: 2.1 time: 0.242128 Oct 02 01:23:17.552319 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2497/4838] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:17 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 1302 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:17.558414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.559321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.560474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.561712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.562368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.562847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.884180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a23a4c17-0cb5-428b-83f0-4c8ba3fb47fa req-f3ee685b-b0a2-45e8-94e4-6f0e28b7fb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "name": "network-vif-plugged", "status": "completed", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:17.899053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.909148 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9edabc78-52ea-4633-9fa2-665f2988f366 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1512 microversion: 2.1 time: 0.391708 Oct 02 01:23:17.914061 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2342/4839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:17 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:17.928408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a23a4c17-0cb5-428b-83f0-4c8ba3fb47fa req-f3ee685b-b0a2-45e8-94e4-6f0e28b7fb5b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.928841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a23a4c17-0cb5-428b-83f0-4c8ba3fb47fa req-f3ee685b-b0a2-45e8-94e4-6f0e28b7fb5b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.929289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a23a4c17-0cb5-428b-83f0-4c8ba3fb47fa req-f3ee685b-b0a2-45e8-94e4-6f0e28b7fb5b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.943905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:17.949845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.950896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:17.965094 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a23a4c17-0cb5-428b-83f0-4c8ba3fb47fa req-f3ee685b-b0a2-45e8-94e4-6f0e28b7fb5b service nova] Creating event network-vif-plugged:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:23:17.987836 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a23a4c17-0cb5-428b-83f0-4c8ba3fb47fa req-f3ee685b-b0a2-45e8-94e4-6f0e28b7fb5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114760 Oct 02 01:23:17.988994 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2498/4840] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:18.227013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.228359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.228842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.230860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.231372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.231906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.398271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:18.480843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:18.481627 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:18.486699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f880b779-a50f-4090-bb5b-381725c1eb95 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 346 microversion: 2.1 time: 0.547673 Oct 02 01:23:18.495575 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2343/4841] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:17 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 346 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:23:18.496233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.496854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.497297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.498015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.499154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.499584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.503108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:18.503737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:18.512392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.514564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.514901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.515492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.516066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.516507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.883048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:18.897565 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f08d053a-e0df-4138-96cf-dd7e335f2a84 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1512 microversion: 2.1 time: 0.392884 Oct 02 01:23:18.899043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2344/4842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:18 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:18.906990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:18.911640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] [instance: 82a2a405-c654-4910-b6bf-9daaece3d115] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:18.922383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:18.933629 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3a98191-e059-492b-8514-d3bb9f230f63 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1322 microversion: 2.1 time: 0.459155 Oct 02 01:23:18.942989 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2499/4843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:18 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:18.956624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.960625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:18.961392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.962068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.963054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.964615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:18.965151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.965858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.983535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.987616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.989007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.990316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.994345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.996494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.019797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] HTTP exception thrown: Instance 82a2a405-c654-4910-b6bf-9daaece3d115 could not be found. Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Request method failure captured: Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 HTTP/1.1 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOfrOOzHrXO_lJyo_i8raMtUK7mqWqO7pCSF497zRthVMnDVO-Z0Czhq2GMT5omf6Dh60CidH73zw7NQ2F7UeprajqoYdlLleky96XtNnwl35_xHA_N2KcOexEVyp8CAMNgdv782_SsK30UBqNRnAx5hUxzHa1K8vDWvvH1SaQhP3-Y Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4426feaf511c44568616f844a3c657f0 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerAddressesTestJSON-2106576134 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4426feaf511c44568616f844a3c657f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4426feaf511c44568616f844a3c657f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4426feaf511c44568616f844a3c657f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4426feaf511c44568616f844a3c657f0"}]}] Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerAddressesTestJSON-2106576134 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4426feaf511c44568616f844a3c657f0 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2106576134 Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerAddressesTestJSON-2106576134-project Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a4ba5c1008c3439689b252d70a0b3f2c Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerAddressesTestJSON-2106576134-project Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 82a2a405-c654-4910-b6bf-9daaece3d115 could not be found. Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '82a2a405-c654-4910-b6bf-9daaece3d115'} Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a2a405-c654-4910-b6bf-9daaece3d115 could not be found. Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a2a405-c654-4910-b6bf-9daaece3d115 could not be found. Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:19.028450 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a2a405-c654-4910-b6bf-9daaece3d115 could not be found. Oct 02 01:23:19.033417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:19.042618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] Returning 404 to user: Instance 82a2a405-c654-4910-b6bf-9daaece3d115 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:19.047874 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8c8081b-bca7-4cb0-ac9e-71faddd94f4c tempest-ServerAddressesTestJSON-2106576134 tempest-ServerAddressesTestJSON-2106576134-project] 10.222.0.23 "GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115" status: 404 len: 111 microversion: 2.1 time: 0.147412 Oct 02 01:23:19.048657 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2345/4844] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:18 2022] GET /compute/v2.1/servers/82a2a405-c654-4910-b6bf-9daaece3d115 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:23:19.722871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:19.738697 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1e85d506-2cdc-43cf-9d07-84bfe041bb57 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 200 len: 1512 microversion: 2.1 time: 0.794379 Oct 02 01:23:19.739322 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2500/4845] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:18 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 1512 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:19.768660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:19.769292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:19.779062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.784668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.785361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.786258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.787205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.788232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.967798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:19.968486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:19.983983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.984724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.985472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.986501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.987525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.988349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.118046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:20.130960 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f523c294-7ece-47b8-a56a-dfd7413d4b8c tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1512 microversion: 2.1 time: 0.366719 Oct 02 01:23:20.133765 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2346/4846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:19 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:20.157018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:20.162051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:20.162874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:20.176603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.176997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.177442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.178163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.178639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.180927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.231312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:20.287596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:20.299104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.299586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.300017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.729986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:20.749121 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-79d0b57e-88fa-47fd-896b-54eebf628c98 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1517 microversion: 2.1 time: 0.778218 Oct 02 01:23:20.750116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2501/4847] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:19 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1517 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:20.782956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:20.788447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:20.801436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.802412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.803212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.805161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.805869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.806513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.843529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lazy-loading 'flavor' on Instance uuid 583dd333-3477-45ed-b1f0-8794fadf2ee6 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:23:20.904388 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:20.969527 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fcab662c-29c4-4c2a-9258-44e6a9e26769 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.817126 Oct 02 01:23:20.970405 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2347/4848] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:23:20 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:21.000219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:21.028521 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d771bac4-da3e-481a-b300-5118a83625f3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action" status: 200 len: 32 microversion: 2.1 time: 0.251961 Oct 02 01:23:21.034349 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2502/4849] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:20 2022] POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 01:23:21.043277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:21.044474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:21.060630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:21.062461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:21.070536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.073399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.073855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.074583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.075144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.075572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.517529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.518319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.518500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.519689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.520328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.520760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.574684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:21.625956 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b46545e8-8e23-47b3-b249-a1993a0687ad tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.633204 Oct 02 01:23:21.638029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2348/4850] 10.222.0.23 () {58 vars in 1150 bytes} [Sun Oct 2 01:23:20 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:21.643419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:21.654627 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:21.655772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:21.668330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.668819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.669255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.669973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.670529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.678295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.843756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:21.919983 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-294026aa-ed98-47c9-81d1-90cf1d7ac9fa tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.280591 Oct 02 01:23:21.920976 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2349/4851] 10.222.0.23 () {58 vars in 1212 bytes} [Sun Oct 2 01:23:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:21.937738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:21.949655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:21.951047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:21.957595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.958715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.960210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.961647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.962310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.962914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.079393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:22.084400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:22.102268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e2f67d1-f76c-4335-b455-48ab6dfba587 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 1.060774 Oct 02 01:23:22.105788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2503/4852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:21 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:22.154566 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2731deeb-928b-4821-b36e-0f7e8ae3d8eb tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.224260 Oct 02 01:23:22.155517 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2350/4853] 10.222.0.23 () {58 vars in 1196 bytes} [Sun Oct 2 01:23:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:22.170555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:22.176097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:22.179016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': '1245463814', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:22.190796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.191287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.191726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.192449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.192903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.193330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.301010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:22.677882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c6faed15-2aff-4b2c-aa18-ae41f9153c46 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?name=1245463814" status: 200 len: 346 microversion: 2.1 time: 0.510031 Oct 02 01:23:22.688920 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2504/4854] 10.222.0.23 () {58 vars in 1156 bytes} [Sun Oct 2 01:23:22 2022] GET /compute/v2.1/servers?name=1245463814 => generated 346 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:22.697492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:22.704703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:22.707970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:22.717981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.722190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.723734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.724774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.731199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.732000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.844092 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=31 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:22.913375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:23.011468 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b9ca7d7-1341-413e-bd4d-8d1d62f619a3 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.318230 Oct 02 01:23:23.022705 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2351/4855] 10.222.0.23 () {58 vars in 1154 bytes} [Sun Oct 2 01:23:22 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:23.025412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:23.043801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:23.044660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-124546381', 'deleted': False, 'project_id': 'cd04da83ed96424998ce30378767d820'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:23:23.055490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.056456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.057839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.059778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.060450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.061062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.136440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:23.137087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:23.158137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.159043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.159196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.159806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.160265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.160689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.190890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:23:23.319705 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f53936a0-9066-4ea4-9137-1f0e960d52d8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-124546381" status: 200 len: 346 microversion: 2.1 time: 0.298121 Oct 02 01:23:23.332969 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2505/4856] 10.222.0.23 () {58 vars in 1228 bytes} [Sun Oct 2 01:23:23 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-124546381 => generated 346 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:23:23.347360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:23.348073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:23.357379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.361491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.362376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.363337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.364010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.364444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.409303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:23:23.570732 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-182a65ed-7250-417c-a960-c9476f10e719 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 204 len: 0 microversion: 2.1 time: 0.226951 Oct 02 01:23:23.577463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2506/4857] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:23:23 2022] DELETE /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:23.589428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:23.591599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:23.604864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.605447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.606079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.607180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.608191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.609206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.754775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:23.759092 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:23.773048 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5664c020-e936-4757-ad78-978fdeee7630 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.644732 Oct 02 01:23:23.796373 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2352/4858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:23 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:24.505794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:24.514151 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e986352d-80b0-4ede-aa9f-9a5970daf417 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1518 microversion: 2.1 time: 0.933510 Oct 02 01:23:24.514758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2507/4859] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:23 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1518 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:24.805922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:24.807225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:24.818179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:24.819079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:24.820309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:24.821400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:24.822141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:24.823212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.155413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:25.158556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:25.162765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.175671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d150d18-692d-4dbd-915f-6f10566e9c67 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.375261 Oct 02 01:23:25.176276 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2353/4860] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:24 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:25.180969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.182017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.182672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.183577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.187847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.188492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.214712 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88785577-581a-422a-b306-3644e018082e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/ips" status: 200 len: 148 microversion: 2.1 time: 0.062846 Oct 02 01:23:25.215321 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2508/4861] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:23:25 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/ips => generated 148 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:25.228006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b5b39fc-07f0-46e0-8d06-2dcc01188e6b"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:25.231512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.237863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.238795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.239464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.240371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.240832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.241291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.328082 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Invalid volume: volume 4b5b39fc-07f0-46e0-8d06-2dcc01188e6b is already attached to instances: 7689d920-d346-41ba-8221-5fc1b39eb664 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/os-volume_attachments HTTP/1.1 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 74 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: {"volumeAttachment": {"volumeId": "4b5b39fc-07f0-46e0-8d06-2dcc01188e6b"}} Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid volume: volume 4b5b39fc-07f0-46e0-8d06-2dcc01188e6b is already attached to instances: 7689d920-d346-41ba-8221-5fc1b39eb664 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': 'd899a89c-af40-4200-bcf5-67168fb541af', 'body': {'volumeAttachment': {'volumeId': '4b5b39fc-07f0-46e0-8d06-2dcc01188e6b'}}} Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4b5b39fc-07f0-46e0-8d06-2dcc01188e6b is already attached to instances: 7689d920-d346-41ba-8221-5fc1b39eb664 Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:23:25.329760 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4b5b39fc-07f0-46e0-8d06-2dcc01188e6b is already attached to instances: 7689d920-d346-41ba-8221-5fc1b39eb664 Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4b5b39fc-07f0-46e0-8d06-2dcc01188e6b is already attached to instances: 7689d920-d346-41ba-8221-5fc1b39eb664 Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 400 to user: Invalid volume: volume 4b5b39fc-07f0-46e0-8d06-2dcc01188e6b is already attached to instances: 7689d920-d346-41ba-8221-5fc1b39eb664 {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fa9099ee-987e-4f11-9448-c2ffd84f44e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107423 Oct 02 01:23:25.337088 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2354/4862] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:23:25 2022] POST /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:23:25.343091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:25.343607 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.350868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.351641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.352444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.353324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.354892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.362380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.395012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:23:25.540602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:25.541505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.570635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.576345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.576657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.579869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.588897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.590334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.668893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1883cc7-8e2a-4a9f-9e15-538100693a0c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 204 len: 0 microversion: 2.1 time: 0.326401 Oct 02 01:23:25.671788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2509/4863] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:23:25 2022] DELETE /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:25.695267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:25.707436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.721895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.722409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.725739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.729370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.733723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.734183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.156418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:26.161065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:26.165827 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4018821e-34fd-4f5b-9124-524164a2c00c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1679 microversion: 2.1 time: 0.488815 Oct 02 01:23:26.170773 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2510/4864] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:25 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1679 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:26.191628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eca61c77-ad8a-4f0b-b898-dd79f00f623a tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1518 microversion: 2.1 time: 0.656419 Oct 02 01:23:26.192238 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2355/4865] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:25 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1518 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:26.206520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:26.207193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:26.231418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.232022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.232479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.233229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.233703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.234217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.569174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2f7f9059-4cdd-489b-b100-399cf8ccc418 req-1e8c2dee-b30e-46cc-8a3d-2b2cb72aafed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c837bb75-f1b2-4521-b7a1-a8a5a9788556", "name": "network-vif-deleted", "tag": "c6fe57bb-b036-4f5f-85a3-97d5c9db4957"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:26.589659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2f7f9059-4cdd-489b-b100-399cf8ccc418 req-1e8c2dee-b30e-46cc-8a3d-2b2cb72aafed service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.590148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2f7f9059-4cdd-489b-b100-399cf8ccc418 req-1e8c2dee-b30e-46cc-8a3d-2b2cb72aafed service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.590589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2f7f9059-4cdd-489b-b100-399cf8ccc418 req-1e8c2dee-b30e-46cc-8a3d-2b2cb72aafed service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.627588 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2f7f9059-4cdd-489b-b100-399cf8ccc418 req-1e8c2dee-b30e-46cc-8a3d-2b2cb72aafed service nova] Creating event network-vif-deleted:c6fe57bb-b036-4f5f-85a3-97d5c9db4957 for instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 on n-h1-master-1 Oct 02 01:23:26.660696 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2f7f9059-4cdd-489b-b100-399cf8ccc418 req-1e8c2dee-b30e-46cc-8a3d-2b2cb72aafed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095322 Oct 02 01:23:26.664598 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2356/4866] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:26.770334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:26.782012 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7f5f8db-8fbb-4831-bf04-a031ddda98b3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.579582 Oct 02 01:23:26.782664 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2511/4867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:26 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:27.195655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:27.196967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:27.215481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.216468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.216863 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:27.217268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.217495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:27.218505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.219174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.219768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.238381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.238928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.239387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.240117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.240583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.241020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.375495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.376017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.376471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.376945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lazy-loading 'fault' on Instance uuid c837bb75-f1b2-4521-b7a1-a8a5a9788556 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:23:27.514146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:27.527558 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7fbfe2b8-a90b-4b84-8d8c-c1a70f9f5403 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 200 len: 1311 microversion: 2.1 time: 0.314116 Oct 02 01:23:27.528486 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2512/4868] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:27 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 1311 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:27.799856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:27.809953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:27.811278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:27.814060 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-31f1c9b1-2c28-4696-98ce-0113039de0a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1679 microversion: 2.1 time: 0.623440 Oct 02 01:23:27.826078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.827980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.828853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.833171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.833761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.835543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.836523 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2357/4869] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:27 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1679 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:28.157553 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:28.176252 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d7bb39ab-dad0-425e-ac84-27167e11b708 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.368550 Oct 02 01:23:28.177237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2513/4870] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:27 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:28.456133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-149b10c9-fc33-46b4-bf61-6d34817a433c req-761ece7c-56d4-4e14-a7c0-86d32895f576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d899a89c-af40-4200-bcf5-67168fb541af", "name": "network-vif-unplugged", "status": "completed", "tag": "ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:28.474135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-149b10c9-fc33-46b4-bf61-6d34817a433c req-761ece7c-56d4-4e14-a7c0-86d32895f576 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.474647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-149b10c9-fc33-46b4-bf61-6d34817a433c req-761ece7c-56d4-4e14-a7c0-86d32895f576 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.477449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-149b10c9-fc33-46b4-bf61-6d34817a433c req-761ece7c-56d4-4e14-a7c0-86d32895f576 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.507832 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-149b10c9-fc33-46b4-bf61-6d34817a433c req-761ece7c-56d4-4e14-a7c0-86d32895f576 service nova] Creating event network-vif-unplugged:ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2 for instance d899a89c-af40-4200-bcf5-67168fb541af on n-h1-master-1 Oct 02 01:23:28.524052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-149b10c9-fc33-46b4-bf61-6d34817a433c req-761ece7c-56d4-4e14-a7c0-86d32895f576 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070338 Oct 02 01:23:28.529148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2358/4871] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:28.557256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:28.558056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: c837bb75-f1b2-4521-b7a1-a8a5a9788556] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:28.568272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.569974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.571622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.573563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.574223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.575294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.582195 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:28.596381 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] HTTP exception thrown: Instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 could not be found. Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Request method failure captured: Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 HTTP/1.1 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOfTcnYUcvSXI7EF0imHsKKwYq9EaOV5ziFYuPffKVT7qDqiZPwfehlh_KvF7iIifW9bJ4bBkoFF5xYz6Xsq6VUodcOizpP6DpJGoOUAEFIxi0MUvHB8IBvvQWztqC-Ews2jbxaQs6nwVqfUHBUo0vMbJ_evjTjvJWNNomjojN6d8ok Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: cd04da83ed96424998ce30378767d820 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd04da83ed96424998ce30378767d820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd04da83ed96424998ce30378767d820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd04da83ed96424998ce30378767d820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd04da83ed96424998ce30378767d820"}]}] Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: cd04da83ed96424998ce30378767d820 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServerFiltersTestJSON-1096524980-project Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 99a3a1761393475fa6f7c95e95b8136b Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServerFiltersTestJSON-1096524980-project Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 could not be found. Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c837bb75-f1b2-4521-b7a1-a8a5a9788556'} Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 could not be found. Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 could not be found. Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:28.598792 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 could not be found. Oct 02 01:23:28.604821 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:28.606290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Returning 404 to user: Instance c837bb75-f1b2-4521-b7a1-a8a5a9788556 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:28.607202 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-331ec3b0-b11a-4daa-94f8-c2034f83ab35 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556" status: 404 len: 111 microversion: 2.1 time: 0.054932 Oct 02 01:23:28.607788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2514/4872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:28 2022] GET /compute/v2.1/servers/c837bb75-f1b2-4521-b7a1-a8a5a9788556 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:23:28.616874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:28.617629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:28.625679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.626581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.627179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.628381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.629011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.629827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.661472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:23:28.795221 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ccea5a5-ce26-4e2b-8a41-6fcb8dc21f31 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 204 len: 0 microversion: 2.1 time: 0.182359 Oct 02 01:23:28.796560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2359/4873] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:23:28 2022] DELETE /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:28.811957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:28.820140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:28.845805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.848621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.849970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.850129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:28.851284 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:28.851408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.853071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.867188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.880792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.882268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.884062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.886878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.891158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.891572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.207440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:29.222427 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a34fb147-254b-46e0-a1ca-00af907a6bc2 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 200 len: 1518 microversion: 2.1 time: 0.419918 Oct 02 01:23:29.223708 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2515/4874] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:28 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 1518 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:29.229973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:29.230926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:29.237558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.238538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.239434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.240362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.241035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.241705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.243194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:29.253059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3d4ad38-76aa-4cc9-85e1-912b68e371db tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1679 microversion: 2.1 time: 0.411140 Oct 02 01:23:29.254945 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2360/4875] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:28 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1679 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:29.502379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:29.524524 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-76d2313e-a7de-44c9-b173-fcd1fe2b3f66 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.299315 Oct 02 01:23:29.543257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:29.544306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:29.544452 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2516/4876] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:29 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:29.559724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.560235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.560677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.561393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.561850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.562272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.768203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lazy-loading 'services' on Instance uuid 1fcb084b-b447-445b-8204-c2fd6ccb1a51 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:23:29.924392 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7c311716-cc44-4a9b-b2f3-524c35acdc36 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-volume_attachments/5cdc04bd-47d8-47be-acb1-a5bc865b872c" status: 202 len: 0 microversion: 2.1 time: 0.383812 Oct 02 01:23:29.940715 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2361/4877] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:23:29 2022] DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-volume_attachments/5cdc04bd-47d8-47be-acb1-a5bc865b872c => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:23:30.254418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:30.257129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:30.269092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.276800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.277618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.279177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.279564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:30.280887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.281132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:30.281288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.286223 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:30.297251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.297773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.298246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.298990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.299453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.299885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.464519 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:30.474216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d8be076-b206-4496-91f9-819036fe99e8 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 200 len: 1611 microversion: 2.1 time: 0.201407 Oct 02 01:23:30.475581 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2362/4878] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:30 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 1611 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:30.483906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a1aa1b1e-b4c2-4a72-b887-9548a5e4274f req-6ab616fb-1bf8-404e-b5a7-f89ce8759208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d899a89c-af40-4200-bcf5-67168fb541af", "name": "network-vif-deleted", "tag": "ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:30.518832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a1aa1b1e-b4c2-4a72-b887-9548a5e4274f req-6ab616fb-1bf8-404e-b5a7-f89ce8759208 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.521602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a1aa1b1e-b4c2-4a72-b887-9548a5e4274f req-6ab616fb-1bf8-404e-b5a7-f89ce8759208 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.522154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a1aa1b1e-b4c2-4a72-b887-9548a5e4274f req-6ab616fb-1bf8-404e-b5a7-f89ce8759208 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.569851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a1aa1b1e-b4c2-4a72-b887-9548a5e4274f req-6ab616fb-1bf8-404e-b5a7-f89ce8759208 service nova] Creating event network-vif-deleted:ca49e0c3-6c28-4cb3-b369-5ef0105e7ab2 for instance d899a89c-af40-4200-bcf5-67168fb541af on n-h1-master-1 Oct 02 01:23:30.600027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a1aa1b1e-b4c2-4a72-b887-9548a5e4274f req-6ab616fb-1bf8-404e-b5a7-f89ce8759208 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116469 Oct 02 01:23:30.605328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2363/4879] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:30.617537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:30.622018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:30.642264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.646362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.648095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.649138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.649891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.651836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.934419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:30.949363 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2526c55d-1ee8-48f2-aa44-a4e7ed8ed3ca tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 200 len: 1518 microversion: 2.1 time: 0.702498 Oct 02 01:23:30.949964 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2517/4880] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:30 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 1518 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:31.406121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:31.414460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccb0115b-cd38-45d5-a32f-9d1aee7d9a6e tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.806638 Oct 02 01:23:31.418735 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2364/4881] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:30 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:31.501049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:31.501658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:31.514752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:31.515489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:31.526029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:31.527023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:31.527382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:31.527826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:31.561009 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af HTTP/1.1 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: exception: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'd899a89c-af40-4200-bcf5-67168fb541af'} Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:31.562503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:23:31.566632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:31.575429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:31.576341 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a00820cc-e56b-4c00-adeb-d1e985a26401 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 404 len: 111 microversion: 2.1 time: 0.080074 Oct 02 01:23:31.585344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c166ba3-2e14-4701-b19b-36739b5ad3bc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '.version_select at 0x7fb880b20430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:31.590569 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8c166ba3-2e14-4701-b19b-36739b5ad3bc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [47c40a63-51e3-45d3-af8f-916b003895e8] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:23:31.590951 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2518/4882] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:31 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:23:31.980977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:31.981676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:31.989802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:31.990647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:31.991367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:31.992456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:31.993201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:31.994106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.605388 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [None req-8c166ba3-2e14-4701-b19b-36739b5ad3bc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [47c40a63-51e3-45d3-af8f-916b003895e8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 47770. Oct 02 01:23:32.658300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c166ba3-2e14-4701-b19b-36739b5ad3bc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139151506" status: 202 len: 0 microversion: 2.1 time: 1.076659 Oct 02 01:23:32.665217 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2365/4883] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:23:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139151506 => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:32.684425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:32.695972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:32.717715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:32.718469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:32.736960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.738139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:32.739574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:32.741166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.881843 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:33.101067 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:33.854347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:33.864186 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8f036cbc-6214-44e6-ac2e-f0e0aaa1c21b tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 200 len: 1518 microversion: 2.1 time: 1.888290 Oct 02 01:23:33.865292 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2519/4884] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:31 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 1518 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:33.881837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c6bdf7dc-36d2-4dc9-a082-5924bba04753 req-5526ad91-90ab-47d3-bb80-f16e002a7aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f66ab8d-7d19-4141-981a-7a55d14cb236", "name": "network-vif-deleted", "tag": "54b1172d-db13-4950-886a-b83bc89b37f9"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:33.910377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c6bdf7dc-36d2-4dc9-a082-5924bba04753 req-5526ad91-90ab-47d3-bb80-f16e002a7aa5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:33.911955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c6bdf7dc-36d2-4dc9-a082-5924bba04753 req-5526ad91-90ab-47d3-bb80-f16e002a7aa5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:33.913509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c6bdf7dc-36d2-4dc9-a082-5924bba04753 req-5526ad91-90ab-47d3-bb80-f16e002a7aa5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:33.936945 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c6bdf7dc-36d2-4dc9-a082-5924bba04753 req-5526ad91-90ab-47d3-bb80-f16e002a7aa5 service nova] Creating event network-vif-deleted:54b1172d-db13-4950-886a-b83bc89b37f9 for instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 on n-h2-master-1 Oct 02 01:23:33.942962 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c6bdf7dc-36d2-4dc9-a082-5924bba04753 req-5526ad91-90ab-47d3-bb80-f16e002a7aa5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074926 Oct 02 01:23:33.943780 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2520/4885] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:34.579293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:34.596324 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b27723d9-140e-40d0-9a1d-d1c25298fbf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 1.926013 Oct 02 01:23:34.596324 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2366/4886] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:32 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:34.902789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:34.906832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 6f66ab8d-7d19-4141-981a-7a55d14cb236] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:34.921145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:34.921897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:34.925978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:34.927150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:34.928019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:34.931333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:34.960826 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] HTTP exception thrown: Instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 could not be found. Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Request method failure captured: Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 HTTP/1.1 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOfTcnYUcvSXI7EF0imHsKKwYq9EaOV5ziFYuPffKVT7qDqiZPwfehlh_KvF7iIifW9bJ4bBkoFF5xYz6Xsq6VUodcOizpP6DpJGoOUAEFIxi0MUvHB8IBvvQWztqC-Ews2jbxaQs6nwVqfUHBUo0vMbJ_evjTjvJWNNomjojN6d8ok Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: cd04da83ed96424998ce30378767d820 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd04da83ed96424998ce30378767d820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd04da83ed96424998ce30378767d820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd04da83ed96424998ce30378767d820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd04da83ed96424998ce30378767d820"}]}] Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: cd04da83ed96424998ce30378767d820 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ListServerFiltersTestJSON-1096524980-project Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 99a3a1761393475fa6f7c95e95b8136b Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ListServerFiltersTestJSON-1096524980-project Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 could not be found. Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '6f66ab8d-7d19-4141-981a-7a55d14cb236'} Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 could not be found. Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 could not be found. Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:34.962699 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 could not be found. Oct 02 01:23:34.967361 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:34.972874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Returning 404 to user: Instance 6f66ab8d-7d19-4141-981a-7a55d14cb236 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:34.977706 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a945e18-fe66-4733-b782-8a66395ba541 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236" status: 404 len: 111 microversion: 2.1 time: 0.087279 Oct 02 01:23:34.983511 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2521/4887] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:34 2022] GET /compute/v2.1/servers/6f66ab8d-7d19-4141-981a-7a55d14cb236 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:23:34.991976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:34.992734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:35.003978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.007271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.007930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.008833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.012189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.012836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.084673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:23:35.294339 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ddb0f5c-fb6f-447f-ba6d-763f5287d7e9 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 204 len: 0 microversion: 2.1 time: 0.306204 Oct 02 01:23:35.297549 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2367/4888] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:23:34 2022] DELETE /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:35.306636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:35.307521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:35.326229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.327255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.328241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.329352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.332042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.333865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.622320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:35.625229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:35.652946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.655117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.664245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.671582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.672114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.672568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.727087 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:36.150755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:36.165225 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36cd2d9c-a205-4104-a93d-49b4ee039df6 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1518 microversion: 2.1 time: 0.863466 Oct 02 01:23:36.173890 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2522/4889] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:35 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1518 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:36.486280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:36.495142 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6015a123-9fdd-43ae-9212-6e2df2af0906 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.881733 Oct 02 01:23:36.503936 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2368/4890] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:35 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:37.203504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:37.205182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:37.223174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.224653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.225108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:37.226462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.229500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.230162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:37.526010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:37.526701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:37.547514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.548033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.548484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:37.549202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.555609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.559329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.310027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:39.332629 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-afd86807-ed95-4048-88c3-1562bd768be8 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1518 microversion: 2.1 time: 2.130900 Oct 02 01:23:39.335550 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2523/4891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:37 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1518 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:39.351000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:39.351974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:39.372332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.374316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.375667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.377743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.379678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.380238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.400975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:39.408896 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-318a6037-3aef-40e2-b6b3-b9884456f86f tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 1.890205 Oct 02 01:23:39.409509 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2369/4892] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:37 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:39.560874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lazy-loading 'services' on Instance uuid 7689d920-d346-41ba-8221-5fc1b39eb664 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:23:39.681594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-db71272e-ee5b-4c64-9b46-404885c247ae req-860a8134-9d1a-43a7-812d-2003ce94f003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9929aeb1-e801-4cfe-8869-5139f02b0024", "name": "network-vif-deleted", "tag": "b771997b-9356-494f-a962-4d5ead7c74f5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:39.701575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-db71272e-ee5b-4c64-9b46-404885c247ae req-860a8134-9d1a-43a7-812d-2003ce94f003 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.702248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-db71272e-ee5b-4c64-9b46-404885c247ae req-860a8134-9d1a-43a7-812d-2003ce94f003 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.703083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-db71272e-ee5b-4c64-9b46-404885c247ae req-860a8134-9d1a-43a7-812d-2003ce94f003 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.721614 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-db71272e-ee5b-4c64-9b46-404885c247ae req-860a8134-9d1a-43a7-812d-2003ce94f003 service nova] Creating event network-vif-deleted:b771997b-9356-494f-a962-4d5ead7c74f5 for instance 9929aeb1-e801-4cfe-8869-5139f02b0024 on n-h2-master-1 Oct 02 01:23:39.728273 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-641b1824-3d8f-4c74-a8f1-418716a6b5a6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments/4b5b39fc-07f0-46e0-8d06-2dcc01188e6b" status: 202 len: 0 microversion: 2.1 time: 0.390543 Oct 02 01:23:39.729404 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2524/4893] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:23:39 2022] DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments/4b5b39fc-07f0-46e0-8d06-2dcc01188e6b => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:39.738434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:39.741371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:39.744070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-db71272e-ee5b-4c64-9b46-404885c247ae req-860a8134-9d1a-43a7-812d-2003ce94f003 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067283 Oct 02 01:23:39.764309 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2370/4894] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:23:39.777054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.777886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.779129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.783620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.784288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.785856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.899264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-00ca9f03-0418-4fd1-abd7-afa94cb2bf89 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165214 Oct 02 01:23:39.904052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2525/4895] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:39 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:23:40.326273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e4c0df1-1da1-4b8e-93b6-4a6a6939bc39 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:40.338181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e4c0df1-1da1-4b8e-93b6-4a6a6939bc39 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.339025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e4c0df1-1da1-4b8e-93b6-4a6a6939bc39 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.339387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e4c0df1-1da1-4b8e-93b6-4a6a6939bc39 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.389759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e4c0df1-1da1-4b8e-93b6-4a6a6939bc39 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Going to try to stop instance {{(pid=122355) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:23:40.496030 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e4c0df1-1da1-4b8e-93b6-4a6a6939bc39 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action" status: 202 len: 0 microversion: 2.1 time: 0.173876 Oct 02 01:23:40.500298 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2526/4896] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:40 2022] POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:40.513342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:40.515321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:40.523976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-681614b2-fb65-4742-9561-fee8b8630c58 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Action: 'create', calling method: .version_select at 0x7fb8811519d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-198187284", "policies": ["affinity"]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:40.526879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.527748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.528514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.529516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.531443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.532150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.602420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-681614b2-fb65-4742-9561-fee8b8630c58 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:40.612598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.621458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.621992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.622485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lazy-loading 'fault' on Instance uuid 9929aeb1-e801-4cfe-8869-5139f02b0024 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:23:40.635426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-681614b2-fb65-4742-9561-fee8b8630c58 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:40.720851 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:40.753870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-681614b2-fb65-4742-9561-fee8b8630c58 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:40.763922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-681614b2-fb65-4742-9561-fee8b8630c58 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:40.791248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-681614b2-fb65-4742-9561-fee8b8630c58 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.576165 Oct 02 01:23:40.792586 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2371/4897] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:40 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:40.799956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:40.801660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:40.810467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.811306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.811914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.813173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.814270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.814887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.873573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3a1761393475fa6f7c95e95b8136b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04da83ed96424998ce30378767d820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:40.886954 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4224352-1cb9-4f35-af94-b9e62fe58571 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 200 len: 1311 microversion: 2.1 time: 0.384958 Oct 02 01:23:40.907115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2527/4898] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:40 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 1311 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:40.913700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:40.914634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:40.925786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.927083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.927782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.928769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.931456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.932297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.245530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:41.254989 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca0992a5-acd5-4da9-83de-6d4922059909 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1678 microversion: 2.1 time: 0.346271 Oct 02 01:23:41.261912 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2528/4899] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:40 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1678 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:41.279727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Action: 'create', calling method: .version_select at 0x7fb881005dc0>, body: {"server_group": {"name": "tempest-server-group-868344510", "policies": ["affinity"]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:41.321046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:41.332571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:41.405483 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [1ca9303e-bd9b-44eb-af41-44da04a3265d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:23:41.449981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:41.458382 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a512ad2f-0834-4b8a-a744-55f867aa804d tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.663314 Oct 02 01:23:41.459289 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2372/4900] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:40 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:41.473393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:41.487631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:41.507762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.508261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.508706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.509929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.510387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.510844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.579489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c261c8b-a3a3-45fe-b090-284a745e0df5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119373 Oct 02 01:23:41.584388 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2373/4901] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:41 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:41.688706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Calling method '.version_select at 0x7fb88111b5e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:41.691895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.692565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.693174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.729696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.732480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.732973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.767373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.770134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.770666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.785293 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bbeac243-418f-4e7c-9cf3-61ec0bf9d673 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1447239619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.199370 Oct 02 01:23:41.792948 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2374/4902] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:23:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:41.914888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:41.916472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] [instance: 9929aeb1-e801-4cfe-8869-5139f02b0024] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:41.927301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.928093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.932020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.933035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.933922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.934514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.971109 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] HTTP exception thrown: Instance 9929aeb1-e801-4cfe-8869-5139f02b0024 could not be found. Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Request method failure captured: Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 HTTP/1.1 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOfTcnYUcvSXI7EF0imHsKKwYq9EaOV5ziFYuPffKVT7qDqiZPwfehlh_KvF7iIifW9bJ4bBkoFF5xYz6Xsq6VUodcOizpP6DpJGoOUAEFIxi0MUvHB8IBvvQWztqC-Ews2jbxaQs6nwVqfUHBUo0vMbJ_evjTjvJWNNomjojN6d8ok Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: cd04da83ed96424998ce30378767d820 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd04da83ed96424998ce30378767d820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd04da83ed96424998ce30378767d820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd04da83ed96424998ce30378767d820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd04da83ed96424998ce30378767d820"}]}] Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: cd04da83ed96424998ce30378767d820 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1096524980 Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ListServerFiltersTestJSON-1096524980-project Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 99a3a1761393475fa6f7c95e95b8136b Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ListServerFiltersTestJSON-1096524980-project Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 9929aeb1-e801-4cfe-8869-5139f02b0024 could not be found. Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '9929aeb1-e801-4cfe-8869-5139f02b0024'} Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9929aeb1-e801-4cfe-8869-5139f02b0024 could not be found. Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9929aeb1-e801-4cfe-8869-5139f02b0024 could not be found. Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:41.973405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9929aeb1-e801-4cfe-8869-5139f02b0024 could not be found. Oct 02 01:23:41.978550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:23:41.980176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] Returning 404 to user: Instance 9929aeb1-e801-4cfe-8869-5139f02b0024 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:41.983861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ae6f977-4c85-4c0b-9ee8-a8acedd0af64 tempest-ListServerFiltersTestJSON-1096524980 tempest-ListServerFiltersTestJSON-1096524980-project] 10.222.0.23 "GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024" status: 404 len: 111 microversion: 2.1 time: 0.073698 Oct 02 01:23:41.984624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2375/4903] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:41 2022] GET /compute/v2.1/servers/9929aeb1-e801-4cfe-8869-5139f02b0024 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:23:42.288137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:42.288832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:42.309138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:42.309966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:42.310571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:42.315582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:42.316317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:42.316921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:42.419806 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [1ca9303e-bd9b-44eb-af41-44da04a3265d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 47968. Oct 02 01:23:42.427763 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:42.498928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:42.533415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:42.573567 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b54a6564-849a-4bd3-9f90-6daa72760f19 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 1.309259 Oct 02 01:23:42.584962 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2529/4904] 10.222.0.23 () {60 vars in 1173 bytes} [Sun Oct 2 01:23:41 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:42.598560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:42.599584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:42.615409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:42.616238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:42.616999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:42.621993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:42.622983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:42.623658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.325209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:43.361485 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40e99d49-f71e-41a5-94e7-d776a926fbc5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1678 microversion: 2.1 time: 1.058668 Oct 02 01:23:43.365815 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2376/4905] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:42 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1678 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:43.393162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:43.401073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:43.426196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:43.429230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:43.432412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.434919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:43.441147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:43.443684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.519803 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f077540-eb63-4fe1-ad2e-f1068b915d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152624 Oct 02 01:23:43.536253 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2377/4906] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:43 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:43.541505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f4355276-4a12-4195-8e0d-b1f1db832f1e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Action: 'create', calling method: .version_select at 0x7fb880b04820>, body: {"server_group": {"name": "tempest-server-group-868344510", "policies": ["affinity"]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:43.581960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f4355276-4a12-4195-8e0d-b1f1db832f1e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:43.593791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f4355276-4a12-4195-8e0d-b1f1db832f1e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:43.629293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:43.642975 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8db07c53-796a-4530-946b-9abb2f3cb792 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 1.053145 Oct 02 01:23:43.643993 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2530/4907] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:42 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:43.732760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f4355276-4a12-4195-8e0d-b1f1db832f1e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:43.746247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f4355276-4a12-4195-8e0d-b1f1db832f1e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:43.785343 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f4355276-4a12-4195-8e0d-b1f1db832f1e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.247750 Oct 02 01:23:43.793210 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2378/4908] 10.222.0.23 () {60 vars in 1173 bytes} [Sun Oct 2 01:23:43 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:43.807631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56b4d9fb-bea3-4d31-acaf-02080fe3b5d0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:43.938970 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56b4d9fb-bea3-4d31-acaf-02080fe3b5d0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/2605c0e4-008c-4af5-b13a-305cefa875df" status: 204 len: 0 microversion: 2.1 time: 0.127881 Oct 02 01:23:43.940237 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2531/4909] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:23:43 2022] DELETE /compute/v2.1/os-server-groups/2605c0e4-008c-4af5-b13a-305cefa875df => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:43.952790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a8bd4ae9-0755-4042-a76f-60a15b59b19e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:43.991684 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a8bd4ae9-0755-4042-a76f-60a15b59b19e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.046356 Oct 02 01:23:44.004516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2379/4910] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:43 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:44.018511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8392733a-b53c-4eeb-89c2-1dc4a2b09f49 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.074544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8392733a-b53c-4eeb-89c2-1dc4a2b09f49 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/72e9be86-0a4d-491e-865e-c26354caeda2" status: 204 len: 0 microversion: 2.1 time: 0.059420 Oct 02 01:23:44.079976 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2532/4911] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:23:44 2022] DELETE /compute/v2.1/os-server-groups/72e9be86-0a4d-491e-865e-c26354caeda2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:44.084494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85525301-35bc-4a3c-990f-6982d370b721 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.121388 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85525301-35bc-4a3c-990f-6982d370b721 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034020 Oct 02 01:23:44.126427 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2380/4912] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:44.135554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a75851a-c189-4ea9-8fda-5c9fce821776 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Action: 'create', calling method: .version_select at 0x7fb8804885e0>, body: {"server_group": {"name": "tempest-server-group-1000738727", "policies": ["affinity"]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:44.189598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2a75851a-c189-4ea9-8fda-5c9fce821776 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:44.204068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2a75851a-c189-4ea9-8fda-5c9fce821776 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:44.294890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2a75851a-c189-4ea9-8fda-5c9fce821776 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:44.311350 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-2a75851a-c189-4ea9-8fda-5c9fce821776 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:44.330881 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a75851a-c189-4ea9-8fda-5c9fce821776 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.199279 Oct 02 01:23:44.338324 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2533/4913] 10.222.0.23 () {60 vars in 1173 bytes} [Sun Oct 2 01:23:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:44.343248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a06b6251-50a6-4ae1-b648-1dde519d2647 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.391438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.392102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:44.400235 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a06b6251-50a6-4ae1-b648-1dde519d2647 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c4d957e0-0e46-41d9-a825-a8501a68b185" status: 204 len: 0 microversion: 2.1 time: 0.061002 Oct 02 01:23:44.400852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2381/4914] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:23:44 2022] DELETE /compute/v2.1/os-server-groups/c4d957e0-0e46-41d9-a825-a8501a68b185 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:23:44.416740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d78c7499-a22a-420c-8691-480a1381b3a2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.420278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.420784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.422849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.423942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.426919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.427577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.456876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d78c7499-a22a-420c-8691-480a1381b3a2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.049804 Oct 02 01:23:44.458280 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2382/4915] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:44.473907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2fd1ead-401d-4888-b612-ee9f10d0c30b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Action: 'create', calling method: .version_select at 0x7fb88142f700>, body: {"server_group": {"name": "tempest-server-group-952595342", "policies": ["anti-affinity"]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:44.515776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e2fd1ead-401d-4888-b612-ee9f10d0c30b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:44.527947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e2fd1ead-401d-4888-b612-ee9f10d0c30b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:44.628896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e2fd1ead-401d-4888-b612-ee9f10d0c30b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:44.641841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e2fd1ead-401d-4888-b612-ee9f10d0c30b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_groups'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:44.706979 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2fd1ead-401d-4888-b612-ee9f10d0c30b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.237460 Oct 02 01:23:44.707624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2383/4916] 10.222.0.23 () {60 vars in 1173 bytes} [Sun Oct 2 01:23:44 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:44.724227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.736618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:44.743467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.747160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.747848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.749388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.750796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.751430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.839322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f405471b-96bd-48c9-b277-ecf8bc887960 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120241 Oct 02 01:23:44.840625 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2384/4917] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:44.845942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.851064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:44.865372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.870034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.870775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.871706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.879520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.880247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.312916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:45.330529 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c14a3a58-1077-49d5-9d6f-7fdc1a9092c5 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1678 microversion: 2.1 time: 0.945096 Oct 02 01:23:45.331681 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2534/4918] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1678 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:45.339185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4efedd61-c85b-4cec-b738-84dcaad577ad tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:45.409299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4efedd61-c85b-4cec-b738-84dcaad577ad tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/547ccc90-efb7-4f64-8830-b848aa1f98a2" status: 204 len: 0 microversion: 2.1 time: 0.074835 Oct 02 01:23:45.413201 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2535/4919] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:23:45 2022] DELETE /compute/v2.1/os-server-groups/547ccc90-efb7-4f64-8830-b848aa1f98a2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:45.432650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c83b51c1-75fc-4573-9125-65b84e595a76 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:45.433063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:45.448732 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3aa3d90-8903-4a74-9c86-4d6c484790bc tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.606331 Oct 02 01:23:45.449344 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2385/4920] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:45.526216 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c83b51c1-75fc-4573-9125-65b84e595a76 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.106454 Oct 02 01:23:45.531155 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2536/4921] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:45 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:45.615913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1359561229", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "bcccf782-4bcb-4fc3-9ce2-3bd76fb95e48"}]}, "os:scheduler_hints": {"group": "584b840c-fe03-4a3d-ba42-529c21526534"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:45.716526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] validate_networks() for [('bcccf782-4bcb-4fc3-9ce2-3bd76fb95e48', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:23:45.853299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:45.855542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:45.869920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:45.873894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:45.874504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.879750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:45.880445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:45.881052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.943428 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:45.969798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-93134c78-7641-4124-a4cd-3ffd6a15db3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117553 Oct 02 01:23:45.970791 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2537/4922] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:45 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:46.358850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:46.360709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:46.381928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.387338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.389403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.391674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.395907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.398975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.787270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:23:46.787764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:23:46.788154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:23:46.788571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:23:46.790593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:23:46.811545 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:46.831479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.831982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.832448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.839587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.840251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.840870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.888979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:46.895680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:46.927192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:23:46.929856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:23:47.051899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:47.067040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:47.165294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:23:47.171461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Getting quotas for user 12321c4eed38481bb09670364f1716c0 and project d51755a194eb4b65bb07bb52dc274f4f. Resources: {'server_group_members'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:23:47.173432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:47.190354 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2dc3633d-5373-424d-8fb8-f14d7920ff62 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1678 microversion: 2.1 time: 0.835877 Oct 02 01:23:47.191508 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2538/4923] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:46 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1678 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:47.202446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:47.203114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:47.219845 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c06bd5d-fbb1-404a-9451-1ae8dc41f9db tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607987 Oct 02 01:23:47.228856 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2386/4924] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:23:47.235919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.240384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.244441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.245477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:47.246351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.248431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.249611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.255063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:47.296894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.299029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.301382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.306456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.311807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.315265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.384005 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5367907c-de18-46a8-ab57-d74e8d4d7248 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153087 Oct 02 01:23:47.389968 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2387/4925] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:47 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:47.415034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dedfc65e-f2d7-4549-a78a-2e448952dbe6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:47.418762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dedfc65e-f2d7-4549-a78a-2e448952dbe6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:47.626426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dedfc65e-f2d7-4549-a78a-2e448952dbe6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:47.637934 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dedfc65e-f2d7-4549-a78a-2e448952dbe6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1213 microversion: 2.1 time: 0.243754 Oct 02 01:23:47.639238 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2388/4926] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:47 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:47.890822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:47.901619 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc2dce29-b480-42da-852a-f2a6b34bfa00 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.707112 Oct 02 01:23:47.907522 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2539/4927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:47 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:48.224819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:48.225764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:48.246905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.257996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.259923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.263748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.264240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.264725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.401014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:48.404590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:48.432082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.432957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.435802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.436980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.437702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.438584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.477933 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1915ea9-79c5-4367-a1dd-4e8cee61fd25 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083762 Oct 02 01:23:48.479867 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2540/4928] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:48 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:23:48.671197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:48.672115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:48.687967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.688693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.689141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.692583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.704386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.705081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.072728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:49.091601 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d3652551-21df-4960-be1a-76544a3bef51 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1265 microversion: 2.1 time: 0.430971 Oct 02 01:23:49.092216 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2541/4929] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:48 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1265 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:49.099172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:49.100166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:49.118252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.118974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.119430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.120172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.120649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.127120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.371987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:49.382939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-def78018-ed7f-4d31-b0e5-814df3fc8715 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1678 microversion: 2.1 time: 1.167452 Oct 02 01:23:49.385400 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2389/4930] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:48 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1678 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:49.500645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:49.504731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:49.513297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.514029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.514680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.515572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.516893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.517474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.580351 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4273d851-a4f8-4977-8ecb-79c0df348c70 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092125 Oct 02 01:23:49.585467 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2390/4931] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:49 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:49.655465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:49.693050 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ba02377-728d-472d-84c8-92c7c741bbed tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 0.595457 Oct 02 01:23:49.699738 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2542/4932] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:49 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:50.120539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.121360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.132588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.133086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.137112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.139046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.140064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.140618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.347728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:50.364278 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2497d859-a246-4d78-b924-7c0588bc0100 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1271 microversion: 2.1 time: 0.247405 Oct 02 01:23:50.365004 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2391/4933] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:50 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:50.410372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.411019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.417987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.418556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.425299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.426317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.429079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.434971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.594966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.597648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.605060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.606854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.607558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.608740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.609949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.610869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.665775 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0932d55c-3155-4f20-9700-ba11c51acd76 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074945 Oct 02 01:23:50.674260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2392/4934] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:23:50 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:23:50.724900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.725889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.737217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.747586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.748511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.751417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.752251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.752995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.792450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:50.807259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff9b7933-dcb4-4b45-b85b-552e928229df tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1678 microversion: 2.1 time: 0.400712 Oct 02 01:23:50.807866 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2543/4935] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:50 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1678 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:50.835209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.835788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.847517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.848027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.848606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.849434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.849826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.850245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.920612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:23:51.152834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c543b1a2-61a7-44cf-99b5-3559d7146be3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 204 len: 0 microversion: 2.1 time: 0.323133 Oct 02 01:23:51.156611 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2544/4936] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:23:50 2022] DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:23:51.168347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:51.169317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:51.185989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.186919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.187612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.190786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.191576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.192236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.847431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:51.859523 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af0057f3-ad68-49c0-8f47-bdcef2c513ea tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1523 microversion: 2.1 time: 1.138486 Oct 02 01:23:51.862364 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2393/4937] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:50 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1523 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:51.869271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:51.870193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:51.880889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.881928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.886934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.888981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.890004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.890684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.012643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:52.028859 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fec8e2a6-d5be-4ae7-b05c-1e87d1e70920 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1681 microversion: 2.1 time: 0.870460 Oct 02 01:23:52.031223 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2545/4938] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:51 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1681 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:52.037729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:52.041043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:52.047912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.048654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.049298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.050024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.050487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.050948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.418167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:52.427191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-79670c2e-90f9-44c1-a366-eb0b2d2fe122 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1313 microversion: 2.1 time: 0.562715 Oct 02 01:23:52.427808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2394/4939] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:51 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:52.567075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:52.603520 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a06f29c-db81-4f82-9e62-def9f13ca9cb tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1655 microversion: 2.1 time: 0.570852 Oct 02 01:23:52.607280 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2546/4940] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:52 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1655 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:52.632287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04db6787-5f13-4803-8525-7f841d761623 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:52.646045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04db6787-5f13-4803-8525-7f841d761623 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.646811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04db6787-5f13-4803-8525-7f841d761623 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.666183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04db6787-5f13-4803-8525-7f841d761623 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.682205 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:52.728016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-04db6787-5f13-4803-8525-7f841d761623 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Going to try to start instance {{(pid=122354) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 01:23:52.847303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04db6787-5f13-4803-8525-7f841d761623 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action" status: 202 len: 0 microversion: 2.1 time: 0.199108 Oct 02 01:23:52.850233 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2395/4941] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:52 2022] POST /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:52.859740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:52.860609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:52.872664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.873413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.874011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.874994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.875664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.876881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.892240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:52.894208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:52.930813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.933716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.936169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.941148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.941931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.942625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.600801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:53.609586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f950393-00b6-4272-bacb-4a1bf10b797c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1664 microversion: 2.1 time: 0.755344 Oct 02 01:23:53.623588 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2547/4942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:52 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1664 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:53.632400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:53.633302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:53.639767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:53.640524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:53.641182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.642085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:53.642768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:53.643389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.659194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:53.673218 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4690cbe8-7987-44f5-abbe-e22cbebc2f6c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1503 microversion: 2.1 time: 0.791030 Oct 02 01:23:53.673819 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2396/4943] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:52 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1503 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:53.696275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:53.696916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:53.706590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:53.707116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:53.707552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.708266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:53.710226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:53.710749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.322880 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:54.610374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:54.620047 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5f2c582f-6dd1-4347-b7e7-7dd0225c9208 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1681 microversion: 2.1 time: 0.994902 Oct 02 01:23:54.620764 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2548/4944] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:53 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1681 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:54.626721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2ff9f65-365b-4493-9247-303ca6237294 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'create', calling method: .version_select at 0x7fb8811adca0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-413800789", "description": "tempest-description-1700135026"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:54.656170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:54.665233 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-30b4a783-c8a9-4553-b8f6-e237f5f096c8 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1313 microversion: 2.1 time: 0.987300 Oct 02 01:23:54.665982 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2397/4945] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:53 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1313 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:54.671169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-5c051e9c-21f2-4147-a2e9-61df407c5716 req-ab4446c8-43b7-4f38-9c9d-8892fdff580c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c0c6de-5131-4f88-8844-8f9b829edfe2", "tag": "6d1eb107-858b-4c2b-85d5-4bdd8052c44f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:54.681791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5c051e9c-21f2-4147-a2e9-61df407c5716 req-ab4446c8-43b7-4f38-9c9d-8892fdff580c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.682283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5c051e9c-21f2-4147-a2e9-61df407c5716 req-ab4446c8-43b7-4f38-9c9d-8892fdff580c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.682749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5c051e9c-21f2-4147-a2e9-61df407c5716 req-ab4446c8-43b7-4f38-9c9d-8892fdff580c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.696034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5c051e9c-21f2-4147-a2e9-61df407c5716 req-ab4446c8-43b7-4f38-9c9d-8892fdff580c service nova] Creating event network-changed:6d1eb107-858b-4c2b-85d5-4bdd8052c44f for instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 on n-h1-master-1 Oct 02 01:23:54.701490 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-5c051e9c-21f2-4147-a2e9-61df407c5716 req-ab4446c8-43b7-4f38-9c9d-8892fdff580c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033701 Oct 02 01:23:54.702212 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2398/4946] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:54.708376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:54.709102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:54.717529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.718909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.719993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.721236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.722062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.722397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.219078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:55.229195 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-013171bb-924f-4d2f-ac88-13b35cac64a3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1664 microversion: 2.1 time: 0.525376 Oct 02 01:23:55.229885 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2399/4947] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:54 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1664 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:55.350906 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2ff9f65-365b-4493-9247-303ca6237294 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.728024 Oct 02 01:23:55.353749 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2549/4948] 10.222.0.23 () {60 vars in 1180 bytes} [Sun Oct 2 01:23:54 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:55.376170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-413800789"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:55.379515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:55.389302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.389839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.390484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.391249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.391711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.392312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.660072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:55.661522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:55.675133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.677899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.678521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.679571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.680705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.681302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.790264 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Adding security group 40f435fa-fcb8-4ac4-ad7d-a88bc1e14d70 to port 1255c7e6-e572-4b38-8f0b-e4e369ce264d Oct 02 01:23:55.913981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:55.924180 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db4fe2b0-9344-4444-9aec-e0609c77e93c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1613 microversion: 2.1 time: 0.279984 Oct 02 01:23:55.939989 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2550/4949] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:55 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1613 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:55.947817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:55.948773 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:55.951143 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:55.958026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.958863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.966333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.980389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.981374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.982751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.619375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:56.639639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-75b88cd0-3504-43b9-8b3e-2da64ec9051b tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1313 microversion: 2.1 time: 0.697935 Oct 02 01:23:56.641309 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2551/4950] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:55 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:56.648231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:56.650742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:56.692927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.703481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.703956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.705038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.705174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.705614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.751967 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83b4be7b-8008-4413-8385-ac0c0a8ace0b tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action" status: 202 len: 0 microversion: 2.1 time: 1.384816 Oct 02 01:23:56.752905 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2400/4951] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:55 2022] POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action => generated 0 bytes in 1387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:56.761466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-413800789"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:56.762005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:56.778396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.778831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.779271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.780003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.781081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.781517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.850408 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:57.475059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:57.484029 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13f8d57f-3e00-4149-b078-e95848560d66 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1668 microversion: 2.1 time: 0.841154 Oct 02 01:23:57.488442 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2552/4952] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:56 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1668 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:57.493462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c468b5f8-7919-44e7-a440-0ce072d09be2 req-57adc654-832b-4844-abb2-83ddda398de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:57.520465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c468b5f8-7919-44e7-a440-0ce072d09be2 req-57adc654-832b-4844-abb2-83ddda398de4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.521192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c468b5f8-7919-44e7-a440-0ce072d09be2 req-57adc654-832b-4844-abb2-83ddda398de4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.521808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c468b5f8-7919-44e7-a440-0ce072d09be2 req-57adc654-832b-4844-abb2-83ddda398de4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.534059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Removing security group 40f435fa-fcb8-4ac4-ad7d-a88bc1e14d70 from port 1255c7e6-e572-4b38-8f0b-e4e369ce264d Oct 02 01:23:57.540506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c468b5f8-7919-44e7-a440-0ce072d09be2 req-57adc654-832b-4844-abb2-83ddda398de4 service nova] Creating event network-changed:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:23:57.561076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c468b5f8-7919-44e7-a440-0ce072d09be2 req-57adc654-832b-4844-abb2-83ddda398de4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071180 Oct 02 01:23:57.561689 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2553/4953] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:57.572949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:57.573907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:57.589102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.589907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.590514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.591428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.593311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.595298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.618901 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:57.631829 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=40 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:57.687757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.688420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.689301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.689406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lazy-loading 'fault' on Instance uuid 7689d920-d346-41ba-8221-5fc1b39eb664 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:23:57.762198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:57.773817 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b208ac08-fded-4b0f-9f3b-c035d07ad64e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 200 len: 1331 microversion: 2.1 time: 0.210213 Oct 02 01:23:57.786684 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2554/4954] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:57 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 1331 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:57.792708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:57.793566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:57.803593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.804332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.805487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.806527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.807163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.810632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.852760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:58.876040 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d7f9585-50ec-4a2c-8eb6-7c0168814cf6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1313 microversion: 2.1 time: 1.087518 Oct 02 01:23:58.877547 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2555/4955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:57 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1313 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:58.884083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:58.885046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:58.891902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:58.893092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:58.894199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.899499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:58.900476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:58.901199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.928513 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 HTTP/1.1 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7689d920-d346-41ba-8221-5fc1b39eb664'} Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:23:58.931197 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:23:58.937451 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:23:58.941463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:23:58.942680 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1557cb94-5fa1-43c9-817e-aa11f4bf8b53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 404 len: 111 microversion: 2.1 time: 0.063919 Oct 02 01:23:58.943587 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2556/4956] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:58 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:23:58.963434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-60e774fc-6db7-4da4-b64d-1a710914e7f3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '.version_select at 0x7fb880765430>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:59.005746 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43648964-d3cf-44cb-8efa-54efc67b5967 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action" status: 202 len: 0 microversion: 2.1 time: 2.248556 Oct 02 01:23:59.008873 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2401/4957] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:23:56 2022] POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action => generated 0 bytes in 2252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:59.019128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c72bd1b0-0af8-4618-b7ab-f369f4835ab0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'create', calling method: .version_select at 0x7fb880a18a60>, body: {"pool": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:59.028055 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-60e774fc-6db7-4da4-b64d-1a710914e7f3 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408936052" status: 202 len: 0 microversion: 2.1 time: 0.075907 Oct 02 01:23:59.030876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2557/4958] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408936052 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:23:59.632128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7689d920-d346-41ba-8221-5fc1b39eb664", "name": "network-vif-deleted", "tag": "5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d"}, {"name": "network-changed", "server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:23:59.651203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:59.652035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:59.653149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:59.668234 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] Creating event network-vif-deleted:5ee3e3b4-6c5a-4cc8-939f-f59b9f24b40d for instance 7689d920-d346-41ba-8221-5fc1b39eb664 on n-h2-master-1 Oct 02 01:23:59.672944 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] Creating event network-changed:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:23:59.685522 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f0ea06c6-acc9-4a92-8c64-66be5f85fdc4 req-0fb82400-649a-4b85-a765-37d651a4d514 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058122 Oct 02 01:23:59.686982 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2558/4959] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:23:59.906925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:59.908378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:59.919967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:59.919967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:59.920430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:59.921398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:59.922066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:59.922681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:00.517042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:00.532865 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0f9744c-9a12-45c8-9dbe-68d7740c2822 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1313 microversion: 2.1 time: 0.631982 Oct 02 01:24:00.535495 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2559/4960] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:59 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:00.670302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2430e408-91d6-4822-b5e8-a324c5957d2b req-ebbb829b-e953-4b94-aae8-81aee8c6637d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c0c6de-5131-4f88-8844-8f9b829edfe2", "name": "network-vif-plugged", "status": "completed", "tag": "6d1eb107-858b-4c2b-85d5-4bdd8052c44f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:00.692690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2430e408-91d6-4822-b5e8-a324c5957d2b req-ebbb829b-e953-4b94-aae8-81aee8c6637d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:00.694020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2430e408-91d6-4822-b5e8-a324c5957d2b req-ebbb829b-e953-4b94-aae8-81aee8c6637d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:00.695203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2430e408-91d6-4822-b5e8-a324c5957d2b req-ebbb829b-e953-4b94-aae8-81aee8c6637d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:00.749608 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2430e408-91d6-4822-b5e8-a324c5957d2b req-ebbb829b-e953-4b94-aae8-81aee8c6637d service nova] Creating event network-vif-plugged:6d1eb107-858b-4c2b-85d5-4bdd8052c44f for instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 on n-h1-master-1 Oct 02 01:24:00.771280 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2430e408-91d6-4822-b5e8-a324c5957d2b req-ebbb829b-e953-4b94-aae8-81aee8c6637d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106323 Oct 02 01:24:00.775882 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2560/4961] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:01.564383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:01.565102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:01.576290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:01.577077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:01.577688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:01.579343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:01.580963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:01.581771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:02.227810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:02.248930 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9fdab378-e54d-480e-a9ae-dc07fb3171c2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1313 microversion: 2.1 time: 0.686756 Oct 02 01:24:02.252511 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2561/4962] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:01 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:02.420366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f7f09cb-2cbe-4204-bd0b-ec8b0b245681 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: .version_select at 0x7fb88088c040>, body: {"keypair": {"name": "tempest-keypair-1354181241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxdZK4rB9rHY363hiPgd5oTIKpt8s60i5Dzr6VcltDy057lFLI5VWP6/F5Agn7Chxkv9Ee/NzlgBNAq21clCbV/NBHYFW+qhxVubLHvrL6XF6b3GMDlKc022EADt0X9WQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:02.451961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9f7f09cb-2cbe-4204-bd0b-ec8b0b245681 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:24:02.469824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9f7f09cb-2cbe-4204-bd0b-ec8b0b245681 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:24:02.521350 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f7f09cb-2cbe-4204-bd0b-ec8b0b245681 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104906 Oct 02 01:24:02.522296 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2562/4963] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:24:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:24:03.271941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:03.273626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:03.300532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.301060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.301576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.302207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.302699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.303139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.697355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:03.707992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c72bd1b0-0af8-4618-b7ab-f369f4835ab0 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.691680 Oct 02 01:24:03.725604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2402/4964] 10.222.0.23 () {60 vars in 1170 bytes} [Sun Oct 2 01:23:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:03.725988 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a5061eff-d3b4-42fb-ba24-a869a1cd4b3f tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1498 microversion: 2.1 time: 0.457862 Oct 02 01:24:03.726709 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2563/4965] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:03 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:03.748984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.214"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:03.755301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd379143-11ba-4560-b80a-2e26113a016e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:03.768681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:03.791957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.794628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_groups [None req-cd379143-11ba-4560-b80a-2e26113a016e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Querying cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) for 1 instances {{(pid=122355) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 02 01:24:03.796038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.799337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.800144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.801481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd379143-11ba-4560-b80a-2e26113a016e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.802005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd379143-11ba-4560-b80a-2e26113a016e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.802911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.803349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.803618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd379143-11ba-4560-b80a-2e26113a016e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.827831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd379143-11ba-4560-b80a-2e26113a016e tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/584b840c-fe03-4a3d-ba42-529c21526534" status: 200 len: 221 microversion: 2.1 time: 0.076806 Oct 02 01:24:03.829161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2564/4966] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:24:03 2022] GET /compute/v2.1/os-server-groups/584b840c-fe03-4a3d-ba42-529c21526534 => generated 221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:24:03.853645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "refresh_cache-583dd333-3477-45ed-b1f0-8794fadf2ee6" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:24:03.854054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquired lock "refresh_cache-583dd333-3477-45ed-b1f0-8794fadf2ee6" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:24:04.097148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-779041314", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:04.204637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] validate_networks() for [('654a27f4-3da1-45ca-83b0-0a0abf247ad4', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:24:06.366119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:24:06.366860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:24:06.367135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:24:06.367581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:24:06.368131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:24:06.378949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.379448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.379939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.380982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.391437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.392134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.420671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Getting quotas for project 084a8da705e0434e8a008ffdd019f6e8. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:24:06.427669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Getting quotas for user 26e4e60bc26a4d229a85c9990e1730a5 and project 084a8da705e0434e8a008ffdd019f6e8. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:24:06.460054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:24:06.463146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:24:06.521892 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-07f00660-e3cd-44fe-8844-6ed2c376c683 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.689281 Oct 02 01:24:06.548249 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2565/4967] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:24:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:24:06.553107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:06.553832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:06.577606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.578540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.579221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.580142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.580768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.581359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.633599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:24:06.861210 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fdcd9760-8bf2-4204-bfbc-5f77180ab467 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 204 len: 0 microversion: 2.1 time: 0.308255 Oct 02 01:24:06.862972 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2566/4968] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:24:06 2022] DELETE /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:24:06.879228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-578540d9-7ede-4f99-a7fe-7d9ce15747de tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:06.880207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-578540d9-7ede-4f99-a7fe-7d9ce15747de tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:07.150775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-578540d9-7ede-4f99-a7fe-7d9ce15747de tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:07.162695 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-578540d9-7ede-4f99-a7fe-7d9ce15747de tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1213 microversion: 2.1 time: 0.296326 Oct 02 01:24:07.179827 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2567/4969] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:06 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1213 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:07.200851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:07.205438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:07.251069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:07.252082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:07.252914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:07.255396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:07.256204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:07.258079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:07.924618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:07.941758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e5dd8966-7956-45f2-ab94-971fc16b72f0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1504 microversion: 2.1 time: 0.756067 Oct 02 01:24:07.942446 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2568/4970] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:07 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1504 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:08.186852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:08.187930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:08.201944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.203589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.205473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.206569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.208034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.209059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.787440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:08.803167 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d31456bb-0df5-464e-ae85-8518a8330e93 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1265 microversion: 2.1 time: 0.619283 Oct 02 01:24:08.817248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2569/4971] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:08 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1265 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:08.982683 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:08.983321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:08.990518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.991266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.992677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.993588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.994234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.994869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.290434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Building network info cache for instance {{(pid=122354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:24:09.557334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321c4eed38481bb09670364f1716c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51755a194eb4b65bb07bb52dc274f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:09.568486 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e873492d-30bd-4213-b446-735cc9013fc0 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 200 len: 1504 microversion: 2.1 time: 0.598665 Oct 02 01:24:09.571007 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2570/4972] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:08 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:09.580622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-873e06e0-7013-4d59-a286-a67c24e60007 req-aaf17dfd-ab81-41a4-8925-f94ad882f4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:09.612761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-873e06e0-7013-4d59-a286-a67c24e60007 req-aaf17dfd-ab81-41a4-8925-f94ad882f4f0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.613428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-873e06e0-7013-4d59-a286-a67c24e60007 req-aaf17dfd-ab81-41a4-8925-f94ad882f4f0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.613998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-873e06e0-7013-4d59-a286-a67c24e60007 req-aaf17dfd-ab81-41a4-8925-f94ad882f4f0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.631511 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-873e06e0-7013-4d59-a286-a67c24e60007 req-aaf17dfd-ab81-41a4-8925-f94ad882f4f0 service nova] Creating event network-changed:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:24:09.638297 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-873e06e0-7013-4d59-a286-a67c24e60007 req-aaf17dfd-ab81-41a4-8925-f94ad882f4f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065552 Oct 02 01:24:09.639578 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2571/4973] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:09.760877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-30c1b6df-b523-41d9-a0a4-afed0e57a124 req-291240cd-4f6d-4b3f-a029-313172da5024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c0c6de-5131-4f88-8844-8f9b829edfe2", "name": "network-vif-deleted", "tag": "6d1eb107-858b-4c2b-85d5-4bdd8052c44f"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:09.781084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30c1b6df-b523-41d9-a0a4-afed0e57a124 req-291240cd-4f6d-4b3f-a029-313172da5024 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.790687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30c1b6df-b523-41d9-a0a4-afed0e57a124 req-291240cd-4f6d-4b3f-a029-313172da5024 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.791441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30c1b6df-b523-41d9-a0a4-afed0e57a124 req-291240cd-4f6d-4b3f-a029-313172da5024 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.807777 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-30c1b6df-b523-41d9-a0a4-afed0e57a124 req-291240cd-4f6d-4b3f-a029-313172da5024 service nova] Creating event network-vif-deleted:6d1eb107-858b-4c2b-85d5-4bdd8052c44f for instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 on n-h1-master-1 Oct 02 01:24:09.813451 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-30c1b6df-b523-41d9-a0a4-afed0e57a124 req-291240cd-4f6d-4b3f-a029-313172da5024 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065129 Oct 02 01:24:09.814294 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2572/4974] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:09.838055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:09.839946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:09.860129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.861162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.862698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.863629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.867071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.868427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:10.020820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:10.038029 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a581807f-6115-45df-83b1-d6a610cc1a32 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1271 microversion: 2.1 time: 0.206842 Oct 02 01:24:10.039720 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2573/4975] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:09 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:10.236758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1449683492", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d59648e8-d54a-41ca-842c-4437e3a4d0f9"}], "security_groups": [{"name": "tempest-securitygroup--1874067113"}], "key_name": "tempest-keypair-1354181241", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:10.802754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] validate_networks() for [('d59648e8-d54a-41ca-842c-4437e3a4d0f9', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:24:12.588882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Updating instance_info_cache with network_info: [{"id": "1255c7e6-e572-4b38-8f0b-e4e369ce264d", "address": "fa:16:3e:df:a0:6c", "network": {"id": "b0e6d21e-9250-461d-9069-14c0a0969fd1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1815371564-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "621bdb6aad704cf9b2f31f9e1e653d8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1255c7e6-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:24:12.607813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Releasing lock "refresh_cache-583dd333-3477-45ed-b1f0-8794fadf2ee6" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:24:12.614968 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20b94cc7-bb3b-4248-8b0a-3b8cf39f5ad8 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action" status: 202 len: 0 microversion: 2.1 time: 8.867520 Oct 02 01:24:12.621508 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2403/4976] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:24:03 2022] POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action => generated 0 bytes in 8895 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:24:12.637871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:12.639356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:12.648679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.649697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.650357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.651426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.652698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.653346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.670364 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 HTTP/1.1 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a0c0c6de-5131-4f88-8844-8f9b829edfe2'} Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:12.672403 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:12.677043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:12.677670 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49ca4a11-d02f-4033-82d3-c9ecf4845d17 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 404 len: 111 microversion: 2.1 time: 0.053959 Oct 02 01:24:12.687268 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2404/4977] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:12 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:12.689208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:12.690112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:12.697114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.697610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.698060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.698786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.699716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.699716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.960765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:24:12.961936 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:24:12.962783 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:24:12.963342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:24:12.964008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:24:12.979825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.980386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.980831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.981557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.982009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.982438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.992796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:13.000841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:24:13.006252 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdc4cfb7-b96c-4869-b9e4-41606c138d9b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.324821 Oct 02 01:24:13.007770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:24:13.022047 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2405/4978] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:12 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:13.022047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.214"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:13.037790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:24:13.040941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:24:13.064243 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:13.101939 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4957dc1a-b092-46b2-bd9e-b8d6a5d47d81 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.871061 Oct 02 01:24:13.103229 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2574/4979] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:24:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:24:13.115261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5dbec65a-d3aa-4ee7-b4c0-5f20ce38d1da tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.154164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_groups [None req-5dbec65a-d3aa-4ee7-b4c0-5f20ce38d1da tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Querying cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) for 1 instances {{(pid=122355) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 02 01:24:13.156038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dbec65a-d3aa-4ee7-b4c0-5f20ce38d1da tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.156809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dbec65a-d3aa-4ee7-b4c0-5f20ce38d1da tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.157576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5dbec65a-d3aa-4ee7-b4c0-5f20ce38d1da tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.173539 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5dbec65a-d3aa-4ee7-b4c0-5f20ce38d1da tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068519 Oct 02 01:24:13.174906 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2575/4980] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:24:13 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:13.190299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff113e46-eb54-405f-88ad-ffc8f5d88aae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.195533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff113e46-eb54-405f-88ad-ffc8f5d88aae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:13.411148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff113e46-eb54-405f-88ad-ffc8f5d88aae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:13.424083 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff113e46-eb54-405f-88ad-ffc8f5d88aae tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1242 microversion: 2.1 time: 0.247586 Oct 02 01:24:13.431586 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2576/4981] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:13 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:13.447562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-548e1778-fda5-4978-b744-3afbfda281a3 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.466147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_groups [None req-548e1778-fda5-4978-b744-3afbfda281a3 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Querying cell f9af6514-793d-4739-b224-af2946cacb7b(cell1) for 1 instances {{(pid=122355) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 02 01:24:13.466903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-548e1778-fda5-4978-b744-3afbfda281a3 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.467793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-548e1778-fda5-4978-b744-3afbfda281a3 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.468415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-548e1778-fda5-4978-b744-3afbfda281a3 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.470688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:13.476973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.477552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.478062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.479832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.480376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.480539 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-548e1778-fda5-4978-b744-3afbfda281a3 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/584b840c-fe03-4a3d-ba42-529c21526534" status: 200 len: 183 microversion: 2.1 time: 0.047327 Oct 02 01:24:13.481661 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2577/4982] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:24:13 2022] GET /compute/v2.1/os-server-groups/584b840c-fe03-4a3d-ba42-529c21526534 => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:13.482276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.497894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.498536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:13.510030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.511975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.512829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.514168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.518383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.519517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.540460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 HTTP/1.1 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: exception: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'a0c0c6de-5131-4f88-8844-8f9b829edfe2'} Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:24:13.543088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.549013 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.551410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:13.552540 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-64c4045c-f4cf-496b-a40a-0f7657444964 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 404 len: 111 microversion: 2.1 time: 0.061642 Oct 02 01:24:13.555401 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2578/4983] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:24:13 2022] DELETE /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:13.563716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.564345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] [instance: a0c0c6de-5131-4f88-8844-8f9b829edfe2] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:13.572190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.572738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.573485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.574476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.575598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.576195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.594114 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 HTTP/1.1 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: exception: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'a0c0c6de-5131-4f88-8844-8f9b829edfe2'} Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.595924 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. Oct 02 01:24:13.599923 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.602626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance a0c0c6de-5131-4f88-8844-8f9b829edfe2 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:13.603687 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9d89eea7-d8c6-4f03-8261-dbee6fbbd5e2 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2" status: 404 len: 111 microversion: 2.1 time: 0.044021 Oct 02 01:24:13.604960 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2579/4984] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:13 2022] GET /compute/v2.1/servers/a0c0c6de-5131-4f88-8844-8f9b829edfe2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:13.615987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5361b122-a5e7-43f6-8ea5-7e919cc065e6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.623793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-5361b122-a5e7-43f6-8ea5-7e919cc065e6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance group 547ccc90-efb7-4f64-8830-b848aa1f98a2 could not be found. Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5361b122-a5e7-43f6-8ea5-7e919cc065e6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-server-groups/547ccc90-efb7-4f64-8830-b848aa1f98a2 HTTP/1.1 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: exception: Instance group 547ccc90-efb7-4f64-8830-b848aa1f98a2 could not be found. Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '547ccc90-efb7-4f64-8830-b848aa1f98a2'} Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 547ccc90-efb7-4f64-8830-b848aa1f98a2 could not be found. Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 547ccc90-efb7-4f64-8830-b848aa1f98a2 could not be found. Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.625548 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.632087 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.632087 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.632087 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:13.632087 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:13.632087 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 547ccc90-efb7-4f64-8830-b848aa1f98a2 could not be found. Oct 02 01:24:13.632087 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.633719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5361b122-a5e7-43f6-8ea5-7e919cc065e6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance group 547ccc90-efb7-4f64-8830-b848aa1f98a2 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:13.634912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5361b122-a5e7-43f6-8ea5-7e919cc065e6 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/547ccc90-efb7-4f64-8830-b848aa1f98a2" status: 404 len: 117 microversion: 2.1 time: 0.024873 Oct 02 01:24:13.636197 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2580/4985] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:24:13 2022] DELETE /compute/v2.1/os-server-groups/547ccc90-efb7-4f64-8830-b848aa1f98a2 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:13.647029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77e36b2d-428e-4573-80eb-e5d588826115 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.657727 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-77e36b2d-428e-4573-80eb-e5d588826115 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance group c4d957e0-0e46-41d9-a825-a8501a68b185 could not be found. Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77e36b2d-428e-4573-80eb-e5d588826115 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-server-groups/c4d957e0-0e46-41d9-a825-a8501a68b185 HTTP/1.1 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: exception: Instance group c4d957e0-0e46-41d9-a825-a8501a68b185 could not be found. Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c4d957e0-0e46-41d9-a825-a8501a68b185'} Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c4d957e0-0e46-41d9-a825-a8501a68b185 could not be found. Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c4d957e0-0e46-41d9-a825-a8501a68b185 could not be found. Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.659612 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.665010 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.665010 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.665010 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:13.665010 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:13.665010 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c4d957e0-0e46-41d9-a825-a8501a68b185 could not be found. Oct 02 01:24:13.665010 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.666818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77e36b2d-428e-4573-80eb-e5d588826115 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance group c4d957e0-0e46-41d9-a825-a8501a68b185 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:13.668653 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-77e36b2d-428e-4573-80eb-e5d588826115 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c4d957e0-0e46-41d9-a825-a8501a68b185" status: 404 len: 117 microversion: 2.1 time: 0.027240 Oct 02 01:24:13.669742 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2581/4986] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:24:13 2022] DELETE /compute/v2.1/os-server-groups/c4d957e0-0e46-41d9-a825-a8501a68b185 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:13.684588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6825b5bd-1a78-4f00-b303-6d11d5132840 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.704941 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6825b5bd-1a78-4f00-b303-6d11d5132840 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance group 72e9be86-0a4d-491e-865e-c26354caeda2 could not be found. Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6825b5bd-1a78-4f00-b303-6d11d5132840 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-server-groups/72e9be86-0a4d-491e-865e-c26354caeda2 HTTP/1.1 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: exception: Instance group 72e9be86-0a4d-491e-865e-c26354caeda2 could not be found. Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '72e9be86-0a4d-491e-865e-c26354caeda2'} Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 72e9be86-0a4d-491e-865e-c26354caeda2 could not be found. Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 72e9be86-0a4d-491e-865e-c26354caeda2 could not be found. Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.709692 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.714618 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.714618 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.714618 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:13.714618 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:13.714618 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 72e9be86-0a4d-491e-865e-c26354caeda2 could not be found. Oct 02 01:24:13.714618 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.718484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6825b5bd-1a78-4f00-b303-6d11d5132840 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance group 72e9be86-0a4d-491e-865e-c26354caeda2 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:13.719647 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6825b5bd-1a78-4f00-b303-6d11d5132840 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/72e9be86-0a4d-491e-865e-c26354caeda2" status: 404 len: 117 microversion: 2.1 time: 0.044861 Oct 02 01:24:13.720721 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2582/4987] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:24:13 2022] DELETE /compute/v2.1/os-server-groups/72e9be86-0a4d-491e-865e-c26354caeda2 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:13.749099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7188a0e0-96de-4b09-9a70-574579cc24b5 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.789050 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7188a0e0-96de-4b09-9a70-574579cc24b5 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] HTTP exception thrown: Instance group 2605c0e4-008c-4af5-b13a-305cefa875df could not be found. Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7188a0e0-96de-4b09-9a70-574579cc24b5 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Request method failure captured: Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-server-groups/2605c0e4-008c-4af5-b13a-305cefa875df HTTP/1.1 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgc48mBWTnAnAZYYh4w1y0jOGGnp-pRzmNjyMBcgGETGM2V0wbPLsczHMLgx9RYtLc1N6Zwz15GIWdSOnNyH50GDc8yoemlsR560M0zU-BqhH_iL7Eem79jPDkkIR_Q0cOF7fMmjO0xcPnmr4XrvlwsCWKXbgmUsxZB18tnzYO2Wt0 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d51755a194eb4b65bb07bb52dc274f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d51755a194eb4b65bb07bb52dc274f4f"}]}] Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d51755a194eb4b65bb07bb52dc274f4f Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerGroupTestJSON-833377242 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 12321c4eed38481bb09670364f1716c0 Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerGroupTestJSON-833377242-project Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: exception: Instance group 2605c0e4-008c-4af5-b13a-305cefa875df could not be found. Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '2605c0e4-008c-4af5-b13a-305cefa875df'} Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2605c0e4-008c-4af5-b13a-305cefa875df could not be found. Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2605c0e4-008c-4af5-b13a-305cefa875df could not be found. Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.792030 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:13.797066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:13.797066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:13.797066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:13.797066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:13.797066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2605c0e4-008c-4af5-b13a-305cefa875df could not be found. Oct 02 01:24:13.797066 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:24:13.797843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7188a0e0-96de-4b09-9a70-574579cc24b5 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Returning 404 to user: Instance group 2605c0e4-008c-4af5-b13a-305cefa875df could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:13.802830 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7188a0e0-96de-4b09-9a70-574579cc24b5 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/2605c0e4-008c-4af5-b13a-305cefa875df" status: 404 len: 117 microversion: 2.1 time: 0.077180 Oct 02 01:24:13.803328 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2583/4988] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:24:13 2022] DELETE /compute/v2.1/os-server-groups/2605c0e4-008c-4af5-b13a-305cefa875df => generated 117 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:24:13.814519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56524533-c683-4954-a6df-dc32e9058864 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.878394 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56524533-c683-4954-a6df-dc32e9058864 tempest-ServerGroupTestJSON-833377242 tempest-ServerGroupTestJSON-833377242-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/584b840c-fe03-4a3d-ba42-529c21526534" status: 204 len: 0 microversion: 2.1 time: 0.069115 Oct 02 01:24:13.880504 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2584/4989] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:24:13 2022] DELETE /compute/v2.1/os-server-groups/584b840c-fe03-4a3d-ba42-529c21526534 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:24:14.034704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:14.037423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:14.049988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:14.050508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:14.051067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:14.052675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:14.053425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:14.055036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:14.089279 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:14.141653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "refresh_cache-583dd333-3477-45ed-b1f0-8794fadf2ee6" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 01:24:14.142762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquired lock "refresh_cache-583dd333-3477-45ed-b1f0-8794fadf2ee6" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 01:24:14.847533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:14.866917 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e7d8127-2d2d-460e-9eae-a56bf65dbadf tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.839261 Oct 02 01:24:14.900478 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2585/4990] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:14 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:14.906807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:14.907503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:14.918348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:14.926524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:14.927157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:14.927925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:14.929125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:14.930322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:15.148533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:15.161035 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06a2c001-b1bd-4d4d-9ba2-63edb0000e7a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1302 microversion: 2.1 time: 0.258795 Oct 02 01:24:15.161571 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2586/4991] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:14 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:15.889355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:15.890222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:15.904133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:15.904641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:15.905287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:15.906018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:15.906488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:15.906983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:17.225066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:17.234424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a99d1f8c-2636-4532-9e75-3cc03d63200d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 1.348886 Oct 02 01:24:17.256453 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2587/4992] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:15 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:17.267170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:17.270017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:17.286615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:17.290578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:17.291045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:17.291822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:17.292654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:17.292807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.095894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Building network info cache for instance {{(pid=122354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 02 01:24:18.140542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:18.166051 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d130e718-9165-40be-87e7-44944908440d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 0.906605 Oct 02 01:24:18.167327 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2588/4993] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:17 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:18.173688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ef17ae24-1d71-4ecf-af34-96c40c11e438 req-a95bd4c6-2864-4bc0-8289-3792a7695c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b", "tag": "1fac1a5d-4275-48c4-91f0-510625f6ed41"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:18.193859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ef17ae24-1d71-4ecf-af34-96c40c11e438 req-a95bd4c6-2864-4bc0-8289-3792a7695c2b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.194886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ef17ae24-1d71-4ecf-af34-96c40c11e438 req-a95bd4c6-2864-4bc0-8289-3792a7695c2b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.197892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ef17ae24-1d71-4ecf-af34-96c40c11e438 req-a95bd4c6-2864-4bc0-8289-3792a7695c2b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.227009 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ef17ae24-1d71-4ecf-af34-96c40c11e438 req-a95bd4c6-2864-4bc0-8289-3792a7695c2b service nova] Creating event network-changed:1fac1a5d-4275-48c4-91f0-510625f6ed41 for instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b on n-h2-master-1 Oct 02 01:24:18.234695 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ef17ae24-1d71-4ecf-af34-96c40c11e438 req-a95bd4c6-2864-4bc0-8289-3792a7695c2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064835 Oct 02 01:24:18.236395 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2589/4994] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:18.273726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:18.276164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:18.294658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.295541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.296217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.297799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.298707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.299348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:19.017383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:19.033322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-15076c0a-7461-41e5-bf24-bd1ad0214354 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.767252 Oct 02 01:24:19.034344 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2590/4995] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:18 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:19.193208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:19.193846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:19.212651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:19.213159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:19.213612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:19.214340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:19.214889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:19.215319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.131252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:20.150622 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b6cd2666-8e8f-42d2-b589-3fde82d33f9a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 0.961014 Oct 02 01:24:20.152113 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2591/4996] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:19 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:20.158370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:20.159519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:20.167168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.167844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.168540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.169975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.170625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.171292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.595433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Updating instance_info_cache with network_info: [{"id": "1255c7e6-e572-4b38-8f0b-e4e369ce264d", "address": "fa:16:3e:df:a0:6c", "network": {"id": "b0e6d21e-9250-461d-9069-14c0a0969fd1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1815371564-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "621bdb6aad704cf9b2f31f9e1e653d8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1255c7e6-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 02 01:24:20.610959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Releasing lock "refresh_cache-583dd333-3477-45ed-b1f0-8794fadf2ee6" {{(pid=122354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 01:24:20.612625 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e12f5159-aede-4eda-9f04-ed17b3ae49d3 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action" status: 202 len: 0 microversion: 2.1 time: 7.601119 Oct 02 01:24:20.613390 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2406/4997] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:24:13 2022] POST /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6/action => generated 0 bytes in 7603 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 02 01:24:20.620932 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-444fc654-0912-4ed5-afd4-b8aa42ecce16 req-9ed1a4ae-4e6e-447c-9464-382050ae30cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:20.626389 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:20.634435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-444fc654-0912-4ed5-afd4-b8aa42ecce16 req-9ed1a4ae-4e6e-447c-9464-382050ae30cb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.635110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-444fc654-0912-4ed5-afd4-b8aa42ecce16 req-9ed1a4ae-4e6e-447c-9464-382050ae30cb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.635649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-444fc654-0912-4ed5-afd4-b8aa42ecce16 req-9ed1a4ae-4e6e-447c-9464-382050ae30cb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.649614 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-444fc654-0912-4ed5-afd4-b8aa42ecce16 req-9ed1a4ae-4e6e-447c-9464-382050ae30cb service nova] Creating event network-changed:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:24:20.655705 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-444fc654-0912-4ed5-afd4-b8aa42ecce16 req-9ed1a4ae-4e6e-447c-9464-382050ae30cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040696 Oct 02 01:24:20.656734 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2407/4998] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:20.667260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-db272667-8b81-48bf-a8d5-45c1733698a0 req-39cbbc88-f262-4b59-a47f-cdf92ab64dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443bec7b-b69b-4575-9feb-edce6851b262", "tag": "9ab26bd3-12b5-444c-9d5f-830875c0e174"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:20.683980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-db272667-8b81-48bf-a8d5-45c1733698a0 req-39cbbc88-f262-4b59-a47f-cdf92ab64dbc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.685084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-db272667-8b81-48bf-a8d5-45c1733698a0 req-39cbbc88-f262-4b59-a47f-cdf92ab64dbc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.685686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-db272667-8b81-48bf-a8d5-45c1733698a0 req-39cbbc88-f262-4b59-a47f-cdf92ab64dbc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.694635 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:20.703864 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-db272667-8b81-48bf-a8d5-45c1733698a0 req-39cbbc88-f262-4b59-a47f-cdf92ab64dbc service nova] Creating event network-changed:9ab26bd3-12b5-444c-9d5f-830875c0e174 for instance 443bec7b-b69b-4575-9feb-edce6851b262 on n-h1-master-1 Oct 02 01:24:20.709041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-db272667-8b81-48bf-a8d5-45c1733698a0 req-39cbbc88-f262-4b59-a47f-cdf92ab64dbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050723 Oct 02 01:24:20.710362 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2408/4999] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:20.716671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc9238ed-cbc4-4024-a17b-aee3b4809bf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '.version_select at 0x7fb8817b8310>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:20.722858 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-142f6599-3d68-476e-b90f-002a008ca030 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.569140 Oct 02 01:24:20.727309 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2592/5000] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:20 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:21.177046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:21.180926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:21.190259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:21.191052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:21.191901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:21.193153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:21.195013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:21.195999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.333888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:22.346963 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-404ad99a-05ec-474d-bac2-7f019500f395 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 1.176811 Oct 02 01:24:22.348072 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2593/5001] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:21 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:22.354493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:22.355509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:22.362568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:22.363352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:22.363971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.364876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:22.365883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:22.366501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.992198 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:23.062590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:23.070708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1d4e826-acaf-4047-9291-1745c42b4633 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.721330 Oct 02 01:24:23.071318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2594/5002] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:22 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:23.374356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:23.380505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:23.391947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:23.393002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:23.393655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:23.394807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:23.395427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:23.396076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:23.424838 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=20 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:23.774977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:23.790332 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da73114c-5d7c-4607-83ad-9f0fc80d3a14 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 0.424670 Oct 02 01:24:23.801862 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2595/5003] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:23 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:24.095146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:24.095774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:24.103075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.103887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.104691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.105632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.106319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.107040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.346670 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc9238ed-cbc4-4024-a17b-aee3b4809bf7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/15aadcb2-fa42-4a8e-853c-4bccd478ad90" status: 202 len: 0 microversion: 2.1 time: 3.634766 Oct 02 01:24:24.352225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2409/5004] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:24:20 2022] DELETE /compute/v2.1/os-floating-ips/15aadcb2-fa42-4a8e-853c-4bccd478ad90 => generated 0 bytes in 3641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:24:24.357367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d38176d0-99b0-4c56-b466-ed52a9aa084d req-78a60104-dd7a-4a31-912e-fdf4fbcc7e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b", "name": "network-vif-plugged", "status": "completed", "tag": "1fac1a5d-4275-48c4-91f0-510625f6ed41"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:24.369737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d38176d0-99b0-4c56-b466-ed52a9aa084d req-78a60104-dd7a-4a31-912e-fdf4fbcc7e0d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.370459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d38176d0-99b0-4c56-b466-ed52a9aa084d req-78a60104-dd7a-4a31-912e-fdf4fbcc7e0d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.370969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d38176d0-99b0-4c56-b466-ed52a9aa084d req-78a60104-dd7a-4a31-912e-fdf4fbcc7e0d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.375736 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:24.387757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d38176d0-99b0-4c56-b466-ed52a9aa084d req-78a60104-dd7a-4a31-912e-fdf4fbcc7e0d service nova] Creating event network-vif-plugged:1fac1a5d-4275-48c4-91f0-510625f6ed41 for instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b on n-h2-master-1 Oct 02 01:24:24.393226 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d38176d0-99b0-4c56-b466-ed52a9aa084d req-78a60104-dd7a-4a31-912e-fdf4fbcc7e0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039385 Oct 02 01:24:24.394037 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2410/5005] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:24.403350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16f8e39f-2ddc-4e13-a55b-b7d68b6abe1c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '.version_select at 0x7fb8816671f0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:24.481557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:24.503705 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9374c534-b087-4ac3-aa94-44a5ea49ddcb tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.409400 Oct 02 01:24:24.507294 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2596/5006] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:24 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:24.818198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:24.819025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:24.830736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.832231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.832829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.833919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.835509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.836127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.159571 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16f8e39f-2ddc-4e13-a55b-b7d68b6abe1c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/40f435fa-fcb8-4ac4-ad7d-a88bc1e14d70" status: 202 len: 0 microversion: 2.1 time: 0.763794 Oct 02 01:24:25.160168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2411/5007] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 01:24:24 2022] DELETE /compute/v2.1/os-security-groups/40f435fa-fcb8-4ac4-ad7d-a88bc1e14d70 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:24:25.170065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:25.170523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:25.177875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.178413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.179304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.180034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.180655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.181252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.219717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:24:25.266120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:25.293459 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b146401d-ae81-459b-8b9a-fae05b13af52 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 0.475135 Oct 02 01:24:25.299839 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2597/5008] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:24 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:25.368665 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7466876c-6e80-473c-bcfc-3c823b7ae818 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "DELETE /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 204 len: 0 microversion: 2.1 time: 0.202828 Oct 02 01:24:25.369698 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2412/5009] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:24:25 2022] DELETE /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:24:25.378382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:25.379416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:25.387818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.388666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.389314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.390513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.391294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.391991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.536007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:25.536920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:25.552276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.554962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.556786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.558183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.559636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.560288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.088665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:26.098810 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1caf0981-3155-494f-abb8-b60f5a3a209a tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1509 microversion: 2.1 time: 0.724818 Oct 02 01:24:26.099938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2598/5010] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:25 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1509 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:26.110833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:26.125623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05a5123e-0d40-4739-b8a1-cb7f90f31477 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.598601 Oct 02 01:24:26.143054 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2413/5011] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:25 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:26.318030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:26.319118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:26.325669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:26.326228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:26.326899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.327965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:26.328613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:26.329354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.703304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:26.716708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3412cad1-be9d-4c11-a498-347f8f790c96 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 0.402449 Oct 02 01:24:26.721545 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2599/5012] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:26 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:27.031641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-dcf70a6d-f317-4f58-8c9b-aca8af25c738 req-7c0593d5-4ff6-4326-9226-c3360785de7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443bec7b-b69b-4575-9feb-edce6851b262", "name": "network-vif-plugged", "status": "completed", "tag": "9ab26bd3-12b5-444c-9d5f-830875c0e174"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:27.075267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-dcf70a6d-f317-4f58-8c9b-aca8af25c738 req-7c0593d5-4ff6-4326-9226-c3360785de7a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.076130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-dcf70a6d-f317-4f58-8c9b-aca8af25c738 req-7c0593d5-4ff6-4326-9226-c3360785de7a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.076987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-dcf70a6d-f317-4f58-8c9b-aca8af25c738 req-7c0593d5-4ff6-4326-9226-c3360785de7a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.103873 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-dcf70a6d-f317-4f58-8c9b-aca8af25c738 req-7c0593d5-4ff6-4326-9226-c3360785de7a service nova] Creating event network-vif-plugged:9ab26bd3-12b5-444c-9d5f-830875c0e174 for instance 443bec7b-b69b-4575-9feb-edce6851b262 on n-h1-master-1 Oct 02 01:24:27.122802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:27.124790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:27.135642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.136115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.137436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-dcf70a6d-f317-4f58-8c9b-aca8af25c738 req-7c0593d5-4ff6-4326-9226-c3360785de7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110161 Oct 02 01:24:27.139191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.140343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.140587 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2414/5013] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:27.141186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.141727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.150184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:27.155013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:27.169349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.171988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.172710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.174917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.176162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.177754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.562770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:27.579359 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c64dc655-6a71-4e1c-aaf1-366280f04e01 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1509 microversion: 2.1 time: 0.460800 Oct 02 01:24:27.595845 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2600/5014] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:27 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1509 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:27.630397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:27.645058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-00779039-9cd9-4229-a19a-9135457e2075 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1313 microversion: 2.1 time: 0.499318 Oct 02 01:24:27.655154 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2415/5015] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:27 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:27.750225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:27.750881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:27.757329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.758032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.758846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.759779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.760613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.761261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.946839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1155569952", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:28.030537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:24:28.031343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:24:28.032061 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:24:28.032663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:24:28.033253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:24:28.044539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.045316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.045933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.047029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.047846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.048793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.075814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Getting quotas for project 6d0540166c8146a9b853f288bc048b63. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:24:28.083625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Getting quotas for user 7c17addef0664acbacdf877431d73888 and project 6d0540166c8146a9b853f288bc048b63. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:24:28.102090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:24:28.104486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:24:28.162067 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b72cc79e-a1ed-4bc4-b3c2-20d6304937e2 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.565037 Oct 02 01:24:28.163722 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2601/5016] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:24:28.173468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.180135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c6b2808c-f313-4c98-a209-75db066d4915 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:28.181054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c6b2808c-f313-4c98-a209-75db066d4915 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:28.198178 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d46f3024-d5cf-40fa-9437-382847024aea tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1368 microversion: 2.1 time: 0.452752 Oct 02 01:24:28.214625 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2416/5017] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:27 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:28.292505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6b2808c-f313-4c98-a209-75db066d4915 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.305962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6b2808c-f313-4c98-a209-75db066d4915 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.308471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c6b2808c-f313-4c98-a209-75db066d4915 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.310075 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c6b2808c-f313-4c98-a209-75db066d4915 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1278 microversion: 2.57 time: 0.138585 Oct 02 01:24:28.325411 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2602/5018] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:28 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:28.610687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:28.611949 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:28.627241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.627553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.630454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.632737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.633465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.634008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.669271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:28.670005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:28.692428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.693224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.695670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.699782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.702886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.703608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.905706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.919584 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9745dfb5-0d7a-4f79-a0a1-b215bc6562c7 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1467 microversion: 2.1 time: 0.314874 Oct 02 01:24:28.952781 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2417/5019] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:28 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:29.233690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.235354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.247919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.254189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.254676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.255428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.262260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.262753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.346428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.356665 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-808c71a2-9570-41bc-9a07-9740618bc43e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1497 microversion: 2.1 time: 0.691339 Oct 02 01:24:29.357269 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2603/5020] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:28 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1497 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:29.373316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.374275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.388561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.389504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.390190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.391531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.392441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.393395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.426546 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:29.544717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.558784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.560520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.561966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-79c25f46-e110-4ad9-99d2-b8d1072e1378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1274 microversion: 2.57 time: 0.197984 Oct 02 01:24:29.563118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2604/5021] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:29.568126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8762e89f-4574-4283-971d-225c9d9841cd req-f77cc8b4-52dc-47b8-b5fa-af9478aa54ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583dd333-3477-45ed-b1f0-8794fadf2ee6", "name": "network-vif-deleted", "tag": "1255c7e6-e572-4b38-8f0b-e4e369ce264d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:29.580479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8762e89f-4574-4283-971d-225c9d9841cd req-f77cc8b4-52dc-47b8-b5fa-af9478aa54ae service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.580971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8762e89f-4574-4283-971d-225c9d9841cd req-f77cc8b4-52dc-47b8-b5fa-af9478aa54ae service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.581407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8762e89f-4574-4283-971d-225c9d9841cd req-f77cc8b4-52dc-47b8-b5fa-af9478aa54ae service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.604266 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8762e89f-4574-4283-971d-225c9d9841cd req-f77cc8b4-52dc-47b8-b5fa-af9478aa54ae service nova] Creating event network-vif-deleted:1255c7e6-e572-4b38-8f0b-e4e369ce264d for instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 on n-h2-master-1 Oct 02 01:24:29.618935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8762e89f-4574-4283-971d-225c9d9841cd req-f77cc8b4-52dc-47b8-b5fa-af9478aa54ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054225 Oct 02 01:24:29.621519 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2605/5022] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:29.643066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.655671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:29.658575 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3087b982-01f0-4e7a-bc5c-c40d3c6b48a2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1558 microversion: 2.1 time: 0.428364 Oct 02 01:24:29.659244 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2418/5023] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1558 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:29.666980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.691610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.692718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.695802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.696437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.696893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.716687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.716869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.717110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.717556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.717973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.718267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.718754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.718959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.719181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.768693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lazy-loading 'flavor' on Instance uuid 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:24:29.854624 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9b6193d-4de8-4ca4-84a5-972ff7c32359 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172871 Oct 02 01:24:29.855297 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2419/5024] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:24:29.895745 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d9bbdc8c-515c-48df-a246-0a011475ce7a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "POST /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b/action" status: 200 len: 32 microversion: 2.1 time: 0.272262 Oct 02 01:24:29.898145 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2606/5025] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:24:29 2022] POST /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b/action => generated 32 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:24:29.907936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.908580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.915863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.916360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.916853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.917561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.918239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.918922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.957059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.964317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.976246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.980376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.981023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.981775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.985095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.985541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.054881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.055603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.056255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.061199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lazy-loading 'fault' on Instance uuid 583dd333-3477-45ed-b1f0-8794fadf2ee6 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:24:30.176889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4701f06a10ad4f89984132f8ec72b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621bdb6aad704cf9b2f31f9e1e653d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.207967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbf10e85-460a-4560-8fc3-d60d1ae74912 tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 200 len: 1312 microversion: 2.1 time: 0.240534 Oct 02 01:24:30.207967 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2607/5026] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:30.400759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.409692 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e45b285-3780-490b-a916-c85fd188ea73 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.506773 Oct 02 01:24:30.410293 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2420/5027] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:30.595060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:30.596231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:30.603194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.603835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.604380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.605190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.605746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.606284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.778742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.794534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.796085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.797267 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b8b02710-5d8d-4836-8afe-5e2916aca991 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1336 microversion: 2.57 time: 0.206184 Oct 02 01:24:30.798350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2608/5028] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:30 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:31.226955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:31.227651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] [instance: 583dd333-3477-45ed-b1f0-8794fadf2ee6] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:31.234632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.235134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.235652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.236369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.237716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.238163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.257840 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] HTTP exception thrown: Instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 could not be found. Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Request method failure captured: Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 HTTP/1.1 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOf2yD8KJ7WwvpXxyYUiu2NJ0Wi-HRLhpe2CCETFALtuYoeTBZCQzNnrpBI2GS2C4fGoyPESQJCqaH0YA4fXu6dAiyGqNc3dlcTC9Rgrrj0XWlDOJOPx5Lfad2W8j3YIxGW7hJsQbgKDK1vCpJryFoywUHKSOJi7nTebOfFA-Q0eE4A Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 621bdb6aad704cf9b2f31f9e1e653d8c Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1054219309 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/621bdb6aad704cf9b2f31f9e1e653d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/621bdb6aad704cf9b2f31f9e1e653d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/621bdb6aad704cf9b2f31f9e1e653d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_621bdb6aad704cf9b2f31f9e1e653d8c"}]}] Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1054219309 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 621bdb6aad704cf9b2f31f9e1e653d8c Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1054219309 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueTestJSONUnderV235-1054219309-project Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 4701f06a10ad4f89984132f8ec72b955 Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1054219309-project Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 could not be found. Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '583dd333-3477-45ed-b1f0-8794fadf2ee6'} Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 could not be found. Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 could not be found. Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:31.259584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 could not be found. Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] Returning 404 to user: Instance 583dd333-3477-45ed-b1f0-8794fadf2ee6 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d77f317e-d072-4092-b6ae-9561a1ff763c tempest-ServerRescueTestJSONUnderV235-1054219309 tempest-ServerRescueTestJSONUnderV235-1054219309-project] 10.222.0.23 "GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6" status: 404 len: 111 microversion: 2.1 time: 0.041910 Oct 02 01:24:31.264079 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2421/5029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:31 2022] GET /compute/v2.1/servers/583dd333-3477-45ed-b1f0-8794fadf2ee6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:24:31.438961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:31.439622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:31.442272 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:31.447702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.448207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.448654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.449383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.449847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.450286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.781963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:31.797434 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24914047-c9a8-49d5-b1d9-9cd1ec06616d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.363227 Oct 02 01:24:31.804144 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2609/5030] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:31 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:31.825152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:31.825700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:31.835204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.837458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.838066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.840010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.840479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.841663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.942386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:31.950984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:31.952557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:31.953719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08ad5f81-7503-48fa-acf8-11848fd6b47c tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1336 microversion: 2.57 time: 0.132619 Oct 02 01:24:31.954786 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2422/5031] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:31 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:32.133434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6f7e3e84-3557-4a24-8abf-6a391b8539f9 req-ffe76a95-7843-41cb-bea0-ea93c2c201de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443bec7b-b69b-4575-9feb-edce6851b262", "tag": "9ab26bd3-12b5-444c-9d5f-830875c0e174"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:32.145940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f7e3e84-3557-4a24-8abf-6a391b8539f9 req-ffe76a95-7843-41cb-bea0-ea93c2c201de service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:32.147375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f7e3e84-3557-4a24-8abf-6a391b8539f9 req-ffe76a95-7843-41cb-bea0-ea93c2c201de service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:32.148301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6f7e3e84-3557-4a24-8abf-6a391b8539f9 req-ffe76a95-7843-41cb-bea0-ea93c2c201de service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:32.160736 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6f7e3e84-3557-4a24-8abf-6a391b8539f9 req-ffe76a95-7843-41cb-bea0-ea93c2c201de service nova] Creating event network-changed:9ab26bd3-12b5-444c-9d5f-830875c0e174 for instance 443bec7b-b69b-4575-9feb-edce6851b262 on n-h1-master-1 Oct 02 01:24:32.166045 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6f7e3e84-3557-4a24-8abf-6a391b8539f9 req-ffe76a95-7843-41cb-bea0-ea93c2c201de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037062 Oct 02 01:24:32.166944 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2610/5032] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:32.827321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:32.828124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:32.839093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:32.844938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:32.845569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:32.846428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:32.847051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:32.847606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:32.994316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:32.997138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:33.020595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:33.023972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:33.024673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:33.026809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:33.028921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:33.030346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:33.195690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:33.206958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:33.212507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:33.214212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:33.220202 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bdabd6c9-13ca-4ff1-8d07-c9df960e0bc4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.398137 Oct 02 01:24:33.220825 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f3fbb085-e6a8-460d-824a-cf078b01d71b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1336 microversion: 2.57 time: 0.242075 Oct 02 01:24:33.223090 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2423/5033] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:32 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:33.231434 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2611/5034] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:32 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1336 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:34.265870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:34.267204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:34.267587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:34.268290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:34.280012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.283248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.283922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.284447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.284776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.290822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.290822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.290822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.291394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.293301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.294058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.295205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.577703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:34.594078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:34.600444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:34.606572 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fa4f4431-1da3-46c1-b33b-027f1696f5ef tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1336 microversion: 2.57 time: 0.344194 Oct 02 01:24:34.618778 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2612/5035] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:34 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1336 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:34.914929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:34.930792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2f3c852-6a8d-4e0e-92e9-3bcc200504d1 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.669440 Oct 02 01:24:34.939243 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2424/5036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:34 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:35.679952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:35.693985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:35.704529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.705315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.705920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.707129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.707823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.708418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.859507 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:35.873063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:35.878105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:35.883934 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ddd952df-f5c2-4f3f-a7a3-6bc3b0151d96 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1357 microversion: 2.57 time: 0.237939 Oct 02 01:24:35.885195 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2613/5037] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:35 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:35.916042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:35.920348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:35.941555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.942357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.943670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.950777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.951757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.952395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.956053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:35.956679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:35.987599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.988110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.988557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.989287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.989749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.990776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.129825 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:24:36.131167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:24:36.132135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:24:36.132824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:24:36.133594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:24:36.260319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:36.269492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:36.270072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:36.270816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.271985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:36.272773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:36.273497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.346338 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3fa69b2f-7c34-47b8-b69c-a382c70ad6c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "POST /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b/action" status: 202 len: 1138 microversion: 2.57 time: 0.436097 Oct 02 01:24:36.347774 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2425/5038] 10.222.0.23 () {62 vars in 1320 bytes} [Sun Oct 2 01:24:35 2022] POST /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b/action => generated 1138 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 454 bytes (3 switches on core 0) Oct 02 01:24:36.374303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:36.376155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:36.395898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:36.398748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:36.399628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.401270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:36.403243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:36.405426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.444960 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:36.562495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:36.579404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a65473e-839f-424e-8350-29b1d9950654 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.620317 Oct 02 01:24:36.582964 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2614/5039] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:35 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:37.608847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:37.609463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:37.620596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:37.621099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:37.621547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:37.622281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:37.622782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:37.623221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:37.821783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:37.862985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:37.869944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:37.871939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a6580ed-2317-4e18-b5e2-97821dcacf5b tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 1.501331 Oct 02 01:24:37.882799 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2426/5040] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:36 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:38.061064 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:38.184978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:38.195992 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7cd53d38-c447-4299-8558-3f922178eecd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.591080 Oct 02 01:24:38.206630 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2615/5041] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:37 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:38.911488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:38.913642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:38.933400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:38.935273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:38.935919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:38.938800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:38.939509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:38.940080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.221538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:39.222176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:39.232101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:39.232415 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:39.240352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:39.240960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:39.241408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.242150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:39.242634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:39.243341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.250678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:39.252610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:39.260167 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9e248a8-4f67-44e6-a03b-879d452c429e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.356479 Oct 02 01:24:39.260840 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2427/5042] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:38 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:39.578105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:39.589492 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f624570b-bb84-45d0-b1b4-3e402ad8e402 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.372000 Oct 02 01:24:39.603648 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2616/5043] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:39 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:40.290288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:40.292112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:40.300078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.303046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.304468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.306195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.308627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.310493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.442110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:40.454055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:40.462895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:40.465287 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5523d73a-b86e-41a0-94d3-fc22dcf59395 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.179865 Oct 02 01:24:40.469020 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2428/5044] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:40 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:40.623088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:40.625422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:40.633505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.634330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.635044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.636259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.636934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.637695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.921811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:40.932882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8d500992-cabb-4797-b733-021e270abb63 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.316338 Oct 02 01:24:40.946623 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2617/5045] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:40 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:41.493509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:41.494128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:41.509275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.509763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.510194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.510928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.511386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.511807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.663236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:41.678915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:41.685995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:41.687278 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d6dfbde-8992-4ea5-b336-59ee08413894 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.197898 Oct 02 01:24:41.705159 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2429/5046] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:41 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:41.961388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:41.962560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:41.975466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.982584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.987294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.989083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.992173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.994282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:42.476018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:42.486441 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9761350b-3731-4962-a813-bebfb8cc3e2e tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.529181 Oct 02 01:24:42.487490 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2618/5047] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:41 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:42.722009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:42.722644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:42.733142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:42.735913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:42.736636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:42.743755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:42.747688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:42.748147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:42.849341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:42.866426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:42.869286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:42.870901 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48eb5fb3-f542-48ac-bac4-03cce15a23c7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.154678 Oct 02 01:24:42.872337 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2430/5048] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:42 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:43.511457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:43.512275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:43.533003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.536488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.537702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.538322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.542548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.543095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.897953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:43.901535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:43.917098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.917737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.918038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.918791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.923728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.924339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.994435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:44.020384 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20f0a677-7c6a-4a6f-98ba-05014da18d2d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.512775 Oct 02 01:24:44.025358 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2619/5049] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:43 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:44.054036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:44.065268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:44.066779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:44.068929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bfb854e-c363-4e7b-8592-409049f6aa7d tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.174503 Oct 02 01:24:44.069506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2431/5050] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:43 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:45.048450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:45.049942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:45.062893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.063542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.067903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.069059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.069966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.071047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.081789 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:45.102757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:45.104173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:45.131630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.137088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.137534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.138288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.138786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.139222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.378508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:45.395343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:45.401010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:45.402868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-078ab02b-484c-4fd9-b38a-a4ea0ad23d13 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.305645 Oct 02 01:24:45.404403 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2432/5051] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:45 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:24:45.472904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:45.485115 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-482c0b44-99a3-41c5-a6d5-77389667f039 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.438368 Oct 02 01:24:45.488706 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2620/5052] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:45 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:46.430564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:46.431925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:46.444059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.444850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.445526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.446844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.447549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.448439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.517510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:46.518002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:46.532841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.533431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.534869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.537076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.537876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.539844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.668107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:46.702176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:46.702176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:46.708943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9069949a-eb4a-4160-8124-c48876af04e3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.277017 Oct 02 01:24:46.734144 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2433/5053] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:46 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:47.200938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:47.218006 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-337a11dd-314f-4a5c-bd72-c4b7e97a61f0 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.704841 Oct 02 01:24:47.218645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2621/5054] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:46 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:47.742966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:47.743625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:47.764105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:47.764702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:47.765294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:47.773265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:47.774442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:47.775959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:47.958786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:47.975089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:47.978746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:47.984067 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bd257c3-658f-41b3-acae-1bcfb6ff4aa6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.246071 Oct 02 01:24:47.999988 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2434/5055] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:47 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:48.241131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:48.243174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:48.264219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:48.265008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:48.272098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:48.273080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:48.273718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:48.274356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:48.664264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:48.683854 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6052855b-7a0f-4b72-aae5-ff7ba5c8624f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1503 microversion: 2.1 time: 0.446402 Oct 02 01:24:48.699292 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2622/5056] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:48 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1503 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:49.038085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:49.040143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:49.052504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.055927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.056648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.059393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.061367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.062006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.283533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:49.309864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:49.315260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:49.322752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-393188dd-ab01-41ad-a36f-26161cb41861 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.289506 Oct 02 01:24:49.324682 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2435/5057] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:49 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:49.708778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:49.709695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:49.719558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.725314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.726087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.727621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.728411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.729061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.155527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:50.171525 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9c9339a2-8e8c-476f-8aa5-4d9fae4495d4 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1483 microversion: 2.1 time: 0.466817 Oct 02 01:24:50.172132 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2623/5058] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:49 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1483 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:50.353225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:50.355749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:50.373239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:50.375900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:50.376639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.380912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:50.381991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:50.382994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.589868 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1013117025", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:50.692877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] validate_networks() for [('654a27f4-3da1-45ca-83b0-0a0abf247ad4', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:24:50.763466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:50.779506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:50.785139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:50.788106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebfa2fd1-c91f-4692-8d77-bd084e5245fe tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.439373 Oct 02 01:24:50.803505 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2436/5059] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:50 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:51.839808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:51.841697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:51.853249 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:51.871135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:51.872779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:51.874808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:51.876322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:51.879411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:51.881100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:52.752929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:52.775143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:52.777929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:52.779204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5d82244e-387e-42ec-846a-f04a93408429 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.945344 Oct 02 01:24:52.803517 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2437/5060] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:51 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:52.803849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:24:52.804327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:24:52.804755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:24:52.805172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:24:52.807044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:24:52.827044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:52.827470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:52.827915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:52.828664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:52.834475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:52.839324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:52.879509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Getting quotas for project 084a8da705e0434e8a008ffdd019f6e8. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:24:52.887521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Getting quotas for user 26e4e60bc26a4d229a85c9990e1730a5 and project 084a8da705e0434e8a008ffdd019f6e8. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:24:52.906369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:24:52.909537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:24:53.043115 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bfe0747d-b109-4073-894b-3509c3f03334 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.457469 Oct 02 01:24:53.047704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2624/5061] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:24:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:24:53.057629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fc78a93-8f51-4c9b-96ab-d9ed5ced738d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:53.060155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5fc78a93-8f51-4c9b-96ab-d9ed5ced738d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:53.226406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5fc78a93-8f51-4c9b-96ab-d9ed5ced738d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:53.233990 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5fc78a93-8f51-4c9b-96ab-d9ed5ced738d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1214 microversion: 2.1 time: 0.181348 Oct 02 01:24:53.235050 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2438/5062] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:53 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:53.843333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:53.846298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:53.879130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:53.882720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:53.883908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:53.887046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:53.889267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:53.890894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.023199 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-233201922", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:54.140960 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] validate_networks() for [('1ff916bd-12e6-4293-adde-bfdeed6c5886', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:24:54.156634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:54.171823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:54.173259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:54.174446 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9052bfd-0aca-4658-b3a1-a2d73faba378 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.356738 Oct 02 01:24:54.187644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2439/5063] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:53 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:54.199960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:54.202527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:54.215384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.218279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.220127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.221456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.222046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.222737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.283666 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f88527ca-0fe8-40e7-9958-3ea90586b950 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094628 Oct 02 01:24:54.284856 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2440/5064] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:24:54 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:24:54.290570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:54.291500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:54.299081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.300104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.300814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.301787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.302398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.303189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.468809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:54.478085 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02ff94b2-f52d-4b80-85eb-2663d6d8bf99 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1210 microversion: 2.1 time: 0.191973 Oct 02 01:24:54.478701 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2441/5065] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:54 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1210 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:54.484744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:54.486526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:54.494907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.496460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.497222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.498105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.498574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.499033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.559406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:24:54.663996 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:54.738267 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1e3883f-2540-4f21-b42d-0f44e0b5f591 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 204 len: 0 microversion: 2.1 time: 0.257540 Oct 02 01:24:54.740804 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2442/5066] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:24:54 2022] DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:24:54.750903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:54.752394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:54.763094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.764071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.764802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.765873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.766452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.767109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.383071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:24:55.384908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:24:55.385630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:24:55.386653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:24:55.387303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:24:55.401334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.402204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.402964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.404510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.405348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.406413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.452368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Getting quotas for project ca7d49167f014e31841f231f94b43e60. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:24:55.470477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Getting quotas for user a003e4392e9c4aa587573cb1dfa605e0 and project ca7d49167f014e31841f231f94b43e60. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:24:55.492858 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:24:55.503311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:24:55.507640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.516455 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-89d32bd7-2bac-453e-956d-ced3c6de5931 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1674 microversion: 2.1 time: 0.772022 Oct 02 01:24:55.545353 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2443/5067] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:54 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1674 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:55.552415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:55.554103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:55.560993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.561893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.562563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.563560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.564256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.564936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.568549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97b9b0a0-6e59-4b62-82e7-26934340566f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.104117 Oct 02 01:24:55.569621 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2625/5068] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:24:55.574343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:55.585366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:55.592217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.592707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.593141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.593860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.594315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.594787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.781786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.781929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.799299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6df9deaa-20c5-4611-acfd-4b081d708790 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1272 microversion: 2.1 time: 0.228591 Oct 02 01:24:55.799910 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2626/5069] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:55 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:55.805292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ad3c473-559f-47a0-a64a-bd17ad3d53a9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:55.805905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ad3c473-559f-47a0-a64a-bd17ad3d53a9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:55.816528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.820673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.821901 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a1e7578-4abd-4e79-8577-5d2b2feab471 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.273978 Oct 02 01:24:55.822476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2444/5070] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:55 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:55.954309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ad3c473-559f-47a0-a64a-bd17ad3d53a9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.969759 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ad3c473-559f-47a0-a64a-bd17ad3d53a9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1216 microversion: 2.1 time: 0.166902 Oct 02 01:24:55.971258 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2627/5071] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:55 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:56.557996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:56.558909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:56.572774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.573618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.574855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.575731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.577322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.578349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.857815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:56.859561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:56.884739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.886032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.887950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.892948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.894032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.896923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.177231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.189368 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8497ff4f-9b26-448d-adb1-e5c3bc9c5bc7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1674 microversion: 2.1 time: 0.637935 Oct 02 01:24:57.214640 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2445/5072] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:56 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1674 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:57.214640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:57.214640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:57.218855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:57.223625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:57.224490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.226247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:57.227875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:57.231193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.518754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.550280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.561713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.574738 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b00c8990-381b-420e-823f-bfd5aae597b6 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.371561 Oct 02 01:24:57.575509 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2446/5073] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:57 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:57.604409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:57.605049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:57.633265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:57.637120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:57.638685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.639668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:57.642550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:57.644111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.750988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.775854 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c27f1ddd-ed53-451a-a64a-8eaf24f50824 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 0.925937 Oct 02 01:24:57.777224 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2628/5074] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:56 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:57.878110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.927291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b0e098c7-a904-45c5-a18a-5236311badde tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1268 microversion: 2.1 time: 0.344360 Oct 02 01:24:57.928075 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2447/5075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:57 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1268 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:58.229440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:58.231548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:58.253191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.257878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.261323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.262108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.264543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.266983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.606857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:58.608185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:58.615862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.616711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.617391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.618335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.625773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.626632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.792581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:58.804719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:58.806170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:58.807672 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fb1318c2-eb98-48da-a1fc-33ce9078979e tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.206102 Oct 02 01:24:58.815451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:58.828400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ef26f4a-9199-4bb8-babc-a22153375689 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1674 microversion: 2.1 time: 0.603556 Oct 02 01:24:58.833164 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2448/5076] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:58 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:24:58.838197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:58.839411 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2629/5077] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:58 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1674 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:58.840700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:58.846916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.847613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.849653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.864858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.865948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.866668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.953333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:58.954500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:58.974970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.975479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.976334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.976629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.977088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.977512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.139675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:59.160320 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9d967b5-cf8b-4ca8-a2aa-819421027c0e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1274 microversion: 2.1 time: 0.210652 Oct 02 01:24:59.174649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2630/5078] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:58 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:59.422102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:59.434207 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2db60a9f-b8cf-458f-b117-a38cbeddbc6f tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 0.599652 Oct 02 01:24:59.436961 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2449/5079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:58 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:59.603483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ce2dc723-f6f4-4a51-ac21-376f62e1187b req-2cb1ae8a-7dcf-44ab-add1-d0a0cceadb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e699a53-6928-480a-935a-581b04a117a5", "tag": "33e94ecf-e6ae-4aea-96bf-b7da845e3b5c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:24:59.648321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce2dc723-f6f4-4a51-ac21-376f62e1187b req-2cb1ae8a-7dcf-44ab-add1-d0a0cceadb2b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.648871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce2dc723-f6f4-4a51-ac21-376f62e1187b req-2cb1ae8a-7dcf-44ab-add1-d0a0cceadb2b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.649321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ce2dc723-f6f4-4a51-ac21-376f62e1187b req-2cb1ae8a-7dcf-44ab-add1-d0a0cceadb2b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.680374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ce2dc723-f6f4-4a51-ac21-376f62e1187b req-2cb1ae8a-7dcf-44ab-add1-d0a0cceadb2b service nova] Creating event network-changed:33e94ecf-e6ae-4aea-96bf-b7da845e3b5c for instance 5e699a53-6928-480a-935a-581b04a117a5 on n-h2-master-1 Oct 02 01:24:59.696604 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ce2dc723-f6f4-4a51-ac21-376f62e1187b req-2cb1ae8a-7dcf-44ab-add1-d0a0cceadb2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098220 Oct 02 01:24:59.697828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2631/5080] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:24:59.862255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:59.866865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:59.871165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:59.872356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:59.881907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.882404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.886343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.887193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.887482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.888159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.888614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.889347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.889814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.890249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.891505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.894187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.140272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.148775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.150274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.151509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fef5ea7f-7ee7-4846-833f-267df8b84683 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.293701 Oct 02 01:25:00.154800 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2450/5081] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:24:59 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:00.189492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:00.189978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:00.206031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.206525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.206995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.207771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.208231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.208654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.369610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.389230 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4fbce760-2b8b-4c30-b375-57b6c6f04de3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1274 microversion: 2.1 time: 0.203610 Oct 02 01:25:00.391327 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2451/5082] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:00 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:00.462693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:00.467082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:00.483317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.484497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.487364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.490300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.491089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.491784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.795452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.818973 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2019490e-fb28-4e1f-b0a0-b81d098b0850 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1674 microversion: 2.1 time: 0.952133 Oct 02 01:25:00.838704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2632/5083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:59 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1674 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:01.180435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:01.184011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:01.204951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.210630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.214057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.215697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.219050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.220391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.664331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:01.667153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:01.683075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dee5a9e1-9501-42e5-bf26-9fe22049081a tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 1.223124 Oct 02 01:25:01.684183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2452/5084] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:00 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:01.691963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:01.695405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:01.710491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.711517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.712958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:01.713303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.714651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.717052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:01.719125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.720010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.725661 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24c6fd89-2352-4899-a481-3231f66481b1 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.543057 Oct 02 01:25:01.758969 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2633/5085] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:01 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:01.772626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d5191e4b-fa7c-431e-ae2c-84f58abc5fcd req-c85733bf-7a5e-4829-95da-12d75938fef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fcb084b-b447-445b-8204-c2fd6ccb1a51", "name": "network-vif-deleted", "tag": "7693d4a5-e295-4578-b67a-11e78e1e1e87"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:01.803576 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:01.805555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5191e4b-fa7c-431e-ae2c-84f58abc5fcd req-c85733bf-7a5e-4829-95da-12d75938fef7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.806402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5191e4b-fa7c-431e-ae2c-84f58abc5fcd req-c85733bf-7a5e-4829-95da-12d75938fef7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.807062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5191e4b-fa7c-431e-ae2c-84f58abc5fcd req-c85733bf-7a5e-4829-95da-12d75938fef7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.826788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d5191e4b-fa7c-431e-ae2c-84f58abc5fcd req-c85733bf-7a5e-4829-95da-12d75938fef7 service nova] Creating event network-vif-deleted:7693d4a5-e295-4578-b67a-11e78e1e1e87 for instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 on n-h1-master-1 Oct 02 01:25:01.836707 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d5191e4b-fa7c-431e-ae2c-84f58abc5fcd req-c85733bf-7a5e-4829-95da-12d75938fef7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074084 Oct 02 01:25:01.838373 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2634/5086] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:01.893021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:01.894068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:01.907930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.909051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.909926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.912172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.913400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.914189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.973974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.974846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.975595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.976303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lazy-loading 'fault' on Instance uuid 1fcb084b-b447-445b-8204-c2fd6ccb1a51 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:25:02.334128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:02.346967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-07b42435-3618-45e5-895d-a72da932f03c tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1327 microversion: 2.1 time: 0.483943 Oct 02 01:25:02.351525 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2635/5087] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:01 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1327 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:02.712107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:02.712943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:02.735264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.736441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.738311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.741158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.742461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.743485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.904671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:02.941194 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c41baac2-a9fa-4604-9585-b6b841850196 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 1.255656 Oct 02 01:25:02.952358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2453/5088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:01 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:02.962324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:02.965798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:02.980398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.980902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.981399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.982308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.983094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.983673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.234335 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:03.368984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:03.390249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:03.395547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:03.400430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16d572c6-d9cc-4ce2-811f-7e68ca25a0c3 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1366 microversion: 2.57 time: 0.444705 Oct 02 01:25:03.401299 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2454/5089] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:02 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:03.415739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:03.417013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:03.437397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.440142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.440887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.443775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.444973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.446000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.524394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.525750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.526547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.527255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lazy-loading 'fault' on Instance uuid 1fcb084b-b447-445b-8204-c2fd6ccb1a51 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:25:03.742870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:03.757428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:03.757927 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-390f224b-879c-40e3-94ee-2e8ec7cc8280 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 1.051568 Oct 02 01:25:03.763371 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2636/5090] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:02 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:03.777063 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1166154c-af96-43e9-b0cf-6493e7b53bfd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 200 len: 1327 microversion: 2.1 time: 0.369327 Oct 02 01:25:03.778449 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2455/5091] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:03 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 1327 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:03.970078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:03.972471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:03.996150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.996657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.999842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.000585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.004539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.005716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.117796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-94486377-bb4f-4bbf-8b87-334ddbd7f28c req-28ae2446-5411-490b-986c-b1387e7d5d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96486de-fc69-42c7-a62e-00eb5168b457", "tag": "8bdae8b4-9693-43bf-a3f9-b140a3ffeda5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:04.140338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-94486377-bb4f-4bbf-8b87-334ddbd7f28c req-28ae2446-5411-490b-986c-b1387e7d5d51 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.140957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-94486377-bb4f-4bbf-8b87-334ddbd7f28c req-28ae2446-5411-490b-986c-b1387e7d5d51 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.141530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-94486377-bb4f-4bbf-8b87-334ddbd7f28c req-28ae2446-5411-490b-986c-b1387e7d5d51 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.183220 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-94486377-bb4f-4bbf-8b87-334ddbd7f28c req-28ae2446-5411-490b-986c-b1387e7d5d51 service nova] Creating event network-changed:8bdae8b4-9693-43bf-a3f9-b140a3ffeda5 for instance f96486de-fc69-42c7-a62e-00eb5168b457 on n-h1-master-1 Oct 02 01:25:04.194539 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-94486377-bb4f-4bbf-8b87-334ddbd7f28c req-28ae2446-5411-490b-986c-b1387e7d5d51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083038 Oct 02 01:25:04.195342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2456/5092] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:04.436180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:04.437276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:04.438992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:04.455170 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5bf287c-cee5-4d74-b243-837bc47dc9d1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.490585 Oct 02 01:25:04.456030 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2637/5093] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:03 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:04.478149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.485516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.486796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.487556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.489101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.489645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.650548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:04.662589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:04.670547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:04.672136 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e77ae3af-f2be-45dc-926a-7075b1d3fcbd tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1372 microversion: 2.57 time: 0.243777 Oct 02 01:25:04.672877 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2457/5094] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:04 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:04.782959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:04.783587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:04.795190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.797034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.797802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.799818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.800512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.802216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.802362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:04.803060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:04.830732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.832427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.833067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.838530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.839840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.840293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.871821 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] HTTP exception thrown: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Request method failure captured: Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 HTTP/1.1 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOcyf13r2ZU821Q-HA_tQOCi4IfBvEBGzSvElEiuXxrS7uKoxYN5sFvudbb8-iKG4ImDMYh6TvzdU-6lXchvRsl4NvGr_dQoruG72BQGbXPUDMQMgGBQPqh3n9op1uqy2ZFQpM-utPE9WiMj4P0ZCYnBKBpyrXP1nivC_P9-bg2GmBg Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8ab6dbed6cd4a09989164757910b06b"}]}] Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: fe1fa0967b8444279e5bad164b635df5 Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1fcb084b-b447-445b-8204-c2fd6ccb1a51'} Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:04.876461 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Returning 404 to user: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:04.882958 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5fced8e6-b489-4e7b-b704-453e18f31122 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 404 len: 111 microversion: 2.1 time: 0.084979 Oct 02 01:25:04.889523 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2458/5095] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:04 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:25:04.900255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-261a92c1-8b59-4d5a-8809-889e098276c0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '.version_select at 0x7fb885608e50>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:04.944977 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-261a92c1-8b59-4d5a-8809-889e098276c0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-294640462" status: 202 len: 0 microversion: 2.1 time: 0.054232 Oct 02 01:25:04.945561 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2459/5096] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-294640462 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:25:05.096630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.108891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4637d73e-333e-4d1f-ac43-f2cf7874883b tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 0.331615 Oct 02 01:25:05.109497 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2638/5097] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:04 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:05.481880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:05.482497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:05.500950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.502266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.505349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.506330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.506838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.508363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.700444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:05.701197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:05.710851 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:05.713685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.714691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.715802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.716879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.717571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.718245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.863218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.884887 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.886358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.887608 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-265f6a7b-7253-4b39-8e21-9f06d089a295 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1372 microversion: 2.57 time: 0.191836 Oct 02 01:25:05.887733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.888383 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2639/5098] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:05 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:05.932682 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b4d829a-ba19-410d-b2ec-05e4f7a4cb42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.455499 Oct 02 01:25:05.943857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2460/5099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:05 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:06.133680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:06.134513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:06.139751 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:06.150901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.152979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.155380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.158227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.171372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.172289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.182495 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:06.241459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e82f17e2-f290-47be-817f-2aebb5d0d243 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: .version_select at 0x7fb8814b2940>, body: {"keypair": {"name": "tempest-keypair-1924298514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVEa9Xjklycdin1sIKPb3+rtBFmINzZubScUK7TPt5ybmIZ6RBKUN34ZeVaMOK0v5RznH0q+Y4FZZo+9a4ViYlZVSH1jRUvRu0BWkdEznebIFTdhlNOSmcoYImdGIpajQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:06.297733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e82f17e2-f290-47be-817f-2aebb5d0d243 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for project e8ab6dbed6cd4a09989164757910b06b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:25:06.312411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e82f17e2-f290-47be-817f-2aebb5d0d243 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for user fe1fa0967b8444279e5bad164b635df5 and project e8ab6dbed6cd4a09989164757910b06b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:25:06.366915 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e82f17e2-f290-47be-817f-2aebb5d0d243 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133653 Oct 02 01:25:06.370500 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2461/5100] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:25:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:06.425368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:06.440329 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a4d6f6b-5b59-4cef-a8ae-198ff548dbec tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 0.312321 Oct 02 01:25:06.460932 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2640/5101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:06 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:06.529299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2a0637e9-c004-4c21-9d1f-6ad126247f28 req-bf66cbba-737a-4b34-8861-7b861cdf21c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e699a53-6928-480a-935a-581b04a117a5", "name": "network-vif-plugged", "status": "completed", "tag": "33e94ecf-e6ae-4aea-96bf-b7da845e3b5c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:06.551004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2a0637e9-c004-4c21-9d1f-6ad126247f28 req-bf66cbba-737a-4b34-8861-7b861cdf21c0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.551876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2a0637e9-c004-4c21-9d1f-6ad126247f28 req-bf66cbba-737a-4b34-8861-7b861cdf21c0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.552531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2a0637e9-c004-4c21-9d1f-6ad126247f28 req-bf66cbba-737a-4b34-8861-7b861cdf21c0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.560656 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:06.571848 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2a0637e9-c004-4c21-9d1f-6ad126247f28 req-bf66cbba-737a-4b34-8861-7b861cdf21c0 service nova] Creating event network-vif-plugged:33e94ecf-e6ae-4aea-96bf-b7da845e3b5c for instance 5e699a53-6928-480a-935a-581b04a117a5 on n-h2-master-1 Oct 02 01:25:06.580053 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2a0637e9-c004-4c21-9d1f-6ad126247f28 req-bf66cbba-737a-4b34-8861-7b861cdf21c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059506 Oct 02 01:25:06.581085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2462/5102] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:06.916559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:06.917436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:06.928788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.929872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.931053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.932037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.933200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.934047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.969199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:06.971187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:06.988207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.989254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.992004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.995841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.996707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.998953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.237988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.257772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.262080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.266115 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-85d1e7bd-0341-4ac1-b721-69778a46e859 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1372 microversion: 2.57 time: 0.352867 Oct 02 01:25:07.267063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2641/5103] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:06 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:07.342245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.359649 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f316efc3-dbca-4f8d-b5fb-252c1a8d6383 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.396356 Oct 02 01:25:07.360246 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2463/5104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:06 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:07.468137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:07.469988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:07.487509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:07.488992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:07.491619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.492849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:07.493661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:07.494990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.915117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.923115 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f041460e-547a-4695-99ce-c5635b68e9e3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1314 microversion: 2.1 time: 0.461503 Oct 02 01:25:07.930496 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2642/5105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:07 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:08.297785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:08.303529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:08.318554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.323187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.325088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.326650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.328339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.329618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.389009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:08.390005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:08.403735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.405994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.406707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.407855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.408555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.409186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.564048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:08.577261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:08.581157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:08.586553 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-388310ad-51bf-4386-8ead-ce963aa8ff60 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1357 microversion: 2.57 time: 0.290706 Oct 02 01:25:08.601136 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2464/5106] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:08 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:08.621545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:08.622084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:08.636127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.637168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.637885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.638848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.639475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.640118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.674758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:25:08.729450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:08.739279 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad4ec598-3bb7-4b87-801a-acaa45ee138c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.357182 Oct 02 01:25:08.750484 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2643/5107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:08 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:08.818243 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-646f601d-a6c4-4e99-b809-656447e739c9 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 204 len: 0 microversion: 2.57 time: 0.202024 Oct 02 01:25:08.820679 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2465/5108] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:25:08 2022] DELETE /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:25:08.828401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:08.829053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:08.837324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.837814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.838267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.838991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.839448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.839869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.950498 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:08.951559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:08.970145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.970584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.972096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.973447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.973924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.985225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.130748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:09.160242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:09.177571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:09.181079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b8495b6-477b-4b18-b641-fcb08b2ee59a tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1363 microversion: 2.57 time: 0.356891 Oct 02 01:25:09.184198 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2644/5109] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:08 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:09.311017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:09.331266 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a989eee5-64da-4542-a1ef-aebd86276461 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1499 microversion: 2.1 time: 0.384646 Oct 02 01:25:09.333875 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2466/5110] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:08 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1499 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:09.356853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:09.359385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:09.371089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.374770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.375425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.376167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.376629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.377057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.449399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lazy-loading 'flavor' on Instance uuid 5e699a53-6928-480a-935a-581b04a117a5 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:25:09.618778 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f34223a3-2508-496b-b228-514b2ed77671 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "POST /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5/action" status: 200 len: 32 microversion: 2.1 time: 0.266115 Oct 02 01:25:09.619670 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2645/5111] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:25:09 2022] POST /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:25:09.629803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:09.630867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:09.645848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.646587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.647087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.648058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.648518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.648944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.789068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:09.789068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:09.804161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.804659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.809380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.810149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.810631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.815036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.437466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.447150 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-090230ab-86ab-44f8-bea9-fd49cd36ef90 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.821760 Oct 02 01:25:10.460845 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2467/5112] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:09 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:10.478933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1320390469", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f231159f-832c-40c6-b7e8-23936037e5a1"}], "security_groups": [{"name": "tempest-securitygroup--1068913650"}], "key_name": "tempest-keypair-1924298514", "user_data": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:10.527735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.543723 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78313bcc-3f80-4c98-b174-4b67ba702d95 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.770309 Oct 02 01:25:10.545751 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2646/5113] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:09 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:10.555128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:10.556223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:10.576428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:10.577244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:10.577679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.578410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:10.578860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:10.579286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.729124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.744596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.758001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.760967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45c9e1ea-9d9b-46a1-8772-56d4fdebc57f tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1363 microversion: 2.57 time: 0.214024 Oct 02 01:25:10.762151 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2647/5114] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:10 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:11.037998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] validate_networks() for [('f231159f-832c-40c6-b7e8-23936037e5a1', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:25:11.489578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:11.504576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:11.524368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:11.524970 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:11.530288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:11.532066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:11.534430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:11.535945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.088910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.097528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-552ba5fa-3e41-41c7-90f8-bc1faed9ba62 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.613377 Oct 02 01:25:12.107887 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2648/5115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:11 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:12.120230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:12.120869 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:12.130626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.131121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.131565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.132281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.132734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.133166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.513153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:25:12.515155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:25:12.516595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:25:12.518999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:25:12.519142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.522402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:25:12.528427 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e6bad863-b3b2-4a88-9df9-55867cb3cfa3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.419170 Oct 02 01:25:12.529038 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2649/5116] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:12 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:12.544336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:12.551200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:12.566818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.567450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.567897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.577570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.578098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.579100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.584460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.589024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.589855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.597206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.598439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.599706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.648791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for project e8ab6dbed6cd4a09989164757910b06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:25:12.674472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Getting quotas for user fe1fa0967b8444279e5bad164b635df5 and project e8ab6dbed6cd4a09989164757910b06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:25:12.694067 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:12.757529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:25:12.763280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:25:12.795779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.808956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.810429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.818803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2deaa4b5-d130-4355-b813-9efaa074df75 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1363 microversion: 2.57 time: 0.281700 Oct 02 01:25:12.819796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2650/5117] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:12 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:12.897980 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e4e4572-c900-4575-8430-d619b1ffc74a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.435569 Oct 02 01:25:12.905245 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2468/5118] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:25:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:25:12.911880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b00db6d0-175d-4736-a47f-51d8d99c48e2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:12.914171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b00db6d0-175d-4736-a47f-51d8d99c48e2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:13.089148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b00db6d0-175d-4736-a47f-51d8d99c48e2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:13.107017 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b00db6d0-175d-4736-a47f-51d8d99c48e2 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1238 microversion: 2.1 time: 0.200271 Oct 02 01:25:13.112750 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2651/5119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:12 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1238 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:13.142442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:13.143260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:13.155769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.156447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.157132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.158994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.161057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.163429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.552651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:13.553160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:13.584388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:13.585030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.588858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.591751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.594946 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c98a59e1-2cdd-4a64-b0bf-c28c3dc9eb1c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.464584 Oct 02 01:25:13.596013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.599765 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2469/5120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:13 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:13.600671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.602762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.854372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:13.855008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:13.874994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.876467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.878712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.885244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.886203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.887729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.976383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:13.993072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.998326 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9150d713-575d-43b3-95e6-a6c4a1ab2bce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.445335 Oct 02 01:25:14.002089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.004680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.020614 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2652/5121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:13 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:14.022554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lazy-loading 'fault' on Instance uuid d2941523-95b8-4ba7-8fbf-5a55ce7ae53b {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:25:14.081137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:14.092026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:14.093842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c17addef0664acbacdf877431d73888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0540166c8146a9b853f288bc048b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:14.095228 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b822b8d1-089d-4de0-aae4-e9a8e81b26a4 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 200 len: 1368 microversion: 2.57 time: 0.246799 Oct 02 01:25:14.107594 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2470/5122] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:13 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:25:14.140824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:14.141893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:14.165447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.166838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.170976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.172212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.178567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.180027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.331079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:14.343344 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e99eb91-8fde-4545-b973-5815fe8c734a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1234 microversion: 2.1 time: 0.208143 Oct 02 01:25:14.367059 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2653/5123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:14 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1234 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:14.623889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:14.624328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:14.639129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.639633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.640075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.640793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.641440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.641886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.921313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:14.934706 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99b24c4a-0201-4803-b82e-456e9d50e255 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.314856 Oct 02 01:25:14.936743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2471/5124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:14 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:15.035131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:15.036765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:15.055674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.056476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.057363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.058266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.059102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.059573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.124665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:15.125297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] [instance: d2941523-95b8-4ba7-8fbf-5a55ce7ae53b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:15.137414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.137831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.138279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.139035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.141896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.144892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.181661 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] HTTP exception thrown: Instance d2941523-95b8-4ba7-8fbf-5a55ce7ae53b could not be found. Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Request method failure captured: Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b HTTP/1.1 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhLiz8WdJ11n5NlV6UFWdVq8iJ0crba4SvNxpbTcgiXoD7mBDjY7MxDvkG255EYCBQusd__F2GLkiGQyMK7mAn2KKEWBqE75r2H7pqBDwxYHp6_BamsvUa92Q-49BDLcgpM_CtoVC2q60mwu0UyK6Brww2J1UT2tYHZYTOVL_cGDu8 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.57 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 6d0540166c8146a9b853f288bc048b63 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerShowV257Test-1884119879 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6d0540166c8146a9b853f288bc048b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6d0540166c8146a9b853f288bc048b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6d0540166c8146a9b853f288bc048b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6d0540166c8146a9b853f288bc048b63"}]}] Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerShowV257Test-1884119879 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 6d0540166c8146a9b853f288bc048b63 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerShowV257Test-1884119879 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerShowV257Test-1884119879-project Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7c17addef0664acbacdf877431d73888 Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerShowV257Test-1884119879-project Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d2941523-95b8-4ba7-8fbf-5a55ce7ae53b could not be found. Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd2941523-95b8-4ba7-8fbf-5a55ce7ae53b'} Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2941523-95b8-4ba7-8fbf-5a55ce7ae53b could not be found. Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2941523-95b8-4ba7-8fbf-5a55ce7ae53b could not be found. Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:15.186211 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2941523-95b8-4ba7-8fbf-5a55ce7ae53b could not be found. Oct 02 01:25:15.190814 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:15.195295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] Returning 404 to user: Instance d2941523-95b8-4ba7-8fbf-5a55ce7ae53b could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:15.196597 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7060e95-4aeb-44cb-b37d-e3f8eaf8dca7 tempest-ServerShowV257Test-1884119879 tempest-ServerShowV257Test-1884119879-project] 10.222.0.23 "GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b" status: 404 len: 111 microversion: 2.57 time: 0.076912 Oct 02 01:25:15.203412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2472/5125] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:25:15 2022] GET /compute/v2.1/servers/d2941523-95b8-4ba7-8fbf-5a55ce7ae53b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:25:15.371152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:15.371863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:15.387692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.390835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.392398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.400620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.401276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.402717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.639756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:15.651653 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfce1f08-5c43-4212-9b5b-86bf06b59e49 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1296 microversion: 2.1 time: 0.285681 Oct 02 01:25:15.675260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2473/5126] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:15 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1296 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:15.700184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:15.711867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e1ea7d3-36fd-4334-adf7-0c55a02de933 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.688323 Oct 02 01:25:15.718475 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2654/5127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:15 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:15.964556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:15.965531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:15.974757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.977698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.978355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.980640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.983606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.984411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.539841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:16.554691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa31376c-822c-4496-8e9b-1734a5f7e473 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.597780 Oct 02 01:25:16.557793 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2474/5128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:15 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:16.699054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:16.699757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:16.718756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.719477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.721254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.724164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.724618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.726433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.742720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:16.744041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:16.753293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.765135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.765942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.767396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.768166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.768773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.333951 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:17.338012 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:17.349251 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a549d9d6-d9a6-4276-ba3a-3f8b5d613983 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.663264 Oct 02 01:25:17.352490 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2655/5129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:16 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:17.366969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:17.378159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96314377-3a86-476a-a879-1b6beeba59c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.640417 Oct 02 01:25:17.379592 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2475/5130] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:16 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:17.593485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:17.595598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:17.642481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.643173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.644962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.646045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.652276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.656253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.899289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f76b77cc-6708-4492-abf5-7d92f2244562 req-5f0a873b-4583-473f-aea4-f1ab4e944045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96486de-fc69-42c7-a62e-00eb5168b457", "name": "network-vif-plugged", "status": "completed", "tag": "8bdae8b4-9693-43bf-a3f9-b140a3ffeda5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:17.925941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f76b77cc-6708-4492-abf5-7d92f2244562 req-5f0a873b-4583-473f-aea4-f1ab4e944045 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.926543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f76b77cc-6708-4492-abf5-7d92f2244562 req-5f0a873b-4583-473f-aea4-f1ab4e944045 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.927040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f76b77cc-6708-4492-abf5-7d92f2244562 req-5f0a873b-4583-473f-aea4-f1ab4e944045 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.946640 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f76b77cc-6708-4492-abf5-7d92f2244562 req-5f0a873b-4583-473f-aea4-f1ab4e944045 service nova] Creating event network-vif-plugged:8bdae8b4-9693-43bf-a3f9-b140a3ffeda5 for instance f96486de-fc69-42c7-a62e-00eb5168b457 on n-h1-master-1 Oct 02 01:25:17.964675 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f76b77cc-6708-4492-abf5-7d92f2244562 req-5f0a873b-4583-473f-aea4-f1ab4e944045 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070537 Oct 02 01:25:17.967367 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2476/5131] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:25:18.045949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:18.060455 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-69594aa9-f682-461f-a57e-79e5f1767917 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.479164 Oct 02 01:25:18.065083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2656/5132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:17 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:18.378089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:18.379821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:18.392297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.394474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.397734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.398500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.399779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.401127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.406701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:18.407340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:18.420380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.420883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.424667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.431504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.434566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.435982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.906288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:18.919625 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1bc8d172-6f9e-48ee-ba9b-f9bea5027d3a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.516159 Oct 02 01:25:18.920475 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2657/5133] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:18 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:18.964231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:18.978212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5257c54-ab0e-4c6a-8e8a-be9a348998bd tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.605616 Oct 02 01:25:18.987295 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2477/5134] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:18 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:19.093850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:19.093850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:19.107202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.108596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.109062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:19.109799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.110270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.110768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:19.177561 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-07d729e2-5d77-4d97-842f-2e9f58fef71d req-6e3b15db-b47a-4140-979b-9e493dd36544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1a5d10-4ddb-4ea5-a54d-d88b4f919135", "tag": "54bd3ddf-9613-46df-bbba-d5b6ba44bbd2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:19.199011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-07d729e2-5d77-4d97-842f-2e9f58fef71d req-6e3b15db-b47a-4140-979b-9e493dd36544 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.201815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-07d729e2-5d77-4d97-842f-2e9f58fef71d req-6e3b15db-b47a-4140-979b-9e493dd36544 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.202473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-07d729e2-5d77-4d97-842f-2e9f58fef71d req-6e3b15db-b47a-4140-979b-9e493dd36544 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:19.236959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-07d729e2-5d77-4d97-842f-2e9f58fef71d req-6e3b15db-b47a-4140-979b-9e493dd36544 service nova] Creating event network-changed:54bd3ddf-9613-46df-bbba-d5b6ba44bbd2 for instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 on n-h2-master-1 Oct 02 01:25:19.250405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-07d729e2-5d77-4d97-842f-2e9f58fef71d req-6e3b15db-b47a-4140-979b-9e493dd36544 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076880 Oct 02 01:25:19.251924 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2478/5135] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:19.584272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:19.600079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56d7ae84-4284-4c38-bc17-50048cdc64fa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.512311 Oct 02 01:25:19.611032 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2658/5136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:19 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:19.948235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:19.950162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:19.981073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.982293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.983008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:19.984029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.984728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.985781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.010037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:20.010677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:20.022074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.022584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.023046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.023760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.024217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.024648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.764479 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:20.769973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:20.789004 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-acaddaba-1f32-475e-a4c0-14b9ca8b79d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1316 microversion: 2.1 time: 0.844754 Oct 02 01:25:20.790851 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e68c911f-daf1-4b0b-8d8a-5a8987afcd25 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.782347 Oct 02 01:25:20.791939 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2479/5137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:19 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:20.794680 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2659/5138] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:20 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:20.798400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:20.799441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:20.817749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.818718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.822040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.823184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.823514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.823941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.833279 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:21.224619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:21.236984 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2372a01e-aa17-4acb-ae0b-ad2ad47c5df3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.443184 Oct 02 01:25:21.240761 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2480/5139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:20 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:21.813149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:21.813877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:21.821213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:21.822121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:21.831030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.832322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.833090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.834468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.835256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.836238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.837597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.841911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.845946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.846563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.854806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.857652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.491445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:22.505588 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25da28b7-b688-4ac5-bd0a-26eab954e213 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.684622 Oct 02 01:25:22.506367 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2481/5140] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:21 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:22.520423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:22.521268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:22.542250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:22.542799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:22.543230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.543950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:22.544406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:22.544839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.615563 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:22.713968 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:22.863235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:22.876439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8be150b6-fcf2-4914-a4a8-d4bb70a9bea6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.064994 Oct 02 01:25:22.893949 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2660/5141] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:21 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:23.148229 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:23.155295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-973139182", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:23.250311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:23.259784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8f86407-b41a-49fd-8632-4be10059ac7d tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.751987 Oct 02 01:25:23.261605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2482/5142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:22 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:23.277517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] validate_networks() for [('1ff916bd-12e6-4293-adde-bfdeed6c5886', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:25:23.529345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:23.530773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:23.544893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:23.550688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:23.551483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:23.552462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:23.553150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:23.553803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.062382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:24.076747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1aa215bc-0955-47d7-b8ee-9b745b87617d tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.551169 Oct 02 01:25:24.079558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2483/5143] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:23 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:24.297688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:24.299463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:24.313570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.314887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.316083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.317608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.318570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.319979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.541900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:25:24.542432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:25:24.543175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:25:24.543740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:25:24.544255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:25:24.564742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.565716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.566658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.567652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.571389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.572137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.625045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Getting quotas for project ca7d49167f014e31841f231f94b43e60. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:25:24.642702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Getting quotas for user a003e4392e9c4aa587573cb1dfa605e0 and project ca7d49167f014e31841f231f94b43e60. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:25:24.688011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:25:24.696122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:25:24.768563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:24.779316 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2ca6629-043a-489d-ae2f-4b2a3d383795 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.493888 Oct 02 01:25:24.786236 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2484/5144] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:24 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:24.800557 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-816d6f9e-bd7b-4fda-9512-78ad6b4a8938 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648695 Oct 02 01:25:24.810499 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2661/5145] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:25:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:25:24.813863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9deec976-6f9e-4895-9b04-8de9f2c1780a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:24.814591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9deec976-6f9e-4895-9b04-8de9f2c1780a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:24.977286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9deec976-6f9e-4895-9b04-8de9f2c1780a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:24.995422 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9deec976-6f9e-4895-9b04-8de9f2c1780a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1216 microversion: 2.1 time: 0.185666 Oct 02 01:25:24.996129 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2485/5146] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:24 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:25.102960 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:25.103589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:25.121056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:25.121571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:25.122014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:25.126861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:25.127480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:25.127869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:25.619763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:25.628923 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-67565a2a-5308-483d-a0df-3387e6c4832f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.530203 Oct 02 01:25:25.641624 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2662/5147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:25 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:25.813651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:25.814339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:25.837241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:25.838019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:25.838660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:25.841068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:25.841711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:25.843699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:26.028719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:26.029880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:26.061882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:26.071827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:26.073909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:26.074872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:26.079232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:26.080534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.055655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:27.071745 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a564fc50-7fad-4fd2-b5d8-5ed561b22a13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1212 microversion: 2.1 time: 1.050390 Oct 02 01:25:27.075326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2663/5148] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:26 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1212 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:27.087597 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:27.088898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:27.104936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:27.105800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:27.106431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.107355 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:27.111273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:27.111981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.167707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:27.197362 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0447dcf6-a85d-4e6a-bba9-ccaa34a611a2 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 1.386713 Oct 02 01:25:27.200250 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2486/5149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:25 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:27.734487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:27.746586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b3b2cba-f998-4dc3-a7ce-4c73b5b0d3e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.669831 Oct 02 01:25:27.751306 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2664/5150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:27 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:28.112072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:28.115156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:28.152408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.153087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.153553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.158200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.161871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.162432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.225229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:28.226141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:28.242410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.264835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.265550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.283718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.289602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.290110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.340902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:29.358927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7629290-3863-4977-8d15-abcbd18c5059 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 1.257903 Oct 02 01:25:29.360124 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2487/5151] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:28 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:29.375504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:29.376490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:29.400482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:29.401803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:29.402655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.407025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:29.423727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:29.427109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.533168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:29.547350 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f0c49f3f-6509-4087-9fd7-273a52382338 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 1.327479 Oct 02 01:25:29.547950 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2665/5152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:28 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:30.250833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:30.262430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8b9a609-4724-41f3-8b71-9fa6513ba4b3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.898836 Oct 02 01:25:30.272455 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2488/5153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:29 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:30.392912 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:30.395228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:30.419132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:30.423236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:30.426475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:30.429429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:30.434590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:30.436655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:30.575999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:30.576566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:30.591834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:30.595500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:30.596149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:30.597004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:30.597459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:30.604773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.527755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:31.541677 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78f5f450-d262-4723-986e-238cfeb219b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 1.157937 Oct 02 01:25:31.552037 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2666/5154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:30 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:31.564079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-bf515ae9-7e27-4e14-8285-05ecd7f78f8a req-b7e1d6c5-4b51-4535-851b-a6c5fcb0e1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74a644f-49af-425a-ad6f-927d4f1e19da", "tag": "0d3d2205-b7c1-45fd-bfb1-a7e91602ba42"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:31.593728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bf515ae9-7e27-4e14-8285-05ecd7f78f8a req-b7e1d6c5-4b51-4535-851b-a6c5fcb0e1d8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.597654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bf515ae9-7e27-4e14-8285-05ecd7f78f8a req-b7e1d6c5-4b51-4535-851b-a6c5fcb0e1d8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.598128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bf515ae9-7e27-4e14-8285-05ecd7f78f8a req-b7e1d6c5-4b51-4535-851b-a6c5fcb0e1d8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.598912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:31.611517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4dedb7c8-3816-45d3-9587-7a96f5612cc6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 1.040401 Oct 02 01:25:31.617445 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2489/5155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:30 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:31.622639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:31.626943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:31.640439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.646085 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-bf515ae9-7e27-4e14-8285-05ecd7f78f8a req-b7e1d6c5-4b51-4535-851b-a6c5fcb0e1d8 service nova] Creating event network-changed:0d3d2205-b7c1-45fd-bfb1-a7e91602ba42 for instance e74a644f-49af-425a-ad6f-927d4f1e19da on n-h1-master-1 Oct 02 01:25:31.652566 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-bf515ae9-7e27-4e14-8285-05ecd7f78f8a req-b7e1d6c5-4b51-4535-851b-a6c5fcb0e1d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098993 Oct 02 01:25:31.653770 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2667/5156] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:31.654935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.656591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.661291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.664561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.665133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.062547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:32.071059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5193f85d-be9c-4893-8894-aabfad406b9a tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.452015 Oct 02 01:25:32.075019 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2490/5157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:31 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:32.575818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:32.579418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:32.592906 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:32.595642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.597173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.598013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.599647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.600718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.602714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.641301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:32.642493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:32.661666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.662351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.663166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.664047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.664615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.665146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.872585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:32.884399 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-958e63b4-d79c-4657-8e8e-aef05debc698 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 0.313319 Oct 02 01:25:32.888781 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2668/5158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:32 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:32.983482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:32.995700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a9f0d742-f6d1-4f52-aa00-35778c6ed6aa tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.355785 Oct 02 01:25:32.996926 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2491/5159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:32 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:33.072975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-3c90ccba-e88f-4e00-b108-4a3017847e57 req-4c140097-fa05-4656-aafc-8137b4517d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1a5d10-4ddb-4ea5-a54d-d88b4f919135", "name": "network-vif-plugged", "status": "completed", "tag": "54bd3ddf-9613-46df-bbba-d5b6ba44bbd2"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:33.104374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:33.104374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:33.109771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.116799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.120293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.121864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.122755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3c90ccba-e88f-4e00-b108-4a3017847e57 req-4c140097-fa05-4656-aafc-8137b4517d23 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.128046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.128618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3c90ccba-e88f-4e00-b108-4a3017847e57 req-4c140097-fa05-4656-aafc-8137b4517d23 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.130160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.130848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3c90ccba-e88f-4e00-b108-4a3017847e57 req-4c140097-fa05-4656-aafc-8137b4517d23 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.171506 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-3c90ccba-e88f-4e00-b108-4a3017847e57 req-4c140097-fa05-4656-aafc-8137b4517d23 service nova] Creating event network-vif-plugged:54bd3ddf-9613-46df-bbba-d5b6ba44bbd2 for instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 on n-h2-master-1 Oct 02 01:25:33.220657 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-3c90ccba-e88f-4e00-b108-4a3017847e57 req-4c140097-fa05-4656-aafc-8137b4517d23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160880 Oct 02 01:25:33.222573 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2669/5160] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:33.446757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:33.455627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.356946 Oct 02 01:25:33.456326 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2492/5161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:33 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:33.917510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:33.919153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:33.925972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:33.927719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2276e4fb-7a07-45b6-b660-fde8b0582855 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003212 Oct 02 01:25:33.929109 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2493/5162] 10.222.0.23 () {56 vars in 886 bytes} [Sun Oct 2 01:25:33 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 02 01:25:33.934140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.935494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.936180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.941429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.942473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.943185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.031905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:34.047783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:34.060630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.061358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.062019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.062993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.063693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.064604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.601466 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:34.666219 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:34.739104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:34.746538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:34.751967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9506c06-7e74-4ece-b464-3c7c2e5d9924 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 0.843647 Oct 02 01:25:34.755515 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2670/5163] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:33 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:34.771441 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a513fc64-4a82-4e91-a694-3f15cc4ac6ff tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.749647 Oct 02 01:25:34.772049 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2494/5164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:34 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:34.793385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:34.797370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:34.836306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.838284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.847211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.848620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.849309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.849942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:35.176140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:35.197283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ea0efa4-0281-4719-8982-22e093544062 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1364 microversion: 2.1 time: 0.438728 Oct 02 01:25:35.218572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2671/5165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:34 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:35.776661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:35.777910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:35.779782 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:35.794492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:35.795017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:35.795464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:35.796179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:35.798234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:35.798966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:35.809533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:35.812020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:35.822890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:35.823933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:35.824537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:35.826402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:35.827675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:35.829388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.168487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:36.189669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:36.192837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ec29fba-75ea-4b9c-8e76-1c66a641c52b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 0.420198 Oct 02 01:25:36.193628 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2495/5166] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:35 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:36.200011 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bb270b6f-1aa5-4ee8-bc20-487cab8587be tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.405062 Oct 02 01:25:36.210650 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2672/5167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:35 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:36.225412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:36.226291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:36.232733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.233288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.233813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.234584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.235878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.237091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.466362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:36.480917 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af4ec5c9-79d4-48ce-8ec9-3e88f2953dba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1550 microversion: 2.1 time: 0.254359 Oct 02 01:25:36.481738 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2496/5168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:36 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1550 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:36.504609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:36.505573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:36.512178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.512909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.513534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.514428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.515086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.515685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.611821 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9cfdf95a-a1a8-475b-9f7d-cba354eb95c9 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111995 Oct 02 01:25:36.614234 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2673/5169] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:25:36 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:37.216080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:37.217350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:37.225851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:37.227147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:37.236613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.237514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.238134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.239104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.239745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.240345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.241140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.241853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.242560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.244015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.244558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.245064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:38.362745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:38.373098 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6970646d-8e23-407c-a41f-317f84460459 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 1.160723 Oct 02 01:25:38.373709 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2497/5170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:37 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:38.374297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:38.381727 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:38.389238 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1da987bc-9e80-46a7-89a7-5f299076e1fd tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 1.167703 Oct 02 01:25:38.394781 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2674/5171] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:37 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:39.234516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-eaaf7569-1038-4095-b686-cdc869098f44 req-542c2375-14d2-4f3a-8af5-33de39901377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1a5d10-4ddb-4ea5-a54d-d88b4f919135", "tag": "54bd3ddf-9613-46df-bbba-d5b6ba44bbd2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:39.266379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-eaaf7569-1038-4095-b686-cdc869098f44 req-542c2375-14d2-4f3a-8af5-33de39901377 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.272078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-eaaf7569-1038-4095-b686-cdc869098f44 req-542c2375-14d2-4f3a-8af5-33de39901377 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.272078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-eaaf7569-1038-4095-b686-cdc869098f44 req-542c2375-14d2-4f3a-8af5-33de39901377 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.307239 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-eaaf7569-1038-4095-b686-cdc869098f44 req-542c2375-14d2-4f3a-8af5-33de39901377 service nova] Creating event network-changed:54bd3ddf-9613-46df-bbba-d5b6ba44bbd2 for instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 on n-h2-master-1 Oct 02 01:25:39.345222 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-eaaf7569-1038-4095-b686-cdc869098f44 req-542c2375-14d2-4f3a-8af5-33de39901377 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114568 Oct 02 01:25:39.351464 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2498/5172] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:39.396656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:39.397338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:39.418471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:39.419511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:39.427881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.429385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.429879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.430683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.431118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.431514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.436967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.443202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.446930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.450356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.450878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.456396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.551675 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:40.460588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:40.468742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48e4827f-f065-4cdd-be9d-9b844b4f71ca tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 1.055382 Oct 02 01:25:40.474975 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2499/5173] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:39 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:40.479819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2bf39ea7-73a7-4328-b925-af6bfa2f78ae req-c4d19ece-d924-4f82-aa06-38cd7056b878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74a644f-49af-425a-ad6f-927d4f1e19da", "name": "network-vif-plugged", "status": "completed", "tag": "0d3d2205-b7c1-45fd-bfb1-a7e91602ba42"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:40.493319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:40.504966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e693e26b-38bc-400d-98b2-0f574f1be901 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 1.113628 Oct 02 01:25:40.509063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2675/5174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:39 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:40.520368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2bf39ea7-73a7-4328-b925-af6bfa2f78ae req-c4d19ece-d924-4f82-aa06-38cd7056b878 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:40.521133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2bf39ea7-73a7-4328-b925-af6bfa2f78ae req-c4d19ece-d924-4f82-aa06-38cd7056b878 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:40.521714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2bf39ea7-73a7-4328-b925-af6bfa2f78ae req-c4d19ece-d924-4f82-aa06-38cd7056b878 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:40.555632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2bf39ea7-73a7-4328-b925-af6bfa2f78ae req-c4d19ece-d924-4f82-aa06-38cd7056b878 service nova] Creating event network-vif-plugged:0d3d2205-b7c1-45fd-bfb1-a7e91602ba42 for instance e74a644f-49af-425a-ad6f-927d4f1e19da on n-h1-master-1 Oct 02 01:25:40.561489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2bf39ea7-73a7-4328-b925-af6bfa2f78ae req-c4d19ece-d924-4f82-aa06-38cd7056b878 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085197 Oct 02 01:25:40.562708 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2500/5175] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:41.497466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:41.497466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:41.509451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.509927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.510382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.515964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.515964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.515964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.535401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:41.536529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:41.549133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.549626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.550067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.564724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.566436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.570322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.989415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:42.001120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:42.004183 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6058e40d-facf-4b55-85ed-4adfeec869d6 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1485 microversion: 2.1 time: 0.513405 Oct 02 01:25:42.004890 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2676/5176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:41 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1485 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:42.030607 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:42.033021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:42.048086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83961d26-d459-4463-9d98-7e91b7f94df5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1316 microversion: 2.1 time: 0.514246 Oct 02 01:25:42.058659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2501/5177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:41 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:42.059513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:42.059513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:42.059513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:42.059513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:42.059513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:42.059513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:42.217531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e5649a7-8a12-4e5b-a365-6c824d5d34ea tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "POST /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5/action" status: 202 len: 0 microversion: 2.1 time: 0.190255 Oct 02 01:25:42.231113 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2677/5178] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:25:42 2022] POST /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:25:42.242282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:42.243762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:42.257629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:42.258126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:42.258566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:42.259305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:42.259764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:42.260188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.077782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:43.079262 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:43.088726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:43.089593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:43.090277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.091269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:43.091993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:43.092649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.638850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:43.655358 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-795ab071-9637-4314-98ed-b1f18aa6147c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1493 microversion: 2.1 time: 1.418972 Oct 02 01:25:43.656314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2502/5179] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:42 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1493 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:43.696050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:43.704491 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-952de48d-b615-4349-b2f8-c51741247e56 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1505 microversion: 2.1 time: 0.630839 Oct 02 01:25:43.705103 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2678/5180] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:43 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:43.731515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:43.732027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:43.756936 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:43.758520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:43.759063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:43.759643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.760371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:43.760936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:43.767520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.814436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:25:44.033053 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ff1a7f9-933d-4417-afdc-b4b26807e47c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 204 len: 0 microversion: 2.1 time: 0.303944 Oct 02 01:25:44.043058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2503/5181] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:25:43 2022] DELETE /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:25:44.055337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:44.056145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:44.088293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:44.092447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:44.094679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:44.095661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:44.097605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:44.098372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:44.605378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:44.616734 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-350a9729-a08f-4654-b2ad-5b86f2b54f71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1511 microversion: 2.1 time: 0.569175 Oct 02 01:25:44.617909 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2679/5182] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:44 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1511 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:44.686141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:44.686899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:44.699961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:44.703057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:44.703712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:44.711733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:44.711733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:44.711733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:45.188552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:45.210800 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af0f2de2-4a10-4fd6-9586-8c7ff5188160 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1493 microversion: 2.1 time: 0.527443 Oct 02 01:25:45.212435 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2504/5183] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:44 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1493 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:45.645700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:45.646932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:45.659604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:45.660236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:45.660790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:45.662727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:45.663540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:45.664295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:46.205935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:46.221831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8f06c308-00e5-4d08-a947-20dafb31b43b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1511 microversion: 2.1 time: 0.580506 Oct 02 01:25:46.236682 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2680/5184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:45 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:46.240536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:46.241487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:46.258295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:46.258840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:46.259346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:46.260062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:46.281259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:46.281921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:46.500980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fed0d373-e7cd-4f99-af3b-3c38c365bb25 req-7fb02ba4-b7ca-4810-9cfa-bb4a1a0a656b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74a644f-49af-425a-ad6f-927d4f1e19da", "name": "network-vif-deleted", "tag": "0d3d2205-b7c1-45fd-bfb1-a7e91602ba42"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:46.539456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fed0d373-e7cd-4f99-af3b-3c38c365bb25 req-7fb02ba4-b7ca-4810-9cfa-bb4a1a0a656b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:46.541631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fed0d373-e7cd-4f99-af3b-3c38c365bb25 req-7fb02ba4-b7ca-4810-9cfa-bb4a1a0a656b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:46.542628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fed0d373-e7cd-4f99-af3b-3c38c365bb25 req-7fb02ba4-b7ca-4810-9cfa-bb4a1a0a656b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:46.573208 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fed0d373-e7cd-4f99-af3b-3c38c365bb25 req-7fb02ba4-b7ca-4810-9cfa-bb4a1a0a656b service nova] Creating event network-vif-deleted:0d3d2205-b7c1-45fd-bfb1-a7e91602ba42 for instance e74a644f-49af-425a-ad6f-927d4f1e19da on n-h1-master-1 Oct 02 01:25:46.580912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fed0d373-e7cd-4f99-af3b-3c38c365bb25 req-7fb02ba4-b7ca-4810-9cfa-bb4a1a0a656b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085150 Oct 02 01:25:46.583435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2681/5185] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:47.052205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:47.077021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0af4661-ed59-4d76-a0ec-f8e025c0f2e9 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1499 microversion: 2.1 time: 0.845653 Oct 02 01:25:47.079753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2505/5186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:46 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1499 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:47.115837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:47.116508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:47.129290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.130711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.133243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.147897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.152435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.154182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.191723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:25:47.252433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:47.254043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:47.265313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.270726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.271667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.273115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.280529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.281208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.354073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.360770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.362553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.363485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lazy-loading 'fault' on Instance uuid e74a644f-49af-425a-ad6f-927d4f1e19da {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:25:47.397294 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-779f257d-ec1a-4985-8646-de74b563ab3c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 204 len: 0 microversion: 2.1 time: 0.286627 Oct 02 01:25:47.398956 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2682/5187] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:25:47 2022] DELETE /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:25:47.412426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:47.415832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:47.430339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.431163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.432317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.434139 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.434841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.439784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.446995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:47.459137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 200 len: 1306 microversion: 2.1 time: 0.210209 Oct 02 01:25:47.459898 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2506/5188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:47 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 1306 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:47.617358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:47.619203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-561c4fc9-a399-4dbf-bae1-c44e62e01b20 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002357 Oct 02 01:25:47.627166 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2507/5189] 10.222.0.23 () {56 vars in 886 bytes} [Sun Oct 2 01:25:47 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 02 01:25:47.719216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:47.740247 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-76a592d4-f57b-472f-8530-2113431b4f74 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.336364 Oct 02 01:25:47.741443 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2683/5190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:47 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:48.419185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:48.419791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:48.435330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.435330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.435330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.435330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.435330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.438768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.491602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:48.495510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:48.509064 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-841ee520-c146-4710-b932-3c29baa3f491 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/ips" status: 200 len: 150 microversion: 2.1 time: 0.441362 Oct 02 01:25:48.516882 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2508/5191] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:25:48 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/ips => generated 150 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:48.518372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.519185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.519368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.521537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.522447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.524006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.548331 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da HTTP/1.1 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: exception: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'e74a644f-49af-425a-ad6f-927d4f1e19da'} Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:48.550656 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:25:48.556156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:48.557888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:48.558974 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0cd5c880-1a99-4037-86a0-d2f8042c31f1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 404 len: 111 microversion: 2.1 time: 0.079572 Oct 02 01:25:48.563298 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2684/5192] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:48 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:25:48.568640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:48.569265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:48.579948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.581146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.581596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.582304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.584048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.584486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.764695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:48.766040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:48.777782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.778374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.779789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.780504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.781252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.781846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:49.065791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:49.075938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95dee370-09df-440f-966f-db66c46ba977 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.511288 Oct 02 01:25:49.077218 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2509/5193] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:48 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:49.217306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ba3712e-7fd6-44da-b3d3-c75e6bfbc967 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ba3712e-7fd6-44da-b3d3-c75e6bfbc967 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 163 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": 12345, "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 12345 Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:25:49.223635 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ba3712e-7fd6-44da-b3d3-c75e6bfbc967 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ba3712e-7fd6-44da-b3d3-c75e6bfbc967 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.012316 Oct 02 01:25:49.228225 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2510/5194] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:25:49 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:25:49.237255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:49.237998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:49.246437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:49.246973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:49.247421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:49.248246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:49.248711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:49.249149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:49.284242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:49.298559 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-369701ee-5aac-4d49-aff8-4900b34d0129 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.538291 Oct 02 01:25:49.300482 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2685/5195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:48 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:49.636466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:49.660786 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76e37c76-41b8-4068-ad12-0f164a02d0f2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.429406 Oct 02 01:25:49.675505 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2511/5196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:49 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:49.688653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:49.691785 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:49.709591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:49.713808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:49.714874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:49.717058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:49.718271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:49.725243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:50.223212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:50.239130 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0a3d49a4-6d37-454b-927d-e12a8bb7032c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.554628 Oct 02 01:25:50.251606 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2686/5197] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:49 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:50.334950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:50.335811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:50.354644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:50.355860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:50.359158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:50.364291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:50.365889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:50.367910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:50.894161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:50.904403 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9670d909-8a6a-47b8-be41-f0d46b15775c tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.578325 Oct 02 01:25:50.905014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2512/5198] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:50 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:51.324643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20d908f2-be4b-403a-803a-98bf08f52496"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:51.327382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:51.344433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:51.344947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:51.345611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:51.351622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:51.352392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:51.353038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:51.849274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-662e6376-0cb6-4b76-82f5-ddfcc70b1f02 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526014 Oct 02 01:25:51.853176 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2687/5199] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:25:51 2022] POST /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:25:51.934695 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:51.936137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:51.945888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:51.946692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:51.947336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:51.948057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:51.949164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:51.951186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:52.388096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:52.396807 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0ded2575-c680-48bd-a693-ee1dea040f66 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1505 microversion: 2.1 time: 0.468210 Oct 02 01:25:52.397730 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2513/5200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:51 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:52.831972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c7c6beda-a1f7-45ac-babc-e627e517b0d0 req-1b950524-b287-4a3d-a2bb-4db237069566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e699a53-6928-480a-935a-581b04a117a5", "name": "network-vif-deleted", "tag": "33e94ecf-e6ae-4aea-96bf-b7da845e3b5c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:52.860215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c7c6beda-a1f7-45ac-babc-e627e517b0d0 req-1b950524-b287-4a3d-a2bb-4db237069566 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:52.860886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c7c6beda-a1f7-45ac-babc-e627e517b0d0 req-1b950524-b287-4a3d-a2bb-4db237069566 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:52.862713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c7c6beda-a1f7-45ac-babc-e627e517b0d0 req-1b950524-b287-4a3d-a2bb-4db237069566 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:52.900112 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c7c6beda-a1f7-45ac-babc-e627e517b0d0 req-1b950524-b287-4a3d-a2bb-4db237069566 service nova] Creating event network-vif-deleted:33e94ecf-e6ae-4aea-96bf-b7da845e3b5c for instance 5e699a53-6928-480a-935a-581b04a117a5 on n-h2-master-1 Oct 02 01:25:52.922497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c7c6beda-a1f7-45ac-babc-e627e517b0d0 req-1b950524-b287-4a3d-a2bb-4db237069566 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095835 Oct 02 01:25:52.923977 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2688/5201] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:25:53.421800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:53.422425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:53.440401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.440758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.441151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.441857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.442313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.442768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.572322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.572816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.573260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.573720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lazy-loading 'fault' on Instance uuid 5e699a53-6928-480a-935a-581b04a117a5 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:25:53.577129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c795f95d-9d19-435e-beef-9c49d3f8f1b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-402272726", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6cf1f716-aa08-4d40-9c44-5ceded711398", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:53.702998 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c795f95d-9d19-435e-beef-9c49d3f8f1b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Block Device 6cf1f716-aa08-4d40-9c44-5ceded711398 is not bootable. Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c795f95d-9d19-435e-beef-9c49d3f8f1b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 357 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-402272726", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6cf1f716-aa08-4d40-9c44-5ceded711398", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: exception: Block Device 6cf1f716-aa08-4d40-9c44-5ceded711398 is not bootable. Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-402272726', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6cf1f716-aa08-4d40-9c44-5ceded711398'}], 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6cf1f716-aa08-4d40-9c44-5ceded711398 is not bootable. Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:25:53.711740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6cf1f716-aa08-4d40-9c44-5ceded711398 is not bootable. Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6cf1f716-aa08-4d40-9c44-5ceded711398 is not bootable. Oct 02 01:25:53.716083 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:53.720107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c795f95d-9d19-435e-beef-9c49d3f8f1b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Block Device 6cf1f716-aa08-4d40-9c44-5ceded711398 is not bootable. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:53.721844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c795f95d-9d19-435e-beef-9c49d3f8f1b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.151111 Oct 02 01:25:53.723637 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2689/5202] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:25:53 2022] POST /compute/v2.1/servers => generated 110 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:25:53.734205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:53.735309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:53.757906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.758588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.760899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.763048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.765163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.766963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.769598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:53.779334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eed57833-1873-4f93-8abd-d73072eccf80 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 200 len: 1304 microversion: 2.1 time: 0.361635 Oct 02 01:25:53.782988 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2514/5203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:53 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 1304 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:53.845874 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:54.238827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:54.248222 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f93a1bab-8887-433a-a511-37c9af93acc0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.520173 Oct 02 01:25:54.259558 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2690/5204] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:53 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:54.278989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:54.279602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:54.294098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.294618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.295074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.295781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.296245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.296673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.809523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:54.810144 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 5e699a53-6928-480a-935a-581b04a117a5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:54.828674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.829183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.829630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.831013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.831952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.832562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.856791 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] HTTP exception thrown: Instance 5e699a53-6928-480a-935a-581b04a117a5 could not be found. Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Request method failure captured: Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 HTTP/1.1 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOgzMss2qkXuodc-NLVPZkjU6uXlJIbz5bLzvy1LaTcfCrwkolMCGZ770ZQYXWDnpoxJOBPHpS-FaK425KeUpeuaDvqv9gmMtRUQ1SLa2CELQ9DPlWsWIU5Zl8t_0WOfGyMMuLY8rGQ0kaUhkQcUzbaDjsvqXLyKw82l1bSDx-7Mm-0 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 084a8da705e0434e8a008ffdd019f6e8 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServerRescueTestJSON-8366430 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/084a8da705e0434e8a008ffdd019f6e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/084a8da705e0434e8a008ffdd019f6e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/084a8da705e0434e8a008ffdd019f6e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_084a8da705e0434e8a008ffdd019f6e8"}]}] Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServerRescueTestJSON-8366430 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 084a8da705e0434e8a008ffdd019f6e8 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServerRescueTestJSON-8366430 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServerRescueTestJSON-8366430-project Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 26e4e60bc26a4d229a85c9990e1730a5 Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServerRescueTestJSON-8366430-project Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 5e699a53-6928-480a-935a-581b04a117a5 could not be found. Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '5e699a53-6928-480a-935a-581b04a117a5'} Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e699a53-6928-480a-935a-581b04a117a5 could not be found. Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e699a53-6928-480a-935a-581b04a117a5 could not be found. Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:54.868494 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e699a53-6928-480a-935a-581b04a117a5 could not be found. Oct 02 01:25:54.873330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:25:54.875152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Returning 404 to user: Instance 5e699a53-6928-480a-935a-581b04a117a5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:54.876304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d4fd476b-1db3-45fe-90fe-2b03636352ce tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5" status: 404 len: 111 microversion: 2.1 time: 0.070915 Oct 02 01:25:54.877540 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2691/5205] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:54 2022] GET /compute/v2.1/servers/5e699a53-6928-480a-935a-581b04a117a5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:25:54.889546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:54.890347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:54.897565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.898398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.899602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.900572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.901256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.901914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.957842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:25:55.025214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:55.053841 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d257164-dfcf-4600-9c8e-3da9e0a54ef0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.771441 Oct 02 01:25:55.054689 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2515/5206] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:54 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:55.159364 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b64c350-55de-428d-943b-ef364502fa33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 204 len: 0 microversion: 2.1 time: 0.271945 Oct 02 01:25:55.163724 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2692/5207] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:25:54 2022] DELETE /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:25:55.172791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:55.172989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:55.190887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:55.191249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:55.196374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:55.198966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:55.201679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:55.202383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:55.665179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:55.671483 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:55.674581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c48bd05a-f9c3-45a3-b0b2-bb7874c536c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1489 microversion: 2.1 time: 0.506032 Oct 02 01:25:55.699456 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2516/5208] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:55 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1489 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:56.706661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:56.707472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:56.741938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:56.742433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:56.757591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:56.762999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:56.763533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:56.767181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:57.935927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:57.956422 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c657952-3362-4214-8720-6df3ac9f43c5 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1489 microversion: 2.1 time: 1.253377 Oct 02 01:25:57.957409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2693/5209] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:56 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1489 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:58.435896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff0d1f33-2800-46fb-8012-6dae80aae14b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-697110356", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d452563b-d97f-4ef2-b927-770421bd0406", "destination_type": "local"}, {"source_type": "volume", "uuid": "8e679e94-4150-4155-bb3a-b97887018b18", "destination_type": "invalid"}], "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff0d1f33-2800-46fb-8012-6dae80aae14b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 494 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-697110356", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d452563b-d97f-4ef2-b927-770421bd0406", "destination_type": "local"}, {"source_type": "volume", "uuid": "8e679e94-4150-4155-bb3a-b97887018b18", "destination_type": "invalid"}], "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-697110356', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd452563b-d97f-4ef2-b927-770421bd0406', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8e679e94-4150-4155-bb3a-b97887018b18', 'destination_type': 'invalid'}], 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi 'invalid' Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:58.440911 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 02 01:25:58.448398 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:25:58.452128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff0d1f33-2800-46fb-8012-6dae80aae14b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:58.454144 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff0d1f33-2800-46fb-8012-6dae80aae14b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022886 Oct 02 01:25:58.465164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:58.465788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:58.465968 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2517/5210] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:25:58 2022] POST /compute/v2.1/servers => generated 155 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:25:58.484060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:58.488486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:58.490041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:58.490848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:58.493358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:58.493825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:58.983072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:58.983694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:59.010628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:59.011505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:59.012148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:59.013076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:59.013709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:59.014340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:59.985663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:59.994809 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:00.004216 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4eb95c4e-2cf3-4929-b6ba-4cfee9cf8da0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.543080 Oct 02 01:26:00.005847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0f8195b-6941-48ea-aa6d-ee4b17ffad33 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1489 microversion: 2.1 time: 1.021801 Oct 02 01:26:00.007166 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2518/5211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:58 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1489 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:00.024262 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2694/5212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:58 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:00.047502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:00.050518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:00.067988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.069648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.070209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:00.071304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.074807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.075408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:00.611900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a1bae6f1-edb9-4c74-8183-2ed816d6f4b8 req-320881c0-08bf-4ee9-b6e8-ceec5c50667e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b", "name": "network-vif-deleted", "tag": "1fac1a5d-4275-48c4-91f0-510625f6ed41"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:00.636785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a1bae6f1-edb9-4c74-8183-2ed816d6f4b8 req-320881c0-08bf-4ee9-b6e8-ceec5c50667e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.638840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a1bae6f1-edb9-4c74-8183-2ed816d6f4b8 req-320881c0-08bf-4ee9-b6e8-ceec5c50667e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.640536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a1bae6f1-edb9-4c74-8183-2ed816d6f4b8 req-320881c0-08bf-4ee9-b6e8-ceec5c50667e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:00.665791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:00.670623 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a1bae6f1-edb9-4c74-8183-2ed816d6f4b8 req-320881c0-08bf-4ee9-b6e8-ceec5c50667e service nova] Creating event network-vif-deleted:1fac1a5d-4275-48c4-91f0-510625f6ed41 for instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b on n-h2-master-1 Oct 02 01:26:00.679320 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a1bae6f1-edb9-4c74-8183-2ed816d6f4b8 req-320881c0-08bf-4ee9-b6e8-ceec5c50667e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070295 Oct 02 01:26:00.680542 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2695/5213] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:00.697958 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dc4347c7-2085-44a2-a35e-30eded2f66a4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.653006 Oct 02 01:26:00.701857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2519/5214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:00 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:00.936212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32c435de-69e2-4152-92d8-2d9cbbdb7c54 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2067486311", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32c435de-69e2-4152-92d8-2d9cbbdb7c54 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 492 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2067486311", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2067486311', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.944676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 02 01:26:00.948132 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:00.950287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-32c435de-69e2-4152-92d8-2d9cbbdb7c54 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:00.950471 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-32c435de-69e2-4152-92d8-2d9cbbdb7c54 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.020487 Oct 02 01:26:00.951626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2696/5215] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:00 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:00.970052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:00.971830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:00.984390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.986772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.987381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:00.990345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.992721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.993171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.034530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:01.043975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:01.068930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.069451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.070039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.070811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.071282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.071934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.137890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.138455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.139105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.139599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lazy-loading 'fault' on Instance uuid 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:01.452958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e4e60bc26a4d229a85c9990e1730a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084a8da705e0434e8a008ffdd019f6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:01.479995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c85eff2d-16f9-4fd7-94ce-d2ac481fc4c3 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 200 len: 1303 microversion: 2.1 time: 0.446876 Oct 02 01:26:01.483354 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2697/5216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:01 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 1303 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:01.759238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:01.769681 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-daeb110d-fe38-4a03-82a1-e9efa4d18b85 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.813809 Oct 02 01:26:01.770529 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2520/5217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:00 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:01.802908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:01.803539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:01.813825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.817579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.818944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.819722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.821540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.821999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:02.402910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:02.423877 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3aea4a54-4bf7-4d08-9c28-c2e48ca8a46c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.626140 Oct 02 01:26:02.442439 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2698/5218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:01 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:02.505577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:02.506201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] [instance: 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:02.519224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:02.519719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:02.520159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:02.520897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:02.521325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:02.521748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:02.585549 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] HTTP exception thrown: Instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b could not be found. Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Request method failure captured: Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b HTTP/1.1 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOgzMss2qkXuodc-NLVPZkjU6uXlJIbz5bLzvy1LaTcfCrwkolMCGZ770ZQYXWDnpoxJOBPHpS-FaK425KeUpeuaDvqv9gmMtRUQ1SLa2CELQ9DPlWsWIU5Zl8t_0WOfGyMMuLY8rGQ0kaUhkQcUzbaDjsvqXLyKw82l1bSDx-7Mm-0 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 084a8da705e0434e8a008ffdd019f6e8 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerRescueTestJSON-8366430 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/084a8da705e0434e8a008ffdd019f6e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/084a8da705e0434e8a008ffdd019f6e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/084a8da705e0434e8a008ffdd019f6e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_084a8da705e0434e8a008ffdd019f6e8"}]}] Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerRescueTestJSON-8366430 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 084a8da705e0434e8a008ffdd019f6e8 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerRescueTestJSON-8366430 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerRescueTestJSON-8366430-project Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 26e4e60bc26a4d229a85c9990e1730a5 Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerRescueTestJSON-8366430-project Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b could not be found. Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b'} Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b could not be found. Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b could not be found. Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:02.598004 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b could not be found. Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] Returning 404 to user: Instance 8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e6a056d-5ef9-403d-b506-ae93517fe862 tempest-ServerRescueTestJSON-8366430 tempest-ServerRescueTestJSON-8366430-project] 10.222.0.23 "GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b" status: 404 len: 111 microversion: 2.1 time: 0.098585 Oct 02 01:26:02.604722 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2521/5219] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:02 2022] GET /compute/v2.1/servers/8993edb5-f7f3-40cb-b9c7-8e0fd9fa4a6b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:02.669932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ab11ad7-b27a-4d86-a264-78f6884f4217 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ab11ad7-b27a-4d86-a264-78f6884f4217 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 416 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.673888 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:02.678088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ab11ad7-b27a-4d86-a264-78f6884f4217 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:02.680694 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ab11ad7-b27a-4d86-a264-78f6884f4217 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012423 Oct 02 01:26:02.680694 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2699/5220] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:02 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:02.687896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:02.688516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:02.703465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:02.703998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:02.704460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:02.712924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:02.713516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:02.714737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:03.112166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:03.124270 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11881be6-ff0f-4320-aa85-ad6472c2dee9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.439114 Oct 02 01:26:03.129399 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2522/5221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:02 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:03.156488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:03.157399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:03.172604 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:03.173952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:03.174565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:03.175566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:03.176565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:03.177271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:03.177937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:03.648402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:03.665241 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5a20c545-b916-47dd-9009-5591e78fdd8e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.511350 Oct 02 01:26:03.670228 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2700/5222] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:03 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:03.903255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02d675a9-a46b-4528-800a-da3d774f74b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1069190710", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": -1, "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:03.917928 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-02d675a9-a46b-4528-800a-da3d774f74b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Flavor -1 could not be found. Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02d675a9-a46b-4528-800a-da3d774f74b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 206 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1069190710", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": -1, "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor -1 could not be found. Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1069190710', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': -1, 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:03.919984 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 02 01:26:03.926062 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:03.933276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02d675a9-a46b-4528-800a-da3d774f74b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:03.934332 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02d675a9-a46b-4528-800a-da3d774f74b8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.035074 Oct 02 01:26:03.937710 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2523/5223] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:03 2022] POST /compute/v2.1/servers => generated 73 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:03.944353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:03.944982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:03.953902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:03.954402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:03.954960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:03.955675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:03.956133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:03.956561 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:04.451121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:04.463754 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c19d395-0ee7-46a2-b5f1-0465b7668ce5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.523862 Oct 02 01:26:04.465168 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2701/5224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:03 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:04.496193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:04.496826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:04.510850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:04.511354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:04.515711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:04.516508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:04.517531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:04.530835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:05.446919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:05.462362 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5b67e48-c825-45f2-8dd2-dd0aef8786d6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.969779 Oct 02 01:26:05.465956 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2524/5225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:04 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:05.650018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a72691cd-3578-4608-8e2c-8288c5f5dddc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1753830146", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a72691cd-3578-4608-8e2c-8288c5f5dddc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 173 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1753830146", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1753830146', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi -1 Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:26:05.659184 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 02 01:26:05.663765 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:05.668530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a72691cd-3578-4608-8e2c-8288c5f5dddc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:05.670630 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a72691cd-3578-4608-8e2c-8288c5f5dddc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.025473 Oct 02 01:26:05.685244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:05.686462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:05.693260 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2702/5226] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:05 2022] POST /compute/v2.1/servers => generated 145 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:05.699510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:05.701146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:05.701915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:05.702905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:05.704764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:05.705483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:06.692648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:06.715284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a44d70ce-f557-4f85-a656-1e3e7b20398f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.038756 Oct 02 01:26:06.722940 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2525/5227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:05 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:06.744159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:06.745849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:06.768403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:06.769427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:06.779290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:06.780797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:06.781495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:06.782172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:06.996142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:07.011672 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-90a4c9a1-4a6c-40ea-a3e5-6c34fb4aad9f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.270927 Oct 02 01:26:07.037978 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2703/5228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:06 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:07.237275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95eb0e7d-5722-4d05-baad-a27a6a068299 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344084137", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:07.242489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-95eb0e7d-5722-4d05-baad-a27a6a068299 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95eb0e7d-5722-4d05-baad-a27a6a068299 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 215 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344084137", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-344084137', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:07.252434 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 02 01:26:07.257661 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:07.260623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95eb0e7d-5722-4d05-baad-a27a6a068299 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:07.261715 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95eb0e7d-5722-4d05-baad-a27a6a068299 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.029094 Oct 02 01:26:07.265398 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2526/5229] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:07 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:07.274038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:07.274669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:07.284849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:07.285349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:07.285791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:07.286512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:07.287013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:07.287427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:07.763066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:07.783714 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de304aa9-8d68-4afb-bdbf-13613f7061e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.511679 Oct 02 01:26:07.784352 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2704/5230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:07 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:07.825003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:07.826470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:07.856385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:07.856746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:07.857356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:07.858000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:07.866337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:07.866924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:08.443897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3409355-49b7-4fc3-9bc7-50f7a81a2338 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'create', calling method: .version_select at 0x7fb880b0b160>, body: {"keypair": {"name": "tempest-keypair-1719319378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9jz/TV4MkGMaGwFz6CBo4RrQXbCSgZOsc/nSpKw2rFtoy6piTWMONbfCPTieu7+VRJJ4JIcHRO7E+wBHKDu40gR4Eew6cLK9gkdkrhwR4awlcl10NXcRMsNPM7800Rvg=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:08.473529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d3409355-49b7-4fc3-9bc7-50f7a81a2338 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for project d9b8b20b7702433486fbb08f8e801d57. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:08.483061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d3409355-49b7-4fc3-9bc7-50f7a81a2338 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for user 116490a90023449a83265db52a0debb1 and project d9b8b20b7702433486fbb08f8e801d57. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:08.541560 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3409355-49b7-4fc3-9bc7-50f7a81a2338 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.796285 Oct 02 01:26:08.542515 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2527/5231] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:26:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 798 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 02 01:26:08.549774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20d908f2-be4b-403a-803a-98bf08f52496"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:08.558544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:08.578683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:08.581249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:08.583779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:08.584677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:08.585155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:08.586760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:08.769533 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Invalid volume: volume 20d908f2-be4b-403a-803a-98bf08f52496 is already attached to instances: 443bec7b-b69b-4575-9feb-edce6851b262 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments HTTP/1.1 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 74 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: {"volumeAttachment": {"volumeId": "20d908f2-be4b-403a-803a-98bf08f52496"}} Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid volume: volume 20d908f2-be4b-403a-803a-98bf08f52496 is already attached to instances: 443bec7b-b69b-4575-9feb-edce6851b262 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '443bec7b-b69b-4575-9feb-edce6851b262', 'body': {'volumeAttachment': {'volumeId': '20d908f2-be4b-403a-803a-98bf08f52496'}}} Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 20d908f2-be4b-403a-803a-98bf08f52496 is already attached to instances: 443bec7b-b69b-4575-9feb-edce6851b262 Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:08.771204 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 20d908f2-be4b-403a-803a-98bf08f52496 is already attached to instances: 443bec7b-b69b-4575-9feb-edce6851b262 Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 20d908f2-be4b-403a-803a-98bf08f52496 is already attached to instances: 443bec7b-b69b-4575-9feb-edce6851b262 Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 400 to user: Invalid volume: volume 20d908f2-be4b-403a-803a-98bf08f52496 is already attached to instances: 443bec7b-b69b-4575-9feb-edce6851b262 {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a31a407c-ddd2-46f6-8f9b-a2115c29abfc tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.228982 Oct 02 01:26:08.776617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2528/5232] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:26:08 2022] POST /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 174 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:08.854851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:08.883900 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9310838-beef-43f3-8a0a-6ff0c7446a0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.072003 Oct 02 01:26:08.888324 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2705/5233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:07 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:08.987742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:08.988511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:08.997602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:08.998358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:08.999823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:09.001040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:09.001880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:09.002584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:09.161138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lazy-loading 'services' on Instance uuid 443bec7b-b69b-4575-9feb-edce6851b262 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:09.302073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4eb53a32-4282-46f2-a937-b9820488191c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments/20d908f2-be4b-403a-803a-98bf08f52496" status: 202 len: 0 microversion: 2.1 time: 0.333853 Oct 02 01:26:09.303491 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2529/5234] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:26:08 2022] DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments/20d908f2-be4b-403a-803a-98bf08f52496 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:26:09.322079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:09.325597 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:09.352966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:09.367934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:09.368714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:09.371937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:09.372868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:09.373664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:09.375385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4909eb6-31d5-401c-a0bc-bfc994883846 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1108657725", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-key-823079123", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:09.441464 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-703cb8a7-cd29-4653-843f-0423034ad995 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132604 Oct 02 01:26:09.442547 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2706/5235] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:09 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:09.510202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-a4909eb6-31d5-401c-a0bc-bfc994883846 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] validate_networks() for [('1ff916bd-12e6-4293-adde-bfdeed6c5886', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:26:10.383551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a4909eb6-31d5-401c-a0bc-bfc994883846 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Invalid key_name provided. Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4909eb6-31d5-401c-a0bc-bfc994883846 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 246 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1108657725", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-key-823079123", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid key_name provided. Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1108657725', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'key_name': 'tempest-key-823079123', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-823079123 not found for user a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:10.385765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4909eb6-31d5-401c-a0bc-bfc994883846 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid key_name provided. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4909eb6-31d5-401c-a0bc-bfc994883846 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.019398 Oct 02 01:26:10.390353 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2530/5236] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:09 2022] POST /compute/v2.1/servers => generated 70 bytes in 1022 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:10.397561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:10.398072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:10.416728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.418846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.420491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.423586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.432229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.432707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.463558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:10.469053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:10.501562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.502152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.503218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.504552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.505241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.506052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.564214 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f3faca6-c06c-43ac-b6b3-11ffbf9007cd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113125 Oct 02 01:26:10.565191 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2531/5237] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:10 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:10.831689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:10.855414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27525a40-11a9-47b8-82e0-a76aee18331b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.462195 Oct 02 01:26:10.857353 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2707/5238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:10 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:10.888473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:10.893676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:10.918762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.919268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.919715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.920436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.927134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.927669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:11.213854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:11.224687 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cbdf3ce2-4cf8-46ca-84ea-ab90d8ec5bec tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.339974 Oct 02 01:26:11.227471 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2532/5239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:10 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:11.519720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85203a83-c7bb-4453-82cf-93d02e25c5a1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-714532172", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:11.816786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.security_group_api [None req-85203a83-c7bb-4453-82cf-93d02e25c5a1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Neutron security group does_not_exist not found {{(pid=122354) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 02 01:26:11.818315 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-85203a83-c7bb-4453-82cf-93d02e25c5a1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85203a83-c7bb-4453-82cf-93d02e25c5a1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 257 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-714532172", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-714532172', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 02 01:26:11.831842 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 02 01:26:11.836806 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:11.845801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85203a83-c7bb-4453-82cf-93d02e25c5a1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:11.846958 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85203a83-c7bb-4453-82cf-93d02e25c5a1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.335304 Oct 02 01:26:11.851826 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2533/5240] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:11 2022] POST /compute/v2.1/servers => generated 106 bytes in 341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:26:11.857124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:11.863928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:11.879564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:11.882946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:11.886088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:11.887176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:11.887833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:11.888444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:11.980960 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c40bde4f-1d5d-40cc-a82e-5e1a8948fac4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127331 Oct 02 01:26:11.989434 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2534/5241] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:11 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:12.004716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:12.010065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:12.029392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:12.031225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:12.033834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:12.034978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:12.035787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:12.036782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:12.227819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-569792602", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:12.383096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:26:12.383532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:26:12.384020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:26:12.384442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:26:12.386943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:26:12.430861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:12.433302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:12.435632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:12.442865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:12.443992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:12.446669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:12.524400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Getting quotas for project 08b504dc949d418fb27c4149a55f669e. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:12.541424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Getting quotas for user b2ffde89d3704dd68bdb30ac4ad3ff53 and project 08b504dc949d418fb27c4149a55f669e. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:12.566856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:26:12.570789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:26:12.697458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad4c427a-51f7-47d5-9fd0-b25be1c413f7 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.288789 Oct 02 01:26:12.699695 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2708/5242] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:26:12.733787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bddd8d06-738f-403c-9143-ca300ac7fd0e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:12.734645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bddd8d06-738f-403c-9143-ca300ac7fd0e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:13.098337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bddd8d06-738f-403c-9143-ca300ac7fd0e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:13.108229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:13.130122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bddd8d06-738f-403c-9143-ca300ac7fd0e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:13.131898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d069a3a5-b0de-410c-8f9e-3391160dc2e7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.133449 Oct 02 01:26:13.132512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bddd8d06-738f-403c-9143-ca300ac7fd0e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:13.133592 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2535/5243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:11 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:13.134304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bddd8d06-738f-403c-9143-ca300ac7fd0e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51" status: 200 len: 1277 microversion: 2.47 time: 0.421485 Oct 02 01:26:13.136117 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2709/5244] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:12 2022] GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 => generated 1277 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:13.143803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:13.147236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:13.152299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:13.153030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:13.197003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.197921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.198939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.201561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.203579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.205502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.216655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.221034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.222101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.225206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.226448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.228889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.309724 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d09c7306-5187-4b17-bb98-b907c705ac97 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/ips" status: 200 len: 145 microversion: 2.1 time: 0.172619 Oct 02 01:26:13.314068 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2536/5245] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:26:13 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/ips => generated 145 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:13.330644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1055685592", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6333bc5f-8bdd-4ec6-b808-179e141404af"}], "security_groups": [{"name": "tempest-securitygroup--292163976"}], "key_name": "tempest-keypair-1719319378", "user_data": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:13.381452 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c0f33db-ce70-4670-b31f-5a6fc2131cbf tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242946 Oct 02 01:26:13.382889 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2710/5246] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:13 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:13.409883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:13.411603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:13.472029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.474475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.476592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.477216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.483207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.486006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.572387 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:13.661764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] validate_networks() for [('6333bc5f-8bdd-4ec6-b808-179e141404af', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:26:14.188270 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:14.200021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:14.214011 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ea53189-a281-4748-8957-cc191b228a71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.829248 Oct 02 01:26:14.214657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2711/5247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:13 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:14.253669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-950336574", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": "none"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:14.396576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:26:14.397087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:26:14.397651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:26:14.400401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:26:14.401314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:26:14.420794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.426787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.427505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.428634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.429327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.429961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.487824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Getting quotas for project 08b504dc949d418fb27c4149a55f669e. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:14.515001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Getting quotas for user b2ffde89d3704dd68bdb30ac4ad3ff53 and project 08b504dc949d418fb27c4149a55f669e. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:14.549601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:26:14.564822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:26:14.687168 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36ad7ff9-3fa8-409b-bc78-249e07a09976 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.444826 Oct 02 01:26:14.687923 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2712/5248] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:26:14.694253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0fc83bf-5f39-47f7-b97f-4fe1717d04c4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:14.695240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f0fc83bf-5f39-47f7-b97f-4fe1717d04c4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 9d40b3cd-b589-4a62-aa61-d88683829761] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:14.709623 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f0fc83bf-5f39-47f7-b97f-4fe1717d04c4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 9d40b3cd-b589-4a62-aa61-d88683829761 could not be found. Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0fc83bf-5f39-47f7-b97f-4fe1717d04c4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/9d40b3cd-b589-4a62-aa61-d88683829761 HTTP/1.1 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 9d40b3cd-b589-4a62-aa61-d88683829761 could not be found. Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '9d40b3cd-b589-4a62-aa61-d88683829761'} Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d40b3cd-b589-4a62-aa61-d88683829761 could not be found. Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d40b3cd-b589-4a62-aa61-d88683829761 could not be found. Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:14.716500 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d40b3cd-b589-4a62-aa61-d88683829761 could not be found. Oct 02 01:26:14.722366 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:14.724608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0fc83bf-5f39-47f7-b97f-4fe1717d04c4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 9d40b3cd-b589-4a62-aa61-d88683829761 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:14.743769 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f0fc83bf-5f39-47f7-b97f-4fe1717d04c4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9d40b3cd-b589-4a62-aa61-d88683829761" status: 404 len: 111 microversion: 2.1 time: 0.053358 Oct 02 01:26:14.762735 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2713/5249] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:26:14 2022] DELETE /compute/v2.1/servers/9d40b3cd-b589-4a62-aa61-d88683829761 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:14.768555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:14.771898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:26:14.772320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:26:14.773293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:26:14.773705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:26:14.774115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:26:14.776002 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:14.789842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.790337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.794916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.796093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.797797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.799151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.799644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.802232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.812011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.814525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.815298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.817769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.852973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for project d9b8b20b7702433486fbb08f8e801d57. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:14.871078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for user 116490a90023449a83265db52a0debb1 and project d9b8b20b7702433486fbb08f8e801d57. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:14.905714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:26:14.916320 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-94369c82-cf48-4963-a3fb-681f8094daaa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148243 Oct 02 01:26:14.916618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:26:14.921709 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2714/5250] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:14 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:14.941408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b59a2f0-3a77-4506-9774-8f7e8b4d54cb tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:14.949293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b59a2f0-3a77-4506-9774-8f7e8b4d54cb tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.069752 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b59a2f0-3a77-4506-9774-8f7e8b4d54cb tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "PUT /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 991 microversion: 2.47 time: 0.145797 Oct 02 01:26:15.075330 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2715/5251] 10.222.0.23 () {62 vars in 1297 bytes} [Sun Oct 2 01:26:14 2022] PUT /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 991 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:26:15.088587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:15.090214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.107814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.112726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.113652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.115871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.118015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.119912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.204996 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-218a7fdd-89e0-4e0c-b348-fa6902b9a933 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.882425 Oct 02 01:26:15.220027 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2537/5252] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:26:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:26:15.227827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15f77df6-e56a-4a18-8b41-00263202e855 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:15.228446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-15f77df6-e56a-4a18-8b41-00263202e855 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.466960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-15f77df6-e56a-4a18-8b41-00263202e855 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.480448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-15f77df6-e56a-4a18-8b41-00263202e855 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.487465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-15f77df6-e56a-4a18-8b41-00263202e855 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.490992 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-15f77df6-e56a-4a18-8b41-00263202e855 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1277 microversion: 2.47 time: 0.269714 Oct 02 01:26:15.495172 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2538/5253] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:15 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:15.528998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06aeb1c1-46d3-4179-97fe-40b421ece5de tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:15.531202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06aeb1c1-46d3-4179-97fe-40b421ece5de tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.656443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.667150 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8cfd3387-c046-410c-b0b1-3417ce3f5b18 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.590367 Oct 02 01:26:15.685590 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2716/5254] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:15 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:15.713852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:15.715212 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.729383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.730029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.730673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.733539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.735143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.739081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.822881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06aeb1c1-46d3-4179-97fe-40b421ece5de tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.857512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06aeb1c1-46d3-4179-97fe-40b421ece5de tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.858935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06aeb1c1-46d3-4179-97fe-40b421ece5de tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.866830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06aeb1c1-46d3-4179-97fe-40b421ece5de tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1282 microversion: 2.20 time: 0.366307 Oct 02 01:26:15.896543 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2539/5255] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:15 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1282 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:15.934316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:15.936993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.963901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.965980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.966630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.969054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.969752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.971652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.124338 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-106330be-1832-4cf5-9d85-06f340ab5e86 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186249 Oct 02 01:26:16.125610 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2540/5256] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:15 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:16.274427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:16.286782 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d4e16d08-b022-44be-90a1-a436a93115f8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.576866 Oct 02 01:26:16.304116 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2717/5257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:15 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:16.351397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fdd9efa1-82b0-4626-8750-ec44e373c331 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:16.353286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fdd9efa1-82b0-4626-8750-ec44e373c331 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:26:16.356368 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fdd9efa1-82b0-4626-8750-ec44e373c331 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fdd9efa1-82b0-4626-8750-ec44e373c331 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 9223372036854775808 could not be found. Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '9223372036854775808'} Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:16.365205 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:16.371153 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:16.371153 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:16.371153 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:16.371153 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 02 01:26:16.371153 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:16.371153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fdd9efa1-82b0-4626-8750-ec44e373c331 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:16.375042 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fdd9efa1-82b0-4626-8750-ec44e373c331 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.063942 Oct 02 01:26:16.377341 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2541/5258] 10.222.0.23 () {58 vars in 1188 bytes} [Sun Oct 2 01:26:16 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:26:16.390056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:16.391072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:16.405111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.407757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.408565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.410460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.410611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.411533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.529336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:16.530821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:16.569338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.569856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.571601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.575045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.577453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.577883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.742802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:16.758867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:16.763628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:16.767538 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23a4a08c-a12a-42c5-9fe8-b0b5c7a09083 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1273 microversion: 2.47 time: 0.242918 Oct 02 01:26:16.772101 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2542/5259] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:16 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:16.888430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:16.899457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2a27200-4ea5-4a6a-a721-fc5d45a2d105 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:16.900323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2a27200-4ea5-4a6a-a721-fc5d45a2d105 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:16.924412 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c33b963c-e54f-41f4-b1d9-7b5acaa3b55c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.540028 Oct 02 01:26:16.950126 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2718/5260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:16 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:16.969098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:16.970038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:16.986067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.986696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.987529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.989647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.991042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.005392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.088126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2a27200-4ea5-4a6a-a721-fc5d45a2d105 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:17.108104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2a27200-4ea5-4a6a-a721-fc5d45a2d105 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:17.114001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2a27200-4ea5-4a6a-a721-fc5d45a2d105 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:17.115866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2a27200-4ea5-4a6a-a721-fc5d45a2d105 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1282 microversion: 2.20 time: 0.222469 Oct 02 01:26:17.118043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2543/5261] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:16 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:17.138430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:17.141254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:17.156108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.160220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.162882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.165755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.167184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.169224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.213814 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:17.262804 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1082413e-100e-49d2-baa3-438a4b165ecd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127685 Oct 02 01:26:17.264717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2544/5262] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:17 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:26:17.347052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:17.355575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8fdcbf9b-65eb-49a0-8adc-2bccf21ff9f0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.395554 Oct 02 01:26:17.373626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2719/5263] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:16 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:17.380589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6ce567d-74de-472c-938e-26d15d756400 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:17.381375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6ce567d-74de-472c-938e-26d15d756400 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Failed to fetch instance by id -1 {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 02 01:26:17.381911 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f6ce567d-74de-472c-938e-26d15d756400 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance -1 could not be found. Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6ce567d-74de-472c-938e-26d15d756400 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: exception: Instance -1 could not be found. Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '-1'} Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:17.383599 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6ce567d-74de-472c-938e-26d15d756400 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6ce567d-74de-472c-938e-26d15d756400 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008844 Oct 02 01:26:17.390168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2545/5264] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:26:17 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:26:17.395148 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:17.395774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:17.402627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.403151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.403586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.404497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.405128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.405779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.508806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de996026-7253-46fd-9f2a-25731a8319a5"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:17.511847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:17.527278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.528891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.530410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.531519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.532741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.534451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.700942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:17.747117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-891b629c-2658-4f73-b031-4e3c22fe1fbc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.356532 Oct 02 01:26:17.763415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2720/5265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:17 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:17.780490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:17.784782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:17.800157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.801710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.802175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.802935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.808639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.809179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.237211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.247785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a301fc21-e532-4f1f-a783-975983a8cf98 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.473144 Oct 02 01:26:18.269611 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2721/5266] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:17 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:18.276756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:18.283956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:18.296881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.296881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.296881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.300220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.302435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.303173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.414101 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68bd6564-ba84-4294-ae81-2ef9592057e6 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909457 Oct 02 01:26:18.435624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2546/5267] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:26:17 2022] POST /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments => generated 194 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:18.451261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:18.453344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:18.457599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.471167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.471669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.472105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.474396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.476333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.477613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.478323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.481213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.487202 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e70be395-9383-4d7c-93d7-19fe5cb52106 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1335 microversion: 2.47 time: 0.216131 Oct 02 01:26:18.508674 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2722/5268] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:18 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1335 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:18.525129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82523864-4be0-49d8-885e-dcd835005ab7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:18.525601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-82523864-4be0-49d8-885e-dcd835005ab7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 7ec13fcd-4db9-4728-a6e9-6b1735b370bd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:18.546953 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-82523864-4be0-49d8-885e-dcd835005ab7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 7ec13fcd-4db9-4728-a6e9-6b1735b370bd could not be found. Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82523864-4be0-49d8-885e-dcd835005ab7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/7ec13fcd-4db9-4728-a6e9-6b1735b370bd/action HTTP/1.1 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 19 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: {"forceDelete": {}} Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 7ec13fcd-4db9-4728-a6e9-6b1735b370bd could not be found. Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '7ec13fcd-4db9-4728-a6e9-6b1735b370bd', 'body': {'forceDelete': {}}} Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec13fcd-4db9-4728-a6e9-6b1735b370bd could not be found. Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec13fcd-4db9-4728-a6e9-6b1735b370bd could not be found. Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:18.558823 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec13fcd-4db9-4728-a6e9-6b1735b370bd could not be found. Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82523864-4be0-49d8-885e-dcd835005ab7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 7ec13fcd-4db9-4728-a6e9-6b1735b370bd could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82523864-4be0-49d8-885e-dcd835005ab7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/7ec13fcd-4db9-4728-a6e9-6b1735b370bd/action" status: 404 len: 111 microversion: 2.1 time: 0.050033 Oct 02 01:26:18.565352 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2723/5269] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:18 2022] POST /compute/v2.1/servers/7ec13fcd-4db9-4728-a6e9-6b1735b370bd/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:18.567755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:18.572685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:18.590296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.591045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.593624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.596205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.596930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.599347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.667694 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4162d887-cc14-4fe1-a8cf-0c806ad1153e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105191 Oct 02 01:26:18.669835 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2724/5270] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:18 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:18.703101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.717985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.721770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.727216 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20e7c9ad-0b56-4981-ae33-f09668c3e664 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1334 microversion: 2.20 time: 0.287643 Oct 02 01:26:18.731386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2547/5271] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:18 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1334 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:18.755490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:18.756799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:18.764947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.765475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.766219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.768016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:18.769019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:18.769697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.132585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:19.141745 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d07cabfd-4286-47e9-b397-037c5d197d2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.438254 Oct 02 01:26:19.142680 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2725/5272] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:18 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:19.172169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:19.173722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.193688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.194209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.197177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.203761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.205527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.206204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.468668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:19.479340 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f552bd9-fa37-4cdd-ab97-6e12b72dc032 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.311115 Oct 02 01:26:19.479936 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2548/5273] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:19 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:19.509501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9e4f359-2b56-4818-b79c-0b7df5a02579 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:19.513133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9e4f359-2b56-4818-b79c-0b7df5a02579 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 0673077c-5f87-40fa-931f-66c13d5ac334] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.521864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:19.523197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.538726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.539586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.542282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.544441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.544784 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b9e4f359-2b56-4818-b79c-0b7df5a02579 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 0673077c-5f87-40fa-931f-66c13d5ac334 could not be found. Oct 02 01:26:19.545437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.547096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9e4f359-2b56-4818-b79c-0b7df5a02579 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/0673077c-5f87-40fa-931f-66c13d5ac334/action HTTP/1.1 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 39 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: {"os-getConsoleOutput": {"length": 10}} Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0673077c-5f87-40fa-931f-66c13d5ac334 could not be found. Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0673077c-5f87-40fa-931f-66c13d5ac334', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0673077c-5f87-40fa-931f-66c13d5ac334 could not be found. Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0673077c-5f87-40fa-931f-66c13d5ac334 could not be found. Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:19.564391 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:19.569956 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:19.569956 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:19.569956 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:19.569956 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:19.569956 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0673077c-5f87-40fa-931f-66c13d5ac334 could not be found. Oct 02 01:26:19.569956 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:19.571382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9e4f359-2b56-4818-b79c-0b7df5a02579 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 0673077c-5f87-40fa-931f-66c13d5ac334 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:19.572447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9e4f359-2b56-4818-b79c-0b7df5a02579 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/0673077c-5f87-40fa-931f-66c13d5ac334/action" status: 404 len: 111 microversion: 2.1 time: 0.067034 Oct 02 01:26:19.573534 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2726/5274] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:19 2022] POST /compute/v2.1/servers/0673077c-5f87-40fa-931f-66c13d5ac334/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:19.581721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:19.582825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.602050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.602876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.603501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.607099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.607767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.608379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.707685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:19.723617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:19.731648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:19.736916 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f96136e2-3016-4201-b1e0-a5514a536aa3 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1335 microversion: 2.47 time: 0.219357 Oct 02 01:26:19.752902 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2549/5275] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:19 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1335 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:19.781423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:19.791311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.820082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.821141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.823143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.824068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.826433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.827092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.915113 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e09ce18-2c3a-40fc-a7c8-d6114b502baa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149906 Oct 02 01:26:19.916616 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2550/5276] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:19 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:19.928754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:19.929700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.945320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.946429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.947105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.948016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.949367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.950059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.997110 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.009454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95d085c2-199e-4ff4-89dd-097007f3a514 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.432004 Oct 02 01:26:20.019018 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2727/5277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:19 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:20.038452 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.039131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.055296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.055819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.056415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.058058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.059179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.060875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.149628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.164348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.165861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.187476 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96cb9cef-8d5f-4cd2-805b-78bbb8eb8164 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1340 microversion: 2.20 time: 0.247370 Oct 02 01:26:20.193585 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2551/5278] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:19 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1340 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:20.389141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.400178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2663a65b-c82a-4eb9-8389-c0f5f8f25c38 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.365995 Oct 02 01:26:20.401083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2728/5279] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:20.440981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de39697c-52fd-4e4c-b6eb-86c0e942d5a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.442133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de39697c-52fd-4e4c-b6eb-86c0e942d5a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: c14a26fd-3be6-4687-b88e-4ca21efe5905] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.461898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-de39697c-52fd-4e4c-b6eb-86c0e942d5a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance c14a26fd-3be6-4687-b88e-4ca21efe5905 could not be found. Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de39697c-52fd-4e4c-b6eb-86c0e942d5a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c14a26fd-3be6-4687-b88e-4ca21efe5905 HTTP/1.1 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c14a26fd-3be6-4687-b88e-4ca21efe5905 could not be found. Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c14a26fd-3be6-4687-b88e-4ca21efe5905'} Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14a26fd-3be6-4687-b88e-4ca21efe5905 could not be found. Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14a26fd-3be6-4687-b88e-4ca21efe5905 could not be found. Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:20.464249 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:20.470326 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:20.470326 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:20.470326 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:20.470326 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14a26fd-3be6-4687-b88e-4ca21efe5905 could not be found. Oct 02 01:26:20.470326 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:20.476765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de39697c-52fd-4e4c-b6eb-86c0e942d5a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance c14a26fd-3be6-4687-b88e-4ca21efe5905 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:20.482876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de39697c-52fd-4e4c-b6eb-86c0e942d5a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/c14a26fd-3be6-4687-b88e-4ca21efe5905" status: 404 len: 111 microversion: 2.1 time: 0.057320 Oct 02 01:26:20.484726 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2552/5280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/c14a26fd-3be6-4687-b88e-4ca21efe5905 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:20.494270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.495595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.508704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.509691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.511362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.512394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.513172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.513855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.775584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.776637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.786501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.793102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.794094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.797518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.798447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.799184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.832332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.840483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-07182223-9d2f-4d7d-9449-bfd60a116921 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.350313 Oct 02 01:26:20.854114 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2729/5281] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:20.886105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.887595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.896501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.898674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.901467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.903787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.904564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.905789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.906049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.911400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.912867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.914101 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c2b8eb21-5866-418d-acf5-b71fceaaf0a5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1335 microversion: 2.47 time: 0.142313 Oct 02 01:26:20.918678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2553/5282] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1335 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:20.930173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.943274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.962093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.962985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.963685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.965896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.969704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.971949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.066047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba932607-f63b-42e0-a135-11f0764169ed tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139549 Oct 02 01:26:21.070336 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2554/5283] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:21.223815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:21.223815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:21.244032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.253512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.254133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.255038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.258284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.258896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.397649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:21.400585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:21.406342 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09e170b4-8e7e-4a27-b07b-4aad3fe53a62 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.524431 Oct 02 01:26:21.407875 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2730/5284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:21.436304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:21.439130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:21.440571 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-635803bf-5f1d-4648-b3a7-4a38bcdde268 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1340 microversion: 2.20 time: 0.223264 Oct 02 01:26:21.442706 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2555/5285] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:21 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1340 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:21.708246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cdbc3c4-7f47-42c6-8976-d8a8ebc6364f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-220218388", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cdbc3c4-7f47-42c6-8976-d8a8ebc6364f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 237 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-220218388", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-220218388', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.728079 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 02 01:26:21.733519 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:21.737549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2cdbc3c4-7f47-42c6-8976-d8a8ebc6364f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:21.745196 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2cdbc3c4-7f47-42c6-8976-d8a8ebc6364f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043105 Oct 02 01:26:21.750097 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2731/5286] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:21.758511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:21.759173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:21.775249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.775747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.776190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.776903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.777363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.777801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.942484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:21.943621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:21.990502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.991123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.991567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.994779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.995259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.997918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.166180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.181099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.183251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.192289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.204589 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffce8645-d255-494e-84d2-899849ef84ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.453688 Oct 02 01:26:22.205221 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aabfe257-11b8-4492-b04f-3b0c596af45a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1335 microversion: 2.47 time: 0.259990 Oct 02 01:26:22.206513 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2732/5287] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:21 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1335 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:22.209987 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2556/5288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:21 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:22.214794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:22.217422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:22.225461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.226667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.228089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.229061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.229769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.230503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.248544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:22.249530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:22.262515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.263309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.263987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.266112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.270855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.271556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.276706 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:22.322438 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-675e88f6-a49b-4337-88ab-809b3ec1fb1c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114321 Oct 02 01:26:22.323076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2733/5289] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:22 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:26:22.445820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:22.446331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:22.448251 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:22.459646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.462335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.463064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.463985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.468104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.468771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.523615 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:26:22.641149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.698382 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c16231ab-abe4-4ada-9d30-3774be83c54a tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 204 len: 0 microversion: 2.1 time: 0.256376 Oct 02 01:26:22.699677 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2734/5290] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:26:22 2022] DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:26:22.707819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:22.708757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:22.713252 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-92ca3502-467f-4e9f-a640-ac82edd168fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.461047 Oct 02 01:26:22.719254 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2557/5291] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:22 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:22.723954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.724669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.732326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.733299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.734550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.735841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.753134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:22.753780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:22.770576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.783633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.784398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.785162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.785615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.787905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.889571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.903090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.906676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.908447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56e8ce1a-b7d6-489a-9097-a762faffb5a3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1340 microversion: 2.20 time: 0.207442 Oct 02 01:26:22.911712 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2735/5292] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:22 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1340 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:23.013993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0113267-2814-4575-8e38-ba3af19ee1ae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-415860166", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0113267-2814-4575-8e38-ba3af19ee1ae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 234 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-415860166", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-415860166', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.022764 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 02 01:26:23.028917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:23.033371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f0113267-2814-4575-8e38-ba3af19ee1ae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:23.036947 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f0113267-2814-4575-8e38-ba3af19ee1ae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.033778 Oct 02 01:26:23.037373 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2736/5293] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:22 2022] POST /compute/v2.1/servers => generated 133 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:23.057934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:23.058993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:23.082488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.082738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.083062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.083792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.084257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.084693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.300969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:23.316039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6cae3ef5-b321-4557-8c2e-97b7222a043c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1683 microversion: 2.1 time: 0.577372 Oct 02 01:26:23.316996 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2558/5294] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:22 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1683 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:23.330804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:23.331809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:23.352548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.354783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.356998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.358288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.361400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.366232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.613290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:23.635177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:23.637188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:23.639619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-003dff5c-f654-4037-8c8d-e28056ff390f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1356 microversion: 2.47 time: 0.321189 Oct 02 01:26:23.640461 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2559/5295] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:23 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1356 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:23.673317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:23.675411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:23.682909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:23.687534 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bfc60069-7220-497c-85f4-cae269cc047a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.644906 Oct 02 01:26:23.688648 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2737/5296] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:23 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:23.702282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.703190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.707708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.712498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.713472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.714149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.720263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:23.721659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:23.740090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.740648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.741113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.741748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.750300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.751314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.871222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:26:23.894751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:26:23.896604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:26:23.897399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:26:23.898150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:26:23.990304 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:24.109797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:24.129191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.130240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.130895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.133818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.134657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.136198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.196254 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c52d7b2-aa48-439e-bc7d-4281aa910861 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "POST /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc/action" status: 202 len: 1078 microversion: 2.47 time: 0.527803 Oct 02 01:26:24.198691 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2560/5297] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:26:23 2022] POST /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc/action => generated 1078 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 02 01:26:24.210139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:24.211251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:24.229636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.230557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.231317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.232319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.234806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.236092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.379827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.389910 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b33fd23a-7969-40fb-9904-e57d89d0ab17 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.678269 Oct 02 01:26:24.398777 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2738/5298] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:23 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:24.403756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:24.416364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:24.432682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.433635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.434257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.435854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.440186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.442897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.450764 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:24.539310 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:24.685504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.718442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.721822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.731591 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-907c185f-55aa-4d91-96cf-76958c082373 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.331410 Oct 02 01:26:24.734310 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2739/5299] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:24 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:24.742489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:24.746839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:24.771234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.773077 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.775390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.776347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.778287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.780140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.822054 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:24.953114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.979378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.981044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.988183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f879362-508d-4166-aa8b-f7047b17fcfb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.788124 Oct 02 01:26:24.995779 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2561/5300] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:24 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:25.009513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7be3b434-b819-43c9-99be-b3621f62a7fa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:25.010059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7be3b434-b819-43c9-99be-b3621f62a7fa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: ed6a9e98-7328-4170-ac8f-6530adaa9302] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:25.049342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-7be3b434-b819-43c9-99be-b3621f62a7fa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance ed6a9e98-7328-4170-ac8f-6530adaa9302 could not be found. Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7be3b434-b819-43c9-99be-b3621f62a7fa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/ed6a9e98-7328-4170-ac8f-6530adaa9302/action HTTP/1.1 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 13 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: {"pause": {}} Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: exception: Instance ed6a9e98-7328-4170-ac8f-6530adaa9302 could not be found. Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'ed6a9e98-7328-4170-ac8f-6530adaa9302', 'body': {'pause': {}}} Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6a9e98-7328-4170-ac8f-6530adaa9302 could not be found. Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6a9e98-7328-4170-ac8f-6530adaa9302 could not be found. Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:25.060554 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6a9e98-7328-4170-ac8f-6530adaa9302 could not be found. Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7be3b434-b819-43c9-99be-b3621f62a7fa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance ed6a9e98-7328-4170-ac8f-6530adaa9302 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7be3b434-b819-43c9-99be-b3621f62a7fa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/ed6a9e98-7328-4170-ac8f-6530adaa9302/action" status: 404 len: 111 microversion: 2.1 time: 0.064526 Oct 02 01:26:25.066073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2562/5301] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:24 2022] POST /compute/v2.1/servers/ed6a9e98-7328-4170-ac8f-6530adaa9302/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:25.104868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:25.105804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:25.121465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:25.137096 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-16e3d78e-7f82-4ddd-bbfd-a5105b0b53b5 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1683 microversion: 2.1 time: 0.400462 Oct 02 01:26:25.138203 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2740/5302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:24 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1683 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:25.164336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.164853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.165299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.166023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.166477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.166949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.379381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:25.389739 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21dbc7fc-6ae8-4feb-8060-4f9c41cc829f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.316975 Oct 02 01:26:25.394367 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2563/5303] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:25 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:25.416556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:25.417166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:25.424981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.425663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.426276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.427196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.427817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.428409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.770982 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:25.772461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:25.806223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.810085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.813842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.816774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.818002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.818453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.824370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:25.834515 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06847d18-a479-4e0c-b656-e47d176d8122 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.421718 Oct 02 01:26:25.842487 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2741/5304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:25 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:25.872342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:25.876072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:25.949826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.950836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.952999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.955373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.958024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.958904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.035070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:26.049962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:26.054972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:26.059504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38099545-95fc-4373-86fb-0da3f9bc72fe tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.297407 Oct 02 01:26:26.062629 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2564/5305] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:25 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:26.073216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:26.083054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:26.093510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.094987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.095939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.100003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.101176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.102870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.181075 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac1dd8eb-1f18-414e-af68-8019fc16eb16 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 202 len: 0 microversion: 2.1 time: 0.313680 Oct 02 01:26:26.185035 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2742/5306] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:25 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:26:26.212585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:26.219998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:26.227221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.228107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.228729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.229930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.230556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.231170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.745915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:26.757308 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf652495-f693-4e53-a9ec-9452b24ce96f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1615 microversion: 2.1 time: 0.559488 Oct 02 01:26:26.763823 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2743/5307] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:26 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1615 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:26.769467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:26.772913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:26.791412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.791995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.792704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.793672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.795050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.795718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.094484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.097903 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:27.104072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.105577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.127030 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dce41c78-5907-49f2-8c87-bdbb94c55808 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 1.041748 Oct 02 01:26:27.127393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2565/5308] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:26 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:27.132080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8863b8eb-1665-45b2-985d-7dd3760275e5 req-be6c22b0-b2aa-4a15-9609-8f797e54fddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:27.175889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8863b8eb-1665-45b2-985d-7dd3760275e5 req-be6c22b0-b2aa-4a15-9609-8f797e54fddb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.176375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8863b8eb-1665-45b2-985d-7dd3760275e5 req-be6c22b0-b2aa-4a15-9609-8f797e54fddb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.176807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8863b8eb-1665-45b2-985d-7dd3760275e5 req-be6c22b0-b2aa-4a15-9609-8f797e54fddb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.223897 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8863b8eb-1665-45b2-985d-7dd3760275e5 req-be6c22b0-b2aa-4a15-9609-8f797e54fddb service nova] Creating event network-changed:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:26:27.230630 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8863b8eb-1665-45b2-985d-7dd3760275e5 req-be6c22b0-b2aa-4a15-9609-8f797e54fddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101929 Oct 02 01:26:27.234084 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2566/5309] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:27.240341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:27.251809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:27.271351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.271858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.272299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.273019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.273480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.273903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.330660 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.342810 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c424d14b-1d6f-4a1c-a73c-e54f520748af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1490 microversion: 2.1 time: 0.575609 Oct 02 01:26:27.345638 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2744/5310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:26 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1490 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:27.393790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:27.395236 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:27.399210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.408235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.410148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.411523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.411711 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c516b879-945e-473f-afc0-17f02c08da13 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.175439 Oct 02 01:26:27.412739 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2567/5311] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:27 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:27.429210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.429800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.431492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.432640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.438588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.511887 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'pause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state paused Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 13 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: {"pause": {}} Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'pause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state paused Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'pause': {}}} Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state paused. Cannot pause while the instance is in this state. Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state paused Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:27.513983 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state paused Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'pause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state paused {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:27.519171 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec7a53e9-c5d0-427d-b661-76358f5d2be4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 143 microversion: 2.1 time: 0.143215 Oct 02 01:26:27.521503 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2745/5312] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:27 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 143 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:26:27.528023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:27.529221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:27.539008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.539508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.539946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.540645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.541101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.541546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.727770 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7344d9f-ed1d-4cd2-b12e-d6d7f47022ea tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 202 len: 0 microversion: 2.1 time: 0.202961 Oct 02 01:26:27.744046 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2568/5313] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:27 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:26:27.746759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:27.747859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:27.757317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.759771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.763669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.765425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.767336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.769064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.793077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:27.794303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:27.825796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.826298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.826774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.827500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:27.829632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:27.833536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.239278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.252662 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8abf0972-a74c-453d-b9f3-826973256174 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1615 microversion: 2.1 time: 0.464154 Oct 02 01:26:28.255228 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2569/5314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:27 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1615 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:28.272184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:28.273134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:28.280333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:28.281287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:28.282511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.284157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:28.284860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:28.285517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.585430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.602901 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c94da376-85c4-4f83-9eaf-bcb884df35b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1497 microversion: 2.1 time: 0.859524 Oct 02 01:26:28.604112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2746/5315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:27 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1497 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:28.618285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:28.627495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:28.649696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:28.650373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:28.654412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.658304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.659360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:28.659969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:28.660518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.671445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.673747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.675173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc4a8459-5db2-4267-a019-96d3192b6e15 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.418753 Oct 02 01:26:28.676460 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2570/5316] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:28 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:28.941995 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.972409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.976944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.978414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3a1d07d8-6243-4148-9909-a6a9dbeb229b tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.370773 Oct 02 01:26:28.979719 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2747/5317] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:28 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:29.282839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:29.283979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:29.292771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.293597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.294216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.295168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.296074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.302266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.323626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-15077f8b-5fea-41e1-88d2-80a73367af9d req-51319608-f764-4c99-b864-c19be3c48b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443bec7b-b69b-4575-9feb-edce6851b262", "name": "network-vif-deleted", "tag": "9ab26bd3-12b5-444c-9d5f-830875c0e174"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:29.347496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-15077f8b-5fea-41e1-88d2-80a73367af9d req-51319608-f764-4c99-b864-c19be3c48b1a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.351549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-15077f8b-5fea-41e1-88d2-80a73367af9d req-51319608-f764-4c99-b864-c19be3c48b1a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.352326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-15077f8b-5fea-41e1-88d2-80a73367af9d req-51319608-f764-4c99-b864-c19be3c48b1a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.378397 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-15077f8b-5fea-41e1-88d2-80a73367af9d req-51319608-f764-4c99-b864-c19be3c48b1a service nova] Creating event network-vif-deleted:9ab26bd3-12b5-444c-9d5f-830875c0e174 for instance 443bec7b-b69b-4575-9feb-edce6851b262 on n-h1-master-1 Oct 02 01:26:29.391238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.392140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.392605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.393387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lazy-loading 'fault' on Instance uuid 443bec7b-b69b-4575-9feb-edce6851b262 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:29.401649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-15077f8b-5fea-41e1-88d2-80a73367af9d req-51319608-f764-4c99-b864-c19be3c48b1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082571 Oct 02 01:26:29.403170 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2748/5318] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:29.455575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:29.467475 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25c05a36-e9aa-4867-998b-243ca844f50e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1332 microversion: 2.1 time: 0.189776 Oct 02 01:26:29.469156 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2571/5319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:29 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:29.632624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:29.633293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:29.645681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.648441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.649801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.651211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.652833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.653284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.685446 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:29.708074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:29.709170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:29.734306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.736071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.736765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.737710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.738382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.739044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.962288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:29.973766 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f16b243b-0ee8-44ea-9550-a19c8027b3fd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.345450 Oct 02 01:26:29.974793 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2749/5320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:29 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:30.004526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:30.005409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.012135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.012870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.013502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.014405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.015069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.015823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.178335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.187353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.189241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.191291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0f2ae64-e5f8-44ab-930b-09bc1b8be517 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.487365 Oct 02 01:26:30.192308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2572/5321] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:29 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:30.197561 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:30.198264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.204582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.205429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.206156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.207169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.207888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.208553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.322569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.337543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.339743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.341322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05c7aa91-ec6e-48b5-89b1-375b3aede7ee tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.147583 Oct 02 01:26:30.342146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2573/5322] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:30 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:30.414677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.426025 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-420f4666-4a89-4659-a900-5d7dc6bb22b2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.426627 Oct 02 01:26:30.428118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2750/5323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:29 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:30.455588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:30.458024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.467001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.467869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.468488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.470135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.470900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.471899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.489649 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da/action HTTP/1.1 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 28 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: {"reboot": {"type": "SOFT"}} Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: exception: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'e74a644f-49af-425a-ad6f-927d4f1e19da', 'body': {'reboot': {'type': 'SOFT'}}} Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:30.492534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:30.498518 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:30.499680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:30.499680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.502056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:30.503377 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0c2222c9-6686-4302-8ba0-94831f223ec9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da/action" status: 404 len: 111 microversion: 2.1 time: 0.055905 Oct 02 01:26:30.504498 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2574/5324] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:30 2022] POST /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:30.505743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.506239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.506746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.508105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.508574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.509214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.517252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:30.517883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.534491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.534899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.535332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.538116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.540802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.541793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.559751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.560515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.561181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.561801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lazy-loading 'fault' on Instance uuid 443bec7b-b69b-4575-9feb-edce6851b262 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:30.636510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.647397 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-335bdf24-2e49-49e5-96fe-cc312991d792 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 200 len: 1332 microversion: 2.1 time: 0.153343 Oct 02 01:26:30.648248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2751/5325] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:30 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 1332 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:30.821831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.840877 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-211ff7a9-4a9c-4fb2-abcc-f0f4686504e9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.328665 Oct 02 01:26:30.848150 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2575/5326] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:30 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:30.869526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:30.870151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.877273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.877750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.878194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.878920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.879376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.879802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.188672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.197370 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7246af76-cee3-4eb0-9032-d6ac72f0192b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.333151 Oct 02 01:26:31.198690 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2752/5327] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:30 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:31.223614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.224257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.227067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99317fe6-ac45-4baf-b09f-e6d9693a3071 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:31.229506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99317fe6-ac45-4baf-b09f-e6d9693a3071 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: a67ac082-01b9-4b5e-9334-6b9168a5770f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.235414 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:31.240411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.244458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.244458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.244831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.246706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.247183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.248510 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-99317fe6-ac45-4baf-b09f-e6d9693a3071 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance a67ac082-01b9-4b5e-9334-6b9168a5770f could not be found. Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99317fe6-ac45-4baf-b09f-e6d9693a3071 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/a67ac082-01b9-4b5e-9334-6b9168a5770f/action HTTP/1.1 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 28 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: {"reboot": {"type": "SOFT"}} Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: exception: Instance a67ac082-01b9-4b5e-9334-6b9168a5770f could not be found. Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'a67ac082-01b9-4b5e-9334-6b9168a5770f', 'body': {'reboot': {'type': 'SOFT'}}} Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67ac082-01b9-4b5e-9334-6b9168a5770f could not be found. Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67ac082-01b9-4b5e-9334-6b9168a5770f could not be found. Oct 02 01:26:31.252245 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67ac082-01b9-4b5e-9334-6b9168a5770f could not be found. Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.258787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99317fe6-ac45-4baf-b09f-e6d9693a3071 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance a67ac082-01b9-4b5e-9334-6b9168a5770f could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:31.260163 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99317fe6-ac45-4baf-b09f-e6d9693a3071 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/a67ac082-01b9-4b5e-9334-6b9168a5770f/action" status: 404 len: 111 microversion: 2.1 time: 0.036585 Oct 02 01:26:31.261704 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2753/5328] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:31 2022] POST /compute/v2.1/servers/a67ac082-01b9-4b5e-9334-6b9168a5770f/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:26:31.270789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.271414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.279229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.279721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.280158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.280866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.281332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.281814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.500822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.518159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.519885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.524429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-52479d76-7cdf-4c67-862b-740abce1f2ad tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.307384 Oct 02 01:26:31.525147 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2576/5329] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:31 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:31.532008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.541859 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff483c62-3912-4607-a2c4-0a28a4cee38a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.275728 Oct 02 01:26:31.547965 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2754/5330] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:31 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.562675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.577325 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:31.584012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.584641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.598540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.599083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.599535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.600256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.600723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.603941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.641112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.652461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.655210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.656752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1cc6cd4-f749-4f22-8c24-3fdcb38c94c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.130351 Oct 02 01:26:31.657665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2577/5331] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:31 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:31.674852 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.675887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.684076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.694793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.695822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.698889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.699867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.700603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.724330 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 HTTP/1.1 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '443bec7b-b69b-4575-9feb-edce6851b262'} Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:31.725923 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0cc1a98e-099a-43c5-831c-e3bf6184b4f9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 404 len: 111 microversion: 2.1 time: 0.058423 Oct 02 01:26:31.731373 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2578/5332] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:31 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:31.746783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fef395e4-4edf-4939-98f0-49e209cb208d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '.version_select at 0x7fb880917550>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.778834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fef395e4-4edf-4939-98f0-49e209cb208d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354181241" status: 202 len: 0 microversion: 2.1 time: 0.035544 Oct 02 01:26:31.785405 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2579/5333] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:26:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354181241 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:26:31.877808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.891935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e590782-c855-4d1e-ab31-1c9ba947a324 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.314390 Oct 02 01:26:31.894813 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2755/5334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:31 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:31.915645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:31.918439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.932647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.933400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.934043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.935006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.935694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.937899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.004940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da/action HTTP/1.1 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 65 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: exception: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'e74a644f-49af-425a-ad6f-927d4f1e19da', 'body': {'rebuild': {'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406'}}} Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 02 01:26:32.007550 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.013408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:32.014963 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1df7553d-6e4e-4481-99c0-3af5216bc3de tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da/action" status: 404 len: 111 microversion: 2.1 time: 0.102599 Oct 02 01:26:32.015900 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2580/5335] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:31 2022] POST /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:32.027966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:32.029493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.037426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.037930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.038384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.039155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.039622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.040061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.231034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:32.240172 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-92d68aff-4e2b-40dc-b684-ee3aae60adae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.218487 Oct 02 01:26:32.240847 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2756/5336] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:32 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:32.265129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:32.265806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.272390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.272966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.273468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.274238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.274807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.275301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.427205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:32.435526 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-046eb5c7-362c-4769-b0ea-f313653482c5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.174581 Oct 02 01:26:32.436361 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2581/5337] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:32 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:32.459565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f8aa1504-d428-49c9-a25c-7eeaae967b28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:32.462926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f8aa1504-d428-49c9-a25c-7eeaae967b28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 3ad2ee3e-4624-497e-b9f0-668414de04a0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.469907 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f8aa1504-d428-49c9-a25c-7eeaae967b28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 3ad2ee3e-4624-497e-b9f0-668414de04a0 could not be found. Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f8aa1504-d428-49c9-a25c-7eeaae967b28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/3ad2ee3e-4624-497e-b9f0-668414de04a0/action HTTP/1.1 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 65 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 3ad2ee3e-4624-497e-b9f0-668414de04a0 could not be found. Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '3ad2ee3e-4624-497e-b9f0-668414de04a0', 'body': {'rebuild': {'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406'}}} Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad2ee3e-4624-497e-b9f0-668414de04a0 could not be found. Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 02 01:26:32.471752 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad2ee3e-4624-497e-b9f0-668414de04a0 could not be found. Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad2ee3e-4624-497e-b9f0-668414de04a0 could not be found. Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f8aa1504-d428-49c9-a25c-7eeaae967b28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 3ad2ee3e-4624-497e-b9f0-668414de04a0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f8aa1504-d428-49c9-a25c-7eeaae967b28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/3ad2ee3e-4624-497e-b9f0-668414de04a0/action" status: 404 len: 111 microversion: 2.1 time: 0.018286 Oct 02 01:26:32.481315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2757/5338] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:32 2022] POST /compute/v2.1/servers/3ad2ee3e-4624-497e-b9f0-668414de04a0/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:26:32.490236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:32.491182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.498200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.498798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.499239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.500159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.501383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.502679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.559502 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:32.560293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.568946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.569638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.570581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.571686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.572452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.573971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.769032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:32.785531 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a79755d1-cfa0-44b1-af43-f251dcc590ac tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.299235 Oct 02 01:26:32.786136 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2582/5339] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:32 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:32.811527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:32.812156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.820948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.821450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.821992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.822729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.823195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.823622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:33.098850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.110433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.112368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.113802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-781356e9-9993-4875-8220-9baf954b9c2f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.313320 Oct 02 01:26:33.114622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2583/5340] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:32 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:33.139722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:33.140831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:33.149765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:33.150537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:33.151707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:33.153192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:33.153961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:33.154628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:33.154978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.170214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.172697 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.177191 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca8467b2-85d5-416f-87d6-6caa21ecfeef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.626711 Oct 02 01:26:33.191223 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2758/5341] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:32 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:33.210672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1731695994", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:33.329061 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:26:33.665922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.686423 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e54b96d-fb06-4157-9c22-09cda7266925 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.557333 Oct 02 01:26:33.687695 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2584/5342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:33 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:33.713069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d847b5eb-d4ef-4b10-8970-354e71005394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:33.713621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d847b5eb-d4ef-4b10-8970-354e71005394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: ea2bc585-420a-4ad4-b8ca-5609274c1623] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:33.722717 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d847b5eb-d4ef-4b10-8970-354e71005394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance ea2bc585-420a-4ad4-b8ca-5609274c1623 could not be found. Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d847b5eb-d4ef-4b10-8970-354e71005394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/ea2bc585-420a-4ad4-b8ca-5609274c1623/action HTTP/1.1 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 15 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: {"restore": {}} Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: exception: Instance ea2bc585-420a-4ad4-b8ca-5609274c1623 could not be found. Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'ea2bc585-420a-4ad4-b8ca-5609274c1623', 'body': {'restore': {}}} Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2bc585-420a-4ad4-b8ca-5609274c1623 could not be found. Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2bc585-420a-4ad4-b8ca-5609274c1623 could not be found. Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:33.724783 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2bc585-420a-4ad4-b8ca-5609274c1623 could not be found. Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d847b5eb-d4ef-4b10-8970-354e71005394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance ea2bc585-420a-4ad4-b8ca-5609274c1623 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d847b5eb-d4ef-4b10-8970-354e71005394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/ea2bc585-420a-4ad4-b8ca-5609274c1623/action" status: 404 len: 111 microversion: 2.1 time: 0.017077 Oct 02 01:26:33.729584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2585/5343] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:33 2022] POST /compute/v2.1/servers/ea2bc585-420a-4ad4-b8ca-5609274c1623/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:33.740799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:33.741839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:33.752083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:33.753030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:33.753596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:33.754431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:33.756807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:33.757487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.127753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.138681 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1a133f3d-4035-46d1-9e9d-bb038629ebfc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.407714 Oct 02 01:26:34.141957 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2586/5344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:33 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:34.145489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:26:34.146282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:26:34.146967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:26:34.148446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:26:34.149123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:26:34.164500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:34.165142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:34.169291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.169825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.170218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.176532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.177278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.177927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.181315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.193509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.194328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.195672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.196309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.196920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.247069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Getting quotas for project 133349796718454eb3b452ed62d15a8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:34.269016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Getting quotas for user dc7cc78032a34034aed2d761e8cfe068 and project 133349796718454eb3b452ed62d15a8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:34.307073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:26:34.317175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:26:34.414532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.427087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.433043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.433369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e01ffc4-7c7f-421e-986e-c5856536e5d6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240711 Oct 02 01:26:34.435141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b4110210-ca66-4d31-8733-7fdaeaa2ad8a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.277189 Oct 02 01:26:34.437598 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2587/5345] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:34 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:34.449491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:34.450517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:34.455054 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2759/5346] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:26:34.466343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.467717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.470240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.472001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.473890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.474879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.495763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:34.496394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:34.514261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.514902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.516618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.516782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.517773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.518224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.855971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.877331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.883601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.889589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-28d1443e-26a2-4377-b293-b6b7b4a8c660 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.418201 Oct 02 01:26:34.895555 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2760/5347] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:34 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:34.911690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-147fb7dc-75fd-48a2-85aa-e5681fddb5c3 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:34.912814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-147fb7dc-75fd-48a2-85aa-e5681fddb5c3 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:34.936074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.948939 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2555346f-047f-4531-8973-706fdc76d8a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.508675 Oct 02 01:26:34.952955 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2588/5348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:34 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:34.989536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91628bd8-60ae-44f3-8fb1-9b3e69d41d3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: .version_select at 0x7fb88088b280>, body: {"keypair": {"name": "tempest-keypair-937335786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbON43xjBEyX3XpW5PO0V16l1UWkLmJaN2GjvW+Cc/SrkJJF+bf7S01t5jrqKtN+KkfGdD+115Wd2LYYqB/dMd+K54lLr7egBlrua1zDHfJHHAdizsnP99moXack4CLMw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:35.038281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-91628bd8-60ae-44f3-8fb1-9b3e69d41d3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:35.051880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-91628bd8-60ae-44f3-8fb1-9b3e69d41d3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:35.071613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-147fb7dc-75fd-48a2-85aa-e5681fddb5c3 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:35.083078 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-147fb7dc-75fd-48a2-85aa-e5681fddb5c3 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1214 microversion: 2.1 time: 0.185415 Oct 02 01:26:35.085672 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2761/5349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:34 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:35.098365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:35.100055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.127821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.132932 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-91628bd8-60ae-44f3-8fb1-9b3e69d41d3c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153064 Oct 02 01:26:35.134947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.136209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.136928 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2589/5350] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:26:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:35.141510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.142830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.155030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.215307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'restore' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 15 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: {"restore": {}} Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'restore' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'restore': {}}} Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state active. Cannot restore while the instance is in this state. Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:35.221021 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:35.226632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:35.226632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:35.226632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:35.226632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:35.226632 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:35.226632 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'restore' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:35.229177 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-daa77bfb-9772-4c46-8cd8-d69adb6fc67a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 145 microversion: 2.1 time: 0.141127 Oct 02 01:26:35.230700 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2762/5351] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:35 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 145 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:26:35.239830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:35.240526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.252903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.253815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.258570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.259719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.262509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.264036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.483746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:35.485396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.512834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.516487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.517303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.536754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.537266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.537827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.762033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:35.777210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:35.782855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:35.784491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:35.785067 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4233955f-0e93-47e9-b40d-85e3c726d8cf tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.311610 Oct 02 01:26:35.786625 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2763/5352] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:35.792620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:35.795844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.802866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.803582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.804839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.805815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.806453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.807158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.810035 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45710afa-042a-4758-b43f-4740577c1598 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.574965 Oct 02 01:26:35.811078 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2590/5353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:35.842103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:35.846041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.859019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.860337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.863211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.864255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.865018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.867032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.873940 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9a36eb1-2adf-42cb-9ab5-9a365a485a13 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084432 Oct 02 01:26:35.876361 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2764/5354] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:35.892444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:35.893486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.901112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.901865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.902855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.903883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.904670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.905325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.981706 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-113a3c18-c387-42c5-88e0-fd7a82294e79 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/de996026-7253-46fd-9f2a-25731a8319a5" status: 200 len: 194 microversion: 2.1 time: 0.097771 Oct 02 01:26:35.988268 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2765/5355] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/de996026-7253-46fd-9f2a-25731a8319a5 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:36.000921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:36.001556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:36.021881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.022380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.024765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.025527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.025994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.026422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.396996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:36.426159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b410b8e-7691-4be7-8a10-57e0d9ca6462 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.587708 Oct 02 01:26:36.430662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2591/5356] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:36.480058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:36.490881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:36.517519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.522713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.526025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.528106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.534921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.536051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.642587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:36.681150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:36.696671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:36.698387 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de28dab4-1b93-4b18-97f5-bbc2c5ed2143 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.714606 Oct 02 01:26:36.699312 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2766/5357] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:36.753179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a583aa7a-932a-4990-a911-75c06881e5b1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:36.753878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a583aa7a-932a-4990-a911-75c06881e5b1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: ce5c5676-1dc1-42c4-aed4-81e4084d08a6] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:36.780147 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a583aa7a-932a-4990-a911-75c06881e5b1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance ce5c5676-1dc1-42c4-aed4-81e4084d08a6 could not be found. Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a583aa7a-932a-4990-a911-75c06881e5b1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/ce5c5676-1dc1-42c4-aed4-81e4084d08a6/action HTTP/1.1 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 14 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: {"resume": {}} Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: exception: Instance ce5c5676-1dc1-42c4-aed4-81e4084d08a6 could not be found. Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'ce5c5676-1dc1-42c4-aed4-81e4084d08a6', 'body': {'resume': {}}} Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5c5676-1dc1-42c4-aed4-81e4084d08a6 could not be found. Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5c5676-1dc1-42c4-aed4-81e4084d08a6 could not be found. Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:36.810905 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5c5676-1dc1-42c4-aed4-81e4084d08a6 could not be found. Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a583aa7a-932a-4990-a911-75c06881e5b1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance ce5c5676-1dc1-42c4-aed4-81e4084d08a6 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a583aa7a-932a-4990-a911-75c06881e5b1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/ce5c5676-1dc1-42c4-aed4-81e4084d08a6/action" status: 404 len: 111 microversion: 2.1 time: 0.081590 Oct 02 01:26:36.822657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2767/5358] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:36 2022] POST /compute/v2.1/servers/ce5c5676-1dc1-42c4-aed4-81e4084d08a6/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:36.856086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:36.856902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:36.893570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.899287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.899911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.905765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.908174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.909575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.975854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:36.993411 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-519462d1-37ad-4c28-a5ca-4d84258e5839 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1266 microversion: 2.1 time: 0.561391 Oct 02 01:26:36.994027 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2592/5359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:36 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1266 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:37.012535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:37.013170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:37.028018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.028433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.028878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:37.029607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.030069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.034631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:37.065355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:37.076100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:37.079712 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:37.083855 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e871fd6a-b7c3-45c6-b10a-f02100242480 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.243237 Oct 02 01:26:37.084515 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2768/5360] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:36 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:37.305174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:37.319893 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7210c2c7-05f0-4e6d-8fe6-854465488851 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.316650 Oct 02 01:26:37.321146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2593/5361] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:36 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:37.350480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:37.353123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:37.370140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.374415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.377101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:37.381540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.382026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.382480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:37.728329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:37.728952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:37.751337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.751871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.752320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:37.753071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.762967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.763498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:38.071691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:38.090094 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ce1248ba-b9c1-48d7-805e-e63731657a1a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.742098 Oct 02 01:26:38.092104 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2769/5362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:37 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:38.115107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:38.115750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:38.128187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:38.134911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:38.138546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:38.139630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:38.142742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:38.143585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:38.550174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:38.557228 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:38.565527 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-850ba554-bb2a-44c3-b953-5b6073c476f7 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1272 microversion: 2.1 time: 0.471921 Oct 02 01:26:38.566727 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2770/5363] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:38 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:38.571927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:38.572811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:38.580398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:38.590965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:38.591545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:38.592416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:38.592991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:38.593525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.030012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.036421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.050083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.052500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.054064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.054864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.057112 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1250228-02cf-4bbb-a4b1-2954571937e1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 1.332459 Oct 02 01:26:39.057709 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2594/5364] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:37 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:39.067848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-687604a7-0291-45d2-9ec7-fb91bc0b09b8 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.499733 Oct 02 01:26:39.082434 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2771/5365] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:38 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:39.087204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:39.087951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:39.101809 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6ff953a2-7eb2-4a29-b9a6-7d78d1f2ba27 req-3a348c19-304e-452e-ac9c-14dc70d0562c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "name": "network-vif-plugged", "status": "completed", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:39.107443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.107855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.113073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.113849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.114336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.114858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.135943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6ff953a2-7eb2-4a29-b9a6-7d78d1f2ba27 req-3a348c19-304e-452e-ac9c-14dc70d0562c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.136915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6ff953a2-7eb2-4a29-b9a6-7d78d1f2ba27 req-3a348c19-304e-452e-ac9c-14dc70d0562c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.138216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6ff953a2-7eb2-4a29-b9a6-7d78d1f2ba27 req-3a348c19-304e-452e-ac9c-14dc70d0562c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.163781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6ff953a2-7eb2-4a29-b9a6-7d78d1f2ba27 req-3a348c19-304e-452e-ac9c-14dc70d0562c service nova] Creating event network-vif-plugged:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:26:39.170780 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6ff953a2-7eb2-4a29-b9a6-7d78d1f2ba27 req-3a348c19-304e-452e-ac9c-14dc70d0562c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086269 Oct 02 01:26:39.172838 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2772/5366] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:39.180584 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'resume' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:39.182771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9a98a4b-4e78-46d3-ac97-67c37c95923c"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 14 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: {"resume": {}} Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'resume' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'resume': {}}} Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state active. Cannot resume while the instance is in this state. Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:39.186445 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:26:39.193308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:26:39.194046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:39.194168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'resume' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:39.194168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5e4b11f-ae90-4df1-904a-944c9c4c3aaa tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 144 microversion: 2.1 time: 0.129276 Oct 02 01:26:39.194168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2595/5367] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:39 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 144 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:26:39.201535 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:39.205656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:39.206469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:39.215827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.218098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.220156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.221116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.221786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.222959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.223751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.224172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.224838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.226702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.228322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.232560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.791086 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6623d740-ab49-452f-8f31-e73e4a19db4f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "POST /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614130 Oct 02 01:26:39.792849 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2773/5368] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:26:39 2022] POST /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:39.808421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:39.809349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:39.825472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.828965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.829608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.830346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.830881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.831593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.986886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.997217 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4fe90ac-d78b-472c-9cce-f7d809deb99f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1272 microversion: 2.1 time: 0.201953 Oct 02 01:26:39.997834 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2774/5369] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:39 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:40.006537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1948742646", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d59648e8-d54a-41ca-842c-4437e3a4d0f9"}], "security_groups": [{"name": "tempest-securitygroup--1397413144"}], "key_name": "tempest-keypair-937335786", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:40.056155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:40.068683 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0476ebd-41c7-45f7-a088-6a61cbb10c13 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.873721 Oct 02 01:26:40.079659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2596/5370] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:39 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:40.101488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:40.102232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:40.108401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:40.108891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:40.110192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:40.110951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:40.111618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:40.112047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:40.352805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] validate_networks() for [('d59648e8-d54a-41ca-842c-4437e3a4d0f9', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:26:40.672823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:40.697329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:40.702980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:40.704648 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40deaa53-2fb4-43bc-a870-8ce91c3e8556 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1407 microversion: 2.20 time: 0.611537 Oct 02 01:26:40.722634 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2597/5371] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:40 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:40.722634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:40.722634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:40.728005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:40.728723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:40.729267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:40.730225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:40.731138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:40.731826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.254163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:41.259080 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:41.272431 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e51148bc-a572-4e13-9cea-5b5db99c6eee tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.564582 Oct 02 01:26:41.274060 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2598/5372] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:40 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:41.281138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:41.308062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:41.317228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.318054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.321026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.321989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.322651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.325112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.509790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:41.518809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:41.520566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:41.521982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea250b3b-4b06-4051-ad76-4a4f9516723d tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.246176 Oct 02 01:26:41.535942 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2599/5373] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:41 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:41.556361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:26:41.557221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:26:41.557700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:26:41.558117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:26:41.558536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:26:41.558721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:41.559275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:41.568189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.568804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.569290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.570256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.570988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.571648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.577129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.579451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.580001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.580678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.581151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.581584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.616466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:26:41.623864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Getting quotas for user bfae16ed6efb490d8d953bb78a5c1a00 and project 550c19f69633414698e9c62c717660ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:26:41.639058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:26:41.641751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:26:41.721788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c89ff29b-8e3f-4def-b11f-44859701d913 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.722631 Oct 02 01:26:41.729315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2775/5374] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:26:41.735274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2d96c02-a187-46a1-a99f-f39b52f18895 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2d96c02-a187-46a1-a99f-f39b52f18895 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 160 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "1ff916bd-12e6-4293-adde-bfdeed6c5886"}]}} Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd452563b-d97f-4ef2-b927-770421bd0406', 'flavorRef': '452', 'networks': [{'uuid': '1ff916bd-12e6-4293-adde-bfdeed6c5886'}]}}} Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi '' Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:26:41.762067 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:26:41.768389 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:41.770255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2d96c02-a187-46a1-a99f-f39b52f18895 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:41.772349 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2d96c02-a187-46a1-a99f-f39b52f18895 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.041629 Oct 02 01:26:41.786054 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2776/5375] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:26:41 2022] POST /compute/v2.1/servers => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:26:41.799169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:41.804908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:41.825590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.829628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.831665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.832725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.854175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.854682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:42.397786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:42.409895 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd6d4167-34aa-4f22-a97a-4815ed30abeb tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.872581 Oct 02 01:26:42.415074 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2600/5376] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:41 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:42.426960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-506a9144-a438-4fc4-8c5c-6c9fcf633135 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:42.427898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-506a9144-a438-4fc4-8c5c-6c9fcf633135 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:42.654450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-506a9144-a438-4fc4-8c5c-6c9fcf633135 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:42.663938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-506a9144-a438-4fc4-8c5c-6c9fcf633135 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1241 microversion: 2.1 time: 0.247492 Oct 02 01:26:42.678882 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2601/5377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:42 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1241 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:42.678882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:42.678882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:42.701979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:42.703868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:42.705631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:42.707969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:42.709533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:42.710495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:42.736405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:42.751376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:42.753105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:42.754310 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bff3f441-a2d4-4cee-bf29-71627d7d4073 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1598 microversion: 2.20 time: 0.966594 Oct 02 01:26:42.762107 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2777/5378] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:41 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1598 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:42.789495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:42.790118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:42.801981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:42.815295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:42.816019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:42.816941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:42.817592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:42.818253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.001623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:43.010964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:43.013099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:43.014566 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52ed8fdf-a20f-42a1-b384-d0502a1648d0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.250786 Oct 02 01:26:43.027830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2778/5379] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:42 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:43.043164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:43.044048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:43.051506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.052412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.053917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.054975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.055699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.056356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.269146 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b2fc35f-7172-4a48-ad54-051ede2037a5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.239366 Oct 02 01:26:43.270443 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2779/5380] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:26:43 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:26:43.350921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:43.363348 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f3c21254-3be2-45a0-8e82-a05b47b43df2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.694141 Oct 02 01:26:43.364912 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2602/5381] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:42 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:43.392315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:43.393390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:43.406143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.408541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.413845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.416623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.426341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.426866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.442131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:43.443725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:43.452917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.454541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.455269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.456684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.457367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.458077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.333969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.347915 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7df9e2ec-173f-46ea-838f-305acd3d8e19 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.910148 Oct 02 01:26:44.353358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2603/5382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:43 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:44.364505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:44.367856 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:44.382816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.383493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.385329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.386231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.388285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.388850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.608779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.623449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab1859ab-d4ed-4042-9419-8bfc963da676 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1299 microversion: 2.1 time: 0.266704 Oct 02 01:26:44.624049 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2604/5383] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:44 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:44.629231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:44.629846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:44.652068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.652581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.653027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.653773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.654235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.654695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.672844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.681476 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-49074757-69cc-461a-80f3-d78d68947d67 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.295627 Oct 02 01:26:44.692126 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2780/5384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:43 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:44.717326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3dd0b5cf-a640-49dc-a146-34e1161ddbb8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:44.717998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3dd0b5cf-a640-49dc-a146-34e1161ddbb8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 384a86e3-aa4c-4831-9795-f9227306318a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:44.732790 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-3dd0b5cf-a640-49dc-a146-34e1161ddbb8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 384a86e3-aa4c-4831-9795-f9227306318a could not be found. Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3dd0b5cf-a640-49dc-a146-34e1161ddbb8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/384a86e3-aa4c-4831-9795-f9227306318a/action HTTP/1.1 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 14 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: {"shelve": {}} Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 384a86e3-aa4c-4831-9795-f9227306318a could not be found. Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '384a86e3-aa4c-4831-9795-f9227306318a', 'body': {'shelve': {}}} Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384a86e3-aa4c-4831-9795-f9227306318a could not be found. Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384a86e3-aa4c-4831-9795-f9227306318a could not be found. Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:26:44.736584 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384a86e3-aa4c-4831-9795-f9227306318a could not be found. Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3dd0b5cf-a640-49dc-a146-34e1161ddbb8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 384a86e3-aa4c-4831-9795-f9227306318a could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3dd0b5cf-a640-49dc-a146-34e1161ddbb8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/384a86e3-aa4c-4831-9795-f9227306318a/action" status: 404 len: 111 microversion: 2.1 time: 0.025133 Oct 02 01:26:44.741893 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2781/5385] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:44 2022] POST /compute/v2.1/servers/384a86e3-aa4c-4831-9795-f9227306318a/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:26:44.754584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:44.755218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:44.786372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.786885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.787326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.788056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.788518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.788954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.830801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.842478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.850578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.853598 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-140d21f6-ec92-4f89-bbeb-e737d4e6ac6a tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.228564 Oct 02 01:26:44.854311 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2605/5386] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:44 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:45.383884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:45.384608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:45.409229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:45.410524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:45.411126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:45.422196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:45.423224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:45.424301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:45.866721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:45.887968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-11601f7a-d7e6-4254-b597-d432554a7eb7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.137658 Oct 02 01:26:45.895168 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2782/5387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:44 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:45.923493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:45.926584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:45.944322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:45.946276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:45.946885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:45.947925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:45.950486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:45.951884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.166367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.175623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2bddd53a-db2b-4d28-a715-50ab16acc972 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.798106 Oct 02 01:26:46.180433 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2606/5388] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:45 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:46.188666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-80d90236-1c0a-476d-a8e5-7f99d8a9199a req-08a92dcc-ba51-42f0-bd64-bf8fd8a94510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:46.202479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80d90236-1c0a-476d-a8e5-7f99d8a9199a req-08a92dcc-ba51-42f0-bd64-bf8fd8a94510 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.205133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80d90236-1c0a-476d-a8e5-7f99d8a9199a req-08a92dcc-ba51-42f0-bd64-bf8fd8a94510 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.205901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80d90236-1c0a-476d-a8e5-7f99d8a9199a req-08a92dcc-ba51-42f0-bd64-bf8fd8a94510 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.224469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-80d90236-1c0a-476d-a8e5-7f99d8a9199a req-08a92dcc-ba51-42f0-bd64-bf8fd8a94510 service nova] Creating event network-changed:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:26:46.233837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-80d90236-1c0a-476d-a8e5-7f99d8a9199a req-08a92dcc-ba51-42f0-bd64-bf8fd8a94510 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050993 Oct 02 01:26:46.235070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2607/5389] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:46.243944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:46.244843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:46.256185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.276756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.277822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.280013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.281123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.281752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.440441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.452123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.455489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.457298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7d5c6d0-eb17-4903-8fbf-6a91122b6ef9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.218947 Oct 02 01:26:46.458386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2608/5390] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:46 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:46.463276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:46.464183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:46.472342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.473025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.473644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.474888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.476020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.476732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.483409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.505311 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ee3f8d27-9082-404e-8b4a-8cba5c739ee9 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.608785 Oct 02 01:26:46.510942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2783/5391] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:45 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:46.937742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.948946 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8780ed14-13f8-4350-a142-2b3c6ce0050a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.489170 Oct 02 01:26:46.988340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2609/5392] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:46 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:46.994871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:46.995611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:47.005655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.007416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.008001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.008850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.009464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.010026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.082410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a964ff48-8745-4ac2-a2f7-7a5e4b6ea972 req-9cf6cbb1-598e-4781-ae22-88695b1a6046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a37695b5-6c72-4eec-8d3c-5ff9e4e36a14", "tag": "e0bff18f-9442-4954-b549-578578d326bc"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:47.102070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a964ff48-8745-4ac2-a2f7-7a5e4b6ea972 req-9cf6cbb1-598e-4781-ae22-88695b1a6046 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.103321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a964ff48-8745-4ac2-a2f7-7a5e4b6ea972 req-9cf6cbb1-598e-4781-ae22-88695b1a6046 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.104810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a964ff48-8745-4ac2-a2f7-7a5e4b6ea972 req-9cf6cbb1-598e-4781-ae22-88695b1a6046 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.121696 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a964ff48-8745-4ac2-a2f7-7a5e4b6ea972 req-9cf6cbb1-598e-4781-ae22-88695b1a6046 service nova] Creating event network-changed:e0bff18f-9442-4954-b549-578578d326bc for instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 on n-h2-master-1 Oct 02 01:26:47.128090 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a964ff48-8745-4ac2-a2f7-7a5e4b6ea972 req-9cf6cbb1-598e-4781-ae22-88695b1a6046 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344720 Oct 02 01:26:47.129254 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2784/5393] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:26:47.131951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lazy-loading 'flavor' on Instance uuid f96486de-fc69-42c7-a62e-00eb5168b457 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:47.212925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:47.213888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:47.230038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.233144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.233785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.234849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.235596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.237919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.545307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84442b61-ab36-448c-85de-23dcf38367c7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 202 len: 0 microversion: 2.1 time: 0.555099 Oct 02 01:26:47.551790 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2610/5394] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:26:46 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:26:47.559259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:47.570823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:47.574329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:47.594294 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82675413-bd4b-4008-a4fd-d63600c4a18b tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.376151 Oct 02 01:26:47.619050 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2785/5395] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:47 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:47.630050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.630531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.632931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:47.633564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.635456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.637193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:47.638875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.639885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.674907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.675524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.675976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.676717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.677176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.677601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.818069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:47.832725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:47.848149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:47.858239 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24845efd-e0db-4338-bb56-e125998be5db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.298862 Oct 02 01:26:47.878448 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2611/5396] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:47 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:47.894981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:47.895935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:47.909604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.910381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.911057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.913422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.914434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.916109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:48.232282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:48.250238 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e024facb-8879-474c-8f41-fb6aefda2869 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.629418 Oct 02 01:26:48.252979 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2786/5397] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:47 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:48.260934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:48.274766 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57825267-caa2-438d-aeec-a43442fb7540 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.386952 Oct 02 01:26:48.275643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2612/5398] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:47 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:48.624627 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:48.625522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:48.637774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:48.638528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:48.639256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:48.639995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:48.641076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:48.641762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:48.783394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:48.793263 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a03445b5-986c-4caa-8651-139d68a24074 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.172807 Oct 02 01:26:48.793899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2787/5399] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:48 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:48.903335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:48.904071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:48.920543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:48.922182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:48.922902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:48.923921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:48.924567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:48.925182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.000486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:49.010318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:49.012030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:49.020129 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4549272b-dd69-4fe1-933a-07468263368f tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.124182 Oct 02 01:26:49.020129 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2613/5400] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:48 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:49.274990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:49.275778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:49.292479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.292986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.293428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.294147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.294652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.295054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.301560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:49.302181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:49.319705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.321353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.322038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.323365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.325253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.326304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.691022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:49.696873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:49.713179 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe6efb83-3621-4fe7-ba84-b44a35a1562e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.415267 Oct 02 01:26:49.740221 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2614/5401] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:49 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:49.741284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a8e3fa8b-16d3-49a2-a71c-12f3ff5ff93f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.445667 Oct 02 01:26:49.758906 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2788/5402] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:49 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:49.808791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ea425bf2-bacb-4be2-8524-e5a0a441046d req-841cc324-b86a-48b7-8ddd-e3aca37bb696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426e4648-6aad-45c7-b4e9-a4ea6db88755", "tag": "27657d53-7e84-46a9-8b74-751994c1572c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:49.818506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:49.819520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:49.836287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.838623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.840286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ea425bf2-bacb-4be2-8524-e5a0a441046d req-841cc324-b86a-48b7-8ddd-e3aca37bb696 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.841095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.842387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:49.843141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ea425bf2-bacb-4be2-8524-e5a0a441046d req-841cc324-b86a-48b7-8ddd-e3aca37bb696 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.845058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ea425bf2-bacb-4be2-8524-e5a0a441046d req-841cc324-b86a-48b7-8ddd-e3aca37bb696 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.845757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:49.847091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.859589 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:49.884837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ea425bf2-bacb-4be2-8524-e5a0a441046d req-841cc324-b86a-48b7-8ddd-e3aca37bb696 service nova] Creating event network-changed:27657d53-7e84-46a9-8b74-751994c1572c for instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 on n-h2-master-1 Oct 02 01:26:49.894246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ea425bf2-bacb-4be2-8524-e5a0a441046d req-841cc324-b86a-48b7-8ddd-e3aca37bb696 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094640 Oct 02 01:26:49.895963 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2615/5403] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:50.051302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:50.052857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:50.069817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.071940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.072584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.073500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.075943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.076585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.195756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:50.197965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:50.205956 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-53094cce-1075-455c-9860-cfa720ff7f9f tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.391359 Oct 02 01:26:50.206551 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2789/5404] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:49 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:50.215582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:50.219948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:50.223746 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f5d0025-da9a-439d-ba18-f2ff2da2c803 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.184444 Oct 02 01:26:50.224738 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2616/5405] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:50 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:50.747084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:50.748554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:50.764501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:50.765124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:50.783795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.785470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.786190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.788101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.788336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.789503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.791014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.791473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.792100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.792876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.798070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.803435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.870185 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:51.113529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.121479 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae07a6b3-36ae-43d5-80ea-bea6c81c0149 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.360724 Oct 02 01:26:51.135006 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2617/5406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:50 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:51.135174 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.138762 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6d8ef20c-7d88-41fa-8a3a-4b3547ee4fc7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.392685 Oct 02 01:26:51.139534 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2790/5407] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:50 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:51.229583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:51.230965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:51.243478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:51.249278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:51.250084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:51.253208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:51.255648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:51.256404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:51.256880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:51.257306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:51.264165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:51.264670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:51.265435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:51.266344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:51.266613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:51.267052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:51.363340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.371707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.373196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.374383 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-772d2408-3d11-420e-b5fe-b17d75887cf4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1365 microversion: 2.47 time: 0.128946 Oct 02 01:26:51.379283 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2791/5408] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:51 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:51.451329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.479789 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6bf47d6b-d02c-4450-b3b0-b20fe2459783 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.254145 Oct 02 01:26:51.492886 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2618/5409] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:51 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:52.142981 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:52.143834 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:52.153385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:52.156745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:52.166034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:52.167249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:52.170314 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:52.188741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.190723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.191396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.192269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.192898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.194053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.195443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.196015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.196399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.199299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.199800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.200233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.660577 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:52.909078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:52.914577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:52.928217 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ce48a606-3f3a-40da-86c2-e87c59d14a71 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.785930 Oct 02 01:26:52.930322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c60d28d5-ccb9-4192-8bdf-a9fff1235a76 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.768838 Oct 02 01:26:52.947466 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2619/5410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:52 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:52.953866 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2792/5411] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:52 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:52.960654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:52.962626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:52.969741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.973253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.974020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.974584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.975321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.975798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.036882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1adbca7f-0310-496d-afca-24249ac24848 req-8a4396b8-3938-409d-8f9b-b31f2a1e0964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a37695b5-6c72-4eec-8d3c-5ff9e4e36a14", "name": "network-vif-plugged", "status": "completed", "tag": "e0bff18f-9442-4954-b549-578578d326bc"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:53.048367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1adbca7f-0310-496d-afca-24249ac24848 req-8a4396b8-3938-409d-8f9b-b31f2a1e0964 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.048762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1adbca7f-0310-496d-afca-24249ac24848 req-8a4396b8-3938-409d-8f9b-b31f2a1e0964 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.049355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1adbca7f-0310-496d-afca-24249ac24848 req-8a4396b8-3938-409d-8f9b-b31f2a1e0964 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.063778 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1adbca7f-0310-496d-afca-24249ac24848 req-8a4396b8-3938-409d-8f9b-b31f2a1e0964 service nova] Creating event network-vif-plugged:e0bff18f-9442-4954-b549-578578d326bc for instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 on n-h2-master-1 Oct 02 01:26:53.068659 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1adbca7f-0310-496d-afca-24249ac24848 req-8a4396b8-3938-409d-8f9b-b31f2a1e0964 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119705 Oct 02 01:26:53.069321 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2620/5412] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:53.079882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:53.080768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:53.088387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.089039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.089712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.090478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.090970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.091457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.091589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:53.103326 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:53.105397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:53.106793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0bf142a-4009-4a4f-9b61-40923c63e2df tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1371 microversion: 2.47 time: 0.152217 Oct 02 01:26:53.108110 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2793/5413] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:52 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:53.345241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:53.354709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48ad966e-4899-4c68-8f80-6c26d524f6b4 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.279789 Oct 02 01:26:53.370751 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2621/5414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:53 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:53.960552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:53.975515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:53.980993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:53.981757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:53.985638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.986147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.986584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.987321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.987778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.988203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.996256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.996752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.997190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.997902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.998352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.998807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.477029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.482125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.492834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-558cd27e-5f19-4c1d-9585-535c6c6a5ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.541119 Oct 02 01:26:54.495602 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2794/5415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:53 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:54.497327 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23552aa2-23ed-4419-b7b7-85165f2f6d30 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.540951 Oct 02 01:26:54.498118 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2622/5416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:53 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:54.503037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:54.503661 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:54.505749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:54.506555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:54.514938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.515396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.517704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.519077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.519872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.520457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.520727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.521318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.522424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.523775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.524342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.524878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.680571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.694078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.698295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.700187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2afd5bd5-15a5-45f5-8838-ae4dfadf7464 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1371 microversion: 2.47 time: 0.203377 Oct 02 01:26:54.701012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2795/5417] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:54 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:54.707417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:54.710408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:54.719995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.720704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.721329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.722217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.722885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.723489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.762544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d7b6e11-508a-4d7a-89d7-d28023035634 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060206 Oct 02 01:26:54.763777 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2796/5418] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:26:54 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:54.914700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:54.915770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:54.927024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.927578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.929229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.930125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.931329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.932402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.933299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.941422 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e8ff4c6-59ea-4e47-b1fe-78fd607c6982 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1314 microversion: 2.1 time: 0.439591 Oct 02 01:26:54.942630 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2623/5419] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:54 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:55.001804 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-00c49599-1b53-4a52-a7d7-11277f4962ba tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/de996026-7253-46fd-9f2a-25731a8319a5" status: 200 len: 194 microversion: 2.1 time: 0.091760 Oct 02 01:26:55.007985 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2797/5420] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Oct 2 01:26:54 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/de996026-7253-46fd-9f2a-25731a8319a5 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:26:55.016541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:55.017364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:55.024006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.024495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.025404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.025928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.027067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.027663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.127864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lazy-loading 'services' on Instance uuid 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:55.208438 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-caeabe22-8170-4bfd-9819-50eab93491d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/de996026-7253-46fd-9f2a-25731a8319a5" status: 202 len: 0 microversion: 2.1 time: 0.198963 Oct 02 01:26:55.209146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2624/5421] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:26:55 2022] DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/de996026-7253-46fd-9f2a-25731a8319a5 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:26:55.516542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:55.517166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:55.522158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:55.523627 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:55.527538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.528366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.534894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.537046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.537684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.537811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.538208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.538675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.538939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.539932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.540954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.541680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.787425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:55.807838 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e5f6b2bc-9632-429c-86d9-b4bd909cf02e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.292316 Oct 02 01:26:55.814997 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2798/5422] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:55 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:55.820873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:55.824331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:55.832753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:55.839047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.839567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.841700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.842045 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-270ff39f-92dc-4559-a539-12d86630aa53 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.325960 Oct 02 01:26:55.842451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.844196 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2625/5423] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:55 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:55.847192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.847819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.952479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:55.968459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:55.969597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:55.973821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:55.976219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:55.977628 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-320319dc-4931-4f15-b36c-27364c2fc6f4 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1356 microversion: 2.47 time: 0.161433 Oct 02 01:26:55.980884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.982467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.982668 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2799/5424] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:55 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:55.983242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.984629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.985124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.985558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.015854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:56.021568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:56.026050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Searching by: {'deleted': False, 'project_id': '08b504dc949d418fb27c4149a55f669e'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:26:56.039570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.049932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.049932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.049932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.054395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.058347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.307351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:26:56.377707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:56.389826 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-488bd5d0-13d8-4249-b152-1a70065132cc tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1464 microversion: 2.1 time: 0.423885 Oct 02 01:26:56.412818 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2626/5425] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:55 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1464 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:56.431379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0ab01909-7d2d-4971-bd95-9a5b95379f2e req-00baf307-8c54-41fc-ac61-fe1f2e164d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426e4648-6aad-45c7-b4e9-a4ea6db88755", "name": "network-vif-plugged", "status": "completed", "tag": "27657d53-7e84-46a9-8b74-751994c1572c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:56.490253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ab01909-7d2d-4971-bd95-9a5b95379f2e req-00baf307-8c54-41fc-ac61-fe1f2e164d40 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.491016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ab01909-7d2d-4971-bd95-9a5b95379f2e req-00baf307-8c54-41fc-ac61-fe1f2e164d40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.495420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0ab01909-7d2d-4971-bd95-9a5b95379f2e req-00baf307-8c54-41fc-ac61-fe1f2e164d40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.520561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0ab01909-7d2d-4971-bd95-9a5b95379f2e req-00baf307-8c54-41fc-ac61-fe1f2e164d40 service nova] Creating event network-vif-plugged:27657d53-7e84-46a9-8b74-751994c1572c for instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 on n-h2-master-1 Oct 02 01:26:56.521938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:56.533196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.533854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.534513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.537533 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0ab01909-7d2d-4971-bd95-9a5b95379f2e req-00baf307-8c54-41fc-ac61-fe1f2e164d40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120832 Oct 02 01:26:56.538514 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2627/5426] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:56.546043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29d7b003-a530-4a73-bc99-8e93a698869a", "device": "/dev/sdb"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:26:56.549964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:56.561682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:56.565074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:56.571244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.571745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.572366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.573242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.573850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.574429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.631549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e0525b63-72b3-4bb4-aebd-4ef6f5b75eb5 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.621616 Oct 02 01:26:56.650755 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2800/5427] 10.222.0.23 () {60 vars in 1187 bytes} [Sun Oct 2 01:26:56 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:26:56.666421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:56.667206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:56.683387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.684116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.684718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.685586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.686183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.691541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.746776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:26:56.962387 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc7cd243-cc86-4101-82ce-00f7a0bc20db tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 204 len: 0 microversion: 2.47 time: 0.302468 Oct 02 01:26:56.964033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2801/5428] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:26:56 2022] DELETE /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:26:56.975451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:56.977160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:57.005003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.006364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.008251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.010988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.012462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.014945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.155816 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9be51bd-2b38-4715-bb85-f806f49aeef2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "POST /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613401 Oct 02 01:26:57.158056 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2628/5429] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:26:56 2022] POST /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:26:57.172590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:57.177255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:57.191545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.193431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.193996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.199735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.200765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.201689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.592519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:57.602189 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-efcf6e0e-11b3-49fd-9352-ffef3bb69fe0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.636633 Oct 02 01:26:57.605041 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2802/5430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:56 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:57.617578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:57.619069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:57.633106 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.636523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.637512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.638384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.641194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.644537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.791703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:57.804769 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14bda607-c62f-4c7e-a4bf-5cd8ac4c2134 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1367 microversion: 2.1 time: 0.645173 Oct 02 01:26:57.805355 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2629/5431] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:57 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1367 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:57.875252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:57.886223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:57.891377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:57.892831 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a1f718a6-879b-46e8-ac6c-77e623e6e8ea tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1362 microversion: 2.47 time: 0.285100 Oct 02 01:26:57.908048 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2803/5432] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:57 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:26:58.635726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:58.637558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:58.656984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:58.667608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:58.668337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:58.669168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:58.674672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:58.675271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:58.844156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:58.845465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:58.896755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:58.902559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:58.907718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:58.908644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:58.909261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:58.909861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.142430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:59.155544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6b10ed6-657c-4876-bfa8-83f3772c439d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.524534 Oct 02 01:26:59.172997 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2630/5433] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:58 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:59.172997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:59.175149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:59.197085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.199803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.200342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.202700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.207697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.209977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.416261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:59.422407 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:59.433858 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7163db97-fd39-4ccc-b3c8-b8734a4d942e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1556 microversion: 2.1 time: 0.602970 Oct 02 01:26:59.441470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2804/5434] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:58 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1556 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:59.469281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:59.470069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:59.487011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.492741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.493456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.503238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.512607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.513351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.748819 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58448941-7156-4970-96e5-e7a9f6b7469d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.284270 Oct 02 01:26:59.750974 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2805/5435] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:26:59 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:26:59.911899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.912693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.913380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.914005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lazy-loading 'fault' on Instance uuid 2031ce3e-becf-43bc-aad7-d28030fc55bc {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:26:59.920705 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:59.992279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:00.002439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:00.004230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:00.008066 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e19742b-2857-4e54-b8a7-0b4b486ed57e tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 200 len: 1367 microversion: 2.47 time: 0.847642 Oct 02 01:27:00.026624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2631/5436] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:26:59 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 1367 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:27:00.180523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:00.181290 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:00.196589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:00.196960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:00.197419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:00.198289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:00.198796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:00.199230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:00.850906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:00.868736 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4db22a1-6c1f-4c89-ba5e-e53f810aa6b4 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1532 microversion: 2.1 time: 0.690646 Oct 02 01:27:00.874346 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2806/5437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:00 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1532 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:01.044487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:01.045142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: 2031ce3e-becf-43bc-aad7-d28030fc55bc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:01.075660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.076166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.076603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.077330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.078367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.078835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.121855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] HTTP exception thrown: Instance 2031ce3e-becf-43bc-aad7-d28030fc55bc could not be found. Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Request method failure captured: Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc HTTP/1.1 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOizCvcnLdmfsLLsAqUASDVklinaXWsEGn_KADhFWo4MXs3qYWKwU2eLvfaSFnl4362chkvcWM4m_RfyQ46uQbasIsP1p9kOshLw_M2VBL4-NYL5Jth__HJpFdSNsEBGx078SC2kOW6R9PjSip0x5ul9y0WeTf0ZYkWdfnYzH8va7ZA Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.47 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 08b504dc949d418fb27c4149a55f669e Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerShowV247Test-876684651 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/08b504dc949d418fb27c4149a55f669e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08b504dc949d418fb27c4149a55f669e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08b504dc949d418fb27c4149a55f669e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_08b504dc949d418fb27c4149a55f669e"}]}] Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerShowV247Test-876684651 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 08b504dc949d418fb27c4149a55f669e Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerShowV247Test-876684651 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerShowV247Test-876684651-project Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: b2ffde89d3704dd68bdb30ac4ad3ff53 Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerShowV247Test-876684651-project Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 2031ce3e-becf-43bc-aad7-d28030fc55bc could not be found. Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '2031ce3e-becf-43bc-aad7-d28030fc55bc'} Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2031ce3e-becf-43bc-aad7-d28030fc55bc could not be found. Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2031ce3e-becf-43bc-aad7-d28030fc55bc could not be found. Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:01.124644 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2031ce3e-becf-43bc-aad7-d28030fc55bc could not be found. Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Returning 404 to user: Instance 2031ce3e-becf-43bc-aad7-d28030fc55bc could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:01.130348 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ca5d97a-c285-4fdb-b2b2-3d34320d68c9 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc" status: 404 len: 111 microversion: 2.47 time: 0.086675 Oct 02 01:27:01.132140 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2632/5438] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:27:01 2022] GET /compute/v2.1/servers/2031ce3e-becf-43bc-aad7-d28030fc55bc => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:27:01.140232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:01.141443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:01.165701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.166864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.167769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.169155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.170777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.172808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.210229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:27:01.369955 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dcf98349-49f2-4ef4-9c07-30678c6129ae tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51" status: 204 len: 0 microversion: 2.47 time: 0.233514 Oct 02 01:27:01.371424 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2807/5439] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:27:01 2022] DELETE /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:27:01.380317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:01.381265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:01.389143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.389771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.391066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.392213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.392925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.393588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.690375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:01.699707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:01.702113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:01.704814 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-571449b8-3805-42a7-9767-00104b21bef0 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51" status: 200 len: 1362 microversion: 2.47 time: 0.328884 Oct 02 01:27:01.706127 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2633/5440] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:27:01 2022] GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:27:01.899220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:01.900874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:01.919027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.919698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.923319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.924236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.925357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.928531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:02.098559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:02.109966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc83528d-29e9-44dd-b713-a8507a249f33 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1532 microversion: 2.1 time: 0.215640 Oct 02 01:27:02.110571 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2808/5441] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:01 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1532 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:02.208072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f474f5a6-ec6d-48a6-9cc6-d851faea644b req-fd65a3e7-15b8-424f-b6cc-24384467c2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426e4648-6aad-45c7-b4e9-a4ea6db88755", "tag": "27657d53-7e84-46a9-8b74-751994c1572c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:02.228158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f474f5a6-ec6d-48a6-9cc6-d851faea644b req-fd65a3e7-15b8-424f-b6cc-24384467c2d6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:02.228644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f474f5a6-ec6d-48a6-9cc6-d851faea644b req-fd65a3e7-15b8-424f-b6cc-24384467c2d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:02.229071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f474f5a6-ec6d-48a6-9cc6-d851faea644b req-fd65a3e7-15b8-424f-b6cc-24384467c2d6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:02.264141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f474f5a6-ec6d-48a6-9cc6-d851faea644b req-fd65a3e7-15b8-424f-b6cc-24384467c2d6 service nova] Creating event network-changed:27657d53-7e84-46a9-8b74-751994c1572c for instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 on n-h2-master-1 Oct 02 01:27:02.286312 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f474f5a6-ec6d-48a6-9cc6-d851faea644b req-fd65a3e7-15b8-424f-b6cc-24384467c2d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081917 Oct 02 01:27:02.287275 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2634/5442] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:02.729989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:02.730614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:02.733605 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:02.751548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:02.752052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:02.752502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:02.753229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:02.753695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:02.754129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:02.850273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:02.863114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:02.864821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:02.866186 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6fe4ebdd-bd00-4a05-8e35-ea7c7ace94d2 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51" status: 200 len: 1362 microversion: 2.47 time: 0.140700 Oct 02 01:27:02.867419 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2809/5443] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:27:02 2022] GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:27:03.143875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:03.144611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:03.190908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.191634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.197993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.199072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.199712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.200405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.308416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:03.309242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:03.320247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.324884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.328211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.329475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.331181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.331784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.381302 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-29f5d8cd-f20b-4be2-a928-e999c37faf91 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/c9a98a4b-4e78-46d3-ac97-67c37c95923c" status: 200 len: 194 microversion: 2.1 time: 0.077258 Oct 02 01:27:03.382659 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2810/5444] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Oct 2 01:27:03 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/c9a98a4b-4e78-46d3-ac97-67c37c95923c => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:03.398160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:03.399419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:03.407654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.408508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.409157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.410114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.412683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.413406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.461932 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:03.470824 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6f961d9-9b54-4ce2-82c5-12e0876b8e28 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1532 microversion: 2.1 time: 0.337738 Oct 02 01:27:03.488422 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2635/5445] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:03 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1532 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:03.559698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lazy-loading 'services' on Instance uuid 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:27:03.664261 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7739d928-620a-4ccf-ae25-441a004687d3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/c9a98a4b-4e78-46d3-ac97-67c37c95923c" status: 202 len: 0 microversion: 2.1 time: 0.270493 Oct 02 01:27:03.665406 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2811/5446] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:27:03 2022] DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments/c9a98a4b-4e78-46d3-ac97-67c37c95923c => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:27:03.893872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:03.894815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:03.939122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.939643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.940103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.940850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.941322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.941764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.044370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:04.044870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:04.063266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.063831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lazy-loading 'fault' on Instance uuid c5671673-544c-4aa1-9f36-92ea92b29f51 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:27:04.126273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-70916a7f-dbdb-4ec9-ac0b-928ac30b44b5 req-6cda4f7b-ee9b-4769-86f1-403f10af4b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96486de-fc69-42c7-a62e-00eb5168b457", "name": "network-vif-plugged", "status": "completed", "tag": "8bdae8b4-9693-43bf-a3f9-b140a3ffeda5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:04.143699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70916a7f-dbdb-4ec9-ac0b-928ac30b44b5 req-6cda4f7b-ee9b-4769-86f1-403f10af4b73 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:04.144352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70916a7f-dbdb-4ec9-ac0b-928ac30b44b5 req-6cda4f7b-ee9b-4769-86f1-403f10af4b73 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:04.144935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70916a7f-dbdb-4ec9-ac0b-928ac30b44b5 req-6cda4f7b-ee9b-4769-86f1-403f10af4b73 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.166528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:04.178366 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-70916a7f-dbdb-4ec9-ac0b-928ac30b44b5 req-6cda4f7b-ee9b-4769-86f1-403f10af4b73 service nova] Creating event network-vif-plugged:8bdae8b4-9693-43bf-a3f9-b140a3ffeda5 for instance f96486de-fc69-42c7-a62e-00eb5168b457 on n-h1-master-1 Oct 02 01:27:04.180138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:04.182194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2ffde89d3704dd68bdb30ac4ad3ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b504dc949d418fb27c4149a55f669e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:04.183632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4f25dce9-0fdf-4c75-a030-2e0c50a61278 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51" status: 200 len: 1367 microversion: 2.47 time: 0.294203 Oct 02 01:27:04.185187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-70916a7f-dbdb-4ec9-ac0b-928ac30b44b5 req-6cda4f7b-ee9b-4769-86f1-403f10af4b73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063974 Oct 02 01:27:04.186100 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2812/5447] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:04.196570 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2636/5448] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:27:03 2022] GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:27:04.506073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:04.508266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:04.519825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:04.520569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:04.521015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.521736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:04.522198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:04.522646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.762671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:04.774781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a73109ea-0024-44de-a141-1559648ad047 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1532 microversion: 2.1 time: 0.280067 Oct 02 01:27:04.775396 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2813/5449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:04 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1532 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:05.213170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:05.214373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] [instance: c5671673-544c-4aa1-9f36-92ea92b29f51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:05.223236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:05.223734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:05.224172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:05.224890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:05.225347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:05.225772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:05.241606 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] HTTP exception thrown: Instance c5671673-544c-4aa1-9f36-92ea92b29f51 could not be found. Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Request method failure captured: Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 HTTP/1.1 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOizCvcnLdmfsLLsAqUASDVklinaXWsEGn_KADhFWo4MXs3qYWKwU2eLvfaSFnl4362chkvcWM4m_RfyQ46uQbasIsP1p9kOshLw_M2VBL4-NYL5Jth__HJpFdSNsEBGx078SC2kOW6R9PjSip0x5ul9y0WeTf0ZYkWdfnYzH8va7ZA Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.47 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 08b504dc949d418fb27c4149a55f669e Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerShowV247Test-876684651 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/08b504dc949d418fb27c4149a55f669e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08b504dc949d418fb27c4149a55f669e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08b504dc949d418fb27c4149a55f669e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_08b504dc949d418fb27c4149a55f669e"}]}] Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerShowV247Test-876684651 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 08b504dc949d418fb27c4149a55f669e Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerShowV247Test-876684651 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerShowV247Test-876684651-project Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: b2ffde89d3704dd68bdb30ac4ad3ff53 Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerShowV247Test-876684651-project Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c5671673-544c-4aa1-9f36-92ea92b29f51 could not be found. Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c5671673-544c-4aa1-9f36-92ea92b29f51'} Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5671673-544c-4aa1-9f36-92ea92b29f51 could not be found. Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5671673-544c-4aa1-9f36-92ea92b29f51 could not be found. Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:05.243571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5671673-544c-4aa1-9f36-92ea92b29f51 could not be found. Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] Returning 404 to user: Instance c5671673-544c-4aa1-9f36-92ea92b29f51 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9a7c5e7a-53e4-436d-9513-2dae2eaf3829 tempest-ServerShowV247Test-876684651 tempest-ServerShowV247Test-876684651-project] 10.222.0.23 "GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51" status: 404 len: 111 microversion: 2.47 time: 0.036711 Oct 02 01:27:05.246870 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2637/5450] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:27:05 2022] GET /compute/v2.1/servers/c5671673-544c-4aa1-9f36-92ea92b29f51 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:27:05.809194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:05.810655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:05.841126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:05.842577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:05.843852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:05.846977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:05.847695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:05.848753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:06.083454 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:27:06.084862 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 (ip 10.222.0.23) !!! Oct 02 01:27:06.127856 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:06.137504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:06.170202 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46787975-90ef-4dd6-aaa9-c3211a9b4e42 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1532 microversion: 2.1 time: 0.374740 Oct 02 01:27:06.171854 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2814/5451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:05 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1532 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:07.197864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:07.198536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:07.200795 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:07.222251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:07.223820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:07.224325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:07.225038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:07.225510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:07.225950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:07.354401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9d15cd4b-28d2-44eb-8fe2-227666103478 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Action: 'create', calling method: .version_select at 0x7fb880818ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-188495137", "metadata": {"Type": "work"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:07.474833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:07.484975 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-807bc2e3-be2b-4b01-a7b0-cae80e5640a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.291314 Oct 02 01:27:07.485738 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2815/5452] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:07 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:27:08.508716 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:08.509545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:08.522888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:08.523397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:08.523841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:08.524567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:08.525032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:08.525469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:08.857727 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:08.870949 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-545795bc-2489-40b9-9661-5d785835bb83 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.365963 Oct 02 01:27:08.872105 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2816/5453] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:08 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:09.895894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:09.896509 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:09.910109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:09.910637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:09.911176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:09.911892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:09.912347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:09.912889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:10.191477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:10.200589 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f2052233-2ff7-470c-8525-556e208ca0fe tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.308697 Oct 02 01:27:10.206160 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2817/5454] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:09 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:11.228407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:11.230346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:11.244685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:11.257158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:11.258493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:11.259652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:11.260380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:11.262578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:11.673942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:11.683050 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb89060f-591b-4629-9d69-fc3199ae94d0 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.459103 Oct 02 01:27:11.691910 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2818/5455] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:11 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:27:12.717368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:12.718029 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:12.734482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:12.742543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:12.743615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:12.745236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:12.746360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:12.752923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:13.191855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:13.209862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3767dfa2-4c6a-4030-9940-d23a33a08189 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.497387 Oct 02 01:27:13.227107 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2819/5456] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:12 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:14.240489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:14.242242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:14.279271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:14.282330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:14.283437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:14.287347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:14.290615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:14.297306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:14.334551 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:14.779878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:14.802457 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8dc61138-186d-4ae0-bea2-24baad447854 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.565727 Oct 02 01:27:14.803359 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2820/5457] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:14 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:14.889646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:14.892792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:14.901610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:14.903054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:14.904103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:14.905088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:14.906010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:14.906676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:14.943246 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d39112ab-0f45-4417-a109-43c85b105f86 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058208 Oct 02 01:27:14.944422 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2821/5458] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:27:14 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:27:14.992382 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9d15cd4b-28d2-44eb-8fe2-227666103478 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 7.866312 Oct 02 01:27:14.993320 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2638/5459] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:27:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 7868 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 02 01:27:15.008729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9aff34fb-dbcd-4aae-b68c-43d575113376 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb88102e0d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:15.141834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9aff34fb-dbcd-4aae-b68c-43d575113376 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 200 len: 352 microversion: 2.1 time: 0.138582 Oct 02 01:27:15.142873 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2822/5460] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:15 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:15.222738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:15.224935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:15.240349 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=41 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:15.241353 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=29 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:15.246706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.247258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.247747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.248449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.259121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.260007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.300305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-61359919-a88b-41b1-b982-46ccd2e6b9f7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084291 Oct 02 01:27:15.308418 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2639/5461] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:27:15 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:27:15.521572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:15.522224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:15.534150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.535344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.536061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.536913 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.539474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.540622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.575133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:27:15.709047 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-489e6bfd-2016-4c7b-be72-30a8efae153b tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 204 len: 0 microversion: 2.1 time: 0.191777 Oct 02 01:27:15.709728 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2823/5462] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:27:15 2022] DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:27:15.719092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:15.719660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:15.737272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.739278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.742618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.743590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.747409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.748152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.832298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:15.833578 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:15.861560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.863905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.864644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.868796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.870069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.873187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:16.337396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:16.357331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-468ee2a1-5171-471c-8420-116e931a61c1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1674 microversion: 2.1 time: 0.638260 Oct 02 01:27:16.361708 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2640/5463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:15 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1674 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:16.381121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-635e3957-2ad4-452a-8853-e8405d2dc1d7 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb8808185e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:16.458330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:16.470906 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8aed1fb2-25e3-40c5-933c-ff20923212a3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.645877 Oct 02 01:27:16.471649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2824/5464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:15 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:16.563948 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-635e3957-2ad4-452a-8853-e8405d2dc1d7 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 200 len: 353 microversion: 2.1 time: 0.200063 Oct 02 01:27:16.573585 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2641/5465] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:16 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:16.580699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc611e18-c222-4371-8af9-9fe9ae1ad469 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb882092820>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:16.679756 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc611e18-c222-4371-8af9-9fe9ae1ad469 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 200 len: 353 microversion: 2.1 time: 0.102221 Oct 02 01:27:16.680759 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2825/5466] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:16 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:16.696507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08d0b0f4-b4a4-4179-8581-64b42923b796 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb8808d55e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:16.835837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08d0b0f4-b4a4-4179-8581-64b42923b796 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 202 len: 0 microversion: 2.1 time: 0.143119 Oct 02 01:27:16.845026 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2642/5467] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:27:16 2022] DELETE /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:27:16.847518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a0fb91a-8794-41a4-be04-f6791123574b tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb8809d6670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:16.930398 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a0fb91a-8794-41a4-be04-f6791123574b tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 200 len: 352 microversion: 2.1 time: 0.089392 Oct 02 01:27:16.940786 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2826/5468] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:16 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:17.394340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:17.395606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:17.413693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:17.425816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:17.434934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:17.435981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:17.438425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:17.440553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:17.498184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:17.500749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:17.552115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:17.553607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:17.555548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:17.556566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:17.558135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:17.560186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:17.931491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:17.946515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9050b258-a60a-4a3b-8fc5-14a9d674e1e7 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1674 microversion: 2.1 time: 0.557455 Oct 02 01:27:17.949772 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2643/5469] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:17 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1674 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:17.993823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9ca58d6-fe7d-4c8d-9783-847056accb7e tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb880912940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:18.087702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:18.096931 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea072923-6dd4-4aff-866f-904b1ddcd7f5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.605822 Oct 02 01:27:18.133752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9ca58d6-fe7d-4c8d-9783-847056accb7e tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 200 len: 352 microversion: 2.1 time: 0.169006 Oct 02 01:27:18.134321 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2644/5471] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:17 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:18.134426 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2827/5471] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:17 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:18.978539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:18.979305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:19.004450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:19.004966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:19.005441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:19.006173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:19.006627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:19.007071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:19.133162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:19.133845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:19.150098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:19.150639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:19.151101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:19.151797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:19.152257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:19.152696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:19.600601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:19.659035 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab90fa3f-7ecc-41bb-9a02-9e6fa2f41ce1 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1606 microversion: 2.1 time: 0.662377 Oct 02 01:27:19.661107 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2645/5472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:18 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1606 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:19.707004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26b8e857-7ac7-4b81-8d65-87c7663fa7c3 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb88084ef70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:19.932859 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26b8e857-7ac7-4b81-8d65-87c7663fa7c3 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 200 len: 352 microversion: 2.1 time: 0.252649 Oct 02 01:27:19.934460 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2646/5473] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:19 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 352 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:20.041031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:20.051013 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8bc81ec2-8320-4205-ada0-3e5b7db07935 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.920619 Oct 02 01:27:20.062949 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2828/5474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:19 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:20.221536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6a0bbda4-a197-4d79-8fba-4d1022a04b6f req-1db4b2a1-acaf-4171-8d9a-e51eb75cfe14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1a5d10-4ddb-4ea5-a54d-d88b4f919135", "name": "network-vif-deleted", "tag": "54bd3ddf-9613-46df-bbba-d5b6ba44bbd2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:20.279535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6a0bbda4-a197-4d79-8fba-4d1022a04b6f req-1db4b2a1-acaf-4171-8d9a-e51eb75cfe14 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:20.287584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6a0bbda4-a197-4d79-8fba-4d1022a04b6f req-1db4b2a1-acaf-4171-8d9a-e51eb75cfe14 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:20.288211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6a0bbda4-a197-4d79-8fba-4d1022a04b6f req-1db4b2a1-acaf-4171-8d9a-e51eb75cfe14 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:20.317064 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6a0bbda4-a197-4d79-8fba-4d1022a04b6f req-1db4b2a1-acaf-4171-8d9a-e51eb75cfe14 service nova] Creating event network-vif-deleted:54bd3ddf-9613-46df-bbba-d5b6ba44bbd2 for instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 on n-h2-master-1 Oct 02 01:27:20.328188 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6a0bbda4-a197-4d79-8fba-4d1022a04b6f req-1db4b2a1-acaf-4171-8d9a-e51eb75cfe14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110248 Oct 02 01:27:20.333898 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2647/5475] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:20.693137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:20.693948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:20.705635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:20.706493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:20.708833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:20.709796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:20.713725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:20.714453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:20.803030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:20.803853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:20.804526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:20.806377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lazy-loading 'fault' on Instance uuid 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:27:20.889197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1fa0967b8444279e5bad164b635df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ab6dbed6cd4a09989164757910b06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:20.902029 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-51104db2-2ae8-4638-b884-b31bc27e813f tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 200 len: 1328 microversion: 2.1 time: 0.211819 Oct 02 01:27:20.907528 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2829/5476] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:20 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:20.949356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb5e8580-7529-4406-b502-6dcce5b7ba00 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Calling method '.version_select at 0x7fb880991b80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:21.081780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:21.082460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:21.125779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:21.126533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:21.131411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:21.132373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:21.132865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:21.133310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:21.588133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:21.602560 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5da22efb-4ac5-479d-9c23-b2e55eeacb90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.525896 Oct 02 01:27:21.605710 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2830/5477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:21 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:27:21.932562 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:21.934015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:21.957558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:21.980048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:21.984732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:21.985638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:21.986136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:21.989494 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:22.037638 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] HTTP exception thrown: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Request method failure captured: Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 HTTP/1.1 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOcyf13r2ZU821Q-HA_tQOCi4IfBvEBGzSvElEiuXxrS7uKoxYN5sFvudbb8-iKG4ImDMYh6TvzdU-6lXchvRsl4NvGr_dQoruG72BQGbXPUDMQMgGBQPqh3n9op1uqy2ZFQpM-utPE9WiMj4P0ZCYnBKBpyrXP1nivC_P9-bg2GmBg Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8ab6dbed6cd4a09989164757910b06b"}]}] Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fe1fa0967b8444279e5bad164b635df5 Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0a1a5d10-4ddb-4ea5-a54d-d88b4f919135'} Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:22.044183 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:22.049586 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.051198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Returning 404 to user: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:22.052261 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb6b3d69-9c57-4a1a-9a4e-e68e4e7504e0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 404 len: 111 microversion: 2.1 time: 0.125195 Oct 02 01:27:22.054013 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2831/5478] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:21 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:27:22.063227 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-82c57908-be6f-4c9b-9349-b6323609cfd0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '.version_select at 0x7fb880547700>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:22.111365 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-82c57908-be6f-4c9b-9349-b6323609cfd0 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924298514" status: 202 len: 0 microversion: 2.1 time: 0.052218 Oct 02 01:27:22.112788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2832/5479] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924298514 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:27:22.630137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:22.632676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:22.656994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:22.659400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:22.660276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:22.664145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:22.667014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:22.667532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:22.823501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-cb5e8580-7529-4406-b502-6dcce5b7ba00 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] HTTP exception thrown: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb5e8580-7529-4406-b502-6dcce5b7ba00 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Request method failure captured: Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 HTTP/1.1 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOjqe0JqZXYnG29fDgtOGCovbR121jPc4rtVQpq0v8U1XqNnxQcGrU3lfAAyNXqYRY4Y3xJtecqY57IJeqNOXKcgeuPpWyY1AnnO5Pby341VNbI8-OB12l9IN8cFTRqwdRdVepenjj9Wf-GVdF9RQ1itQyuc6NT1sDylylYH6GI34kg Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8aa90be9f4d34051b2d556a871bd960c Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesGetTestJSON-757547617 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8aa90be9f4d34051b2d556a871bd960c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8aa90be9f4d34051b2d556a871bd960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8aa90be9f4d34051b2d556a871bd960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8aa90be9f4d34051b2d556a871bd960c"}]}] Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesGetTestJSON-757547617 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8aa90be9f4d34051b2d556a871bd960c Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesGetTestJSON-757547617 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesGetTestJSON-757547617-project Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 554662c41c244bf5b2720aced1f66355 Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesGetTestJSON-757547617-project Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: exception: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3581e2e7-378a-44c7-9ceb-60033dc32575'} Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. (HTTP 404) (Request-ID: req-bffaa5f0-c629-4a8c-8148-493aea177f77) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:27:22.826517 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb5e8580-7529-4406-b502-6dcce5b7ba00 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] Returning 404 to user: Volume 3581e2e7-378a-44c7-9ceb-60033dc32575 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb5e8580-7529-4406-b502-6dcce5b7ba00 tempest-VolumesGetTestJSON-757547617 tempest-VolumesGetTestJSON-757547617-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575" status: 404 len: 109 microversion: 2.1 time: 1.884071 Oct 02 01:27:22.832432 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2648/5480] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:27:20 2022] GET /compute/v2.1/os-volumes/3581e2e7-378a-44c7-9ceb-60033dc32575 => generated 109 bytes in 1885 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:27:22.982480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:22.993013 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9bdd12fb-9321-49e7-9d63-e0d5f4ed7322 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.368364 Oct 02 01:27:22.993948 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2833/5481] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:22 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:27:24.019944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:24.020705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:24.028425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:24.029818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:24.030716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:24.031706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:24.033965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:24.034751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:24.453959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:24.465555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-da576e5e-5ff2-458e-af33-306b448204a5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.451922 Oct 02 01:27:24.493483 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2649/5482] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:24 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:25.490384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:25.491105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:25.502741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:25.503249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:25.503696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:25.504422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:25.504886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:25.505321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:26.261437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:26.271839 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a73a4b8a-b7f7-4fcb-ad6a-1f35a3155c6b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.786029 Oct 02 01:27:26.295115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2834/5483] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:25 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:27.310451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:27.312222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:27.338892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:27.344230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:27.344772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:27.345578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:27.346015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:27.346456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:27.759942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:27.782206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e57853fd-1d55-4b68-9c41-4d1c3ec1c11d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.478462 Oct 02 01:27:27.786301 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2650/5484] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:27 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:28.816595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:28.818067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:28.835338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:28.837434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:28.843140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:28.844601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:28.845292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:28.845934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:29.254332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:29.278958 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-553d48df-b92c-45c5-8208-3227b4d0989e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1527 microversion: 2.1 time: 0.464475 Oct 02 01:27:29.281654 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2835/5485] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:28 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:30.313741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:30.315406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:30.337292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:30.337790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:30.338231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:30.338970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:30.354225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:30.355358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:30.604432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:30.618051 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b450f41-aa8f-4823-aefa-abff105fff00 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1509 microversion: 2.1 time: 0.315352 Oct 02 01:27:30.619545 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2651/5486] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:30 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:31.646015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:31.647571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:31.680643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:31.681656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:31.683158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:31.684255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:31.685012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:31.685709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:31.976472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:31.992921 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-246a264c-84d2-448f-9fdb-89766bf4dbc3 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1509 microversion: 2.1 time: 0.350709 Oct 02 01:27:31.993535 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2836/5487] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:31 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:32.251476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d567d4d9-da84-4dda-b80a-2e461d097efd req-66b576e8-14d9-4a7f-9213-952798b33c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96486de-fc69-42c7-a62e-00eb5168b457", "name": "network-vif-unplugged", "status": "completed", "tag": "8bdae8b4-9693-43bf-a3f9-b140a3ffeda5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:32.296249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d567d4d9-da84-4dda-b80a-2e461d097efd req-66b576e8-14d9-4a7f-9213-952798b33c40 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:32.308503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d567d4d9-da84-4dda-b80a-2e461d097efd req-66b576e8-14d9-4a7f-9213-952798b33c40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:32.309128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d567d4d9-da84-4dda-b80a-2e461d097efd req-66b576e8-14d9-4a7f-9213-952798b33c40 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:32.332739 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d567d4d9-da84-4dda-b80a-2e461d097efd req-66b576e8-14d9-4a7f-9213-952798b33c40 service nova] Creating event network-vif-unplugged:8bdae8b4-9693-43bf-a3f9-b140a3ffeda5 for instance f96486de-fc69-42c7-a62e-00eb5168b457 on n-h1-master-1 Oct 02 01:27:32.345607 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d567d4d9-da84-4dda-b80a-2e461d097efd req-66b576e8-14d9-4a7f-9213-952798b33c40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097764 Oct 02 01:27:32.346475 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2652/5488] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:33.032028 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:33.032530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:33.035295 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:33.042986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:33.043484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:33.043927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:33.044641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:33.045096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:33.046066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:33.365260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:33.376674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-52c4b3d6-83af-4ad2-b2d8-07dff7bd5f2b tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1512 microversion: 2.1 time: 0.348321 Oct 02 01:27:33.377820 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2837/5489] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:33 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:33.410567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:33.412173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:33.439021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:33.441292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:33.442014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:33.446940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:33.448569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:33.449537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:33.784211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:33.801102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c5b33a5-3c6d-48e3-a088-2c30b9e38d90 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1452 microversion: 2.1 time: 0.394648 Oct 02 01:27:33.802472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2653/5490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:33 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1452 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:33.876601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:33.877379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:33.887912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:33.888624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:33.889906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:33.895562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:33.896244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:33.896841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:33.946976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lazy-loading 'flavor' on Instance uuid f96486de-fc69-42c7-a62e-00eb5168b457 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:27:33.971149 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'shelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state shelved_offloaded Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 14 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: {"shelve": {}} Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'shelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state shelved_offloaded Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'shelve': {}}} Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:27:33.980005 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state shelved_offloaded Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state shelved_offloaded Oct 02 01:27:33.984403 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:33.985779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'shelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state shelved_offloaded {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:33.986867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f23142cf-c86c-4cf9-b9aa-47871dfa43ce tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 155 microversion: 2.1 time: 0.114394 Oct 02 01:27:33.987619 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2838/5491] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:27:33 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 155 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:27:34.002819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:34.003853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:34.025776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:34.027080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:34.028583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:34.030186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:34.033381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:34.034817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:34.138247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122354) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:27:34.326201 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53454a64-09ab-4964-a414-7459b510b595 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 202 len: 0 microversion: 2.1 time: 0.332124 Oct 02 01:27:34.343665 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2654/5492] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:27:33 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:27:34.351445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:34.352062 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:34.369926 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:34.370633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:34.371244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:34.372108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:34.372715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:34.373289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:34.398788 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:34.930755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:34.941122 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1abcd0b1-80b0-4da0-9b9c-5a9bc5f7947a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1460 microversion: 2.1 time: 0.593461 Oct 02 01:27:34.944612 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2839/5493] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:34 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1460 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:35.977408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:35.979111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:35.991883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:35.993142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:35.993744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:35.996303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:35.996942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.000552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.538652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:36.539721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:36.558246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:36.560117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.560550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:36.560695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.565438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:36.567325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.567582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.580636 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df2a1190-cb76-4754-b3fb-11420e43e9df tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1460 microversion: 2.1 time: 0.607387 Oct 02 01:27:36.581696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2655/5494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:35 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1460 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:36.606697 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] HTTP exception thrown: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Request method failure captured: Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 HTTP/1.1 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOcyf13r2ZU821Q-HA_tQOCi4IfBvEBGzSvElEiuXxrS7uKoxYN5sFvudbb8-iKG4ImDMYh6TvzdU-6lXchvRsl4NvGr_dQoruG72BQGbXPUDMQMgGBQPqh3n9op1uqy2ZFQpM-utPE9WiMj4P0ZCYnBKBpyrXP1nivC_P9-bg2GmBg Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8ab6dbed6cd4a09989164757910b06b"}]}] Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fe1fa0967b8444279e5bad164b635df5 Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0a1a5d10-4ddb-4ea5-a54d-d88b4f919135'} Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:36.608917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.612439 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.615511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Returning 404 to user: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:36.616924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65a9e300-2522-49e8-95dc-a484025389c3 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 404 len: 111 microversion: 2.1 time: 0.082965 Oct 02 01:27:36.618085 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2840/5495] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:27:36 2022] DELETE /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:27:36.626928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:36.627664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:36.639618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:36.640828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.641286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.642017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:36.642484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.642953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.654143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:36.655946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:36.672877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:36.674183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.674828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.675751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:36.676694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:36.677809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:36.680951 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] HTTP exception thrown: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Request method failure captured: Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 HTTP/1.1 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOcyf13r2ZU821Q-HA_tQOCi4IfBvEBGzSvElEiuXxrS7uKoxYN5sFvudbb8-iKG4ImDMYh6TvzdU-6lXchvRsl4NvGr_dQoruG72BQGbXPUDMQMgGBQPqh3n9op1uqy2ZFQpM-utPE9WiMj4P0ZCYnBKBpyrXP1nivC_P9-bg2GmBg Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8ab6dbed6cd4a09989164757910b06b"}]}] Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: fe1fa0967b8444279e5bad164b635df5 Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0a1a5d10-4ddb-4ea5-a54d-d88b4f919135'} Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:36.689049 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Returning 404 to user: Instance 0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-98c851b8-cc9a-488c-8ba1-88178eaa7abf tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135" status: 404 len: 111 microversion: 2.1 time: 0.069342 Oct 02 01:27:36.692588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2656/5496] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:36 2022] GET /compute/v2.1/servers/0a1a5d10-4ddb-4ea5-a54d-d88b4f919135 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:27:36.731186 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2e466ea-58f1-41ed-8e11-8f9ce1ed588b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/ips" status: 200 len: 148 microversion: 2.1 time: 0.081645 Oct 02 01:27:36.737647 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2841/5497] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:27:36 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/ips => generated 148 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:27:37.605734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:37.606349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:37.623896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:37.632131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:37.636124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:37.641236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:37.643194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:37.643860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:40.104658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:40.122105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20c9086a-491d-48cf-9e8e-fe53912e2010 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 2.513092 Oct 02 01:27:40.125047 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2657/5498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:37 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:41.053445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "310185a5-6c14-420b-a6cd-f69b5324b940"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:27:41.062394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:41.091661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:41.093394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:41.094230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:41.095194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:41.108369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:41.113585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:41.150137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:41.151518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:41.203961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:41.204833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:41.205895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:41.207482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:41.211860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:41.216424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:41.862197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:41.888476 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a95ca44-d51c-4833-811a-894bec7f4e46 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.739465 Oct 02 01:27:41.893591 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2658/5499] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:41 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:27:42.065611 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c38c55c6-5f7f-4ca7-b4e0-671b4ead8dfa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "POST /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016295 Oct 02 01:27:42.071966 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2842/5500] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:27:41 2022] POST /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 194 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:27:42.923459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:42.924599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:42.938814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:42.939309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:42.939759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:42.940451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:42.940921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:42.941350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:43.885500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:43.894474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3587e3ea-ee43-4e1d-80de-4b9f7a8316c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.975540 Oct 02 01:27:43.907788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2659/5501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:42 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:27:44.937356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:44.938825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:44.980141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:44.986225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:44.988102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:44.989039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:44.995090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:44.996013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:45.601734 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:45.611327 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c88b1ea-ccd9-4a7b-9f08-5e6528b38db9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.683164 Oct 02 01:27:45.616606 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2843/5502] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:44 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:46.285244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:46.286338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:46.304038 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:46.306389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:46.310009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:46.314315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:46.317940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:46.318692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:46.324569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:46.385899 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:46.399224 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] HTTP exception thrown: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Request method failure captured: Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 HTTP/1.1 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOcyf13r2ZU821Q-HA_tQOCi4IfBvEBGzSvElEiuXxrS7uKoxYN5sFvudbb8-iKG4ImDMYh6TvzdU-6lXchvRsl4NvGr_dQoruG72BQGbXPUDMQMgGBQPqh3n9op1uqy2ZFQpM-utPE9WiMj4P0ZCYnBKBpyrXP1nivC_P9-bg2GmBg Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8ab6dbed6cd4a09989164757910b06b"}]}] Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: fe1fa0967b8444279e5bad164b635df5 Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '1fcb084b-b447-445b-8204-c2fd6ccb1a51'} Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:46.401620 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.405284 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.415029 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Returning 404 to user: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:46.418918 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0bb8050f-0e1c-40b1-9b5f-5341003bf613 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 404 len: 111 microversion: 2.1 time: 0.137807 Oct 02 01:27:46.426439 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2660/5503] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:27:46 2022] DELETE /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:27:46.441595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:46.441595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] [instance: 1fcb084b-b447-445b-8204-c2fd6ccb1a51] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:46.458176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:46.472790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:46.473830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:46.475229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:46.482903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:46.483934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:46.586759 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] HTTP exception thrown: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Request method failure captured: Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 HTTP/1.1 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOcyf13r2ZU821Q-HA_tQOCi4IfBvEBGzSvElEiuXxrS7uKoxYN5sFvudbb8-iKG4ImDMYh6TvzdU-6lXchvRsl4NvGr_dQoruG72BQGbXPUDMQMgGBQPqh3n9op1uqy2ZFQpM-utPE9WiMj4P0ZCYnBKBpyrXP1nivC_P9-bg2GmBg Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e8ab6dbed6cd4a09989164757910b06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e8ab6dbed6cd4a09989164757910b06b"}]}] Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e8ab6dbed6cd4a09989164757910b06b Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1201660433 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: fe1fa0967b8444279e5bad164b635df5 Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeTestJSON-1201660433-project Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '1fcb084b-b447-445b-8204-c2fd6ccb1a51'} Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:27:46.588870 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. Oct 02 01:27:46.593390 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:27:46.595823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] Returning 404 to user: Instance 1fcb084b-b447-445b-8204-c2fd6ccb1a51 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:27:46.603783 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a21d457d-46d2-4711-a398-0ff99579c381 tempest-AttachVolumeTestJSON-1201660433 tempest-AttachVolumeTestJSON-1201660433-project] 10.222.0.23 "GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51" status: 404 len: 111 microversion: 2.1 time: 0.175697 Oct 02 01:27:46.605253 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2844/5504] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:46 2022] GET /compute/v2.1/servers/1fcb084b-b447-445b-8204-c2fd6ccb1a51 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:27:46.653635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:46.656927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:46.700345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:46.700857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:46.721314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:46.723114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:46.724137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:46.724772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:48.273380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:48.288058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d13efb7-365b-4070-8815-5c2afa6f342e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 1.651905 Oct 02 01:27:48.288711 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2661/5505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:46 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:49.316260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:49.317080 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:49.360275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:49.360974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:49.361755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:49.362671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:49.363290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:49.367900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:50.312386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:50.337378 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-024b5a59-96ed-4f3f-bf3f-bbc617a9a4e5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 1.024233 Oct 02 01:27:50.340086 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2845/5506] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:49 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:51.383111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:51.403503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:51.461506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:51.464348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:51.467229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:51.468975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:51.469743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:51.470517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:52.963311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:52.977223 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5295d83a-00be-49b1-94b0-a07f4dc1d466 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 1.610748 Oct 02 01:27:52.999724 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2662/5507] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:51 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:54.008669 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:54.009356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:54.025227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:54.030151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:54.030685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:54.031604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:54.032228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:54.032697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:54.814588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:54.835429 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a9fa0dde-be39-4383-98f2-0e5f80d4db8f tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.831643 Oct 02 01:27:54.838588 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2846/5508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:54 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:55.871529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:55.872245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:55.899319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:55.900120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:55.900780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:55.902451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:55.903135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:55.903890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:58.021152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:58.046503 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2452f748-2acf-41d2-a884-2fe900df2051 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 2.177699 Oct 02 01:27:58.047667 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2663/5509] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:55 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:59.073428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:59.075264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:59.111412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:59.111666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:59.112080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:59.114150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:59.118044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:59.119045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:59.951094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:59.951944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:59.988515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:59.989045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:59.995845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:59.996639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:59.997116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:59.997552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:00.121960 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-46e5091b-da8f-4e1a-b9e9-344c9e0349af tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/ips" status: 200 len: 151 microversion: 2.20 time: 0.182663 Oct 02 01:28:00.141626 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2664/5510] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Oct 2 01:27:59 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/ips => generated 151 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:28:00.662485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:00.671151 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be1dfe4e-cf5f-4117-a518-ad2788eb6962 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 1.602816 Oct 02 01:28:00.691097 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2847/5511] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:59 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:01.704509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:01.705280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:01.715832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:01.724018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:01.724732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:01.725697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:01.726315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:01.726958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:02.739615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:02.750868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6669cefe-02c5-4024-b17e-63d898b402c6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 1.050970 Oct 02 01:28:02.771251 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2665/5512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:01 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:03.782464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:03.785839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:03.790707 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=22 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:03.816578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:03.817083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:03.817529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:03.818252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:03.818756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:03.819229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:04.414978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:04.432685 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea10ac6f-e1b2-4830-9499-91b2ab20a442 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.655124 Oct 02 01:28:04.436066 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2848/5513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:03 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:05.465168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:05.475377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:05.520031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:05.539624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:05.540568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:05.541865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:05.544035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:05.547370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:05.564099 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:05.646500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53405d70-f410-481e-9adb-c2996568e1b4 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Action: 'create', calling method: .version_select at 0x7fb8807c28b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-190384146", "metadata": {"Type": "work"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53405d70-f410-481e-9adb-c2996568e1b4 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Request method failure captured: Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 121 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOkk7kv9ZgFC_eQCg0dhvrtQ69xeJC_3FwKrQUfTzKtuSPU2JCSljaEIZJ0rKy29uT01uOf9uCxyiLqLl-AnWTXJDz56CSMyVnJo9oc4B-y9Os7TCdBcCRc0M8PDnCAgF5VSFBHxT7uG097NgIuYPaND_sZgljUoiIbyFE1mSR6SJ-g Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c4d8943425647fabfcd0fff04733488"}]}] Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7160547fe5964123bf610168bf57625e Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-190384146", "metadata": {"Type": "work"}}} Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-190384146', 'metadata': {'Type': 'work'}}}} Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '#$%' Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:28:05.650974 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.655928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53405d70-f410-481e-9adb-c2996568e1b4 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:05.669556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53405d70-f410-481e-9adb-c2996568e1b4 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.503768 Oct 02 01:28:05.673357 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2666/5514] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:28:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 525 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:28:05.688946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a63e329c-eb6f-4a92-a200-70dbfa6ef244 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Action: 'create', calling method: .version_select at 0x7fb880bde1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-579431032", "metadata": {"Type": "work"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a63e329c-eb6f-4a92-a200-70dbfa6ef244 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Request method failure captured: Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 119 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOkk7kv9ZgFC_eQCg0dhvrtQ69xeJC_3FwKrQUfTzKtuSPU2JCSljaEIZJ0rKy29uT01uOf9uCxyiLqLl-AnWTXJDz56CSMyVnJo9oc4B-y9Os7TCdBcCRc0M8PDnCAgF5VSFBHxT7uG097NgIuYPaND_sZgljUoiIbyFE1mSR6SJ-g Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c4d8943425647fabfcd0fff04733488"}]}] Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7160547fe5964123bf610168bf57625e Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-579431032", "metadata": {"Type": "work"}}} Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-579431032', 'metadata': {'Type': 'work'}}}} Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '0' Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:28:05.693346 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 01:28:05.697088 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.698650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a63e329c-eb6f-4a92-a200-70dbfa6ef244 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:05.699668 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a63e329c-eb6f-4a92-a200-70dbfa6ef244 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020834 Oct 02 01:28:05.703602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2667/5515] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:28:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:28:05.714076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9185df3-5145-4e85-824d-19849495e025 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Action: 'create', calling method: .version_select at 0x7fb8807c2550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1683169807", "metadata": {"Type": "work"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9185df3-5145-4e85-824d-19849495e025 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Request method failure captured: Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 119 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOkk7kv9ZgFC_eQCg0dhvrtQ69xeJC_3FwKrQUfTzKtuSPU2JCSljaEIZJ0rKy29uT01uOf9uCxyiLqLl-AnWTXJDz56CSMyVnJo9oc4B-y9Os7TCdBcCRc0M8PDnCAgF5VSFBHxT7uG097NgIuYPaND_sZgljUoiIbyFE1mSR6SJ-g Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c4d8943425647fabfcd0fff04733488"}]}] Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7160547fe5964123bf610168bf57625e Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1683169807", "metadata": {"Type": "work"}}} Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1683169807', 'metadata': {'Type': 'work'}}}} Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '' Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:28:05.721244 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 01:28:05.725993 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.728745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9185df3-5145-4e85-824d-19849495e025 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:05.730115 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9185df3-5145-4e85-824d-19849495e025 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021136 Oct 02 01:28:05.731277 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2668/5516] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:28:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 01:28:05.764712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75752f23-4c84-46d6-95fd-77879ed4b959 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Calling method '.version_select at 0x7fb880818af0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:05.957866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-75752f23-4c84-46d6-95fd-77879ed4b959 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] HTTP exception thrown: Volume tempest-invalid-532140500 could not be found. Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75752f23-4c84-46d6-95fd-77879ed4b959 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Request method failure captured: Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-532140500 HTTP/1.1 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOkk7kv9ZgFC_eQCg0dhvrtQ69xeJC_3FwKrQUfTzKtuSPU2JCSljaEIZJ0rKy29uT01uOf9uCxyiLqLl-AnWTXJDz56CSMyVnJo9oc4B-y9Os7TCdBcCRc0M8PDnCAgF5VSFBHxT7uG097NgIuYPaND_sZgljUoiIbyFE1mSR6SJ-g Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c4d8943425647fabfcd0fff04733488"}]}] Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 7160547fe5964123bf610168bf57625e Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: method: Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: exception: Volume tempest-invalid-532140500 could not be found. Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'tempest-invalid-532140500'} Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-532140500 could not be found. (HTTP 404) (Request-ID: req-70a235b7-20af-4024-af32-b4238d2a13e5) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:28:05.962139 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-532140500 could not be found. Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-532140500 could not be found. Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-532140500 could not be found. Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75752f23-4c84-46d6-95fd-77879ed4b959 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Returning 404 to user: Volume tempest-invalid-532140500 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75752f23-4c84-46d6-95fd-77879ed4b959 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-532140500" status: 404 len: 98 microversion: 2.1 time: 0.214031 Oct 02 01:28:05.965748 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2669/5517] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Oct 2 01:28:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-532140500 => generated 98 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:28:05.983993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:05.984540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:06.018706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:06.019154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:06.019593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:06.020320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:06.020781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:06.021211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:06.048776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:06.068001 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4825b17-aafa-4870-8382-3f04aa23a007 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.609844 Oct 02 01:28:06.083753 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2849/5518] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:05 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:28:06.095262 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f9338ed3-b3c8-4367-9b9d-8b30914328e1 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010217 Oct 02 01:28:06.095865 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2850/5519] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 2 01:28:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 01:28:06.107473 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b75edce7-8e97-43ac-8b5f-ef872ed966da tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006019 Oct 02 01:28:06.111811 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2851/5520] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:28:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 01:28:06.119597 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3a5dd48-2b18-43b4-9372-a3bceec256c2 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Calling method '.version_select at 0x7fb88043e0d0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:06.129930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lazy-loading 'flavor' on Instance uuid 02903664-5ea7-411a-9883-d72d1c0319c5 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:28:06.162721 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e3a5dd48-2b18-43b4-9372-a3bceec256c2 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] HTTP exception thrown: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3a5dd48-2b18-43b4-9372-a3bceec256c2 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Request method failure captured: Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/os-volumes/80093a52-21d6-4ac5-9db6-ae03475a2ade HTTP/1.1 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOkk7kv9ZgFC_eQCg0dhvrtQ69xeJC_3FwKrQUfTzKtuSPU2JCSljaEIZJ0rKy29uT01uOf9uCxyiLqLl-AnWTXJDz56CSMyVnJo9oc4B-y9Os7TCdBcCRc0M8PDnCAgF5VSFBHxT7uG097NgIuYPaND_sZgljUoiIbyFE1mSR6SJ-g Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c4d8943425647fabfcd0fff04733488"}]}] Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7160547fe5964123bf610168bf57625e Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: exception: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '80093a52-21d6-4ac5-9db6-ae03475a2ade'} Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. (HTTP 404) (Request-ID: req-5fb78d1f-2a1d-4c68-a817-515d6b5d3038) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:28:06.164957 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. Oct 02 01:28:06.168527 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.174021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3a5dd48-2b18-43b4-9372-a3bceec256c2 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Returning 404 to user: Volume 80093a52-21d6-4ac5-9db6-ae03475a2ade could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:06.175733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3a5dd48-2b18-43b4-9372-a3bceec256c2 tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/80093a52-21d6-4ac5-9db6-ae03475a2ade" status: 404 len: 109 microversion: 2.1 time: 0.059512 Oct 02 01:28:06.177120 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2852/5521] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:28:06 2022] DELETE /compute/v2.1/os-volumes/80093a52-21d6-4ac5-9db6-ae03475a2ade => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:06.187607 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25bfd5b7-b0c4-4bc0-9648-71acaf162aaf tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Calling method '.version_select at 0x7fb880317040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:06.251661 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-25bfd5b7-b0c4-4bc0-9648-71acaf162aaf tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] HTTP exception thrown: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25bfd5b7-b0c4-4bc0-9648-71acaf162aaf tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Request method failure captured: Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/os-volumes/c00745af-4a44-4b96-9f2d-a51b7053930e HTTP/1.1 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOkk7kv9ZgFC_eQCg0dhvrtQ69xeJC_3FwKrQUfTzKtuSPU2JCSljaEIZJ0rKy29uT01uOf9uCxyiLqLl-AnWTXJDz56CSMyVnJo9oc4B-y9Os7TCdBcCRc0M8PDnCAgF5VSFBHxT7uG097NgIuYPaND_sZgljUoiIbyFE1mSR6SJ-g Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c4d8943425647fabfcd0fff04733488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c4d8943425647fabfcd0fff04733488"}]}] Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 9c4d8943425647fabfcd0fff04733488 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesNegativeTest-963702380 Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 7160547fe5964123bf610168bf57625e Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesNegativeTest-963702380-project Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: method: Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: exception: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c00745af-4a44-4b96-9f2d-a51b7053930e'} Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. (HTTP 404) (Request-ID: req-893b9be4-95b7-4243-b630-8e7df6a97612) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:28:06.253739 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. Oct 02 01:28:06.257881 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:06.261815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25bfd5b7-b0c4-4bc0-9648-71acaf162aaf tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] Returning 404 to user: Volume c00745af-4a44-4b96-9f2d-a51b7053930e could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:06.263007 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-25bfd5b7-b0c4-4bc0-9648-71acaf162aaf tempest-VolumesNegativeTest-963702380 tempest-VolumesNegativeTest-963702380-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/c00745af-4a44-4b96-9f2d-a51b7053930e" status: 404 len: 109 microversion: 2.1 time: 0.080301 Oct 02 01:28:06.264313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2853/5522] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:28:06 2022] GET /compute/v2.1/os-volumes/c00745af-4a44-4b96-9f2d-a51b7053930e => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:06.744528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-423267d9-c4a8-4f0c-a543-9fba52e4d4ac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/action" status: 202 len: 0 microversion: 2.20 time: 0.777382 Oct 02 01:28:06.745518 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2670/5523] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:28:05 2022] POST /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:28:06.754560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:06.755247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:06.776010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:06.776516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:06.776961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:06.777683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:06.780874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:06.783274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:07.098395 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:07.098509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:07.123834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:07.124556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:07.125271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:07.127861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:07.128517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:07.131102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:07.349064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:07.371792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:07.373701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:07.375173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f576b7f-975f-443f-875f-0f3f66e8c3e7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.625662 Oct 02 01:28:07.380068 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2854/5524] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:06 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:07.672097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:07.683861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-660598f5-2e56-4b21-93c0-ae1765107508 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.592187 Oct 02 01:28:07.696393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2671/5525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:07 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:08.409938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:08.411014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:08.426778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:08.428248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:08.428790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:08.446343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:08.447155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:08.447806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:08.709288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:08.709893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:08.720991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:08.721538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:08.726686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:08.727693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:08.728327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:08.728914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:08.772407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:08.786036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:08.787964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:08.792064 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9b93728-6596-434d-b491-2e023de8898e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.389061 Oct 02 01:28:08.795618 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2855/5526] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:08 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:09.088044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:09.102927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7a728ef-de88-42cc-ac7b-4a112830b0d7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.394944 Oct 02 01:28:09.104258 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2672/5527] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:08 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:09.833919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:09.834551 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:09.845960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:09.846382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:09.846848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:09.847536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:09.847999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:09.848426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:10.135473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:10.136316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:10.157662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:10.162226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:10.165395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:10.167443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:10.170748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:10.171431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:10.520060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:10.535368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:10.538283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:10.540085 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f27aff87-69f5-4af4-812f-4f8f6af1f96c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.720344 Oct 02 01:28:10.541344 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2856/5528] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:09 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:10.583978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:10.603845 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b1b81e5-bbc8-4835-bfe8-fb55e286c8c9 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.475199 Oct 02 01:28:10.605479 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2673/5529] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:10 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:11.567976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:11.570344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:11.583403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:11.593076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:11.594184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:11.595632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:11.597841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:11.599324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:11.631994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:11.633342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:11.650074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:11.657409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:11.658148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:11.661832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:11.662325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:11.662803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:12.822939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:12.852237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:12.854500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:12.861901 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fadc45c-1e0e-44b0-92ee-f27ce35c467e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 1.298378 Oct 02 01:28:12.869508 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2857/5530] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:11 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:12.998049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:13.011604 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c6a17e78-3eb5-467b-a759-4ca5e803f96a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 1.380000 Oct 02 01:28:13.029314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2674/5531] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:11 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:13.894921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:13.895591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:13.936909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:13.938852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:13.940693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:13.944965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:13.956048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:13.971716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:14.047294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:14.048732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:14.068956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:14.078860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:14.081109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:14.082845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:14.083631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:14.085127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:14.829015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:14.837484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a57c588d-aa47-4b35-b640-c02010ad02c8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.795741 Oct 02 01:28:14.841338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2675/5532] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:14 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:14.852919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6139891a-c0f8-4fc3-922a-10b97f36dc23 req-510f6bfc-0df0-49b6-ad04-96ffc71398ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96486de-fc69-42c7-a62e-00eb5168b457", "name": "network-vif-plugged", "status": "completed", "tag": "8bdae8b4-9693-43bf-a3f9-b140a3ffeda5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:14.905452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6139891a-c0f8-4fc3-922a-10b97f36dc23 req-510f6bfc-0df0-49b6-ad04-96ffc71398ba service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:14.905452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6139891a-c0f8-4fc3-922a-10b97f36dc23 req-510f6bfc-0df0-49b6-ad04-96ffc71398ba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:14.905452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6139891a-c0f8-4fc3-922a-10b97f36dc23 req-510f6bfc-0df0-49b6-ad04-96ffc71398ba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:14.942094 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6139891a-c0f8-4fc3-922a-10b97f36dc23 req-510f6bfc-0df0-49b6-ad04-96ffc71398ba service nova] Creating event network-vif-plugged:8bdae8b4-9693-43bf-a3f9-b140a3ffeda5 for instance f96486de-fc69-42c7-a62e-00eb5168b457 on n-h1-master-1 Oct 02 01:28:14.958091 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6139891a-c0f8-4fc3-922a-10b97f36dc23 req-510f6bfc-0df0-49b6-ad04-96ffc71398ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115305 Oct 02 01:28:14.961661 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2676/5533] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:15.166341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:15.180534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:15.185522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:15.191277 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-42da5495-42dc-4d15-a7cc-62531e6e009a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 1.301837 Oct 02 01:28:15.194150 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2858/5534] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:13 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:15.561678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:15.563057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:15.580154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:15.583182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:15.587901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:15.592261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:15.592892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:15.596491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:15.874903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:15.876285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:15.890932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:15.892984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:15.893676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:15.897167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:15.898372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:15.899475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:15.973082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lazy-loading 'services' on Instance uuid 426e4648-6aad-45c7-b4e9-a4ea6db88755 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:28:16.227059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a487d72-83a8-4129-940f-d0d34ce76b2e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments/310185a5-6c14-420b-a6cd-f69b5324b940" status: 202 len: 0 microversion: 2.1 time: 0.671741 Oct 02 01:28:16.227710 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2677/5535] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:28:15 2022] DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments/310185a5-6c14-420b-a6cd-f69b5324b940 => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:28:16.248452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:16.256077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:16.284222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:16.284751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:16.285241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:16.285942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:16.289070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:16.297633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:16.802487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:16.813044 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09798a8f-eb76-4d58-9862-f961073dd8da tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.944745 Oct 02 01:28:16.814253 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2859/5536] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:15 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:28:16.824385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:16.828465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:16.881165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:16.885207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:16.887202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:16.890779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:16.898410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:16.899070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:16.994408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-16d54d73-d538-4931-bdbe-16aa3d089658 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178792 Oct 02 01:28:17.001291 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2860/5537] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:16 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:17.079882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:17.084002 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:17.146633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:17.153539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:17.161287 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f045a43-ae7d-4fa4-9578-5c022d3ee510 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.927139 Oct 02 01:28:17.183796 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2678/5538] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:16 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:17.845626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:17.846434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:17.861432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:17.862045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:17.862370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:17.870165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:17.870696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:17.871155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:18.010470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:18.020310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:18.055269 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=30 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:18.063039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:18.065829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:18.068605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:18.072344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:18.073459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:18.074632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:18.204948 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-759e5439-70b6-4d69-ba76-55d15106480e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200556 Oct 02 01:28:18.207710 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2679/5539] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:18 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:18.222708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:18.226924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:18.244567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:18.246753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:18.248824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:18.254251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:18.255252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:18.256466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:18.345171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:18.359116 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-39b59f08-2088-4994-ab74-4a7780855b30 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1518 microversion: 2.1 time: 0.519368 Oct 02 01:28:18.360196 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2861/5540] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:17 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1518 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:18.806947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:18.829037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:18.833436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:18.836505 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-74109214-b1b1-4b39-ad65-9b14799c7a05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.626370 Oct 02 01:28:18.840790 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2680/5541] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:18 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:19.222446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:19.225862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:19.245939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.246845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.249197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.250993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.251708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.255664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.321547 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36d60e31-ded4-4081-8e7b-2331165267be tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105194 Oct 02 01:28:19.323409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2862/5542] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:19 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:19.383507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:19.384337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:19.400186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.416185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.416666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.420645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.421414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.421879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.756717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:19.811191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2a0df000-4b1b-42a8-8d6e-69999a80531a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.430295 Oct 02 01:28:19.812655 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2681/5543] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:19 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:19.844486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:19.846892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:19.867748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.869556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:19.870942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:19.877783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.879557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.881840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.882326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.885392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.905945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.919286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.921020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:19.923529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:19.924423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:19.925084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:20.427871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:20.446769 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c05e2833-653a-4955-b09c-da3388daaefd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.606745 Oct 02 01:28:20.451701 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2863/5544] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:19 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:20.454137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:20.462026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:20.476835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:20.483750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:20.486044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:20.486483 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-62f13e6a-7534-416a-b6e7-62138b5088d9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.621933 Oct 02 01:28:20.498919 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2682/5545] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:19 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:20.499117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:20.499236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:20.499316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:20.499316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:20.503529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:20.503862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:20.504403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:20.505420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:20.532892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:20.532892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:20.532892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:20.545572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:20.546115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:20.546547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:20.589739 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a337d800-7123-44ba-8d48-927e19a77916 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136674 Oct 02 01:28:20.591501 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2864/5546] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:20 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:20.893059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:20.923178 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f94c481a-6798-40c8-9694-60a206dab555 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.430933 Oct 02 01:28:20.924565 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2683/5547] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:20 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:20.952159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f648dff-89a2-4a7a-8615-445fc10d69bb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:20.958285 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4f648dff-89a2-4a7a-8615-445fc10d69bb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 049752f2-4373-42fe-876d-73d1609fc01e has no mapping to a cell. Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f648dff-89a2-4a7a-8615-445fc10d69bb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/049752f2-4373-42fe-876d-73d1609fc01e/action HTTP/1.1 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 15 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: {"os-stop": {}} Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 049752f2-4373-42fe-876d-73d1609fc01e has no mapping to a cell. Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '049752f2-4373-42fe-876d-73d1609fc01e', 'body': {'os-stop': {}}} Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 049752f2-4373-42fe-876d-73d1609fc01e has no mapping to a cell. Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:20.987162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049752f2-4373-42fe-876d-73d1609fc01e has no mapping to a cell. Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049752f2-4373-42fe-876d-73d1609fc01e has no mapping to a cell. Oct 02 01:28:20.991503 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:20.993105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f648dff-89a2-4a7a-8615-445fc10d69bb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 049752f2-4373-42fe-876d-73d1609fc01e has no mapping to a cell. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:20.994119 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f648dff-89a2-4a7a-8615-445fc10d69bb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/049752f2-4373-42fe-876d-73d1609fc01e/action" status: 404 len: 117 microversion: 2.1 time: 0.049960 Oct 02 01:28:20.994893 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2865/5548] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:20 2022] POST /compute/v2.1/servers/049752f2-4373-42fe-876d-73d1609fc01e/action => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:21.005477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:21.006140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:21.020435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.021691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.023083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.027843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.028468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.029128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.351356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:21.370892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5892c152-9936-4758-96ba-0f3e7cc3b300 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.363475 Oct 02 01:28:21.375324 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2684/5549] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:20 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:21.407557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:21.410339 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:21.437498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.441752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.443183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.445257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.447411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.447936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.517781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:21.524667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:21.549256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.551343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.552020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.552963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.553670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.554396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.803694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:21.821659 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ffcd3c5c-76f4-44c1-acc1-91f615590b45 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.421993 Oct 02 01:28:21.823544 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2866/5550] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:21 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:21.837098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:21.841501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:21.879874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.885278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.885807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.887355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:21.893198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.893777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.897445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.901438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:21.903579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:21.905847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-da0e2c4a-dab7-49ad-b7f2-b62bd4d1a867 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.392367 Oct 02 01:28:21.907809 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2685/5551] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:21 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:28:21.913979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3f3a95e-3438-4f59-b344-989053daa65c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:21.914790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f3f3a95e-3438-4f59-b344-989053daa65c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 010c7372-582f-4456-b28b-da80e0d91487] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:21.923114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f3f3a95e-3438-4f59-b344-989053daa65c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 010c7372-582f-4456-b28b-da80e0d91487 could not be found. Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3f3a95e-3438-4f59-b344-989053daa65c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/010c7372-582f-4456-b28b-da80e0d91487/action HTTP/1.1 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 15 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: {"suspend": {}} Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 010c7372-582f-4456-b28b-da80e0d91487 could not be found. Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '010c7372-582f-4456-b28b-da80e0d91487', 'body': {'suspend': {}}} Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010c7372-582f-4456-b28b-da80e0d91487 could not be found. Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010c7372-582f-4456-b28b-da80e0d91487 could not be found. Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:21.925229 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:21.928857 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:21.928857 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:21.928857 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010c7372-582f-4456-b28b-da80e0d91487 could not be found. Oct 02 01:28:21.928857 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:21.930591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3f3a95e-3438-4f59-b344-989053daa65c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 010c7372-582f-4456-b28b-da80e0d91487 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:21.931691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f3f3a95e-3438-4f59-b344-989053daa65c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/010c7372-582f-4456-b28b-da80e0d91487/action" status: 404 len: 111 microversion: 2.1 time: 0.022579 Oct 02 01:28:21.932474 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2686/5552] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:21 2022] POST /compute/v2.1/servers/010c7372-582f-4456-b28b-da80e0d91487/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:21.952257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:21.953322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:21.983976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.984594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.985830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:21.986857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:21.989545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:21.991778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:22.062214 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-83f47ec2-fbca-4f54-85a0-dd074f19fd00 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235127 Oct 02 01:28:22.068075 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2867/5553] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:21 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:22.405761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:22.416787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53010d54-f8c9-4e28-9bbe-51baa00443af tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.477973 Oct 02 01:28:22.423316 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2687/5554] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:21 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:22.446168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:22.447413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:22.459590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:22.460369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:22.460977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:22.462780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:22.463528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:22.464434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:22.857834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:22.875527 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6efb4bcb-7413-47d1-9525-12ff2709a330 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.431443 Oct 02 01:28:22.893496 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2868/5555] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:22 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:22.913716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:22.914316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:22.938902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:22.939777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:22.949209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:22.951612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:22.954496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:22.955910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:22.956567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:22.958124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:22.958775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:22.959769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:22.975275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:22.976770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:22.981327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:22.983569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:23.043758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lazy-loading 'flavor' on Instance uuid f96486de-fc69-42c7-a62e-00eb5168b457 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:28:23.179787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0338a3d-6830-48d0-83b2-947c23d0d19c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 202 len: 0 microversion: 2.1 time: 0.281722 Oct 02 01:28:23.184338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2688/5556] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:22 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:28:23.205625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:23.213308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:23.229138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:23.229646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:23.230095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:23.235015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:23.236292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:23.237583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:23.318358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:23.327615 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-875a52eb-9a0b-4384-a19c-9d3fb817f600 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141684 Oct 02 01:28:23.328415 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2689/5557] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:23 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:23.337893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:23.340609 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:23.347472 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2b5f05a-0450-4650-8dce-3673b1de7d74 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.413435 Oct 02 01:28:23.358662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:23.358662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:23.358904 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2869/5558] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:22 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:28:23.367832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:23.368332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:23.368773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:23.369484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:23.374189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:23.374697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:23.673238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:23.681982 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3b07757-7248-411c-8eea-71dfd8fd2377 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1513 microversion: 2.1 time: 0.344956 Oct 02 01:28:23.682488 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2690/5559] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:23 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:24.344214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:24.350141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:24.360024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:24.360773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:24.361419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:24.362576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:24.363222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:24.363791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:24.380162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:24.381013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:24.394964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:24.396260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:24.397470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:24.400026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:24.401323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:24.403380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:24.475204 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:24.477790 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71ccaa16-314c-4b43-81dd-5c270d331485 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142107 Oct 02 01:28:24.482659 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2870/5560] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:24 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:24.713073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:24.713706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:24.728921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:24.736259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:24.736976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:24.737915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:24.738406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:24.738870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:24.746721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:24.758266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:24.758763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:24.760186 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a403a4e5-603d-48b1-aec8-014a739ceda9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1744 microversion: 2.20 time: 0.384880 Oct 02 01:28:24.771663 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2691/5561] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:24 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1744 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:25.290414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:25.310830 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1bebf461-a652-40ab-ab1a-9bd58bc1042d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1496 microversion: 2.1 time: 0.601135 Oct 02 01:28:25.311936 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2871/5562] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:24 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1496 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:28:25.350335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:25.351151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:25.360232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.361423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.363537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.365029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.367387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.368406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.433333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lazy-loading 'flavor' on Instance uuid f96486de-fc69-42c7-a62e-00eb5168b457 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:28:25.478660 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'suspend' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state suspended Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 15 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: {"suspend": {}} Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'suspend' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state suspended Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'suspend': {}}} Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 02 01:28:25.492331 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state suspended Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state suspended Oct 02 01:28:25.496731 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:25.497698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:25.499216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'suspend' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state suspended {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:25.500635 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b28bc66d-86d4-4a41-8c8b-7258c2984d71 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 148 microversion: 2.1 time: 0.165321 Oct 02 01:28:25.504440 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2692/5563] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:25 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 148 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:28:25.505241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:25.518556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.519343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.519938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.520799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.521598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.522191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.523675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:25.524813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:25.559030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.559030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.559030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.559372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.562437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.564346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.590021 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7665225d-b056-41e1-9500-932a6a2726e2 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100437 Oct 02 01:28:25.591863 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2872/5564] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:25 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:25.752680 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:25.792171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:25.793079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:25.823700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a195f4a8-f584-4067-b917-1b27048e7fd7 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 202 len: 0 microversion: 2.1 time: 0.300137 Oct 02 01:28:25.824501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.825371 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2693/5565] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:25 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:28:25.826460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.828282 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.830881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.831482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.833272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.848090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:25.851412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:25.889397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.891061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.899663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:25.901176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:25.901780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:25.904716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:26.546981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:26.555640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:26.557090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:26.568386 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-733a2400-678f-4bdb-992d-b674a24ad976 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1744 microversion: 2.20 time: 0.782810 Oct 02 01:28:26.569025 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2873/5566] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:25 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1744 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:28:26.603655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:26.605821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:26.623055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:26.623786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:26.624378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:26.625241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:26.625847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:26.626439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:26.711218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:26.722288 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-76a39c38-5f21-40e9-a7d7-d3af88036f8c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1502 microversion: 2.1 time: 0.889792 Oct 02 01:28:26.724314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2694/5567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:25 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1502 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:28:26.764138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a197935f-343b-451e-a5cb-df2e2a20bad4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155643 Oct 02 01:28:26.766408 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2874/5568] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:26 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:28:27.596604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:27.597745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:27.632078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:27.633315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:27.635124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:27.638745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:27.640316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:27.641933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:27.753898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:27.755753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:27.772098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:27.773720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:27.774353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:27.775906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:27.776575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:27.778781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:28.142814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:28.152833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:28.161682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:28.165418 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ced0140-e4bb-47ab-8666-e3a082321c3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1744 microversion: 2.20 time: 0.575342 Oct 02 01:28:28.166427 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2695/5569] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:27 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1744 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:28.178080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:28.183244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:28.203058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:28.203855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:28.204304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:28.206976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:28.211802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:28.212380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:28.284022 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac53b2c3-4896-46bb-8af8-f789dba925aa tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113973 Oct 02 01:28:28.290699 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2696/5570] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:28 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:28.314749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:28.359674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe996f89-45d8-4916-860c-11262b365ed1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1502 microversion: 2.1 time: 0.596241 Oct 02 01:28:28.384366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2875/5571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:27 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1502 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:28.542729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-fab56dc5-8e26-45d1-ba8e-56d3523dab72 req-1cbe0dca-dc3a-4986-9d33-586fcdc4b62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "name": "network-vif-plugged", "status": "completed", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:28.573382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fab56dc5-8e26-45d1-ba8e-56d3523dab72 req-1cbe0dca-dc3a-4986-9d33-586fcdc4b62b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:28.578295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fab56dc5-8e26-45d1-ba8e-56d3523dab72 req-1cbe0dca-dc3a-4986-9d33-586fcdc4b62b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:28.582482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fab56dc5-8e26-45d1-ba8e-56d3523dab72 req-1cbe0dca-dc3a-4986-9d33-586fcdc4b62b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:28.622975 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-fab56dc5-8e26-45d1-ba8e-56d3523dab72 req-1cbe0dca-dc3a-4986-9d33-586fcdc4b62b service nova] Creating event network-vif-plugged:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:28:28.634585 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-fab56dc5-8e26-45d1-ba8e-56d3523dab72 req-1cbe0dca-dc3a-4986-9d33-586fcdc4b62b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094782 Oct 02 01:28:28.636384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2697/5572] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:29.204831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:29.205757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:29.237544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:29.238656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:29.242136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:29.243518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:29.246327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:29.247872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:29.298998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:29.301411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:29.318341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:29.328162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:29.329951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:29.332248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:29.334043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:29.336869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:29.444441 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42507bb4-3ed7-46fd-93df-35b73de553d4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144719 Oct 02 01:28:29.447093 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2698/5573] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:29 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:28:29.455593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:29.456212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:29.473746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:29.474349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:29.475117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:29.478148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:29.478865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:29.479446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:30.199105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:30.208282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:30.214281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:30.219171 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-77ea2ea0-0afa-4f8a-ba88-b05d413a529a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.017939 Oct 02 01:28:30.221382 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2876/5574] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:29 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:30.335146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:30.360164 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81c85a47-6a79-4807-8488-af1daddf54a8 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.911952 Oct 02 01:28:30.360788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2699/5575] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:29 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:30.393253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:30.394448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:30.426979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:30.428690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:30.433401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:30.435243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:30.440660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:30.442354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:30.458720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:30.461792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:30.499903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:30.500399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:30.500834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:30.501642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:30.501983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:30.502405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:30.607674 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3d450e42-53a7-43e3-bab7-1e526ad870e1 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153734 Oct 02 01:28:30.613815 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2700/5576] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:30 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:28:30.905619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:30.916389 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0dff4577-a133-40b4-8777-68eeaab64362 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.530292 Oct 02 01:28:30.917946 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2877/5577] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:30 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:30.944175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1642b642-b0ac-430c-a183-a7a1faa40ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:30.944706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1642b642-b0ac-430c-a183-a7a1faa40ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 28bd9774-33ac-49a9-bb3e-aa34ff364eb5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:30.957474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-1642b642-b0ac-430c-a183-a7a1faa40ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 28bd9774-33ac-49a9-bb3e-aa34ff364eb5 could not be found. Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1642b642-b0ac-430c-a183-a7a1faa40ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/28bd9774-33ac-49a9-bb3e-aa34ff364eb5/action HTTP/1.1 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 15 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: {"unpause": {}} Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 28bd9774-33ac-49a9-bb3e-aa34ff364eb5 could not be found. Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '28bd9774-33ac-49a9-bb3e-aa34ff364eb5', 'body': {'unpause': {}}} Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28bd9774-33ac-49a9-bb3e-aa34ff364eb5 could not be found. Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28bd9774-33ac-49a9-bb3e-aa34ff364eb5 could not be found. Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:30.959833 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:30.964233 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:30.964233 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:30.964233 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28bd9774-33ac-49a9-bb3e-aa34ff364eb5 could not be found. Oct 02 01:28:30.964233 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:30.969684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1642b642-b0ac-430c-a183-a7a1faa40ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 28bd9774-33ac-49a9-bb3e-aa34ff364eb5 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:30.974544 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1642b642-b0ac-430c-a183-a7a1faa40ed2 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/28bd9774-33ac-49a9-bb3e-aa34ff364eb5/action" status: 404 len: 111 microversion: 2.1 time: 0.033398 Oct 02 01:28:30.982427 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2701/5578] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:30 2022] POST /compute/v2.1/servers/28bd9774-33ac-49a9-bb3e-aa34ff364eb5/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:30.991755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:30.992740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:31.000177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:31.003526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:31.004869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:31.006498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:31.007850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:31.009827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:31.250813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:31.251435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:31.268410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:31.272446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:31.277143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:31.288092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:31.288907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:31.289541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:31.352436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:31.365365 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cf24e418-97c4-413b-803d-e6821d64c0a6 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.378395 Oct 02 01:28:31.377231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2878/5579] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:30 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:31.429345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:31.430624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:31.445681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:31.446289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:31.446826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:31.448550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:31.454345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:31.454876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:32.199138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:32.212271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:32.215119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:32.217630 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02f80c09-b674-47b2-a55f-049bf7bab715 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.973269 Oct 02 01:28:32.240249 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2702/5580] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:31 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:28:32.260715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:32.264869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:32.273528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:32.285380 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68ea4d5f-f68b-4e64-9b8a-6609e628ea8a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.862340 Oct 02 01:28:32.285980 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2879/5581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:31 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:32.316161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:32.316745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:32.334216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:32.338490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:32.339009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:32.350995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:32.351647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:32.359043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:32.363353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:32.364464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:32.365720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:32.369780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:32.370414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:32.373060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:32.414242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6266e05-4596-42e0-a7e2-20e61486aae0 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172054 Oct 02 01:28:32.427328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2703/5582] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:32 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:32.443045 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'unpause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 15 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: {"unpause": {}} Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: exception: Cannot 'unpause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'unpause': {}}} Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state active. Cannot unpause while the instance is in this state. Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:32.448177 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'unpause' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:32.452750 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a14a06d-0b8c-4a99-9887-08ed2769ec0a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 145 microversion: 2.1 time: 0.137731 Oct 02 01:28:32.464315 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2880/5583] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:32 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 145 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:28:32.470770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:32.476698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:32.547436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:32.549870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:32.551253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:32.552942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:32.554017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:32.554966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:33.251397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:33.252268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:33.290697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:33.291197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:33.291644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:33.292359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:33.292816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:33.293243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:33.456783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:33.486528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab3c5e7b-da37-477b-83e7-66de5c225746 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.010749 Oct 02 01:28:33.487858 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2704/5584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:32 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:33.499243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:33.505614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:33.523878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:33.524695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:33.525860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:33.526912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:33.527710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:33.529260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:33.645629 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13e44773-972c-4f28-9ab8-49ffa6656d9b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.156460 Oct 02 01:28:33.653350 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2705/5585] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:28:33 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:28:33.658774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:33.659652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:33.666224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:33.667043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:33.668148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:33.669941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:33.670794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:33.671431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:34.071780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:34.098419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:34.117196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:34.118448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ebe788ce-51a2-454e-9019-ab0b8af28ae5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.871724 Oct 02 01:28:34.119061 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2881/5586] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:33 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:34.145539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:34.146058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:34.166640 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=60 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:34.174131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:34.174664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:34.179393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:34.180502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:34.181232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:34.181996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:34.196573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:34.208661 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6cf03ccd-5087-45a3-ab56-8ca45b6db10c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.553820 Oct 02 01:28:34.211877 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2706/5587] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:33 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:34.239811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-137bb3cf-c341-496c-9aca-24775c937a5c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:34.240957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-137bb3cf-c341-496c-9aca-24775c937a5c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: 4250d4b0-5f91-497a-be26-9dfff542d13a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:34.255830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-137bb3cf-c341-496c-9aca-24775c937a5c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance 4250d4b0-5f91-497a-be26-9dfff542d13a could not be found. Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-137bb3cf-c341-496c-9aca-24775c937a5c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/4250d4b0-5f91-497a-be26-9dfff542d13a/action HTTP/1.1 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 18 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: {"unshelve": null} Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 4250d4b0-5f91-497a-be26-9dfff542d13a could not be found. Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '4250d4b0-5f91-497a-be26-9dfff542d13a', 'body': {'unshelve': None}} Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4250d4b0-5f91-497a-be26-9dfff542d13a could not be found. Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4250d4b0-5f91-497a-be26-9dfff542d13a could not be found. Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:34.259186 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4250d4b0-5f91-497a-be26-9dfff542d13a could not be found. Oct 02 01:28:34.263500 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:34.268649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-137bb3cf-c341-496c-9aca-24775c937a5c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance 4250d4b0-5f91-497a-be26-9dfff542d13a could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:34.269933 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-137bb3cf-c341-496c-9aca-24775c937a5c tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/4250d4b0-5f91-497a-be26-9dfff542d13a/action" status: 404 len: 111 microversion: 2.1 time: 0.034646 Oct 02 01:28:34.274949 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2707/5588] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:34 2022] POST /compute/v2.1/servers/4250d4b0-5f91-497a-be26-9dfff542d13a/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:34.308535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:28:34.308886 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:34.309930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:34.348300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:34.348804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:34.351062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:34.352822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:34.357844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:34.361867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:34.549451 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac5a6922-8541-4a33-9787-0725191174bd tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 204 len: 0 microversion: 2.1 time: 0.428989 Oct 02 01:28:34.550947 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2882/5589] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:28:34 2022] DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:28:34.568470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:34.569789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:34.587194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:34.588486 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:34.591253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:34.593137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:34.593989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:34.596604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:35.299476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:35.308326 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1827c478-6168-4510-8cce-01ac8b190dcc tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.030866 Oct 02 01:28:35.308923 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2708/5590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:34 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:35.349087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:35.365835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:35.376226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:35.377005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:35.377592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:35.378449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:35.379109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:35.379681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:35.823879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:35.858255 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62276cb7-3366-4ab7-a216-1a61a924a58d tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1680 microversion: 2.1 time: 1.302654 Oct 02 01:28:35.867199 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2883/5591] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:34 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1680 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:35.888096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:35.889141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:35.919056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:35.920845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:35.923240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:35.930823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:35.936573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:35.937134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:35.999304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:36.015183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:36.019165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:36.021518 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-205dc458-51a0-4e0f-a758-4447aee4060f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.697336 Oct 02 01:28:36.023935 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2709/5592] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:35 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:36.834901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:36.843676 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2ab5b21-fa84-4c8e-9ce6-b03bc56f9394 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.974639 Oct 02 01:28:36.844276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2884/5593] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:35 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:36.871011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:36.872387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:36.879561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:36.881139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:36.881680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:36.882662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:36.883264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:36.883786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:36.893060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:36.893826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:36.909267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:36.915521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:36.917351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:36.919362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:36.920102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:36.922210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:36.975659 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Cannot 'unshelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action HTTP/1.1 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 18 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: {"unshelve": null} Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: exception: Cannot 'unshelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'unshelve': None}} Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f96486de-fc69-42c7-a62e-00eb5168b457 in vm_state active. Cannot unshelve while the instance is in this state. Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 01:28:36.982750 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active Oct 02 01:28:36.986369 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:36.991874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 409 to user: Cannot 'unshelve' instance f96486de-fc69-42c7-a62e-00eb5168b457 while it is in vm_state active {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:36.993405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f8365c1-ddf7-4dd5-adaf-87e7b9dffbae tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action" status: 409 len: 146 microversion: 2.1 time: 0.127731 Oct 02 01:28:37.000791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2710/5594] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:28:36 2022] POST /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 01:28:37.014243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:37.016311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:37.032118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:37.034647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:37.036066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:37.037553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:37.038277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:37.039104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:37.823691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:37.853377 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97610805-527a-4e41-8362-0291d190ac16 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1680 microversion: 2.1 time: 0.965334 Oct 02 01:28:37.854870 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2885/5595] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:36 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1680 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:28:37.860075 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:37.863520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:37.879393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:37.880275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:37.882839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:37.883980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:37.884703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:37.886871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:37.925013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:37.948292 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6080e7d8-5127-4c05-801e-531c71194719 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.936181 Oct 02 01:28:37.972979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2711/5596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:37 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:37.979288 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:37.988659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:37.993016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:38.022336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:38.030673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:38.031623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:38.035079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:38.035719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:38.036333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:38.784616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:38.800138 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44a4de4d-040f-4382-abab-a65192952638 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.822307 Oct 02 01:28:38.805903 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2712/5597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:37 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:38.830689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbb30fa4-bb39-41c3-b4c9-ba51b0b326db tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064831286_updated"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:38.833463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cbb30fa4-bb39-41c3-b4c9-ba51b0b326db tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: b6f00dce-26aa-4827-b1a5-52307cd8ec3d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:38.838276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:38.846658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-cbb30fa4-bb39-41c3-b4c9-ba51b0b326db tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance b6f00dce-26aa-4827-b1a5-52307cd8ec3d could not be found. Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbb30fa4-bb39-41c3-b4c9-ba51b0b326db tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/servers/b6f00dce-26aa-4827-b1a5-52307cd8ec3d HTTP/1.1 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 81 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064831286_updated"}} Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: exception: Instance b6f00dce-26aa-4827-b1a5-52307cd8ec3d could not be found. Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b6f00dce-26aa-4827-b1a5-52307cd8ec3d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2064831286_updated'}}} Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f00dce-26aa-4827-b1a5-52307cd8ec3d could not be found. Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 02 01:28:38.848396 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f00dce-26aa-4827-b1a5-52307cd8ec3d could not be found. Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f00dce-26aa-4827-b1a5-52307cd8ec3d could not be found. Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbb30fa4-bb39-41c3-b4c9-ba51b0b326db tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance b6f00dce-26aa-4827-b1a5-52307cd8ec3d could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:38.853168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cbb30fa4-bb39-41c3-b4c9-ba51b0b326db tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "PUT /compute/v2.1/servers/b6f00dce-26aa-4827-b1a5-52307cd8ec3d" status: 404 len: 111 microversion: 2.1 time: 0.026355 Oct 02 01:28:38.854771 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2713/5598] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:28:38 2022] PUT /compute/v2.1/servers/b6f00dce-26aa-4827-b1a5-52307cd8ec3d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:28:38.872341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:38.887054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:38.888488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:38.891799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:38.895781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-94bf6cd0-0fdc-40e1-966a-55badb82c7b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.039606 Oct 02 01:28:38.902224 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2886/5599] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:37 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:38.920410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:38.922040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:38.924755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:38.925893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:38.928410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:38.929152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:38.931938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:38.933467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:38.966196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:38.977697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:38.978562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:38.980112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:38.983303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:38.983932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:39.030183 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:39.373220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfae16ed6efb490d8d953bb78a5c1a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c19f69633414698e9c62c717660ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:39.405951 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61956d34-a3fc-4b8d-92ba-cc185f84e47c tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 200 len: 1612 microversion: 2.1 time: 0.493145 Oct 02 01:28:39.410282 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2887/5600] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:38 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 1612 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:39.714136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:39.738219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2b6e7be-7679-4afe-95b3-e85e1e4b558a tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.878469 Oct 02 01:28:39.743677 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2714/5601] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:38 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:39.777605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:39.779662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:39.821104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:39.821508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:39.821949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:39.822692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:39.823154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:39.823584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:40.288300 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:40.302320 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-900a1f3d-28c0-41b4-9706-88a52aa12702 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.532769 Oct 02 01:28:40.302983 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2715/5602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:39 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:40.330528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:40.333061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:40.364329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:40.364932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:40.365659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:40.368625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:40.372419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:40.377169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:40.443251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-44f3f302-26d7-4a40-b275-941afc447441 req-3a8a0d6a-52a5-4881-96c9-f4a375272d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426e4648-6aad-45c7-b4e9-a4ea6db88755", "name": "network-vif-deleted", "tag": "27657d53-7e84-46a9-8b74-751994c1572c"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:40.474054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-44f3f302-26d7-4a40-b275-941afc447441 req-3a8a0d6a-52a5-4881-96c9-f4a375272d81 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:40.494445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-44f3f302-26d7-4a40-b275-941afc447441 req-3a8a0d6a-52a5-4881-96c9-f4a375272d81 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:40.498485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-44f3f302-26d7-4a40-b275-941afc447441 req-3a8a0d6a-52a5-4881-96c9-f4a375272d81 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:40.533133 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-44f3f302-26d7-4a40-b275-941afc447441 req-3a8a0d6a-52a5-4881-96c9-f4a375272d81 service nova] Creating event network-vif-deleted:27657d53-7e84-46a9-8b74-751994c1572c for instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 on n-h2-master-1 Oct 02 01:28:40.560131 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-44f3f302-26d7-4a40-b275-941afc447441 req-3a8a0d6a-52a5-4881-96c9-f4a375272d81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.056938 Oct 02 01:28:40.562765 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2888/5603] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:28:40.588138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fbab93c3-0ac2-461c-bf55-9b2b44ec7fd1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fbab93c3-0ac2-461c-bf55-9b2b44ec7fd1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: request: PUT /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 HTTP/1.1 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 280 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.618089 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:28:40.621401 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.637298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fbab93c3-0ac2-461c-bf55-9b2b44ec7fd1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:40.649340 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fbab93c3-0ac2-461c-bf55-9b2b44ec7fd1 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "PUT /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 400 len: 619 microversion: 2.1 time: 0.079813 Oct 02 01:28:40.659141 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2889/5604] 10.222.0.23 () {60 vars in 1257 bytes} [Sun Oct 2 01:28:40 2022] PUT /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 619 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:28:40.704159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:40.709345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:40.760474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:40.768857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:40.773895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:40.783237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:40.792203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:40.795149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:40.879674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 HTTP/1.1 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '426e4648-6aad-45c7-b4e9-a4ea6db88755'} Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:40.888011 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:40.891770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:40.895346 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-deffb7ec-7957-4c4d-bb2f-63db8ddbef6e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 404 len: 111 microversion: 2.1 time: 0.233152 Oct 02 01:28:40.899589 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2890/5605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:40 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:40.924839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:40.937472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:40.959503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:40.969008 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:40.970451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:40.993995 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-928de283-6e0f-482c-9711-71cff3ac1d32 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.685850 Oct 02 01:28:40.994611 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2716/5606] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:40 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:41.000673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:41.006773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:41.013324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:41.014433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:41.017602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:41.019313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:41.061511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dae9aa2f-7a7f-466f-8785-dfb270a02153 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '.version_select at 0x7fb880bde4c0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:41.176776 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dae9aa2f-7a7f-466f-8785-dfb270a02153 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-937335786" status: 202 len: 0 microversion: 2.1 time: 0.176632 Oct 02 01:28:41.188857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2717/5607] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-937335786 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:28:42.029371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:42.030633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:42.066373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:42.073245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:42.075084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:42.081330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:42.082617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c3c450c8-c598-405f-b312-3c6e1e6f11dd tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.180654 Oct 02 01:28:42.083213 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2891/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:40 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:42.085554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:42.094452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:42.097031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:42.109515 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:42.116909 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:42.132597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:42.133095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:42.133531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:42.147222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:42.147739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:42.148179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:43.076415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:43.086840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:43.104928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:43.112479 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29be0597-4ef2-468b-b729-55e7ec800ba6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.084476 Oct 02 01:28:43.113475 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2718/5609] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:42 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:43.134677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:43.157779 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-49867560-8327-45e7-9e6b-e65dc524e94e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 1.052727 Oct 02 01:28:43.163079 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2892/5610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:42 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:43.185595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ee3db64-d72a-4fa2-83ba-2f6d72653e2d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ee3db64-d72a-4fa2-83ba-2f6d72653e2d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: request: PUT /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 HTTP/1.1 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 24 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: {"server": {"name": ""}} Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457', 'body': {'server': {'name': ''}}} Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '' Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 01:28:43.192308 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 02 01:28:43.196872 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:43.198494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ee3db64-d72a-4fa2-83ba-2f6d72653e2d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:43.199697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ee3db64-d72a-4fa2-83ba-2f6d72653e2d tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "PUT /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 400 len: 108 microversion: 2.1 time: 0.019130 Oct 02 01:28:43.209388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:43.210235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:43.224146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2719/5611] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:28:43 2022] PUT /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:28:43.226421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:43.227124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:43.227995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:43.228875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:43.229485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:43.230166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:43.664497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:43.672983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-377b8001-5fa8-40d2-be40-126498cb5f86 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1505 microversion: 2.1 time: 0.467439 Oct 02 01:28:43.680698 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2893/5612] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:43 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:44.139781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:44.140407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:44.157527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:44.167535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:44.168301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:44.170472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:44.171207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:44.171807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:44.414817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:44.427317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:44.439153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:44.447249 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-35de3eb1-6aae-4cc6-bd13-662fff21b5dd tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.305671 Oct 02 01:28:44.467573 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2720/5613] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:44 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:45.475843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:45.476464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:45.500955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:45.508815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:45.509288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:45.510058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:45.510528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:45.521039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:46.438953 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:46.448736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:46.463725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:46.472166 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d727ac00-28e3-4250-9304-68136f4ccee8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.000104 Oct 02 01:28:46.474877 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2894/5614] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:45 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:47.506637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:47.507433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:47.527515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:47.528593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:47.529047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:47.529774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:47.530235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:47.530687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:48.554322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:48.575581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:48.577039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:48.578259 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-460216de-b0c8-49cd-b359-f9997e1a2c7a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.078145 Oct 02 01:28:48.600339 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2721/5615] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:47 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:49.647611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:49.647611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:49.659032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:49.659678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:49.660134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:49.660905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:49.661358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:49.661778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:50.191139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:50.231695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:50.237396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:50.259360 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6cd8be09-9a91-4b8c-a7b8-ccd7531aefc9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.631042 Oct 02 01:28:50.263396 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2895/5616] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:49 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:28:51.313964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:51.315200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:51.325207 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:51.335213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:51.336773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:51.339521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:51.340577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:51.341415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:51.343520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:52.133451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:52.147070 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:52.148508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:52.149700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff79a7d5-b655-4e70-820c-7ef42fcf7567 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.841470 Oct 02 01:28:52.150269 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2722/5617] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:51 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:52.792357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Calling method '.version_select at 0x7fb88008e280>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:52.794618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:52.795231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:52.795773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:52.868388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:52.875283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:52.875990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:52.928231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:52.939397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:52.940135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:52.954000 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8b231d0a-7a4e-49f0-90e7-a2c6d68d46dc tempest-PortsAdminExtendedAttrsTestJSON-1022189349 tempest-PortsAdminExtendedAttrsTestJSON-1022189349-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.589585 Oct 02 01:28:52.974096 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2896/5618] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:28:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:28:53.179011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:53.179618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:53.198391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:53.218073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:53.218933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:53.219862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:53.224671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:53.225311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:54.832731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:54.853295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:54.857565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:54.859206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d1122ede-4c35-4589-a835-10c4231890f8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.684134 Oct 02 01:28:54.863448 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2723/5619] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:53 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:55.890840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:55.892176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:55.907194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:55.908053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:55.913841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:55.914948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:55.915798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:55.919548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:56.691282 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:56.706387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:56.708649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:56.727453 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d51912ee-5b14-4782-bc42-0505b81354b1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.825910 Oct 02 01:28:56.743033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2897/5620] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:55 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:56.873813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:56.874317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:56.883278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:56.887675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:56.890264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:56.891393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:56.892076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:56.894426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:56.927385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da HTTP/1.1 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: exception: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'e74a644f-49af-425a-ad6f-927d4f1e19da'} Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:56.933945 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:56.938530 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:28:56.941600 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:56.942651 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f9308dd-9375-4d6b-a69c-6a6f59c12bad tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 404 len: 111 microversion: 2.1 time: 0.073364 Oct 02 01:28:56.943754 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2724/5621] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:28:56 2022] DELETE /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:56.952319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:56.953504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: e74a644f-49af-425a-ad6f-927d4f1e19da] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:56.968845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:56.969621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:56.970228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:56.971268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:56.971900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:56.972476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:57.003928 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da HTTP/1.1 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: exception: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'e74a644f-49af-425a-ad6f-927d4f1e19da'} Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:28:57.009162 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. Oct 02 01:28:57.013762 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:28:57.015634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance e74a644f-49af-425a-ad6f-927d4f1e19da could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:28:57.020350 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1b157697-d7ea-4181-8403-0e181756dc5e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da" status: 404 len: 111 microversion: 2.1 time: 0.072530 Oct 02 01:28:57.025676 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2898/5622] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:56 2022] GET /compute/v2.1/servers/e74a644f-49af-425a-ad6f-927d4f1e19da => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:57.035785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:57.036548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:57.046467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:57.048556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:57.049944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:57.052318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:57.054060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:57.055253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:57.190478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:28:57.376035 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44f8bc65-1b59-4003-a01e-305815d6170e tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 204 len: 0 microversion: 2.1 time: 0.344127 Oct 02 01:28:57.377420 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2725/5623] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:28:57 2022] DELETE /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:28:57.385263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:57.385880 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:57.402247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:57.403543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:57.404162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:57.404755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:57.405211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:57.405638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:57.768482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:57.771044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:57.796580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:57.797252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:57.798478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:57.803585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:57.806337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:57.807972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:58.412942 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:58.432090 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b68a8f2-7bde-4cc9-88bc-99b4ffd14eb5 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 1.049459 Oct 02 01:28:58.434732 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2899/5624] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:57 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:28:58.491001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:58.502064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:58.512473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:28:58.524231 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-551cfbea-df79-4ba7-8851-7e3f7012c244 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.767482 Oct 02 01:28:58.531747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2726/5625] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:57 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:28:59.460497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:59.461115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:59.482013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:59.483603 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:59.485458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:59.487246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:59.490845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:59.500132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:59.562476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:28:59.563137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:28:59.595359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:59.612866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:59.613522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:28:59.614295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:28:59.614815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:28:59.615249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:00.348692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:00.358379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bf025a0a-2fec-4f0b-b19e-f3fb7ef615fb tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1511 microversion: 2.1 time: 0.902209 Oct 02 01:29:00.365826 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2900/5626] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:28:59 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1511 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:29:00.395856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:00.398682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:00.426100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:00.426638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:00.427080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:00.427795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:00.428256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:00.428674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:00.479740 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 HTTP/1.1 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '426e4648-6aad-45c7-b4e9-a4ea6db88755'} Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:00.482424 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.486041 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.499101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:00.501068 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c61777c4-58c9-431f-9ff3-f38c639b9ee4 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 404 len: 111 microversion: 2.1 time: 0.134000 Oct 02 01:29:00.502155 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2901/5627] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:29:00 2022] DELETE /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:00.512979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:00.529441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 426e4648-6aad-45c7-b4e9-a4ea6db88755] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:00.560857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:00.561350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:00.561792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:00.562512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:00.562996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:00.563425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:00.567998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:00.585729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:00.596120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:00.599414 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c12f0305-3de3-4daa-895b-d73fe42189c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.042097 Oct 02 01:29:00.626546 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2727/5628] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:28:59 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:00.631810 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 HTTP/1.1 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '426e4648-6aad-45c7-b4e9-a4ea6db88755'} Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:00.633107 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 426e4648-6aad-45c7-b4e9-a4ea6db88755 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:00.636906 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8031403c-da3b-4ee6-b7ad-ec8ea916cda7 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755" status: 404 len: 111 microversion: 2.1 time: 0.128366 Oct 02 01:29:00.639453 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2902/5629] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:00 2022] GET /compute/v2.1/servers/426e4648-6aad-45c7-b4e9-a4ea6db88755 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:00.953094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-24f73cac-387f-4e47-b0e0-af35423a06b1 req-84c121d2-9a94-485a-af30-ce0ba6ee3d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96486de-fc69-42c7-a62e-00eb5168b457", "name": "network-vif-deleted", "tag": "8bdae8b4-9693-43bf-a3f9-b140a3ffeda5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:29:00.999587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-24f73cac-387f-4e47-b0e0-af35423a06b1 req-84c121d2-9a94-485a-af30-ce0ba6ee3d4a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:01.003231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-24f73cac-387f-4e47-b0e0-af35423a06b1 req-84c121d2-9a94-485a-af30-ce0ba6ee3d4a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:01.006341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-24f73cac-387f-4e47-b0e0-af35423a06b1 req-84c121d2-9a94-485a-af30-ce0ba6ee3d4a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:01.058424 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-24f73cac-387f-4e47-b0e0-af35423a06b1 req-84c121d2-9a94-485a-af30-ce0ba6ee3d4a service nova] Creating event network-vif-deleted:8bdae8b4-9693-43bf-a3f9-b140a3ffeda5 for instance f96486de-fc69-42c7-a62e-00eb5168b457 on n-h1-master-1 Oct 02 01:29:01.079239 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-24f73cac-387f-4e47-b0e0-af35423a06b1 req-84c121d2-9a94-485a-af30-ce0ba6ee3d4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134424 Oct 02 01:29:01.086236 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2728/5630] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:29:01.384754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:01.385874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:01.400132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:01.411466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:01.412332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:01.413248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:01.418917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:01.426303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:01.555622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:01.562278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:01.562757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:01.563228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lazy-loading 'fault' on Instance uuid f96486de-fc69-42c7-a62e-00eb5168b457 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:29:01.643502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:01.644233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:01.665012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:01.667281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:01.672760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:01.674243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:01.678335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:01.680419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:01.830491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a003e4392e9c4aa587573cb1dfa605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7d49167f014e31841f231f94b43e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:01.851228 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50edc8be-8c43-481e-8756-610b32a89973 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 200 len: 1306 microversion: 2.1 time: 0.470370 Oct 02 01:29:01.867386 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2903/5631] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:01 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 1306 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:29:02.709242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:02.726061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:02.732593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:02.742973 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9fffcf99-b607-4a65-aebe-72bec63f4278 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 1.101797 Oct 02 01:29:02.743833 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2729/5632] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:01 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:02.893130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:02.893898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] [instance: f96486de-fc69-42c7-a62e-00eb5168b457] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:02.914036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:02.914750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:02.915210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:02.917305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:02.917777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:02.918803 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:02.951812 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] HTTP exception thrown: Instance f96486de-fc69-42c7-a62e-00eb5168b457 could not be found. Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Request method failure captured: Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 HTTP/1.1 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOhlupXcsJ9C7-DCG1GrPEPrAyezFUicqvWfD0NLnGNOtFWift386N9F5ZuLPVlgfgcDQ7_TymS4GvQxcN35nkTgK0UT_RTZ7XgdUtEMQF5MU4Hm_LcMVhVjdcj6nRVajZEeqrLOVJYf5CQPi72IPmMwBlM6jpr5ZlCp3j-fNxtCONw Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca7d49167f014e31841f231f94b43e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca7d49167f014e31841f231f94b43e60"}]}] Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: ca7d49167f014e31841f231f94b43e60 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-ServersNegativeTestJSON-81112831 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: a003e4392e9c4aa587573cb1dfa605e0 Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-ServersNegativeTestJSON-81112831-project Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: exception: Instance f96486de-fc69-42c7-a62e-00eb5168b457 could not be found. Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f96486de-fc69-42c7-a62e-00eb5168b457'} Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96486de-fc69-42c7-a62e-00eb5168b457 could not be found. Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96486de-fc69-42c7-a62e-00eb5168b457 could not be found. Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:02.958303 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96486de-fc69-42c7-a62e-00eb5168b457 could not be found. Oct 02 01:29:02.962265 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:02.967478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] Returning 404 to user: Instance f96486de-fc69-42c7-a62e-00eb5168b457 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:02.968689 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88c765c8-c04b-45a8-b83d-9f86fcdf8929 tempest-ServersNegativeTestJSON-81112831 tempest-ServersNegativeTestJSON-81112831-project] 10.222.0.23 "GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457" status: 404 len: 111 microversion: 2.1 time: 0.079578 Oct 02 01:29:02.971473 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2904/5633] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:02 2022] GET /compute/v2.1/servers/f96486de-fc69-42c7-a62e-00eb5168b457 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:03.773459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:03.774737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:03.785866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:03.786638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:03.788771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:03.791332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:03.791973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:03.792582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:04.411599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:04.421464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:04.438909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:04.445276 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3bae021b-ee4a-4c0f-a5fa-79d90c7c78c6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.675908 Oct 02 01:29:04.453003 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2730/5634] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:03 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:05.508944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:05.517631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:05.549007 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:05.589890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:05.590988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:05.593297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:05.598923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:05.603294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:05.612776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:06.446432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:06.466242 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:06.468072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:06.472038 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65a80652-57ea-4d7c-8dd3-29514bc0ac33 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.994448 Oct 02 01:29:06.475313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2905/5635] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:05 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:07.513892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:07.523117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:07.611936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:07.611936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:07.611936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:07.611936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:07.611936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:07.611936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:08.289222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:08.301323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:08.303327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:08.309376 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ff9f89c-cf7d-498d-8db1-2c4311569399 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 0.802586 Oct 02 01:29:08.312082 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2731/5636] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:07 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:09.137773 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:09.139724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:09.173376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.175253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.177484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.182137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.182854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.185887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.236412 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=92 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:09.240331 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 HTTP/1.1 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '443bec7b-b69b-4575-9feb-edce6851b262'} Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:09.243627 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.247568 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.250708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:09.252850 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-98a2fc08-5ba0-4074-b8d4-b2f55665238f tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 404 len: 111 microversion: 2.1 time: 0.122609 Oct 02 01:29:09.254614 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2906/5637] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:29:09 2022] DELETE /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:09.263460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:09.268099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 443bec7b-b69b-4575-9feb-edce6851b262] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:09.304018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.308103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.312516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.313331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.317839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.319265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.337217 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:09.360820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:09.361541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:09.381851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 HTTP/1.1 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '443bec7b-b69b-4575-9feb-edce6851b262'} Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.391348 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. Oct 02 01:29:09.395123 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.395523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.395523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.395677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.403365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.403940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 443bec7b-b69b-4575-9feb-edce6851b262 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:09.404461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.404825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-62ce6579-a6ca-444d-b3bd-e909e1c238e6 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262" status: 404 len: 111 microversion: 2.1 time: 0.146003 Oct 02 01:29:09.408930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.411025 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2732/5638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:09 2022] GET /compute/v2.1/servers/443bec7b-b69b-4575-9feb-edce6851b262 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:09.431239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:09.436503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:09.466646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.467182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.467942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.469112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.485369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.485938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.526204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af HTTP/1.1 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd899a89c-af40-4200-bcf5-67168fb541af'} Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:09.534929 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.538581 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.540978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:09.542079 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65786b61-b6d0-4178-b86c-1235e47ec91b tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 404 len: 111 microversion: 2.1 time: 0.130025 Oct 02 01:29:09.544064 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2733/5639] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:29:09 2022] DELETE /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:09.559218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:09.561882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: d899a89c-af40-4200-bcf5-67168fb541af] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:09.579580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.581381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.584410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.590465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:09.592303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:09.594244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:09.633555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af HTTP/1.1 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd899a89c-af40-4200-bcf5-67168fb541af'} Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:09.635704 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. Oct 02 01:29:09.642070 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:09.653223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance d899a89c-af40-4200-bcf5-67168fb541af could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:09.655403 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-91f6c8a1-7381-4d02-b07a-b716d4d3418e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af" status: 404 len: 111 microversion: 2.1 time: 0.107237 Oct 02 01:29:09.656486 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2734/5640] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:09 2022] GET /compute/v2.1/servers/d899a89c-af40-4200-bcf5-67168fb541af => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:11.847323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:11.865531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:11.869749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:11.877384 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-51053cbf-6941-4215-ace1-0ab26eadef6d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1739 microversion: 2.20 time: 2.528935 Oct 02 01:29:11.879444 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2907/5641] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:09 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1739 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:12.905124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:12.905891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:12.921091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:12.923841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:12.925565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:12.929996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:12.931278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:12.931966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:13.678442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:13.698416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:13.700757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:13.704019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58308dc7-7ec2-40c6-af54-c1081e77d4d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1721 microversion: 2.20 time: 0.804510 Oct 02 01:29:13.706309 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2735/5642] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:12 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1721 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:14.741564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:14.742989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:14.755607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:14.759092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:14.759760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:14.760664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:14.761939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:14.765114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:15.361893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:15.406052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:15.410726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:15.420281 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8525ad69-d878-455d-906c-9f01bc6a123f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1721 microversion: 2.20 time: 0.679686 Oct 02 01:29:15.431740 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2908/5643] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:14 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1721 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:16.462800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:16.464363 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:16.502698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:16.505919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:16.506553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:16.509591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:16.514963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:16.515593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:17.075116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8a5828b6-c119-49cd-b4a1-f233707822a9 req-ba3f592c-41fa-489b-b414-594d72b46737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "name": "network-vif-unplugged", "status": "completed", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:29:17.112164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8a5828b6-c119-49cd-b4a1-f233707822a9 req-ba3f592c-41fa-489b-b414-594d72b46737 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:17.115259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8a5828b6-c119-49cd-b4a1-f233707822a9 req-ba3f592c-41fa-489b-b414-594d72b46737 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:17.116358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8a5828b6-c119-49cd-b4a1-f233707822a9 req-ba3f592c-41fa-489b-b414-594d72b46737 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:17.141516 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8a5828b6-c119-49cd-b4a1-f233707822a9 req-ba3f592c-41fa-489b-b414-594d72b46737 service nova] Creating event network-vif-unplugged:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:29:17.154034 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8a5828b6-c119-49cd-b4a1-f233707822a9 req-ba3f592c-41fa-489b-b414-594d72b46737 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096718 Oct 02 01:29:17.160906 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2909/5644] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:29:17.236726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:17.287750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:17.306226 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:17.312657 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a811393c-2072-476b-9a97-cbc97094e8c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1724 microversion: 2.20 time: 0.854489 Oct 02 01:29:17.319958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2736/5645] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:16 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1724 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:17.363927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f324597-d14b-47b5-8d42-9ae2fb8ba494"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:29:17.367407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:17.398988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:17.399948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:17.400627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:17.404155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:17.404903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:17.405529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:17.972430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:17.973425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:17.983305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:17.984173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:17.986767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:17.988892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:17.990355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:17.991529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.017927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 HTTP/1.1 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7689d920-d346-41ba-8221-5fc1b39eb664'} Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:18.021447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.025841 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.028402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:18.029774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e47e734-2d17-4c4f-a58b-ed470cce9339 tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 404 len: 111 microversion: 2.1 time: 0.064489 Oct 02 01:29:18.030574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2737/5646] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:29:17 2022] DELETE /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:29:18.039218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:18.040286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] [instance: 7689d920-d346-41ba-8221-5fc1b39eb664] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:18.061707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:18.062731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:18.065088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.066614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:18.068781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:18.069408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.118777 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] HTTP exception thrown: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Request method failure captured: Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 HTTP/1.1 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOc36kZiOfPPcM70rnHlfjLDFZ_NrhypXs5_llm3dP4Dxv2qYqQHvxBsrNT9RBt7IIeHiogvYFIBcbWCodoNMHaukpem7DUF_x-pLAesiWrmfKtB9DaBZ9U8mF4JkOBimgKgVXQkLY4iAJgLOXsLYWPDWDLUqVBDrtrpD84dXFLFF9c Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/550c19f69633414698e9c62c717660ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/550c19f69633414698e9c62c717660ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_550c19f69633414698e9c62c717660ae"}]}] Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 550c19f69633414698e9c62c717660ae Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-261309337 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: bfae16ed6efb490d8d953bb78a5c1a00 Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeNegativeTest-261309337-project Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7689d920-d346-41ba-8221-5fc1b39eb664'} Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:29:18.122632 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. Oct 02 01:29:18.126735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:29:18.141868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] Returning 404 to user: Instance 7689d920-d346-41ba-8221-5fc1b39eb664 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:29:18.142794 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18c4b420-60d5-4608-9388-52ad2060946e tempest-AttachVolumeNegativeTest-261309337 tempest-AttachVolumeNegativeTest-261309337-project] 10.222.0.23 "GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664" status: 404 len: 111 microversion: 2.1 time: 0.108145 Oct 02 01:29:18.146941 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2738/5647] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:18 2022] GET /compute/v2.1/servers/7689d920-d346-41ba-8221-5fc1b39eb664 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:29:18.191023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95bbafad-5a34-4ae9-93a0-fbb934228b9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.832078 Oct 02 01:29:18.192086 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2910/5648] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Oct 2 01:29:17 2022] POST /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 188 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:29:18.500768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:29:18.502161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:18.520633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:18.521900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:18.523930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.525443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:18.527909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:18.528911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.607259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122354) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:29:18.839774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4c0e3e71-cca1-412e-9fcf-013466e77683 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/action" status: 202 len: 0 microversion: 2.20 time: 0.344100 Oct 02 01:29:18.846367 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2739/5649] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:29:18 2022] POST /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:29:18.859214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:18.862130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:18.884931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:18.885693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:18.886163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.887610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:18.888086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:18.894965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:18.983306 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2818f7f0-79f8-487c-930d-8e0a396ee228 tempest-ExtensionsTest-976893925 tempest-ExtensionsTest-976893925-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:18.985474 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2818f7f0-79f8-487c-930d-8e0a396ee228 tempest-ExtensionsTest-976893925 tempest-ExtensionsTest-976893925-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.371737 Oct 02 01:29:18.986223 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2911/5650] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 2 01:29:18 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:29:18.999947 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-685ebc09-cdf2-46e5-bd64-eb6c7137e658 tempest-ExtensionsTest-976893925 tempest-ExtensionsTest-976893925-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:19.005632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-685ebc09-cdf2-46e5-bd64-eb6c7137e658 tempest-ExtensionsTest-976893925 tempest-ExtensionsTest-976893925-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014287 Oct 02 01:29:19.008544 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2912/5651] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:29:18 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:29:19.667244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:19.696255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:19.697852 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:19.699140 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e5d45c4-2ac1-4959-bf63-d00341147b05 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1750 microversion: 2.20 time: 0.849781 Oct 02 01:29:19.715086 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2740/5652] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:18 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1750 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:20.744490 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:20.745580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:20.755999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:20.765160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:20.773882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:20.775408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:20.779885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:20.780531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:21.684901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:21.719310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:21.723153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:21.729348 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-945eef07-0615-409b-aa3a-718d49dacea3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1750 microversion: 2.20 time: 0.992205 Oct 02 01:29:21.748596 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2913/5653] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:20 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1750 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:22.763930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:22.765303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:22.783190 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:22.784793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:22.788206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:22.789134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:22.790146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:22.790932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:22.791755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:23.602202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:23.616963 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:23.620354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:23.623757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c694c12c-ecdb-413e-b3ba-c583905fcaae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1750 microversion: 2.20 time: 0.865826 Oct 02 01:29:23.635338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2741/5654] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:22 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1750 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:24.655391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:24.656046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:24.719636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:24.725315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:24.726503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:24.727680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:24.732572 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:24.733333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:26.173664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:26.201070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:26.209975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:26.217124 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5ec68c4-acf5-45c2-9e16-0261592d80b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 1.566512 Oct 02 01:29:26.231611 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2914/5655] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:24 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:27.278845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:27.279488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:27.302880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:27.303730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:27.306990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:27.307943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:27.310301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:27.311154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:27.735005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:27.748598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:27.754366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:27.757088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aab0f427-50f3-4406-a76f-a88d16eb3a99 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 0.484719 Oct 02 01:29:27.758746 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2742/5656] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:27 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:28.790841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:28.792287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:28.824550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:28.832882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:28.842301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:28.843610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:28.845300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:28.846847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:29.325017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:29.336688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:29.338675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:29.340521 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-376b20af-56b6-4c94-ae2b-40de456162c3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 0.555087 Oct 02 01:29:29.367465 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2915/5657] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:28 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:30.372787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:30.373410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:30.385569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:30.386664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:30.386664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:30.387667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:30.387985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:30.388391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:31.107705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:31.119563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:31.121043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:31.140157 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-568d6d8f-752f-4030-ae45-9f0c985c0005 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 0.754052 Oct 02 01:29:31.140860 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2743/5658] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:30 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:32.169561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:32.170844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:32.184141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:32.186520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:32.187738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:32.193174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:32.194115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:32.194910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:32.782751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:32.823498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:32.825956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:32.843245 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9f64d5d8-342b-473f-902e-f67baaf22074 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 0.678829 Oct 02 01:29:32.855720 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2916/5659] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:32 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:33.874019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:33.874763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:33.904584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:33.907605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:33.908236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:33.908987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:33.909455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:33.909884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:34.918473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:34.938140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:34.950303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:34.981772 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd4f5646-ab41-4a1d-9105-e5711c09eaee tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 1.112047 Oct 02 01:29:34.982681 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2744/5660] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:33 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:36.012190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:36.013177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:36.027811 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=20 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:36.038879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:36.043892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:36.044890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:36.045664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:36.046144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:36.046587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:36.747508 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:36.768361 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:36.772886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:36.779250 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-84236328-9acc-4e7f-bfd5-f9184f047b16 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 0.774532 Oct 02 01:29:36.806011 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2917/5661] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:36 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:37.810641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:37.811276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:37.826547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:37.830021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:37.833821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:37.835471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:37.838033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:37.850016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:38.641166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:38.659251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:38.666669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:38.670726 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d48ff120-9802-438d-bf2f-b9533270333a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1752 microversion: 2.20 time: 0.864035 Oct 02 01:29:38.672760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2745/5662] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:37 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1752 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:39.716044 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:39.716670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:39.739248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:39.739751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:39.740195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:39.741382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:39.741860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:39.742279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:39.778863 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:40.080917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:40.102416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:40.103932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:40.105293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c57c84c3-ea4b-4917-84b6-7a380d804ce7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.406558 Oct 02 01:29:40.111274 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2918/5663] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:39 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:41.147781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:41.148547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:41.171086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:41.171746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:41.172301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:41.174437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:41.175054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:41.178183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:41.182921 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:41.858181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:41.870731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:41.878537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:41.880159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16ee8a58-a0ba-4aee-80d4-45d1acc27165 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.744940 Oct 02 01:29:41.899299 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2746/5664] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:41 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:42.916864 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:42.918317 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:42.938841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:42.939275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:42.939823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:42.940601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:42.954369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:42.955039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:43.807483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:43.849644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:43.873430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:43.884723 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6d6a7157-7767-45c8-bd7d-66a323336b5a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.963661 Oct 02 01:29:43.894712 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2919/5665] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:42 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:44.916442 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:44.917872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:44.937604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:44.938566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:44.939943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:44.954659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:44.955826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:44.958446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:45.589837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:45.604505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:45.616904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:45.626764 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e24d751-5402-480c-825f-a6c8441b2900 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.714629 Oct 02 01:29:45.630215 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2747/5666] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:44 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:46.664601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:46.665321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:46.715497 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:46.723109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:46.726030 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:46.727827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:46.728319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:46.728763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:47.739886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:47.770908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:47.775026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:47.776275 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-daee83d7-a39b-4139-8fcb-f480104a1eef tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.117008 Oct 02 01:29:47.781072 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2920/5667] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:46 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:48.808667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:48.810219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:48.853043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:48.857981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:48.858705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:48.861202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:48.863257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:48.863904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:49.950847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:49.959924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:49.964992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:49.974037 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3277f0e9-ad3f-4093-9e06-a87a0983fc28 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.168701 Oct 02 01:29:49.987386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2748/5668] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:48 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:51.005600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:51.005600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:51.021867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:51.022386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:51.022861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:51.023584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:51.024045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:51.027133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:52.021369 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:52.069409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:52.079637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:52.083781 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d4d862f6-85c9-448c-83ec-e17ceb3eb427 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.087233 Oct 02 01:29:52.117239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2921/5669] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:50 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:53.130641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:53.132601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:53.195953 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:53.209509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:53.210032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:53.223201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:53.228689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:53.229201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:53.236295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:54.835491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:54.877371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:54.891660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:54.899042 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3cacfe1-7b66-444e-8b1b-2886d4841466 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.781903 Oct 02 01:29:54.910294 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2749/5670] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:53 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:55.941054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:55.941671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:55.987185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:55.988346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:55.988799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:55.997783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:56.002101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:56.006854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:56.692296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:56.723766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:56.732459 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:56.736842 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18aeef03-0d1f-4534-be3a-4ceae2a4687c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.797003 Oct 02 01:29:56.739255 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2922/5671] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:55 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:57.767287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:57.768013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:57.786255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:57.786781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:57.787229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:57.798386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:57.799076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:57.799535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:58.531867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:58.553554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:58.556293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:29:58.565115 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5764467f-9c0b-4e2c-8fca-38597dfef50e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.794662 Oct 02 01:29:58.584550 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2750/5672] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:57 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:29:59.601557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:59.602178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:59.628959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:59.628959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:59.630989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:59.631752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:59.633555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:59.635384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:59.685235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:29:59.686438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:29:59.706412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:59.709269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:59.712526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:29:59.713521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:29:59.715779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:29:59.718522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:00.159545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lazy-loading 'services' on Instance uuid a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:30:00.440078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70c3164c-bd97-42cb-b95f-3533667f5564 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14/os-volume_attachments/29d7b003-a530-4a73-bc99-8e93a698869a" status: 202 len: 0 microversion: 2.1 time: 0.760314 Oct 02 01:30:00.463226 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:00.473768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:00.475562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2751/5673] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:29:59 2022] DELETE /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14/os-volume_attachments/29d7b003-a530-4a73-bc99-8e93a698869a => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:30:00.493984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:00.502533 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43f71020-4039-4bee-ab9d-f74378e39591 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.909768 Oct 02 01:30:00.515432 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2923/5674] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:29:59 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:01.544210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:01.544909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:01.569527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:01.572523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:01.575902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:01.582906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:01.587706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:01.588398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:02.753644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:02.788318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:02.791121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:02.794896 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7fdba898-c1a0-4e22-9788-d94000363000 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.256910 Oct 02 01:30:02.799517 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2752/5675] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:01 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:03.828655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:03.829394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:03.855889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:03.858573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:03.859311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:03.866796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:03.868859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:03.873037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:04.736857 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:04.754774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:04.756105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:04.757339 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0a9352c-ebe9-44e8-9d7e-070545bf23d0 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.934926 Oct 02 01:30:04.757904 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2924/5676] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:03 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:05.788755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:05.790260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:05.805356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:05.813350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:05.817096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:05.818114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:05.818809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:05.821119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:06.767765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:06.781930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:06.783401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:06.795227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3e73e33-4c6d-4a0a-b0e6-ed3f3a260a45 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.011134 Oct 02 01:30:06.814248 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2753/5677] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:05 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:07.857956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:07.859139 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:07.870181 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:07.904160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:07.904586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:07.909149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:07.914156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:07.918331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:07.921599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:08.468483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:08.477222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:08.478750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:08.479925 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fcbfcbdc-5218-4dc3-957c-3b6f71f0afac tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.643625 Oct 02 01:30:08.496781 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2925/5678] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:07 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:09.507881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:09.509166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:09.523402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:09.524280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:09.524987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:09.539334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:09.540289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:09.540989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:09.868840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:09.881158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:09.889882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:09.891287 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6725022-d863-482a-b749-c25ba8dc6ed9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.387376 Oct 02 01:30:09.894254 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2754/5679] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:09 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:10.859047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:10.859503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:10.867530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:10.868029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:10.868466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:10.869334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:10.870500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:10.871198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:10.909034 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=48 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:10.922377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:10.923044 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:10.924271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:30:10.949424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:10.950901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:10.955017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:10.955794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:10.956276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:10.956719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:11.102931 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c64b92ca-d13c-4ad2-bdbc-c9093151a840 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 204 len: 0 microversion: 2.1 time: 0.249324 Oct 02 01:30:11.112550 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2926/5680] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:30:10 2022] DELETE /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:30:11.127915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:11.129784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:11.144089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:11.145791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:11.151477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:11.153277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:11.155093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:11.156797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:11.396314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:11.415117 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:11.420772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:11.422239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:11.423490 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8eaa2ada-7b17-448a-8969-9ab21b48a57a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.505241 Oct 02 01:30:11.424076 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2755/5681] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:10 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:11.632922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:11.658034 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26ec1410-6366-405a-9109-c6de597cd1a5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1470 microversion: 2.1 time: 0.540987 Oct 02 01:30:11.660593 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2927/5682] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:30:11 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1470 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:30:12.456315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:12.457592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:12.477400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:12.478724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:12.482051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:12.489799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:12.490563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:12.492929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:12.684975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:12.685524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:12.702919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:12.705373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:12.705835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:12.711717 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:12.712246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:12.712688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:14.170133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:14.186334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:14.192216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:14.195777 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-836d91eb-ea4a-4585-b104-a530291e9cb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.743804 Oct 02 01:30:14.198860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:14.208893 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1adbcd8d-2541-4c42-8aa8-7901365f9fa5 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1470 microversion: 2.1 time: 1.528820 Oct 02 01:30:14.211757 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2756/5683] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:12 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:14.212626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2928/5684] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:30:12 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1470 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:30:15.246873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:15.248024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:15.249526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:15.250155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:15.258555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:15.266264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:15.267001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:15.269287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:15.270216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:15.270942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:15.271598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:15.271951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:15.272532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:15.275782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:15.277438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:15.278491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:15.739900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7cc78032a34034aed2d761e8cfe068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '133349796718454eb3b452ed62d15a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:15.753149 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96ee76fa-da80-4af2-8baf-042d61b63ae2 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 200 len: 1428 microversion: 2.1 time: 0.507302 Oct 02 01:30:15.756149 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2929/5685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:30:15 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 1428 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:30:15.761119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-55d10820-94c2-41a2-8850-b4d996c32bf3 req-b83d6b0b-a97c-4d0e-803e-f2f174d56946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a37695b5-6c72-4eec-8d3c-5ff9e4e36a14", "name": "network-vif-deleted", "tag": "e0bff18f-9442-4954-b549-578578d326bc"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:30:15.790498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-55d10820-94c2-41a2-8850-b4d996c32bf3 req-b83d6b0b-a97c-4d0e-803e-f2f174d56946 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:15.791290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-55d10820-94c2-41a2-8850-b4d996c32bf3 req-b83d6b0b-a97c-4d0e-803e-f2f174d56946 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:15.792643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-55d10820-94c2-41a2-8850-b4d996c32bf3 req-b83d6b0b-a97c-4d0e-803e-f2f174d56946 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:15.821509 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-55d10820-94c2-41a2-8850-b4d996c32bf3 req-b83d6b0b-a97c-4d0e-803e-f2f174d56946 service nova] Creating event network-vif-deleted:e0bff18f-9442-4954-b549-578578d326bc for instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 on n-h2-master-1 Oct 02 01:30:15.828322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-55d10820-94c2-41a2-8850-b4d996c32bf3 req-b83d6b0b-a97c-4d0e-803e-f2f174d56946 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070584 Oct 02 01:30:15.832785 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2930/5686] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:30:15.953462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:15.990221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:16.009784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:16.022092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1befd7da-37c2-4e45-aa6a-2c07b2148dae tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.775520 Oct 02 01:30:16.039785 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2757/5687] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:15 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:16.791151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:16.792322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] [instance: a37695b5-6c72-4eec-8d3c-5ff9e4e36a14] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:16.811700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:16.812199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:16.812641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:16.815013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:16.815893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:16.820278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:16.871612 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] HTTP exception thrown: Instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 could not be found. Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Request method failure captured: Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 HTTP/1.1 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOjGHPnZUL6-BdnNDBE28VulFSXQSS1VlH6GmP8WI1l0NfSbI50SWrMTfQryFz405-U2H8PtbDXlFch9cD9vlZIj4zl_dnM1KTNc6vHPJ4bvqgGmaWMEXiwGkw4GJZHPN14UoHEFXN4nUppKxfSndFpdD__xaCXhFaiNDYJLn0kcgpE Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 133349796718454eb3b452ed62d15a8d Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesBackupsTest-53784042 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/133349796718454eb3b452ed62d15a8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/133349796718454eb3b452ed62d15a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/133349796718454eb3b452ed62d15a8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_133349796718454eb3b452ed62d15a8d"}]}] Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesBackupsTest-53784042 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 133349796718454eb3b452ed62d15a8d Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesBackupsTest-53784042 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesBackupsTest-53784042-project Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: dc7cc78032a34034aed2d761e8cfe068 Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesBackupsTest-53784042-project Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: exception: Instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 could not be found. Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'a37695b5-6c72-4eec-8d3c-5ff9e4e36a14'} Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 could not be found. Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 could not be found. Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:30:16.881614 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 could not be found. Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] Returning 404 to user: Instance a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e8e8bfe-7f67-45c8-9551-2f6ae0ddaba6 tempest-VolumesBackupsTest-53784042 tempest-VolumesBackupsTest-53784042-project] 10.222.0.23 "GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14" status: 404 len: 111 microversion: 2.1 time: 0.105634 Oct 02 01:30:16.891437 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2931/5688] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:30:16 2022] GET /compute/v2.1/servers/a37695b5-6c72-4eec-8d3c-5ff9e4e36a14 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:30:17.056958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:17.059353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:17.080718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:17.082569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:17.084116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:17.085370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:17.086064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:17.088295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:17.582322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:17.600463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:17.606748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:17.613021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ec380a8-8c78-4264-aff1-a7180e825f24 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.558862 Oct 02 01:30:17.634944 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2758/5689] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:17 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:18.641841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:18.644308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:18.671239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:18.672082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:18.674164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:18.679168 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:18.680220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:18.684185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:19.365668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:19.374659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:19.376082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:19.377266 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c48550e-72ba-4a5d-a7ba-5374ed5c982c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.740360 Oct 02 01:30:19.387325 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2932/5690] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:18 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:20.414361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:20.417286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:20.431535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:20.433359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:20.433805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:20.434539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:20.438142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:20.438622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:20.780097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:20.804624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:20.815537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:20.822295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfb8cc8a-83cf-4355-ba9a-c5010a03fa95 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 0.408649 Oct 02 01:30:20.841659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2759/5691] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:20 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:21.855641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:21.856277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:21.871938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:21.872440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:21.876697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:21.878161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:21.878912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:21.881746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:22.008399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4eac49c7-da2e-4fa3-ba7b-cff279afb28c req-c72aebcf-6a26-4cfa-8714-eddd6147eaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "name": "network-vif-plugged", "status": "completed", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:30:22.037018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4eac49c7-da2e-4fa3-ba7b-cff279afb28c req-c72aebcf-6a26-4cfa-8714-eddd6147eaa2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:22.040853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4eac49c7-da2e-4fa3-ba7b-cff279afb28c req-c72aebcf-6a26-4cfa-8714-eddd6147eaa2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:22.041814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4eac49c7-da2e-4fa3-ba7b-cff279afb28c req-c72aebcf-6a26-4cfa-8714-eddd6147eaa2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:22.073245 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4eac49c7-da2e-4fa3-ba7b-cff279afb28c req-c72aebcf-6a26-4cfa-8714-eddd6147eaa2 service nova] Creating event network-vif-plugged:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:30:22.085198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4eac49c7-da2e-4fa3-ba7b-cff279afb28c req-c72aebcf-6a26-4cfa-8714-eddd6147eaa2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082024 Oct 02 01:30:22.091460 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2760/5692] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:30:23.497537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:23.508495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:23.509796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:23.513923 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f27cba1e-9419-4c0b-bb40-c5e899d99d7e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.664997 Oct 02 01:30:23.529915 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2933/5693] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:21 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:30:24.543347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:24.544834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:24.569910 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=24 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:24.576605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:24.580712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:24.581634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:24.582892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:24.585947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:24.586640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:25.812129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:25.835277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:25.853572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:25.860297 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf28c5af-4985-461e-bcc1-fa7c15c3765c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1808 microversion: 2.20 time: 1.316974 Oct 02 01:30:25.863620 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2761/5694] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:24 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1808 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:30:26.889017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:30:26.889910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:30:26.904437 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:30:26.904693 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 (ip 10.222.0.23) !!! Oct 02 01:30:26.911757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:26.913461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:26.915441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:26.918118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:30:26.919949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:30:26.920623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:30:28.403373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:28.424299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:28.435991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:30:28.437273 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-536a1e5a-d12e-42d1-b256-232e9186d167 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1795 microversion: 2.20 time: 1.553910 Oct 02 01:30:28.437869 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2934/5695] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:30:26 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1795 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:31:23.941329 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 02 01:31:23.943629 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:23.947635 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=33 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:24.428254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:24.430169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:24.455273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:24.456074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:24.457414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:24.458822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:24.459466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:24.463476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:24.517263 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5b57cdf-633f-4732-89d9-5cad336beb0a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments/5f324597-d14b-47b5-8d42-9ae2fb8ba494" status: 200 len: 194 microversion: 2.20 time: 0.586363 Oct 02 01:31:24.518930 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2762/5696] 10.222.0.23 () {60 vars in 1454 bytes} [Sun Oct 2 01:31:23 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments/5f324597-d14b-47b5-8d42-9ae2fb8ba494 => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:24.656518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:24.657649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:24.667194 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:24.669024 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:24.675838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:24.677942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:24.678585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:24.682155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:24.683975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:24.684424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:24.906534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lazy-loading 'services' on Instance uuid 02903664-5ea7-411a-9883-d72d1c0319c5 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:31:25.102211 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a8cd774-d045-485a-afc1-1aa0c69d981c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments/5f324597-d14b-47b5-8d42-9ae2fb8ba494" status: 202 len: 0 microversion: 2.20 time: 0.449955 Oct 02 01:31:25.106343 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2935/5697] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Oct 2 01:31:24 2022] DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments/5f324597-d14b-47b5-8d42-9ae2fb8ba494 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:25.116202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:25.121490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:25.167490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:25.170833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:25.171373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:25.173414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:25.177594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:25.179469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:25.278901 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b98a72bb-5b7d-4338-8c3e-522f33a97ec4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170191 Oct 02 01:31:25.286191 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2763/5698] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:25 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:31:26.299505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:26.301854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:26.323093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:26.323516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:26.323964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:26.324683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:26.325140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:26.329239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:26.411869 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ff11a33b-390f-4a12-891a-503439b7faa1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117788 Oct 02 01:31:26.422549 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2936/5699] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:26 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:27.430769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:27.435407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:27.458510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:27.459034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:27.459476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:27.462995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:27.467142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:27.473829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:27.573572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebd4248c-9bd7-4a86-bff9-7e03e4958315 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148346 Oct 02 01:31:27.575864 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2764/5700] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:27 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:28.585798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:28.590358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:28.609654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:28.610080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:28.610527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:28.611288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:28.611751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:28.612180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:28.697972 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9440b962-08a9-489c-b47c-245ca105c75b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116267 Oct 02 01:31:28.713913 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2937/5701] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:28 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:29.710727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:29.714814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:29.738131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:29.746361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:29.747778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:29.748563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:29.758625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:29.759308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:29.859917 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-144d2a6f-70fe-43f1-8b23-b0afe743a7ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.153319 Oct 02 01:31:29.864038 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2765/5702] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:29 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:30.874210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:30.876859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:30.895022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:30.895938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:30.896398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:30.897338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:30.898022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:30.898688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:30.988532 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7723180-54cb-441e-96f0-683fe5db6c21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118155 Oct 02 01:31:30.989742 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2938/5703] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:30 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:32.001376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:32.004141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:32.020193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:32.020942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:32.021663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:32.023769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:32.025719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:32.026337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:32.102251 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fff9c78a-b988-4044-8868-9954988772e3 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104747 Oct 02 01:31:32.108776 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2766/5704] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:31 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:33.116950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:33.120334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:33.142951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:33.143449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:33.143889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:33.144591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:33.145044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:33.145467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:33.256074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-844a8a9d-6978-49df-a0bb-738267f25228 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137208 Oct 02 01:31:33.264760 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2939/5705] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:33 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:34.267879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:34.270327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:34.303521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:34.305301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:34.306343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:34.307523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:34.311227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:34.319265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:34.430827 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57e8d2a4-8f0f-4f0e-826c-f0c947f57eb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.166903 Oct 02 01:31:34.436958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2767/5706] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:34 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:35.452523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:35.456517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:35.496922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:35.498055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:35.502684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:35.509823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:35.511544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:35.514997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:35.609725 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec5b48cc-7365-4cb5-944a-c231a197b478 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168598 Oct 02 01:31:35.610620 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2940/5707] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:35 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:31:36.627770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:36.636133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:36.671939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:36.672455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:36.672950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:36.673617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:36.680133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:36.687043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:36.816361 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b28a2d9-22b4-4a24-8074-52fe3ea51ab2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.196745 Oct 02 01:31:36.827575 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2768/5708] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:31:36 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:31:36.983958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:36.985691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:37.003472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:37.004662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:37.007669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:37.012434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:37.016056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:37.019081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:37.097770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:31:37.327678 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9792d66-eadf-48d2-96e6-d21890d3df6b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 204 len: 0 microversion: 2.20 time: 0.344528 Oct 02 01:31:37.333417 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2941/5709] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:31:36 2022] DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:31:37.342394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:37.343309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:37.355827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:37.356686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:37.357353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:37.358975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:37.360767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:37.362073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:39.403725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:39.432826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:39.434698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:39.436227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c4bc747-f56f-4231-a767-6c918f07d23a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 2.097909 Oct 02 01:31:39.447829 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2769/5710] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:31:37 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:31:40.467293 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:40.468746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:40.485814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:40.489488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:40.490194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:40.491193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:40.496416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:40.497072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:41.143664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:41.163054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:41.170313 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:41.172785 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6be7204f-ad7c-4bb6-b6eb-2bdb56d29a43 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.710879 Oct 02 01:31:41.179208 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2942/5711] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:31:40 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:31:42.206714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:42.208691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:42.236568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:42.237074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:42.237523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:42.243971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:42.244924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:42.245487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:42.796281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:42.820675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:42.824011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:42.825487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0417213f-609a-43d4-a6aa-6ab819a02257 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1723 microversion: 2.20 time: 0.624014 Oct 02 01:31:42.827905 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2770/5712] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:31:42 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1723 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:31:43.860676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:43.861413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:43.883728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:43.885381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:43.889682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:43.892686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:43.898146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:43.900328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:44.162207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:44.180693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:44.188054 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:44.193868 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91d2d71d-323e-4e5b-be27-9624e6ce2505 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1656 microversion: 2.20 time: 0.340459 Oct 02 01:31:44.199273 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2943/5713] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:31:43 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1656 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:31:44.872380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7b025470-5b29-4ea6-a3df-d7a5f74bc36e req-c8b9bd7f-1600-4770-9b3b-10112c9382aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02903664-5ea7-411a-9883-d72d1c0319c5", "name": "network-vif-deleted", "tag": "993fef52-3afd-4262-81b8-8d4f8c6fb2d0"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:31:44.903236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7b025470-5b29-4ea6-a3df-d7a5f74bc36e req-c8b9bd7f-1600-4770-9b3b-10112c9382aa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:44.903926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7b025470-5b29-4ea6-a3df-d7a5f74bc36e req-c8b9bd7f-1600-4770-9b3b-10112c9382aa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:44.904532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7b025470-5b29-4ea6-a3df-d7a5f74bc36e req-c8b9bd7f-1600-4770-9b3b-10112c9382aa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:44.928959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7b025470-5b29-4ea6-a3df-d7a5f74bc36e req-c8b9bd7f-1600-4770-9b3b-10112c9382aa service nova] Creating event network-vif-deleted:993fef52-3afd-4262-81b8-8d4f8c6fb2d0 for instance 02903664-5ea7-411a-9883-d72d1c0319c5 on n-h1-master-1 Oct 02 01:31:44.940919 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7b025470-5b29-4ea6-a3df-d7a5f74bc36e req-c8b9bd7f-1600-4770-9b3b-10112c9382aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073672 Oct 02 01:31:44.942281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2771/5714] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:31:45.234292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:45.236702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:45.300689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:45.309841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:45.312466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:45.315894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:45.320835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:45.323243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:45.438019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:45.441239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:45.442145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:45.444652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lazy-loading 'fault' on Instance uuid 02903664-5ea7-411a-9883-d72d1c0319c5 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:31:45.575036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:45.597266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:45.604050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:31:45.612005 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eda150a8-8729-4c8d-a3dc-f2d54a0af092 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 200 len: 1372 microversion: 2.20 time: 0.384542 Oct 02 01:31:45.616534 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2944/5715] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:31:45 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 1372 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:31:46.645578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:46.646406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:31:46.669269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:46.670239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:46.671501 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:46.673873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:46.675692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:46.679271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:46.735737 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] HTTP exception thrown: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Request method failure captured: Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 HTTP/1.1 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOivokbkb32c-U8ZoEw1HMCCTqBMf_XTJTiOiHdpUxzKrZWSVfJCLBc2D1Lj3cgrhCbvwVmJLaA-NJF0Xzbqiq7ajJvOipQz0di4s44Jb2fA-w6FRXgxvsT9UuD2ARwsBddwSQxWG7SDMgsIPjI1Og72kNGVgQwkOCvy9p2lpd1bbKo Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9b8b20b7702433486fbb08f8e801d57"}]}] Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 116490a90023449a83265db52a0debb1 Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '02903664-5ea7-411a-9883-d72d1c0319c5'} Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:31:46.745297 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:31:46.752234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Returning 404 to user: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:31:46.755485 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f37f7571-dc43-4f7d-8fd6-4b59ef6ffdf1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 404 len: 111 microversion: 2.20 time: 0.115239 Oct 02 01:31:46.764936 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8b7021f8-6bfd-4c44-a836-a6cca853638f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '.version_select at 0x7fb87bffc040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:46.776766 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2772/5716] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:31:46 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:31:46.847061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8b7021f8-6bfd-4c44-a836-a6cca853638f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719319378" status: 204 len: 0 microversion: 2.20 time: 0.086041 Oct 02 01:31:46.847693 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2945/5717] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719319378 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 01:31:50.473023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5be1b553-90e8-4ecd-9e4c-f9ef37cfd935 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'create', calling method: .version_select at 0x7fb88569ff70>, body: {"keypair": {"name": "tempest-keypair-1408885479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxPcLAp1/FYwM+boLvXsTZy6YBHcDX9ek87fHCq1VNUD6iMdzn+tfe8GxVFm3KmrltUa8vUcQyfRGfZa8p0T1ZtxJmIHEz39QEEio/4BFbtpQvvvl0HfOFGyH8PJqN20Q=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:31:50.521286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-5be1b553-90e8-4ecd-9e4c-f9ef37cfd935 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for project d9b8b20b7702433486fbb08f8e801d57. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:31:50.542699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-5be1b553-90e8-4ecd-9e4c-f9ef37cfd935 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for user 116490a90023449a83265db52a0debb1 and project d9b8b20b7702433486fbb08f8e801d57. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:31:50.607475 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5be1b553-90e8-4ecd-9e4c-f9ef37cfd935 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.138705 Oct 02 01:31:50.608671 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2773/5718] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 2 01:31:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 01:31:54.573763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-826568131", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6333bc5f-8bdd-4ec6-b808-179e141404af"}], "security_groups": [{"name": "tempest-securitygroup--508692136"}], "key_name": "tempest-keypair-1408885479", "user_data": "}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:31:55.455746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] validate_networks() for [('6333bc5f-8bdd-4ec6-b808-179e141404af', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:31:55.580356 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:57.317480 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:58.733035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:31:58.734266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:31:58.735665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:31:58.736196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:31:58.736782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:31:58.755981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:58.756849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:58.758333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:58.759485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:31:58.762272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:31:58.763044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:31:58.865474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for project d9b8b20b7702433486fbb08f8e801d57. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:31:58.884140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Getting quotas for user 116490a90023449a83265db52a0debb1 and project d9b8b20b7702433486fbb08f8e801d57. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:31:58.912450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:31:58.917343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:31:59.257582 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [6d816150-16c7-4987-bbfb-07a8c19e4cc2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:32:00.269771 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [6d816150-16c7-4987-bbfb-07a8c19e4cc2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34458. Oct 02 01:32:00.287179 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81fdb1d2-202f-4b83-84a7-f3687d3f3e23 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.718496 Oct 02 01:32:00.288062 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2946/5719] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 2 01:31:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 5722 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 01:32:00.302275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-893d0d07-234f-4e35-94e1-3b81ac1cf351 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:00.302946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-893d0d07-234f-4e35-94e1-3b81ac1cf351 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:00.310002 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=58 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:00.314719 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:00.490038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-893d0d07-234f-4e35-94e1-3b81ac1cf351 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:00.516005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-893d0d07-234f-4e35-94e1-3b81ac1cf351 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:00.526285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-893d0d07-234f-4e35-94e1-3b81ac1cf351 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:00.534839 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-893d0d07-234f-4e35-94e1-3b81ac1cf351 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1281 microversion: 2.20 time: 0.235447 Oct 02 01:32:00.537994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2774/5720] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:00 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:01.566568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e5654e7-2b2b-45b5-8e5c-f61146ffbf3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:01.567772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e5654e7-2b2b-45b5-8e5c-f61146ffbf3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:01.968087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e5654e7-2b2b-45b5-8e5c-f61146ffbf3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:01.980728 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e5654e7-2b2b-45b5-8e5c-f61146ffbf3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:01.989732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e5654e7-2b2b-45b5-8e5c-f61146ffbf3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:01.995708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e5654e7-2b2b-45b5-8e5c-f61146ffbf3d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1281 microversion: 2.20 time: 0.434048 Oct 02 01:32:02.001528 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2947/5721] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:01 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1281 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:03.028724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:03.032059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:03.081304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:03.085803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:03.092044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:03.096210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:03.097161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:03.106014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:03.415732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:03.442846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:03.444767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:03.446217 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b4014563-8231-40b5-9b83-9e8b81df691b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1341 microversion: 2.20 time: 0.425756 Oct 02 01:32:03.449548 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2775/5722] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:03 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1341 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:32:04.480392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:04.481589 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:04.497464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:04.498132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:04.498782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:04.502212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:04.502934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:04.503540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:04.607525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:04.617847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:04.620222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:04.621764 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bcff0121-b7c5-4fa6-be8a-5d691f12893b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1339 microversion: 2.20 time: 0.146032 Oct 02 01:32:04.622543 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2948/5723] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:04 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:05.651055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:05.652646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:05.664469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:05.666280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:05.668640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:05.671035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:05.671766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:05.673016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:05.863555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:05.889019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:05.895659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:05.900756 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7eeff269-0d09-43b6-8e04-7c6c63d14260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1339 microversion: 2.20 time: 0.251877 Oct 02 01:32:05.903039 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2776/5724] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:05 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:06.960000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:06.961280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:06.986627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:06.996763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:06.997507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:06.998523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:07.000792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:07.002047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:07.771501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:07.780628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:07.796086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:07.800184 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9e95ad6-6b3d-4356-a000-eed97ac28b83 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 0.872326 Oct 02 01:32:07.803246 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2949/5725] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:06 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:08.848356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:08.849671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:08.872551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:08.879404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:08.880119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:08.881844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:08.882477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:08.883701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:09.530642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:09.546565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:09.550040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:09.562383 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0674f57b-15fe-47ff-b6ee-158de49192df tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 0.712754 Oct 02 01:32:09.563294 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2777/5726] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:08 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:10.282846 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f0576db6-e913-4ff7-9a6a-d70812edfc8a req-1dcb3f35-0ae1-418b-a008-d808700170b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:32:10.294948 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:10.302648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0576db6-e913-4ff7-9a6a-d70812edfc8a req-1dcb3f35-0ae1-418b-a008-d808700170b3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:10.310090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0576db6-e913-4ff7-9a6a-d70812edfc8a req-1dcb3f35-0ae1-418b-a008-d808700170b3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:10.310865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f0576db6-e913-4ff7-9a6a-d70812edfc8a req-1dcb3f35-0ae1-418b-a008-d808700170b3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:10.345467 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f0576db6-e913-4ff7-9a6a-d70812edfc8a req-1dcb3f35-0ae1-418b-a008-d808700170b3 service nova] Creating event network-changed:1125e00f-59a0-4cb0-86b6-7d49be923a42 for instance 79f9b386-194d-4808-962c-455ebf93e0d0 on n-h2-master-1 Oct 02 01:32:10.357969 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f0576db6-e913-4ff7-9a6a-d70812edfc8a req-1dcb3f35-0ae1-418b-a008-d808700170b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079345 Oct 02 01:32:10.359216 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2950/5727] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:32:10.594202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:10.596287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:10.608578 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:10.619912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:10.626432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:10.629864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:10.640651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:10.640651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:10.640651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:11.549986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:11.563448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:11.566421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:11.570714 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e72cb19-f1b7-4885-8fbf-131356de54ed tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 0.981014 Oct 02 01:32:11.587791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2778/5728] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:10 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:32:12.601499 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:12.603025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:12.609086 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:12.637076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:12.637584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:12.641274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:12.642035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:12.642510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:12.646979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:13.343348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:13.362439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:13.363966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:13.365124 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3a92c2b1-e15f-4892-907d-5e9fbbf611bb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 0.768197 Oct 02 01:32:13.393218 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2951/5729] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:12 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:14.407730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:14.408343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:14.424606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:14.425103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:14.425546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:14.426259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:14.426752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:14.427182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:15.771788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:15.783161 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:15.790850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:15.792194 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-752f6471-e3d3-4146-9ebe-b6542ebda600 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 1.388437 Oct 02 01:32:15.819662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2779/5730] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:14 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:16.821806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:16.822352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:16.835816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:16.836311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:16.837274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:16.860747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:16.862916 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:16.863900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:17.369888 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:17.393351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:17.396618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:17.403765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5bc9756a-5e83-4309-b980-6a3cf14f085a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 0.586074 Oct 02 01:32:17.408241 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2952/5731] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:16 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:18.437043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:18.437911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:18.453420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:18.453922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:18.461505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:18.467186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:18.467901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:18.468546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:19.096825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-710e9ec0-588e-4b28-bb46-870cb2135bac req-f4315342-7a56-43e2-a19e-b77b526b6ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "name": "network-vif-plugged", "status": "completed", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:32:19.127500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:19.146110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-710e9ec0-588e-4b28-bb46-870cb2135bac req-f4315342-7a56-43e2-a19e-b77b526b6ef7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:19.150633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-710e9ec0-588e-4b28-bb46-870cb2135bac req-f4315342-7a56-43e2-a19e-b77b526b6ef7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:19.151619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:19.152674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-710e9ec0-588e-4b28-bb46-870cb2135bac req-f4315342-7a56-43e2-a19e-b77b526b6ef7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:19.156265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:19.160931 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed82db6d-e4e0-4284-a110-c282abc181fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 0.727278 Oct 02 01:32:19.161574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2780/5732] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:18 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:19.192721 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-710e9ec0-588e-4b28-bb46-870cb2135bac req-f4315342-7a56-43e2-a19e-b77b526b6ef7 service nova] Creating event network-vif-plugged:1125e00f-59a0-4cb0-86b6-7d49be923a42 for instance 79f9b386-194d-4808-962c-455ebf93e0d0 on n-h2-master-1 Oct 02 01:32:19.228423 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-710e9ec0-588e-4b28-bb46-870cb2135bac req-f4315342-7a56-43e2-a19e-b77b526b6ef7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.724746 Oct 02 01:32:19.233604 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2953/5733] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:32:20.189014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:20.189638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:20.228869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:20.229776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:20.233190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:20.240414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:20.246043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:20.246669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:21.662539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:21.677245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:21.679034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:21.685242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f21fbba8-f4c0-453c-a7a5-90941ae11b5e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1406 microversion: 2.20 time: 1.500284 Oct 02 01:32:21.687324 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2781/5734] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:20 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1406 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:32:22.718866 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:22.722347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:22.747477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:22.749082 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:22.749541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:22.752458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:22.753071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:22.753733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:23.466295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:23.476582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:23.483277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:32:23.486508 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6032e28-89e9-4f36-9e4d-987eba1e3620 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1597 microversion: 2.20 time: 0.777183 Oct 02 01:32:23.491913 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2954/5735] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:32:22 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1597 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:32:23.517777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:23.519374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:23.533215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:23.534896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:23.536933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:23.540345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:23.541007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:23.541969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:23.807657 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-61f735e9-a45f-459c-a159-6656441b5736 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.299022 Oct 02 01:32:23.809011 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2782/5736] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 2 01:32:23 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:32:26.573797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-bd84a02d-7d63-4887-b81d-db233a2c9b35 req-5515d262-4f0d-4b27-a562-41af446ddbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:32:26.595956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bd84a02d-7d63-4887-b81d-db233a2c9b35 req-5515d262-4f0d-4b27-a562-41af446ddbc5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:26.596452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bd84a02d-7d63-4887-b81d-db233a2c9b35 req-5515d262-4f0d-4b27-a562-41af446ddbc5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:26.596887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-bd84a02d-7d63-4887-b81d-db233a2c9b35 req-5515d262-4f0d-4b27-a562-41af446ddbc5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:26.607376 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=37 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:26.651401 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-bd84a02d-7d63-4887-b81d-db233a2c9b35 req-5515d262-4f0d-4b27-a562-41af446ddbc5 service nova] Creating event network-changed:1125e00f-59a0-4cb0-86b6-7d49be923a42 for instance 79f9b386-194d-4808-962c-455ebf93e0d0 on n-h2-master-1 Oct 02 01:32:26.676380 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-bd84a02d-7d63-4887-b81d-db233a2c9b35 req-5515d262-4f0d-4b27-a562-41af446ddbc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344464 Oct 02 01:32:26.678632 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2955/5737] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:32:58.643440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:32:58.644263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:32:58.648102 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=19 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:58.654218 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=46 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:58.706056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:58.708991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:58.710877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:58.713812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:32:58.721900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:32:58.728032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:32:58.909845 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-78450cc9-16c0-4d9a-8127-86636d76f356 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/ips" status: 200 len: 151 microversion: 2.20 time: 0.263212 Oct 02 01:32:58.915569 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2783/5738] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Oct 2 01:32:58 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/ips => generated 151 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:33:02.396041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:33:02.396663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:02.409198 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:02.413498 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:02.435474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:02.436768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:02.437340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:02.440563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:02.441191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:02.443482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:02.491241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lazy-loading 'flavor' on Instance uuid 79f9b386-194d-4808-962c-455ebf93e0d0 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:33:02.828891 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cf11ba46-0631-4dfb-b217-cf4f73449ea9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/action" status: 202 len: 0 microversion: 2.20 time: 0.436524 Oct 02 01:33:02.829713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2956/5739] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:33:02 2022] POST /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:33:02.840135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:02.841165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:02.857524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:02.858008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:02.858450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:02.862146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:02.862650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:02.863114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:03.255552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:03.269369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:03.271067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:03.272322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bd1e267-4eef-4e13-8d36-29afddf24064 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.438219 Oct 02 01:33:03.272921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2784/5740] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:02 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:04.301986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:04.302898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:04.358115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:04.358643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:04.359107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:04.362398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:04.363109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:04.365761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:04.951296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:04.961955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:04.963719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:04.965182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f601265-94bf-4bdf-ad0d-a57addc9d4cb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.669698 Oct 02 01:33:04.965942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2957/5741] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:04 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:05.992940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:05.994670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:06.006354 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:33:06.009721 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 (ip 10.222.0.23) !!! Oct 02 01:33:06.045989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:06.051688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:06.053461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:06.054245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:06.054781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:06.067061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:06.426457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:06.440167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:06.448910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:06.453508 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e12f215-d25d-456b-b791-2c4699f04665 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.465265 Oct 02 01:33:06.457502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2785/5742] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:05 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:07.487441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:07.488677 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:07.506309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:07.507125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:07.508328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:07.513949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:07.515000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:07.515702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:08.083699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:08.099517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:08.100967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:08.112701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db658aa1-d6f9-43a2-99b3-2042c5d35045 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.621498 Oct 02 01:33:08.127914 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2958/5743] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:07 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:09.144452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:09.145163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:09.185729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:09.186645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:09.187269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:09.188297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:09.189198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:09.189794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:09.729751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:09.743382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:09.748875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:09.755011 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d29570c6-3545-437d-a951-446a5c172060 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.615311 Oct 02 01:33:09.782766 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2786/5744] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:09 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:10.815603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:10.816713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:10.836432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:10.837164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:10.843476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:10.848904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:10.849462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:10.849915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:11.260064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:11.285770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:11.288340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:11.289655 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-92fdd965-80cf-4c82-a022-43700ff038f1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.480229 Oct 02 01:33:11.290432 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2959/5745] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:10 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:12.323943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:12.326194 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:12.339472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:12.341830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:12.342651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:12.343598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:12.344305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:12.345053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:13.109611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:13.136181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:13.144293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:13.147388 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e3e304e2-7690-45be-8b55-77a437187294 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.834747 Oct 02 01:33:13.149839 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2787/5746] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:12 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:14.178346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:14.178989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:14.191936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:14.195010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:14.196806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:14.200986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:14.205345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:14.206006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:14.694543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:14.726940 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:14.728946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:14.730180 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-710ed132-af00-47fe-85b8-7d011864009f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1743 microversion: 2.20 time: 0.555801 Oct 02 01:33:14.730785 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2960/5747] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:14 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1743 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:15.763180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:15.763873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:15.786043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:15.786806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:15.788242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:15.793733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:15.794798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:15.796156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:16.334006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:16.369258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:16.374926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:16.379089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-681a9e04-0526-4d65-90b4-c861c5947c5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.622463 Oct 02 01:33:16.381481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2788/5748] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:15 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:17.410411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:17.411748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:17.427991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:17.428739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:17.429348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:17.431018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:17.431649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:17.432248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:17.710445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:17.736116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:17.738040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:17.756160 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8310c5f3-7bb0-4264-be1d-2c995e8752d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.353226 Oct 02 01:33:17.756769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2961/5749] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:17 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:18.047612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-65e96db7-d785-48ad-880e-2dddb1e0218c req-c8e862ec-e628-4d4f-8e47-fabcd5062b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "name": "network-vif-plugged", "status": "completed", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:33:18.074903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-65e96db7-d785-48ad-880e-2dddb1e0218c req-c8e862ec-e628-4d4f-8e47-fabcd5062b9b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:18.083666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-65e96db7-d785-48ad-880e-2dddb1e0218c req-c8e862ec-e628-4d4f-8e47-fabcd5062b9b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:18.087355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-65e96db7-d785-48ad-880e-2dddb1e0218c req-c8e862ec-e628-4d4f-8e47-fabcd5062b9b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:18.116209 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-65e96db7-d785-48ad-880e-2dddb1e0218c req-c8e862ec-e628-4d4f-8e47-fabcd5062b9b service nova] Creating event network-vif-plugged:1125e00f-59a0-4cb0-86b6-7d49be923a42 for instance 79f9b386-194d-4808-962c-455ebf93e0d0 on n-h2-master-1 Oct 02 01:33:18.136773 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-65e96db7-d785-48ad-880e-2dddb1e0218c req-c8e862ec-e628-4d4f-8e47-fabcd5062b9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098124 Oct 02 01:33:18.137386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2789/5750] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 02 01:33:18.787357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:18.788224 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:18.814398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:18.815977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:18.823431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:18.825472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:18.829171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:18.833384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:20.231457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:20.240784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:20.252547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:20.254077 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f095c4ec-4008-4b4f-aa69-53da60c013f9 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 1.470635 Oct 02 01:33:20.271518 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2962/5751] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:18 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:21.293345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:21.294714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:21.317280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:21.322073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:21.324866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:21.325837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:21.328978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:21.331076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:21.694634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:21.721033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:21.728450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:21.732248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27a16006-847e-48cf-b294-8cd7a28b3de2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.444194 Oct 02 01:33:21.734974 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2790/5752] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:21 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:22.768436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:22.769800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:22.790418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:22.791346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:22.793694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:22.795771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:22.798449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:22.800338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:23.120934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:23.136544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:23.138316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:23.139835 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e307ff40-6677-4499-b2f5-ba5b1eba96fa tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.376273 Oct 02 01:33:23.141071 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2963/5753] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:22 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:24.176984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:24.179243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:24.217232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:24.217727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:24.218165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:24.226373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:24.231468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:24.231931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:24.894312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:24.906285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:24.908238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:24.913633 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8b8d793-1924-4dff-a759-b2f7297c1205 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.749710 Oct 02 01:33:24.917161 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2791/5754] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:24 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:25.943860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:25.945030 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:25.961330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:25.974272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:25.974778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:25.982080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:25.983742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:25.984203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:26.592101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:26.601141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:26.611390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:26.622288 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5eebc7c-6340-49fd-a834-38a8654245d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.682161 Oct 02 01:33:26.648901 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2964/5755] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:25 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:27.656461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:27.657928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:27.682276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:27.683272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:27.684541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:27.690971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:27.691914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:27.696049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:28.302575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:28.319723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:28.321954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:28.323186 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-778b5903-92e0-4f5e-86f0-59e58e617d82 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.674158 Oct 02 01:33:28.323769 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2792/5756] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:27 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:29.350994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:29.353972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:29.369619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:29.374195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:29.376114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:29.378186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:29.380269 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:29.381065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:30.500416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:30.513073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:30.518970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:30.520209 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ee18f42-51d1-4832-9c9c-e8eb1bcb5779 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 1.174398 Oct 02 01:33:30.520788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2965/5757] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:29 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:31.552144 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:31.553031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:31.590846 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=21 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:31.597968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:31.599742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:31.601317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:31.608016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:31.608844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:31.609530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:31.627047 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=55 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:32.109053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:32.119020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:32.127685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:32.136698 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0257ac2d-68a9-4991-bac8-751ba945de21 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.586688 Oct 02 01:33:32.139677 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2793/5758] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:31 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:33.168752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:33.169514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:33.181646 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=21 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:33.189178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:33.190365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:33.191109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:33.192115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:33.195060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:33.195763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:33.209617 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:33.469022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:33.484342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:33.490330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:33.493583 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e508f2d-4405-4acd-b811-6ac88c5b0128 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.329971 Oct 02 01:33:33.496245 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2966/5759] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:33 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:34.529908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:34.531724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:34.557170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:34.562315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:34.565782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:34.566993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:34.568116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:34.568714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:35.712280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:35.729999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:35.740897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:35.748247 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-340c7099-025b-4c11-91bf-72c7c6897023 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 1.223476 Oct 02 01:33:35.752954 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2794/5760] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:34 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:36.784363 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:36.785699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:36.794512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:36.801033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:36.801749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:36.802741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:36.803451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:36.804859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:37.185238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:37.200827 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:37.202296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:37.208407 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd3a9f14-2803-4b39-8fbc-0bbf634a628e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.429265 Oct 02 01:33:37.209348 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2967/5761] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:36 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:38.239575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:38.240830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:38.263308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:38.266467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:38.269521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:38.271689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:38.273802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:38.277026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:39.163709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:39.207321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:39.212558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:39.218977 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a1e2c3a-1816-42e5-b814-aa31b0559b30 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.982073 Oct 02 01:33:39.228342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2795/5762] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:38 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:40.256462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:40.257380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:40.270041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:40.275623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:40.280225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:40.281322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:40.282034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:40.282765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:41.669157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:41.685996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:41.688760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:41.701456 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac918c8f-647c-4760-b600-ae2b7bd829b6 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 1.447002 Oct 02 01:33:41.707384 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2968/5763] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:40 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:42.731549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:42.732105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:42.755750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:42.756257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:42.756712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:42.758017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:42.758419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:42.758877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:43.637967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:43.651516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:43.655234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:43.664175 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4691683c-acef-46d1-9c9e-b1aa7ef06a59 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.937419 Oct 02 01:33:43.664806 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2796/5764] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:42 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:44.697233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:44.698225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:44.715638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:44.718229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:44.719235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:44.725485 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:44.726092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:44.729352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:45.289594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:45.314477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:45.323744 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:45.325027 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5bc0fc6d-be18-4460-abc4-20e55fbcdccb tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.637257 Oct 02 01:33:45.328619 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2969/5765] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:44 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:46.359427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:46.360344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:46.373550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:46.374150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:46.374983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:46.379632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:46.380928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:46.381598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:46.888394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:46.914760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:46.925585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:46.931295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-deb7206e-02f0-48be-b1ff-ec9f58bbecb7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.575891 Oct 02 01:33:46.936396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2797/5766] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:46 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:47.981684 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:47.982560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:48.001968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:48.019927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:48.021858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:48.024701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:48.026417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:48.027215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:48.991930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:49.012933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:49.014407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:49.015665 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d0d25b7-2b4a-493e-827d-f0353704fbc2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 1.043336 Oct 02 01:33:49.016250 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2970/5767] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:47 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:50.054888 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:50.057542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:50.094922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:50.095923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:50.096740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:50.097836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:50.098396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:50.099154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:50.475049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:50.496121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:50.505865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:50.508370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-023cf08f-db14-44e6-8923-2cff09bebeb4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1738 microversion: 2.20 time: 0.465066 Oct 02 01:33:50.522654 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2798/5768] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:50 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1738 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:51.537726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:51.539512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:51.552578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:51.553075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:51.553519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:51.554253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:51.572440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:51.573790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:52.031692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:52.044366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:52.045724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:52.050095 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5083c5fd-a3cb-45cc-a186-bb9a157f836a tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1720 microversion: 2.20 time: 0.514387 Oct 02 01:33:52.051938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2971/5769] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:51 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1720 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:53.082845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:53.083453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:53.100658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:53.101675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:53.102115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:53.118561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:53.119554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:53.120170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:53.823919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:53.833931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:53.835420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:53.837016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-303c894c-a2bb-46a6-91a3-49b0052e99cc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1720 microversion: 2.20 time: 0.757941 Oct 02 01:33:53.837755 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2799/5770] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:53 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1720 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:54.865358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:54.867170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:54.884883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:54.885744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:54.886884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:54.887891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:54.889220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:54.889899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:55.720215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:55.735104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:55.743483 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:55.745955 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22e1449f-3ae5-4d9c-b53e-94db3ed110d8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1720 microversion: 2.20 time: 0.886493 Oct 02 01:33:55.750339 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2972/5771] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:54 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1720 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:55.844323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cf88110f-4881-44fc-a24d-fb791530306d req-a70747cf-da49-4c25-9efc-aa62265782e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "name": "network-vif-unplugged", "status": "completed", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:33:55.869529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cf88110f-4881-44fc-a24d-fb791530306d req-a70747cf-da49-4c25-9efc-aa62265782e6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:55.870456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cf88110f-4881-44fc-a24d-fb791530306d req-a70747cf-da49-4c25-9efc-aa62265782e6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:55.871128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cf88110f-4881-44fc-a24d-fb791530306d req-a70747cf-da49-4c25-9efc-aa62265782e6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:55.901860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.compute.server_external_events [req-cf88110f-4881-44fc-a24d-fb791530306d req-a70747cf-da49-4c25-9efc-aa62265782e6 service nova] Unable to find a host for instance 79f9b386-194d-4808-962c-455ebf93e0d0. Dropping event network-vif-unplugged {{(pid=122354) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 01:33:55.904449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cf88110f-4881-44fc-a24d-fb791530306d req-a70747cf-da49-4c25-9efc-aa62265782e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065068 Oct 02 01:33:55.905989 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2800/5772] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 02 01:33:56.781625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:56.782268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:56.795145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:56.809093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:56.813978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:56.816231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:56.816965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:56.817868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:57.609046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:57.620799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:57.626651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:33:57.628318 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e50b03dc-b94a-4cb2-993c-1a8411ab1be5 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1663 microversion: 2.20 time: 0.850643 Oct 02 01:33:57.629708 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2973/5773] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:33:56 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1663 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:33:57.662474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4582c8f-b849-4dcc-b134-5227f8fa8c70"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:33:57.673488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:57.698800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:57.699300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:57.700034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:57.700977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:57.711394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:57.712218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:58.917979 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a51d1043-dbbd-4d65-bc90-0106896beb27 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.259567 Oct 02 01:33:58.919201 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2801/5774] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Oct 2 01:33:57 2022] POST /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-volume_attachments => generated 188 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:33:59.289625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:33:59.290418 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:33:59.309352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:59.310004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:59.311100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:33:59.313842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:33:59.314559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:33:59.335639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:00.034883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4ce5d5f9-36e0-4970-92af-0454e7877bc4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-volume_attachments/b4582c8f-b849-4dcc-b134-5227f8fa8c70" status: 202 len: 0 microversion: 2.20 time: 0.745972 Oct 02 01:34:00.043655 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2974/5775] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Oct 2 01:33:59 2022] DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-volume_attachments/b4582c8f-b849-4dcc-b134-5227f8fa8c70 => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:34:00.262577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:34:00.264103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:00.304089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:00.306085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:00.306824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:00.307821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:00.308522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:00.309216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:00.354065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122354) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:34:00.475328 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3bf405d-dc7c-496e-a097-9cdbdb22222d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "POST /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/action" status: 202 len: 0 microversion: 2.20 time: 0.215852 Oct 02 01:34:00.477994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2802/5776] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 2 01:34:00 2022] POST /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:34:00.504642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:00.505586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:00.515784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:00.516400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:00.528156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:00.529353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:00.530037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:00.530720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:00.903644 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:00.914133 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:00.916098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:00.917314 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec586416-08c4-4f91-b0ca-f1ca16b8c4fc tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1671 microversion: 2.20 time: 0.435028 Oct 02 01:34:00.928929 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2975/5777] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:00 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1671 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:01.945178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:01.974066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:01.985483 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:01.998866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:01.999394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:01.999844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:02.003356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:02.005180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:02.005649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:02.124719 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:02.654520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:02.680712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:02.684187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:02.685425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b3f550a-fd9a-4bbc-97e6-90363421fd50 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1671 microversion: 2.20 time: 0.746243 Oct 02 01:34:02.690800 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2803/5778] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:01 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1671 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:03.721076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:03.723263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:03.726983 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=20 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:03.739337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:03.740283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:03.740964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:03.742162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:03.743002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:03.743681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:03.753717 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:04.282310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:04.297132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:04.302579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:04.306118 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-afdf21e6-84dd-4a61-ae6d-6a456c65bbe8 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.589652 Oct 02 01:34:04.315904 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2976/5779] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:03 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:05.347097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:05.349182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:05.369260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:05.371608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:05.372639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:05.376493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:05.377560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:05.381432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:06.164847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:06.175459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:06.177649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:06.179315 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b39187a0-5ea6-4a35-aff2-d106cb756787 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.837682 Oct 02 01:34:06.180334 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2804/5780] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:05 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:07.214918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:07.216882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:07.244728 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:07.246976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:07.251333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:07.257954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:07.265349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:07.267343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:07.659266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:07.670163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:07.681069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:07.689786 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1d33965-d504-4fcf-baff-0b42960ec61f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.484108 Oct 02 01:34:07.699855 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2977/5781] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:07 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:08.739739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:08.741006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:08.769930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:08.777288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:08.778048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:08.778485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:08.787540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:08.788000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:09.645024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:09.659256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:09.666010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:09.669078 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3d3185b3-306f-4989-bcb0-c4823dc8e5c7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.934110 Oct 02 01:34:09.683032 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2805/5782] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:08 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:10.715698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:10.716467 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:10.765957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:10.767067 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:10.771290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:10.772545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:10.777010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:10.781196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:11.281071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:11.304811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:11.319169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:11.323292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be3b326e-0de7-4e75-8f48-719e009b05d1 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.612715 Oct 02 01:34:11.344275 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2978/5783] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:10 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:12.374797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:12.376225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:12.386294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:12.394639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:12.396263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:12.397460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:12.400036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:12.400769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:12.881033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:12.902037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:12.905950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:12.918355 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea16f7bc-702c-40d1-bb06-028958b08e5c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.542518 Oct 02 01:34:12.921782 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2806/5784] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:12 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:13.957413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:13.959852 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:14.008625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:14.016393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:14.019771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:14.025828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:14.027095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:14.028695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:14.747505 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:14.757939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:14.762126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:14.767567 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e096b8b5-7c30-4052-98bf-c33f6c9ac895 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.818799 Oct 02 01:34:14.770791 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2979/5785] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:13 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:34:15.801218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:15.802143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:15.823336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:15.825406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:15.828419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:15.830375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:15.831908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:15.833512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:16.361576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:16.389541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:16.392239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:16.404395 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43cf4eaf-2ff8-41ee-9899-51d91abd0a6c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.606549 Oct 02 01:34:16.407437 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2807/5786] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:15 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:17.435010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:17.436584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:17.453253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:17.465538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:17.466002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:17.466788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:17.471615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:17.482084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:18.547291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:18.558997 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:18.560874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:18.562932 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40ca7563-7ec7-4fe6-84da-0669d2945e84 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 1.131745 Oct 02 01:34:18.567562 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2980/5787] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:17 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:34:19.605145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:19.607625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:19.627108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:19.640457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:19.651364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:19.653497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:19.666463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:19.669040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:20.651069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:20.669166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:20.675012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:20.677708 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-384894b8-9be3-4c70-84d8-19f2a44c6260 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 1.084090 Oct 02 01:34:20.678653 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2808/5788] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:19 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:21.709884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:21.711331 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:21.731518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:21.735748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:21.739196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:21.750198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:21.750780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:21.753868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:23.232679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:23.257980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:23.264738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:23.271061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-268e8798-48a9-4373-86e1-142b2e8bb5c4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 1.566218 Oct 02 01:34:23.286624 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2981/5789] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:21 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:24.298907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:24.299548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:24.310221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:24.310754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:24.311247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:24.312487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:24.312487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:24.312824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:24.894706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:24.918953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:24.920936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:24.928273 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f150c787-eda2-4b89-8195-b253377b8b61 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.633266 Oct 02 01:34:24.943224 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2809/5790] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:24 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:25.968952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:25.969879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:25.990254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:25.993774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:25.994468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:25.997837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:26.001267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:26.001887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:26.369554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:26.383013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:26.388324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:26.399142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3c059453-9bc0-40f8-9ca6-509e67016934 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.436848 Oct 02 01:34:26.416980 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2982/5791] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:25 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:27.434892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:27.435694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:27.442311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:27.442911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:27.443476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:27.444200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:27.444732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:27.445169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:27.825254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:27.839604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:27.841060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:27.849417 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9e3bfd2-4d87-4c02-b867-594e035ed4ab tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.418770 Oct 02 01:34:27.850023 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2810/5792] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:27 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:28.886559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:28.887380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:28.901352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:28.901856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:28.902297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:28.903167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:28.903628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:28.904058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:29.218108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:29.234082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:29.247366 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:29.248866 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78eac925-3c71-4ae1-b300-715e90ea7dca tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.374117 Oct 02 01:34:29.249791 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2983/5793] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:28 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:30.041503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2fc582bb-d54e-4f4c-ac43-69b7480661d1 req-bee48933-46a9-4953-8609-2571791aff9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "name": "network-vif-plugged", "status": "completed", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:34:30.085413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2fc582bb-d54e-4f4c-ac43-69b7480661d1 req-bee48933-46a9-4953-8609-2571791aff9c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:30.105372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2fc582bb-d54e-4f4c-ac43-69b7480661d1 req-bee48933-46a9-4953-8609-2571791aff9c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:30.109906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2fc582bb-d54e-4f4c-ac43-69b7480661d1 req-bee48933-46a9-4953-8609-2571791aff9c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:30.171323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2fc582bb-d54e-4f4c-ac43-69b7480661d1 req-bee48933-46a9-4953-8609-2571791aff9c service nova] Creating event network-vif-plugged:1125e00f-59a0-4cb0-86b6-7d49be923a42 for instance 79f9b386-194d-4808-962c-455ebf93e0d0 on n-h2-master-1 Oct 02 01:34:30.182138 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2fc582bb-d54e-4f4c-ac43-69b7480661d1 req-bee48933-46a9-4953-8609-2571791aff9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146549 Oct 02 01:34:30.183123 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2811/5794] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:34:30.280506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:30.281120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:30.294888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:30.295646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:30.296538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:30.297427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:30.299341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:30.299978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:30.660690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:30.670084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:30.671480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:30.672669 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db3cfc51-7291-4d0d-96ea-25b7d3083e7b tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.396746 Oct 02 01:34:30.701656 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2984/5795] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:30 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:31.708700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:31.709969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:31.721522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:31.722027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:31.722468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:31.723279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:31.723744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:31.724376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:32.423488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:32.426677 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=54 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:32.444342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:32.450727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:32.452196 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b7718d0-9e34-4a64-9aba-584a6d129b9c tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 0.747972 Oct 02 01:34:32.488507 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2812/5796] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:31 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:34:33.495250 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:33.496943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:33.522508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:33.533311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:33.533771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:33.539862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:33.540395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:33.540851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:34.749746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:34.759042 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=58 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:34.770530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:34.790265 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:34.796092 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd00df4b-2555-4abd-ac54-3fe85b7e5a6f tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1729 microversion: 2.20 time: 1.306604 Oct 02 01:34:34.798001 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2985/5797] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:33 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1729 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:34:35.826844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:34:35.827469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:34:35.830266 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=20 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:35.861341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:35.861851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:35.862304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:35.863054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:34:35.863516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:34:35.863947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:34:37.390005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:37.402383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:37.404745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:34:37.406227 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ea9a202-f792-4d22-9de9-d1e88b9bb277 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1716 microversion: 2.20 time: 1.583793 Oct 02 01:34:37.407810 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2813/5798] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:34:35 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1716 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:35:09.422142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:09.424894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:09.435812 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=19 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:09.441885 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 02 01:35:09.445663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:09.451367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:09.454226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:09.455097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:09.455644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:09.463565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:09.547399 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c63e142-f704-40fa-aecd-a8604f7f6793 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.129359 Oct 02 01:35:09.548465 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2986/5799] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 2 01:35:09 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:09.672007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:09.673108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:09.686476 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:09.688254 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:35:09.688648 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 (ip 10.222.0.23) !!! Oct 02 01:35:09.694552 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:09.696638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:09.697953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:09.698876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:09.703370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:09.704013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:09.706731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:09.765265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:35:09.952476 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab7cf3e1-cc6b-40ed-9c86-5a7fcaefca9d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 204 len: 0 microversion: 2.20 time: 0.284301 Oct 02 01:35:09.953108 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2814/5800] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:35:09 2022] DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:35:09.963764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:09.964642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:09.976751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:09.979419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:09.980110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:09.981048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:09.985320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:09.986115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:10.317988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:10.342500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:10.344488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:10.345898 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-670b37de-044f-4c5b-89ca-b5c574dc528e tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.388484 Oct 02 01:35:10.346658 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2987/5801] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:09 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:35:11.380007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:11.382293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:11.393176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:11.394113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:11.396090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:11.398718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:11.399415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:11.400388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:12.017154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:12.031791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:12.036876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:12.039776 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36e6070b-ead9-487e-9f48-71e987a92554 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1722 microversion: 2.20 time: 0.666822 Oct 02 01:35:12.040391 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2815/5802] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:11 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1722 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:35:13.070083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:13.070784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:13.086834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:13.087342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:13.087979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:13.088769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:13.089183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:13.089622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:13.342299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:13.352705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:13.354178 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:13.373070 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-21f394d6-f64e-4314-8570-8207c69ef200 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1655 microversion: 2.20 time: 0.309754 Oct 02 01:35:13.373732 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2988/5803] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:13 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1655 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:35:14.409225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:14.410769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:14.443309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:14.446564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:14.447172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:14.448142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:14.448954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:14.451066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:14.698054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:14.712323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:14.716122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116490a90023449a83265db52a0debb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b8b20b7702433486fbb08f8e801d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:14.717642 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-71d3ca67-f8b5-4a4a-a802-4268bc6189f2 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 200 len: 1655 microversion: 2.20 time: 0.317939 Oct 02 01:35:14.718906 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2816/5804] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:14 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 1655 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:35:14.954495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d5ffe097-9dd8-4372-9d3e-98fdf1cf478d req-5c8807bc-4bac-4dad-8c86-f44d21be635a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f9b386-194d-4808-962c-455ebf93e0d0", "name": "network-vif-deleted", "tag": "1125e00f-59a0-4cb0-86b6-7d49be923a42"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:14.991133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5ffe097-9dd8-4372-9d3e-98fdf1cf478d req-5c8807bc-4bac-4dad-8c86-f44d21be635a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:14.995261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5ffe097-9dd8-4372-9d3e-98fdf1cf478d req-5c8807bc-4bac-4dad-8c86-f44d21be635a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:14.995930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d5ffe097-9dd8-4372-9d3e-98fdf1cf478d req-5c8807bc-4bac-4dad-8c86-f44d21be635a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:15.016322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d5ffe097-9dd8-4372-9d3e-98fdf1cf478d req-5c8807bc-4bac-4dad-8c86-f44d21be635a service nova] Creating event network-vif-deleted:1125e00f-59a0-4cb0-86b6-7d49be923a42 for instance 79f9b386-194d-4808-962c-455ebf93e0d0 on n-h2-master-1 Oct 02 01:35:15.027419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d5ffe097-9dd8-4372-9d3e-98fdf1cf478d req-5c8807bc-4bac-4dad-8c86-f44d21be635a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.515085 Oct 02 01:35:15.042679 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2989/5805] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:35:15.752078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:15.752959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:15.774080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:15.779649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:15.781789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:15.783773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:15.786878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:15.789201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:15.868996 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] HTTP exception thrown: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Request method failure captured: Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 HTTP/1.1 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOivokbkb32c-U8ZoEw1HMCCTqBMf_XTJTiOiHdpUxzKrZWSVfJCLBc2D1Lj3cgrhCbvwVmJLaA-NJF0Xzbqiq7ajJvOipQz0di4s44Jb2fA-w6FRXgxvsT9UuD2ARwsBddwSQxWG7SDMgsIPjI1Og72kNGVgQwkOCvy9p2lpd1bbKo Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9b8b20b7702433486fbb08f8e801d57"}]}] Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 116490a90023449a83265db52a0debb1 Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '79f9b386-194d-4808-962c-455ebf93e0d0'} Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:15.871750 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:15.875493 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:15.875978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-250530312", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "5b8820e9-dbec-4408-8490-4b73e7ecc086"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:15.876405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Returning 404 to user: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:35:15.877563 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7532a817-798f-4cc8-8904-2856aba1d25d tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 404 len: 111 microversion: 2.20 time: 0.134768 Oct 02 01:35:15.878138 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2990/5806] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:15 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:35:15.894430 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8dc8b5b3-3649-48d7-8842-97039d20c0fe tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '.version_select at 0x7fb87bffc670>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:15.989037 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8dc8b5b3-3649-48d7-8842-97039d20c0fe tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408885479" status: 204 len: 0 microversion: 2.20 time: 0.104862 Oct 02 01:35:15.994681 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2991/5807] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 2 01:35:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408885479 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:35:16.011443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] validate_networks() for [('5b8820e9-dbec-4408-8490-4b73e7ecc086', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:35:17.574962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:35:17.575631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:35:17.576128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:35:17.576546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:35:17.576967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:35:17.601954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:17.606054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:17.606648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:17.607528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:17.613730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:17.614341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:17.657020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Getting quotas for project 9cd5011b4b1c48809d36075a7086d2da. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:35:17.671560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Getting quotas for user c3c2adcbca124733904414c88b325597 and project 9cd5011b4b1c48809d36075a7086d2da. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:35:17.709918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:35:17.719010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:35:17.856811 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36cf8576-8853-4d4f-952d-280c5268bbec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126374 Oct 02 01:35:17.859606 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2817/5808] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:35:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:35:17.873523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fa07e11-fd33-4b5b-ab66-545538f7f89c tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:17.874895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2fa07e11-fd33-4b5b-ab66-545538f7f89c tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:18.087692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2fa07e11-fd33-4b5b-ab66-545538f7f89c tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:18.115956 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2fa07e11-fd33-4b5b-ab66-545538f7f89c tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1214 microversion: 2.1 time: 0.246914 Oct 02 01:35:18.133416 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2992/5809] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:17 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:19.141480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:19.142767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:19.156388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:19.161414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:19.163038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:19.164018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:19.164844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:19.165482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:19.335117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:19.347039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05f44536-a138-45ea-85c1-979e27ed20d5 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1266 microversion: 2.1 time: 0.210097 Oct 02 01:35:19.354141 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2818/5810] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:19 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:20.375654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:20.376272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:20.393291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:20.396354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:20.396354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:20.401573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:20.410798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:20.410798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:20.627920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:20.646143 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-539b9db9-32ec-4094-9afa-40772d5b7031 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1272 microversion: 2.1 time: 0.274227 Oct 02 01:35:20.659636 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2993/5811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:20 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:21.688659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:21.689969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:21.711900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:21.712404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:21.712848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:21.713571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:21.714035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:21.714466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:22.205537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:22.216708 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-163cdc07-d575-4767-8fe0-cac9f266bd03 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.532548 Oct 02 01:35:22.219702 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2819/5812] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:21 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:22.941870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:22.943024 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:22.953146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:22.953646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:22.954095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:22.958556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:22.959135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:22.959591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:22.987753 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] HTTP exception thrown: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Request method failure captured: Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 HTTP/1.1 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOivokbkb32c-U8ZoEw1HMCCTqBMf_XTJTiOiHdpUxzKrZWSVfJCLBc2D1Lj3cgrhCbvwVmJLaA-NJF0Xzbqiq7ajJvOipQz0di4s44Jb2fA-w6FRXgxvsT9UuD2ARwsBddwSQxWG7SDMgsIPjI1Og72kNGVgQwkOCvy9p2lpd1bbKo Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9b8b20b7702433486fbb08f8e801d57"}]}] Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 116490a90023449a83265db52a0debb1 Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '79f9b386-194d-4808-962c-455ebf93e0d0'} Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:35:22.989955 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:22.993124 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:22.995347 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Returning 404 to user: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:35:22.996600 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d1866cf2-ca6f-4350-ae8d-7a50d21bc0a4 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 404 len: 111 microversion: 2.20 time: 0.059412 Oct 02 01:35:22.997811 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2994/5813] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:35:22 2022] DELETE /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:35:23.007679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:23.009581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 79f9b386-194d-4808-962c-455ebf93e0d0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:23.024323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:23.027176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:23.027968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:23.030998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:23.031760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:23.032410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:23.063941 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] HTTP exception thrown: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Request method failure captured: Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 HTTP/1.1 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOivokbkb32c-U8ZoEw1HMCCTqBMf_XTJTiOiHdpUxzKrZWSVfJCLBc2D1Lj3cgrhCbvwVmJLaA-NJF0Xzbqiq7ajJvOipQz0di4s44Jb2fA-w6FRXgxvsT9UuD2ARwsBddwSQxWG7SDMgsIPjI1Og72kNGVgQwkOCvy9p2lpd1bbKo Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9b8b20b7702433486fbb08f8e801d57"}]}] Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 116490a90023449a83265db52a0debb1 Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '79f9b386-194d-4808-962c-455ebf93e0d0'} Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:23.068239 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. Oct 02 01:35:23.073595 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:23.076237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Returning 404 to user: Instance 79f9b386-194d-4808-962c-455ebf93e0d0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:35:23.077508 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83a9da60-93b4-46c5-8b0f-beac330046b7 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0" status: 404 len: 111 microversion: 2.20 time: 0.075692 Oct 02 01:35:23.078911 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2820/5814] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:23 2022] GET /compute/v2.1/servers/79f9b386-194d-4808-962c-455ebf93e0d0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:35:23.246354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:23.247289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:23.255686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:23.256844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:23.257531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:23.258440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:23.259121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:23.259739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:23.899506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:23.926277 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-843a6fad-cf96-4a71-a2dc-04cc8d652566 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.686939 Oct 02 01:35:23.930025 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2995/5815] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:23 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:24.329364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ed8d0399-f0d9-4a32-9115-0f3286bf839b req-10fbafdd-1263-425f-afe8-a6712c8af608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b82f1bd-034a-424d-8aca-01a9a24946ee", "tag": "01388131-cee0-4df6-95f1-91d5e44e3334"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:24.365250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ed8d0399-f0d9-4a32-9115-0f3286bf839b req-10fbafdd-1263-425f-afe8-a6712c8af608 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:24.365748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ed8d0399-f0d9-4a32-9115-0f3286bf839b req-10fbafdd-1263-425f-afe8-a6712c8af608 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:24.366185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ed8d0399-f0d9-4a32-9115-0f3286bf839b req-10fbafdd-1263-425f-afe8-a6712c8af608 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:24.423027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ed8d0399-f0d9-4a32-9115-0f3286bf839b req-10fbafdd-1263-425f-afe8-a6712c8af608 service nova] Creating event network-changed:01388131-cee0-4df6-95f1-91d5e44e3334 for instance 0b82f1bd-034a-424d-8aca-01a9a24946ee on n-h1-master-1 Oct 02 01:35:24.436394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ed8d0399-f0d9-4a32-9115-0f3286bf839b req-10fbafdd-1263-425f-afe8-a6712c8af608 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110644 Oct 02 01:35:24.441542 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2821/5816] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:35:24.963678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:24.965034 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:24.977306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:24.978593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:24.979203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:24.987754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:24.989137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:24.989725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:25.264761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:25.273470 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dbc174f2-658b-45e2-aef5-9334d46e0ee6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.313531 Oct 02 01:35:25.278365 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2996/5817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:24 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:26.312424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:26.313140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:26.338365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:26.339065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:26.339664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:26.340586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:26.344716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:26.356241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:26.711384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:26.721899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd4f98b2-8100-4f91-967c-8e0bdb58ad14 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.421527 Oct 02 01:35:26.729728 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2822/5818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:26 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:27.762868 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:27.764913 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:27.798383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:27.799651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:27.801274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:27.806965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:27.809691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:27.813157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:28.114194 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:28.562421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:28.572244 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bfedb062-aaa7-4738-a619-a4419e799fcd tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.814648 Oct 02 01:35:28.573563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2997/5819] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:27 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:28.908710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:28.909191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:28.928590 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:28.931418 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:28.934209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:28.939045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:28.940009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:28.943581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:28.945393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:28.946012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:28.987810 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] HTTP exception thrown: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Request method failure captured: Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 HTTP/1.1 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOivokbkb32c-U8ZoEw1HMCCTqBMf_XTJTiOiHdpUxzKrZWSVfJCLBc2D1Lj3cgrhCbvwVmJLaA-NJF0Xzbqiq7ajJvOipQz0di4s44Jb2fA-w6FRXgxvsT9UuD2ARwsBddwSQxWG7SDMgsIPjI1Og72kNGVgQwkOCvy9p2lpd1bbKo Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9b8b20b7702433486fbb08f8e801d57"}]}] Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 116490a90023449a83265db52a0debb1 Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '02903664-5ea7-411a-9883-d72d1c0319c5'} Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:35:28.997277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.001028 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.004130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Returning 404 to user: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:35:29.007757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28dde8e5-994f-4eeb-80f7-dbf06c565c63 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 404 len: 111 microversion: 2.20 time: 0.103793 Oct 02 01:35:29.011079 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2823/5820] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 2 01:35:28 2022] DELETE /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:35:29.018168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:29.019688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] [instance: 02903664-5ea7-411a-9883-d72d1c0319c5] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:29.040604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:29.044074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:29.044721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:29.048324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:29.048986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:29.050509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:29.084468 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] HTTP exception thrown: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Request method failure captured: Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 HTTP/1.1 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOivokbkb32c-U8ZoEw1HMCCTqBMf_XTJTiOiHdpUxzKrZWSVfJCLBc2D1Lj3cgrhCbvwVmJLaA-NJF0Xzbqiq7ajJvOipQz0di4s44Jb2fA-w6FRXgxvsT9UuD2ARwsBddwSQxWG7SDMgsIPjI1Og72kNGVgQwkOCvy9p2lpd1bbKo Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9b8b20b7702433486fbb08f8e801d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9b8b20b7702433486fbb08f8e801d57"}]}] Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: d9b8b20b7702433486fbb08f8e801d57 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695910608 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 116490a90023449a83265db52a0debb1 Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695910608-project Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '02903664-5ea7-411a-9883-d72d1c0319c5'} Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.087817 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:35:29.091841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] Returning 404 to user: Instance 02903664-5ea7-411a-9883-d72d1c0319c5 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:35:29.092695 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-57236116-1cc5-4282-b550-30e5b9f5ed81 tempest-AttachVolumeShelveTestJSON-695910608 tempest-AttachVolumeShelveTestJSON-695910608-project] 10.222.0.23 "GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5" status: 404 len: 111 microversion: 2.20 time: 0.075865 Oct 02 01:35:29.094752 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2998/5821] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 2 01:35:29 2022] GET /compute/v2.1/servers/02903664-5ea7-411a-9883-d72d1c0319c5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:35:29.621325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:29.621964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:29.636236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:29.639950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:29.640415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:29.643643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:29.645451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:29.647375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:30.181388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4e9896cf-8a9a-4678-983e-0d5434cd0460 req-901a7909-fb45-4ed0-a231-19e33295db10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b82f1bd-034a-424d-8aca-01a9a24946ee", "name": "network-vif-plugged", "status": "completed", "tag": "01388131-cee0-4df6-95f1-91d5e44e3334"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:30.202205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:30.212537 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-31b134d6-4512-4a19-ad69-9472b9fc39f3 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.596987 Oct 02 01:35:30.216543 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2824/5822] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:29 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:30.219312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4e9896cf-8a9a-4678-983e-0d5434cd0460 req-901a7909-fb45-4ed0-a231-19e33295db10 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:30.224147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4e9896cf-8a9a-4678-983e-0d5434cd0460 req-901a7909-fb45-4ed0-a231-19e33295db10 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:30.224656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4e9896cf-8a9a-4678-983e-0d5434cd0460 req-901a7909-fb45-4ed0-a231-19e33295db10 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:30.274041 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4e9896cf-8a9a-4678-983e-0d5434cd0460 req-901a7909-fb45-4ed0-a231-19e33295db10 service nova] Creating event network-vif-plugged:01388131-cee0-4df6-95f1-91d5e44e3334 for instance 0b82f1bd-034a-424d-8aca-01a9a24946ee on n-h1-master-1 Oct 02 01:35:30.289731 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4e9896cf-8a9a-4678-983e-0d5434cd0460 req-901a7909-fb45-4ed0-a231-19e33295db10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114770 Oct 02 01:35:30.292211 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 2999/5823] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:35:31.241256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:31.241896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:31.256691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:31.257218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:31.257676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:31.258422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:31.258929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:31.259355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:31.699694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:31.708950 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1399278-4d27-4af8-ad47-eb37733ef1ae tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1314 microversion: 2.1 time: 0.472451 Oct 02 01:35:31.710085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2825/5824] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:31 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:32.739971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:32.740770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:32.749165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:32.749994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:32.750831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:32.751705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:32.752309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:32.753540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:33.257521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:33.274857 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-287b7602-be82-49d5-a7f0-c3b993cca999 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1502 microversion: 2.1 time: 0.543975 Oct 02 01:35:33.276248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3000/5825] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:32 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1502 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:33.304191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:33.305623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:33.324634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:33.326896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:33.327676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:33.344268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:33.344825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:33.345293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:33.864987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:33.874805 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9c27422-56b9-4f8b-b36b-d8c281ac707e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1502 microversion: 2.1 time: 0.575765 Oct 02 01:35:33.884412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2826/5826] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:33 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1502 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:33.927316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:33.929437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:33.946319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:33.947181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:33.947908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:33.949096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:33.949769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:33.950471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:34.060837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lazy-loading 'flavor' on Instance uuid 0b82f1bd-034a-424d-8aca-01a9a24946ee {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:35:34.240549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dace1227-d629-4c81-bd05-aa7e5026c102 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action" status: 202 len: 0 microversion: 2.1 time: 0.324134 Oct 02 01:35:34.244552 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3001/5827] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:35:33 2022] POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:35:34.262252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:34.263966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:34.280893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:34.281664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:34.282325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:34.283286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:34.289272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:34.290271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:35.045725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:35.059370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c426b2c-6793-48ff-bc66-f53810bd52fc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1510 microversion: 2.1 time: 0.813329 Oct 02 01:35:35.062151 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2827/5828] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:34 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:36.096533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:36.096533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:36.104489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:36.105258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:36.107018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:36.107975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:36.108857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:36.109666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:36.429955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:36.444028 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-97ede510-07f1-4ec8-9e23-a217713af8cb tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1493 microversion: 2.1 time: 0.357758 Oct 02 01:35:36.446988 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3002/5829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:36 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1493 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:36.476661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:36.477831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:36.497463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:36.497976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:36.498424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:36.503352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:36.504666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:36.505444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:36.666325 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c09bf600-5ff1-4828-911b-b4b38d978b05 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action" status: 202 len: 0 microversion: 2.1 time: 0.195400 Oct 02 01:35:36.667248 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2828/5830] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:35:36 2022] POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:35:36.677266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:36.678222 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:36.688651 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:36.689149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:36.691836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:36.707530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:36.711983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:36.712832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:37.099253 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:37.132226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62c87354-4e86-4579-bbca-bd9c6956b616 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1499 microversion: 2.1 time: 0.460038 Oct 02 01:35:37.154047 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3003/5831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:36 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1499 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:38.162474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:38.163002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:38.191557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:38.193233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:38.194209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:38.195497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:38.196203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:38.221431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:38.406315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:38.422075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3f25751-2041-479b-9ee7-4edef13f59b9 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1499 microversion: 2.1 time: 0.263914 Oct 02 01:35:38.422636 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2829/5832] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:38 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:39.457079 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:39.459676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:39.476302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:39.476825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:39.477287 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:39.478012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:39.478961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:39.479547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:39.760197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:39.770347 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:39.774069 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-860e8c8f-59eb-4d23-bda4-d7b0f7535142 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1502 microversion: 2.1 time: 0.328230 Oct 02 01:35:39.775090 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3004/5833] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:39 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:39.798633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:39.799226 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:39.809361 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:39.828135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:39.828135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:39.828135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:39.828625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:39.829070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:39.829505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:39.842053 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:39.923427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lazy-loading 'flavor' on Instance uuid 0b82f1bd-034a-424d-8aca-01a9a24946ee {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:35:40.121505 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-410e4966-b595-4399-8222-d432758b51dc tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action" status: 202 len: 0 microversion: 2.1 time: 0.326175 Oct 02 01:35:40.134941 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:40.139060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:40.155066 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2830/5834] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:35:39 2022] POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:35:40.166802 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:40.173898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:40.174441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:40.191385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:40.197474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:40.201817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:40.203488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:40.532214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:40.546722 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d753d828-0012-4679-ac26-51e7e6c061f2 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1510 microversion: 2.1 time: 0.416974 Oct 02 01:35:40.552401 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3005/5835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:40 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:41.585555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:41.586291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:41.604467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:41.604979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:41.606317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:41.607608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:41.608091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:41.608537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:41.910861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:41.919793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b96d5ff-94c3-4257-8395-8e905edc194f tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1493 microversion: 2.1 time: 0.345996 Oct 02 01:35:41.920773 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2831/5836] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:41 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1493 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:41.948193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:41.948791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:41.956220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:41.957236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:41.957689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:41.959206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:41.959865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:41.960450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:42.096362 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13da5764-1ced-43c1-b19c-c7b48503a8ec tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action" status: 202 len: 0 microversion: 2.1 time: 0.152130 Oct 02 01:35:42.101027 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3006/5837] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:35:41 2022] POST /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:35:42.109532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:42.110420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:42.120618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:42.121278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:42.122015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:42.129869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:42.130696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:42.131833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:42.592188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:42.603158 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58eb3105-1777-4d39-a7c8-cde2ecbd9312 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1499 microversion: 2.1 time: 0.500659 Oct 02 01:35:42.603785 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2832/5838] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:42 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1499 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:43.629457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:43.630188 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:43.644480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:43.645074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:43.645511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:43.651459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:43.652243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:43.652891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:43.923473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:43.935617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65b7238c-4818-4518-855a-7c36120988fe tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1499 microversion: 2.1 time: 0.312375 Oct 02 01:35:43.951899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3007/5839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:43 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:44.962420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:44.967254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:44.985330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:44.985889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:44.986385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:44.988748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:44.988899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:44.995435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:45.323205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:45.343093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5695bb85-8149-40fa-995a-a328da325c5e tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1502 microversion: 2.1 time: 0.382649 Oct 02 01:35:45.345429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2833/5840] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:44 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1502 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:35:45.371447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:45.372332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:45.385382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:45.386337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:45.387571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:45.389580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:45.390520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:45.391186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:45.427370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:35:45.622829 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f5eb6a2d-2d56-487e-b074-c3f1e01b17ca tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 204 len: 0 microversion: 2.1 time: 0.256097 Oct 02 01:35:45.637387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:45.639078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:45.641363 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3008/5841] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:35:45 2022] DELETE /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:35:45.670285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:45.675425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:45.675898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:45.676664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:45.677134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:45.687979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:46.028971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:46.040983 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b205460-9742-4a2f-982a-92f98d681a3d tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1508 microversion: 2.1 time: 0.409714 Oct 02 01:35:46.041994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2834/5842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:45 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:47.071058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:47.071788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:47.086754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:47.089311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:47.091432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:47.092333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:47.094431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:47.095087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:48.094221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:48.111272 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3b81f391-d7cc-4353-bf8d-30a2e264ab93 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1508 microversion: 2.1 time: 1.042699 Oct 02 01:35:48.119332 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3009/5843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:47 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1508 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:49.027838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2cd2df7e-67a0-4cb0-b05f-b176a211bf14 req-bd2ef651-5fba-4bb4-93ce-f7e6236a5313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b82f1bd-034a-424d-8aca-01a9a24946ee", "name": "network-vif-deleted", "tag": "01388131-cee0-4df6-95f1-91d5e44e3334"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:35:49.058265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2cd2df7e-67a0-4cb0-b05f-b176a211bf14 req-bd2ef651-5fba-4bb4-93ce-f7e6236a5313 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:49.060853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2cd2df7e-67a0-4cb0-b05f-b176a211bf14 req-bd2ef651-5fba-4bb4-93ce-f7e6236a5313 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:49.061697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2cd2df7e-67a0-4cb0-b05f-b176a211bf14 req-bd2ef651-5fba-4bb4-93ce-f7e6236a5313 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:49.099887 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2cd2df7e-67a0-4cb0-b05f-b176a211bf14 req-bd2ef651-5fba-4bb4-93ce-f7e6236a5313 service nova] Creating event network-vif-deleted:01388131-cee0-4df6-95f1-91d5e44e3334 for instance 0b82f1bd-034a-424d-8aca-01a9a24946ee on n-h1-master-1 Oct 02 01:35:49.116944 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2cd2df7e-67a0-4cb0-b05f-b176a211bf14 req-bd2ef651-5fba-4bb4-93ce-f7e6236a5313 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097296 Oct 02 01:35:49.120910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2835/5844] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:35:49.146526 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:49.147337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:49.162016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:49.162536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:49.164087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:49.171335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:49.172578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:49.173087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:49.327731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c2adcbca124733904414c88b325597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5011b4b1c48809d36075a7086d2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:35:49.339792 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0700593b-d2a4-4b88-9c17-2102f6fb2ce6 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 200 len: 1299 microversion: 2.1 time: 0.199699 Oct 02 01:35:49.347257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3010/5845] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:49 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:35:50.367565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:35:50.368274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] [instance: 0b82f1bd-034a-424d-8aca-01a9a24946ee] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:35:50.383290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:50.384027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:50.384636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:50.386049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:35:50.386929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:35:50.387551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:35:50.445682 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] HTTP exception thrown: Instance 0b82f1bd-034a-424d-8aca-01a9a24946ee could not be found. Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Request method failure captured: Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee HTTP/1.1 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOrPEAOSEgppu7QBRZ95wSLNZi8wq0EUK31eQT4odpdEwqWLfedhds18gDZ9yrOFx13Y3EcTnhvpxOoVA7C9bWe_trxKvbKG3-4tdVOOX538Z5L4xFkev-YAXKytw1bA0D9znok7TLzbl1cQJcTrW1o9FbvSCFx0J1k535ybBK_atG8 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9cd5011b4b1c48809d36075a7086d2da Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestServerAdvancedOps-857450106 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cd5011b4b1c48809d36075a7086d2da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cd5011b4b1c48809d36075a7086d2da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cd5011b4b1c48809d36075a7086d2da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cd5011b4b1c48809d36075a7086d2da"}]}] Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestServerAdvancedOps-857450106 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9cd5011b4b1c48809d36075a7086d2da Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestServerAdvancedOps-857450106 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestServerAdvancedOps-857450106-project Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: c3c2adcbca124733904414c88b325597 Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestServerAdvancedOps-857450106-project Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0b82f1bd-034a-424d-8aca-01a9a24946ee could not be found. Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0b82f1bd-034a-424d-8aca-01a9a24946ee'} Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82f1bd-034a-424d-8aca-01a9a24946ee could not be found. Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82f1bd-034a-424d-8aca-01a9a24946ee could not be found. Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:35:50.447988 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82f1bd-034a-424d-8aca-01a9a24946ee could not be found. Oct 02 01:35:50.456610 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:35:50.458995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] Returning 404 to user: Instance 0b82f1bd-034a-424d-8aca-01a9a24946ee could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:35:50.460063 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f7e5f04-ec98-420b-b07d-d53080204c27 tempest-TestServerAdvancedOps-857450106 tempest-TestServerAdvancedOps-857450106-project] 10.222.0.23 "GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee" status: 404 len: 111 microversion: 2.1 time: 0.098364 Oct 02 01:35:50.463584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2836/5846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:35:50 2022] GET /compute/v2.1/servers/0b82f1bd-034a-424d-8aca-01a9a24946ee => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:36:21.264726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1633306905", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "e3134f15-6339-4e20-b4ab-7e65491b30d9"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:36:21.323172 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:21.324179 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:21.419324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] validate_networks() for [('e3134f15-6339-4e20-b4ab-7e65491b30d9', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:36:22.434254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:36:22.435070 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:36:22.435191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:36:22.435594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:36:22.436017 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:36:22.462011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:22.462835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:22.463286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:22.476436 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:22.477245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:22.485119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:22.517090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Getting quotas for project e3d1b3bb7d3e4d6e9ac2e77cd77a4642. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:36:22.527663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Getting quotas for user 6a1352ee9dbe4587800e17d8b3287252 and project e3d1b3bb7d3e4d6e9ac2e77cd77a4642. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:36:22.552364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:36:22.568087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:36:22.710308 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [6d816150-16c7-4987-bbfb-07a8c19e4cc2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:36:23.742860 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [6d816150-16c7-4987-bbfb-07a8c19e4cc2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 42366. Oct 02 01:36:23.754712 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3fb9dc1f-fdf0-4e8c-bd45-1aa24f0c3995 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538960 Oct 02 01:36:23.756470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3011/5847] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:36:23.769127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf5d96a7-57b8-4033-a445-c27a03209454 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:23.770242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf5d96a7-57b8-4033-a445-c27a03209454 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:23.773450 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=13 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:23.774640 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:23.897270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf5d96a7-57b8-4033-a445-c27a03209454 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:23.907840 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf5d96a7-57b8-4033-a445-c27a03209454 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1219 microversion: 2.1 time: 0.142507 Oct 02 01:36:23.926230 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2837/5848] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:23 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:24.939621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-13b6bbcb-73d1-4f5f-b03f-236e1043bce0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:24.941231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-13b6bbcb-73d1-4f5f-b03f-236e1043bce0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:25.029315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-13b6bbcb-73d1-4f5f-b03f-236e1043bce0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:25.037671 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-13b6bbcb-73d1-4f5f-b03f-236e1043bce0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1219 microversion: 2.1 time: 0.107635 Oct 02 01:36:25.039128 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3012/5849] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:24 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:26.067562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-786a6413-5306-42e3-b393-dd92a36e77ba tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:26.069187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-786a6413-5306-42e3-b393-dd92a36e77ba tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:26.168150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-786a6413-5306-42e3-b393-dd92a36e77ba tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:26.190675 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-786a6413-5306-42e3-b393-dd92a36e77ba tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1219 microversion: 2.1 time: 0.129488 Oct 02 01:36:26.202358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2838/5850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:26 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:27.226358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:27.227187 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:27.271134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:27.273409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:27.275309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:27.278838 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:27.280022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:27.281611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:27.383122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:27.393246 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-018a04f1-5d31-4361-a5ef-bfc5b26c9010 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1215 microversion: 2.1 time: 0.170912 Oct 02 01:36:27.397188 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3013/5851] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:27 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:28.425754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:28.426547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:28.457315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:28.457892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:28.458335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:28.459122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:28.461445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:28.461959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:29.273733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:29.290210 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ff7c6c7-bd6e-49d6-afa0-10ab9d797acc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1277 microversion: 2.1 time: 0.870352 Oct 02 01:36:29.307173 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2839/5852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:28 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1277 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:30.318770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:30.321346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:30.354051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:30.354887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:30.355573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:30.358881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:30.360397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:30.360819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:30.755771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:30.768598 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-21fa7a42-35fc-4857-af0a-2f7339063007 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.458441 Oct 02 01:36:30.769849 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3014/5853] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:30 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:31.241355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e637bb54-ca15-4164-a98f-7c2903a570ce req-cb3a968b-e27b-45ad-8d8c-bdfa988a95af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db47254e-04b6-4c57-a34c-cb4ccd2b4243", "tag": "c5094d18-b467-4f23-81aa-93a3e0a28ae5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:36:31.258969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e637bb54-ca15-4164-a98f-7c2903a570ce req-cb3a968b-e27b-45ad-8d8c-bdfa988a95af service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:31.269183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e637bb54-ca15-4164-a98f-7c2903a570ce req-cb3a968b-e27b-45ad-8d8c-bdfa988a95af service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:31.269796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e637bb54-ca15-4164-a98f-7c2903a570ce req-cb3a968b-e27b-45ad-8d8c-bdfa988a95af service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:31.300650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e637bb54-ca15-4164-a98f-7c2903a570ce req-cb3a968b-e27b-45ad-8d8c-bdfa988a95af service nova] Creating event network-changed:c5094d18-b467-4f23-81aa-93a3e0a28ae5 for instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 on n-h2-master-1 Oct 02 01:36:31.312610 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e637bb54-ca15-4164-a98f-7c2903a570ce req-cb3a968b-e27b-45ad-8d8c-bdfa988a95af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074735 Oct 02 01:36:31.317133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2840/5854] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:36:31.793513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:31.794147 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:31.805414 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:31.806785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:31.807495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:31.815605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:31.816344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:31.816979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:32.411243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:32.423165 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b198a7c1-56df-4013-afd0-b914e25edb29 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.633067 Oct 02 01:36:32.425299 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3015/5855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:31 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:33.450124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:33.451052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:33.464097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:33.465007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:33.469253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:33.470269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:33.470999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:33.471665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:34.262625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:34.273764 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11e94cf3-45b3-4b91-ae45-001a9272edf1 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.830164 Oct 02 01:36:34.279752 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2841/5856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:33 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:35.302580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:35.303233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:35.305116 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:35.307073 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:35.322709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:35.323680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:35.324610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:35.325601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:35.326268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:35.326951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:36.154738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:36.165534 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b4771f8-4f81-4c04-96fe-ce77b49d5de0 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.867153 Oct 02 01:36:36.168634 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3016/5857] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:35 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:37.192530 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:37.197191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:37.198162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:37.209539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:37.212911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:37.213699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:37.216551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:37.217393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:37.219137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:37.631195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:37.643729 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-62e4e97e-bc66-4890-84da-3f28e47698a9 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.453074 Oct 02 01:36:37.656435 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2842/5858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:37 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:38.668750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:38.669407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:38.684416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:38.684924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:38.685369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:38.686088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:38.687113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:38.687544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:38.815278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a9ab64e0-df40-4434-8bfc-9b34bd8119be req-d52f9630-ba08-4938-a96c-ea0e03046a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db47254e-04b6-4c57-a34c-cb4ccd2b4243", "name": "network-vif-plugged", "status": "completed", "tag": "c5094d18-b467-4f23-81aa-93a3e0a28ae5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:36:38.833325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a9ab64e0-df40-4434-8bfc-9b34bd8119be req-d52f9630-ba08-4938-a96c-ea0e03046a2b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:38.835468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a9ab64e0-df40-4434-8bfc-9b34bd8119be req-d52f9630-ba08-4938-a96c-ea0e03046a2b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:38.844219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a9ab64e0-df40-4434-8bfc-9b34bd8119be req-d52f9630-ba08-4938-a96c-ea0e03046a2b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:38.877728 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a9ab64e0-df40-4434-8bfc-9b34bd8119be req-d52f9630-ba08-4938-a96c-ea0e03046a2b service nova] Creating event network-vif-plugged:c5094d18-b467-4f23-81aa-93a3e0a28ae5 for instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 on n-h2-master-1 Oct 02 01:36:38.891932 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a9ab64e0-df40-4434-8bfc-9b34bd8119be req-d52f9630-ba08-4938-a96c-ea0e03046a2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080437 Oct 02 01:36:38.897436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2843/5859] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:36:39.117782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:39.129724 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4251ded-c24d-4e9c-9a05-f0a18e2b367b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.463719 Oct 02 01:36:39.132464 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3017/5860] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:38 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:40.163049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:40.163950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:40.184779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:40.190092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:40.190759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:40.192547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:40.193628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:40.195163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:40.405227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:40.414052 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-448c412b-6537-40f6-993e-faacd4dd08bc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1319 microversion: 2.1 time: 0.263944 Oct 02 01:36:40.415324 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2844/5861] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:40 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:36:41.439601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:36:41.440897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:36:41.454325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:41.459994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:41.461275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:41.463991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:36:41.465899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:36:41.468074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:36:41.804375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:36:41.813983 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68e23e23-ec85-42d9-8049-a82e6d524094 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1508 microversion: 2.1 time: 0.379908 Oct 02 01:36:41.815337 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3018/5862] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:36:41 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:14.797642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05fc33cf-d2ee-486c-8575-2b431c3dd428", "device": "/dev/sdb"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:37:14.800781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:14.821566 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=20 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:14.822738 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=28 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:14.824749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:14.825255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:14.825700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:14.831266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:14.832952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:14.833429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:15.267873 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eceb16ed-e433-4773-912e-5ba1af6272c2 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "POST /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476200 Oct 02 01:37:15.268933 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2845/5863] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:37:14 2022] POST /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:37:34.439091 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:34.439982 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=38 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:34.440652 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:37:34.440819 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:37:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:37:34.593056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-79160971", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "8a75af81-762d-4c8b-b434-a037d42b28fe"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:37:34.651927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] validate_networks() for [('8a75af81-762d-4c8b-b434-a037d42b28fe', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:37:35.300883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:37:35.301318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:37:35.301799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:37:35.302214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:37:35.302643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:37:35.317954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:35.320258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:35.321541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:35.324140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:35.324981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:35.326069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:35.361138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Getting quotas for project 8d97558a194b42daa9750cb197f1feaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:37:35.367251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Getting quotas for user 756cfafe3aca4839a8c7e23f87c569b6 and project 8d97558a194b42daa9750cb197f1feaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:37:35.381853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:37:35.384431 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:37:35.461951 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fb54c38d-9599-44f5-984f-7a27d7c03897 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029075 Oct 02 01:37:35.466126 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3019/5864] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:37:35.476785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8591f48b-5983-4332-bc5e-97b186285cb1 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:35.478454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8591f48b-5983-4332-bc5e-97b186285cb1 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:35.511521 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:35.513795 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:35.629102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8591f48b-5983-4332-bc5e-97b186285cb1 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:35.642991 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8591f48b-5983-4332-bc5e-97b186285cb1 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1212 microversion: 2.1 time: 0.168657 Oct 02 01:37:35.643595 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2846/5865] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:35 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1212 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:36.669514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8222c5b9-143e-4d12-a45d-c05ac8a88858 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:36.670149 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8222c5b9-143e-4d12-a45d-c05ac8a88858 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:36.768522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8222c5b9-143e-4d12-a45d-c05ac8a88858 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:36.785006 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8222c5b9-143e-4d12-a45d-c05ac8a88858 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1212 microversion: 2.1 time: 0.120576 Oct 02 01:37:36.795258 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3020/5866] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:36 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:37.811247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:37.812554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:37.845146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:37.846792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:37.848505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:37.849918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:37.850799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:37.852772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:37.988857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:38.000514 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8bbcbcc0-bcfb-42f3-a937-5a0001503b01 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1264 microversion: 2.1 time: 0.195759 Oct 02 01:37:38.001115 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2847/5867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:37 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:39.025114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:39.025898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:39.051029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:39.051894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:39.052834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:39.054013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:39.055445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:39.056314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:39.186729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:39.200160 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8a3c4ad9-2d71-4afc-89cf-73c01f82463c tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1270 microversion: 2.1 time: 0.179471 Oct 02 01:37:39.201151 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3021/5868] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:39 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:40.225391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:40.226625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:40.247080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:40.247869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:40.248494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:40.249374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:40.249987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:40.250570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:40.807743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:40.828482 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0dd27c30-3f50-472b-b61f-b35a0e3753ab tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.607715 Oct 02 01:37:40.831761 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2848/5869] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:40 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:37:41.188233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-14d9adc5-3c65-4fb9-bc6e-086458006206 req-cf2fe788-6f3c-4e20-8e91-ef4069b9969f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b6f42d-47ef-478c-8b31-c6294220d22b", "tag": "6a77b4d2-af26-4a5e-89f8-1fc952492439"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:37:41.223525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-14d9adc5-3c65-4fb9-bc6e-086458006206 req-cf2fe788-6f3c-4e20-8e91-ef4069b9969f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:41.230056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-14d9adc5-3c65-4fb9-bc6e-086458006206 req-cf2fe788-6f3c-4e20-8e91-ef4069b9969f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:41.231570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-14d9adc5-3c65-4fb9-bc6e-086458006206 req-cf2fe788-6f3c-4e20-8e91-ef4069b9969f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:41.265424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-14d9adc5-3c65-4fb9-bc6e-086458006206 req-cf2fe788-6f3c-4e20-8e91-ef4069b9969f service nova] Creating event network-changed:6a77b4d2-af26-4a5e-89f8-1fc952492439 for instance 29b6f42d-47ef-478c-8b31-c6294220d22b on n-h1-master-1 Oct 02 01:37:41.278989 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-14d9adc5-3c65-4fb9-bc6e-086458006206 req-cf2fe788-6f3c-4e20-8e91-ef4069b9969f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094536 Oct 02 01:37:41.283230 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3022/5870] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:37:41.866347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:41.870218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:41.883176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:41.883176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:41.883176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:41.883503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:41.883839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:41.884435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:42.170170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:42.181772 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3fb2e494-a5de-458f-bb56-3586de858677 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.328864 Oct 02 01:37:42.183162 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2849/5871] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:41 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:43.208465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:43.209261 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:43.228347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:43.229060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:43.229597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:43.230387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:43.230958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:43.231431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:43.435842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:43.454524 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d0bc619b-0f81-4ab9-9755-c4ae68af4fd2 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.251086 Oct 02 01:37:43.457849 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3023/5872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:43 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:44.508433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:44.509066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:44.527819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:44.528684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:44.529456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:44.531142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:44.532092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:44.532771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:44.804118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:44.818262 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8e856221-3ea2-48dd-ab53-ea464a4f8fc6 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.332649 Oct 02 01:37:44.820152 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2850/5873] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:44 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:45.844210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:45.845015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:45.858484 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:45.861906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:45.862544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:45.863088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:45.863898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:45.864442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:45.864939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:46.087312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:46.097909 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89fcc8ae-2340-4343-97ca-651d59648a3d tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.259837 Oct 02 01:37:46.098522 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3024/5874] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:45 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:47.121411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:47.122038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:47.133613 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:47.136373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:47.136875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:47.137312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:47.147647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:47.148143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:47.148586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:47.369439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:47.381137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9cec7b85-6d67-4d21-b587-5e28adf05f22 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.263853 Oct 02 01:37:47.398628 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2851/5875] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:47 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:48.416114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:48.416831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:48.420302 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:48.441878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:48.444201 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:48.444910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:48.450283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:48.453374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:48.459474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:48.773718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:48.786618 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81735edf-29b8-4d9f-9ad7-66dde4bdedae tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.373555 Oct 02 01:37:48.799510 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3025/5876] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:48 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:48.898222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e7edba7e-0de0-44ec-bfa0-2579e6067806 req-a254e5d8-f5c4-4955-b5a9-3cc8eb46730e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b6f42d-47ef-478c-8b31-c6294220d22b", "name": "network-vif-plugged", "status": "completed", "tag": "6a77b4d2-af26-4a5e-89f8-1fc952492439"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:37:48.908975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e7edba7e-0de0-44ec-bfa0-2579e6067806 req-a254e5d8-f5c4-4955-b5a9-3cc8eb46730e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:48.909671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e7edba7e-0de0-44ec-bfa0-2579e6067806 req-a254e5d8-f5c4-4955-b5a9-3cc8eb46730e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:48.910259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e7edba7e-0de0-44ec-bfa0-2579e6067806 req-a254e5d8-f5c4-4955-b5a9-3cc8eb46730e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:48.929125 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e7edba7e-0de0-44ec-bfa0-2579e6067806 req-a254e5d8-f5c4-4955-b5a9-3cc8eb46730e service nova] Creating event network-vif-plugged:6a77b4d2-af26-4a5e-89f8-1fc952492439 for instance 29b6f42d-47ef-478c-8b31-c6294220d22b on n-h1-master-1 Oct 02 01:37:48.936152 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e7edba7e-0de0-44ec-bfa0-2579e6067806 req-a254e5d8-f5c4-4955-b5a9-3cc8eb46730e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340623 Oct 02 01:37:48.944386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2852/5877] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:37:49.524655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:49.526504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:49.539671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:49.540172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:49.541111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:49.541997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:49.542977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:49.543973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:49.720281 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lazy-loading 'services' on Instance uuid db47254e-04b6-4c57-a34c-cb4ccd2b4243 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:37:49.832241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:49.834281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:49.847903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:49.848842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:49.849688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:49.851844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:49.853277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:49.853921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:49.893363 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-57ef4174-4a22-4c7a-8245-226db90ccd83 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243/os-volume_attachments/05fc33cf-d2ee-486c-8575-2b431c3dd428" status: 202 len: 0 microversion: 2.1 time: 0.373077 Oct 02 01:37:49.896109 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3026/5878] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:37:49 2022] DELETE /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243/os-volume_attachments/05fc33cf-d2ee-486c-8575-2b431c3dd428 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:37:50.118169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:50.142726 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9d0e43d-ead4-4848-a498-c612e6a75647 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1312 microversion: 2.1 time: 0.328928 Oct 02 01:37:50.143359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2853/5879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:49 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:51.191874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:51.193081 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:51.222956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:51.236047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:51.236981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:51.241876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:51.242567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:51.244954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:51.654207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:51.694993 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3e49501-c830-4704-a2bf-54f8739ceb8f tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1496 microversion: 2.1 time: 0.510554 Oct 02 01:37:51.699706 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3027/5880] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:51 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1496 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:57.281539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:57.282086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:57.290393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:57.291311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:57.292047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:57.300491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:57.301292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:57.302083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:57.355024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:37:57.491140 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6acbab98-c018-4065-be45-388a6ced3801 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 204 len: 0 microversion: 2.1 time: 0.213484 Oct 02 01:37:57.504640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:57.506011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:57.511478 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2854/5881] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:37:57 2022] DELETE /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:37:57.515961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:57.516671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:57.517398 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:57.518132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:57.518784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:57.519582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:57.692574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:57.702184 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-caf39196-a0e9-42b5-88ba-ea150292b5c3 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1502 microversion: 2.1 time: 0.202312 Oct 02 01:37:57.724002 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3028/5882] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:57 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:58.730088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:58.730920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:58.748431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:58.749199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:58.749870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:58.751324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:58.752153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:58.752888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:58.864691 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:58.865938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:58.908562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:58.918498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:58.927428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:58.927903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:58.936901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:58.937698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:59.015197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:59.019760 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:37:59.036171 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5d29b41-81d8-4730-949e-d2927e6dee55 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1502 microversion: 2.1 time: 0.310457 Oct 02 01:37:59.039369 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2855/5883] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:58 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:59.187651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f287509-958f-4e4d-890f-b86344eb810a tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 204 len: 0 microversion: 2.1 time: 0.328569 Oct 02 01:37:59.188548 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3029/5884] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:37:58 2022] DELETE /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:37:59.204968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:37:59.206980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:37:59.214960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:59.215855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:59.216482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:59.218105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:59.218828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:59.219665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:59.407452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:37:59.419144 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aca064f8-c14f-4d6a-a5bf-99e4eb760597 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1514 microversion: 2.1 time: 0.224764 Oct 02 01:37:59.432855 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2856/5885] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:37:59 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:37:59.809804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4e75749f-3852-4559-b5b0-95fb13ab7496 req-1fa87df4-985a-4704-a5ad-4557ca5259c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b6f42d-47ef-478c-8b31-c6294220d22b", "name": "network-vif-deleted", "tag": "6a77b4d2-af26-4a5e-89f8-1fc952492439"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:37:59.843075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4e75749f-3852-4559-b5b0-95fb13ab7496 req-1fa87df4-985a-4704-a5ad-4557ca5259c6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:37:59.843075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4e75749f-3852-4559-b5b0-95fb13ab7496 req-1fa87df4-985a-4704-a5ad-4557ca5259c6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:37:59.847408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4e75749f-3852-4559-b5b0-95fb13ab7496 req-1fa87df4-985a-4704-a5ad-4557ca5259c6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:37:59.868859 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4e75749f-3852-4559-b5b0-95fb13ab7496 req-1fa87df4-985a-4704-a5ad-4557ca5259c6 service nova] Creating event network-vif-deleted:6a77b4d2-af26-4a5e-89f8-1fc952492439 for instance 29b6f42d-47ef-478c-8b31-c6294220d22b on n-h1-master-1 Oct 02 01:37:59.875927 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4e75749f-3852-4559-b5b0-95fb13ab7496 req-1fa87df4-985a-4704-a5ad-4557ca5259c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073393 Oct 02 01:37:59.877394 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3030/5886] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:00.068382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:00.068999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:00.077513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:00.078244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:00.078927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:00.080102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:00.081109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:00.082139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:00.127443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:00.128199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:00.128867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:00.129323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lazy-loading 'fault' on Instance uuid 29b6f42d-47ef-478c-8b31-c6294220d22b {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:38:00.174417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756cfafe3aca4839a8c7e23f87c569b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d97558a194b42daa9750cb197f1feaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:00.182856 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-997c521f-b525-4109-94f2-9f78df2e57c7 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 200 len: 1302 microversion: 2.1 time: 0.118141 Oct 02 01:38:00.183399 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2857/5887] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:00 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:00.447524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:00.448427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:00.471996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:00.473569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:00.474224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:00.475188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:00.475911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:00.476452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:00.678584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:00.699392 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b373acb2-7db7-43e0-9766-0837cf49951b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1514 microversion: 2.1 time: 0.256327 Oct 02 01:38:00.699392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3031/5888] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:00 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:01.209326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:01.210350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] [instance: 29b6f42d-47ef-478c-8b31-c6294220d22b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:01.223291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:01.227254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:01.227783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:01.228528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:01.228995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:01.229708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:01.265667 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] HTTP exception thrown: Instance 29b6f42d-47ef-478c-8b31-c6294220d22b could not be found. Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Request method failure captured: Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b HTTP/1.1 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOtbcBVSsp2liW8cITB-BlHE24-Y5tw1Lm8R-A2hdIyVcmKkjXwnIt1-m1Q0tccFi44gliZ771Y3dTIh6gDgpDXPSCEkwY2tGYJhryndFVpWqajDhtfzb7OJWEj9KK-78mBskJFL6M7sFFVaXgQoxzIEXuiS1d3bkPZ5MNM45bBqKBU Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8d97558a194b42daa9750cb197f1feaa Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesActionsTest-364246739 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d97558a194b42daa9750cb197f1feaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d97558a194b42daa9750cb197f1feaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d97558a194b42daa9750cb197f1feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d97558a194b42daa9750cb197f1feaa"}]}] Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesActionsTest-364246739 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8d97558a194b42daa9750cb197f1feaa Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesActionsTest-364246739 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesActionsTest-364246739-project Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 756cfafe3aca4839a8c7e23f87c569b6 Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesActionsTest-364246739-project Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 29b6f42d-47ef-478c-8b31-c6294220d22b could not be found. Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '29b6f42d-47ef-478c-8b31-c6294220d22b'} Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b6f42d-47ef-478c-8b31-c6294220d22b could not be found. Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b6f42d-47ef-478c-8b31-c6294220d22b could not be found. Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:38:01.267585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b6f42d-47ef-478c-8b31-c6294220d22b could not be found. Oct 02 01:38:01.271779 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:38:01.273934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] Returning 404 to user: Instance 29b6f42d-47ef-478c-8b31-c6294220d22b could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:38:01.275864 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c818ba5-7e16-424c-bd65-b473137fd6e8 tempest-VolumesActionsTest-364246739 tempest-VolumesActionsTest-364246739-project] 10.222.0.23 "GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b" status: 404 len: 111 microversion: 2.1 time: 0.070958 Oct 02 01:38:01.276726 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2858/5889] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:01 2022] GET /compute/v2.1/servers/29b6f42d-47ef-478c-8b31-c6294220d22b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:38:01.729535 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:01.730078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:01.748590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:01.749096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:01.749553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:01.750271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:01.750764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:01.751198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:01.899629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c814fc58-4798-4ae5-a285-569febd573df req-e77da6a3-934d-4a1a-8d43-c7dbcc3c9393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db47254e-04b6-4c57-a34c-cb4ccd2b4243", "name": "network-vif-deleted", "tag": "c5094d18-b467-4f23-81aa-93a3e0a28ae5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:01.919892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c814fc58-4798-4ae5-a285-569febd573df req-e77da6a3-934d-4a1a-8d43-c7dbcc3c9393 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:01.920507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c814fc58-4798-4ae5-a285-569febd573df req-e77da6a3-934d-4a1a-8d43-c7dbcc3c9393 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:01.921187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c814fc58-4798-4ae5-a285-569febd573df req-e77da6a3-934d-4a1a-8d43-c7dbcc3c9393 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:01.946205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:01.959652 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95c21483-f74d-4f96-ac96-5eb779bccd59 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 200 len: 1304 microversion: 2.1 time: 0.229697 Oct 02 01:38:01.963666 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3032/5890] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:01 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:02.000603 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c814fc58-4798-4ae5-a285-569febd573df req-e77da6a3-934d-4a1a-8d43-c7dbcc3c9393 service nova] Creating event network-vif-deleted:c5094d18-b467-4f23-81aa-93a3e0a28ae5 for instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 on n-h2-master-1 Oct 02 01:38:02.044504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c814fc58-4798-4ae5-a285-569febd573df req-e77da6a3-934d-4a1a-8d43-c7dbcc3c9393 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149185 Oct 02 01:38:02.050131 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2859/5891] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:38:02.989276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:02.990564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: db47254e-04b6-4c57-a34c-cb4ccd2b4243] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:03.011517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:03.012673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:03.013450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:03.014591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:03.015305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:03.015977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:03.053654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] HTTP exception thrown: Instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 could not be found. Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Request method failure captured: Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 HTTP/1.1 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOqsyirPlYZMAS9bIeKXaM_uwwd5jP6s7ihFE9JFXilF2Qx7DvdLmXXucI3d_kOlmA0fARR0eI2g8akxOhHvu6Z5dM-DHN__tZAmTJpkjmc9Uhbu-ttRNZp4MRm5x5fqbhVbhWJpud0etAUjmFZRq6OWfnzXIpS8_aFF-Vtrq0rUH-w Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e3d1b3bb7d3e4d6e9ac2e77cd77a4642 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesSnapshotTestJSON-97049679 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}] Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesSnapshotTestJSON-97049679 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e3d1b3bb7d3e4d6e9ac2e77cd77a4642 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-97049679 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesSnapshotTestJSON-97049679-project Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6a1352ee9dbe4587800e17d8b3287252 Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesSnapshotTestJSON-97049679-project Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: exception: Instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 could not be found. Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'db47254e-04b6-4c57-a34c-cb4ccd2b4243'} Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 could not be found. Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 could not be found. Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:38:03.055917 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 could not be found. Oct 02 01:38:03.061001 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:38:03.065176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Returning 404 to user: Instance db47254e-04b6-4c57-a34c-cb4ccd2b4243 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:38:03.066442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1db47061-f66e-45a3-b62e-c7b4ecc32826 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243" status: 404 len: 111 microversion: 2.1 time: 0.081196 Oct 02 01:38:03.067271 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3033/5892] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:02 2022] GET /compute/v2.1/servers/db47254e-04b6-4c57-a34c-cb4ccd2b4243 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:38:14.088317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-889254344", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "e3134f15-6339-4e20-b4ab-7e65491b30d9"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:14.124759 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:14.125676 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:14.200257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] validate_networks() for [('e3134f15-6339-4e20-b4ab-7e65491b30d9', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:38:14.815827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:38:14.816343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:38:14.817071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:38:14.817701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:38:14.818618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:38:14.839428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:14.840719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:14.842569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:14.843331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:14.846083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:14.847710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:14.909180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Getting quotas for project e3d1b3bb7d3e4d6e9ac2e77cd77a4642. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:38:14.939706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Getting quotas for user 6a1352ee9dbe4587800e17d8b3287252 and project e3d1b3bb7d3e4d6e9ac2e77cd77a4642. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:38:14.998817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:38:15.001816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:38:15.113923 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [63d7ff48-bdc8-4d35-bd10-24583cd97a28] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:38:16.136950 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [63d7ff48-bdc8-4d35-bd10-24583cd97a28] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 46108. Oct 02 01:38:16.141082 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2cbf0b00-5fd4-4f6e-bf71-8f3e45ed77ab tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057961 Oct 02 01:38:16.142042 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2860/5893] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:38:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:38:16.153791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bb03a6a3-3bea-4a74-a351-41c6f9b1ffd8 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:16.154801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bb03a6a3-3bea-4a74-a351-41c6f9b1ffd8 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:16.169920 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:16.180093 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:16.313412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bb03a6a3-3bea-4a74-a351-41c6f9b1ffd8 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:16.338231 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bb03a6a3-3bea-4a74-a351-41c6f9b1ffd8 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1218 microversion: 2.1 time: 0.188494 Oct 02 01:38:16.340923 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3034/5894] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:16 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:17.362589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:17.365360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:17.375196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:17.375712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:17.376167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:17.376996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:17.377814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:17.378278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:17.511266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:17.528727 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b488916-5822-4360-8956-56192683ec7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1214 microversion: 2.1 time: 0.170622 Oct 02 01:38:17.540466 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2861/5895] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:17 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:18.561756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:18.562468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:18.583648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:18.584214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:18.584697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:18.585452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:18.590126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:18.590661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:18.812580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:18.833466 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7e6ecbe8-73d0-4894-ad30-55683c76012c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1276 microversion: 2.1 time: 0.281613 Oct 02 01:38:18.834079 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3035/5896] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:18 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:19.861115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:19.861770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:19.880126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:19.883617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:19.884236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:19.884810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:19.885278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:19.885710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:20.091397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:20.102555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f30689ad-0c2c-4843-a738-b738d34cea7d tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.245736 Oct 02 01:38:20.103911 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2862/5897] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:19 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:20.601091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8386c5e2-b3ff-4186-939b-ccd42849ce62 req-416427fc-5fb6-4ba2-96fd-b1dac060de18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13aa18f3-aad8-4741-8408-aec503106490", "tag": "92f206f6-ab48-473f-9cab-529cc9d4076a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:20.629018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8386c5e2-b3ff-4186-939b-ccd42849ce62 req-416427fc-5fb6-4ba2-96fd-b1dac060de18 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:20.629510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8386c5e2-b3ff-4186-939b-ccd42849ce62 req-416427fc-5fb6-4ba2-96fd-b1dac060de18 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:20.629949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8386c5e2-b3ff-4186-939b-ccd42849ce62 req-416427fc-5fb6-4ba2-96fd-b1dac060de18 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:20.674358 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8386c5e2-b3ff-4186-939b-ccd42849ce62 req-416427fc-5fb6-4ba2-96fd-b1dac060de18 service nova] Creating event network-changed:92f206f6-ab48-473f-9cab-529cc9d4076a for instance 13aa18f3-aad8-4741-8408-aec503106490 on n-h2-master-1 Oct 02 01:38:20.695707 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8386c5e2-b3ff-4186-939b-ccd42849ce62 req-416427fc-5fb6-4ba2-96fd-b1dac060de18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099913 Oct 02 01:38:20.704003 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3036/5898] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:21.137475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:21.138281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:21.165247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:21.165860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:21.166352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:21.167300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:21.167773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:21.168202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:21.354964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:21.367473 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24d27c76-f9c3-4efd-b896-b49b2228e45f tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.244599 Oct 02 01:38:21.370649 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2863/5899] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:21 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:22.392503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:22.393930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:22.405306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:22.406189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:22.409407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:22.410880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:22.412405 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:22.413322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:22.798593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:22.807274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-49e6e550-7f06-422f-828d-9a29a0d41abb tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.419107 Oct 02 01:38:22.818681 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3037/5900] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:22 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:23.843343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:23.843966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:23.863078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:23.864304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:23.864857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:23.865621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:23.866103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:23.866653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:24.076096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:24.085075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42e342ef-16b0-43ed-8c5f-7e0b9013ffb6 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.245674 Oct 02 01:38:24.086486 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2864/5901] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:23 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:25.113847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:25.114463 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:25.146782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:25.147404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:25.147895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:25.148635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:25.149099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:25.149535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:25.430647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:25.453296 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a315e22b-cd90-47ff-9bc9-f312ec68ee75 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.344169 Oct 02 01:38:25.455065 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3038/5902] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:25 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:26.488911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:26.490122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:26.493069 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:26.494015 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:26.502204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:26.502763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:26.503217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:26.503940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:26.504405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:26.504838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:26.650042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:26.658940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-560c628b-8d69-4816-99ad-462544eb2b5b tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.174115 Oct 02 01:38:26.659927 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2865/5903] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:26 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:26.914004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2c256575-f014-4613-9765-c8383c409913 req-367013fa-396f-4a00-a277-5241e1f6df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13aa18f3-aad8-4741-8408-aec503106490", "name": "network-vif-plugged", "status": "completed", "tag": "92f206f6-ab48-473f-9cab-529cc9d4076a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:26.927269 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:26.930142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2c256575-f014-4613-9765-c8383c409913 req-367013fa-396f-4a00-a277-5241e1f6df33 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:26.930662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2c256575-f014-4613-9765-c8383c409913 req-367013fa-396f-4a00-a277-5241e1f6df33 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:26.931104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2c256575-f014-4613-9765-c8383c409913 req-367013fa-396f-4a00-a277-5241e1f6df33 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:26.997157 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2c256575-f014-4613-9765-c8383c409913 req-367013fa-396f-4a00-a277-5241e1f6df33 service nova] Creating event network-vif-plugged:92f206f6-ab48-473f-9cab-529cc9d4076a for instance 13aa18f3-aad8-4741-8408-aec503106490 on n-h2-master-1 Oct 02 01:38:27.015057 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2c256575-f014-4613-9765-c8383c409913 req-367013fa-396f-4a00-a277-5241e1f6df33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108890 Oct 02 01:38:27.021560 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3039/5904] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:27.687058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:27.687955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:27.697785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:27.709109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:27.709717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:27.710856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:27.711621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:27.712210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:27.975459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:27.985268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-983a5569-6a08-4ff7-9222-3ac03c8a4c1c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1318 microversion: 2.1 time: 0.302311 Oct 02 01:38:27.987113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2866/5905] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:27 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:29.014436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:29.015251 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:29.035096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:29.035673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:29.043300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:29.044314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:29.045041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:29.045641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:29.264323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:29.275218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-956f26c6-75ff-4172-9822-14391c3ecf1e tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1506 microversion: 2.1 time: 0.267172 Oct 02 01:38:29.276050 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3040/5906] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:29 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:29.299708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d06c8d20-8d82-4616-9610-606eedfcf818", "device": "/dev/sdb"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:29.302344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:29.331307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:29.336304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:29.337015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:29.337950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:29.339123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:29.343083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:29.736804 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dc5ea7f0-219a-434e-b0c5-faa8046e439c tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "POST /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440790 Oct 02 01:38:29.737454 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2867/5907] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 01:38:29 2022] POST /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:39.714167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1801839174", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "00a6ad3b-57bc-4e74-b144-76a3289fdb1a"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:39.724888 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:39.726545 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=28 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:39.781096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] validate_networks() for [('00a6ad3b-57bc-4e74-b144-76a3289fdb1a', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:38:40.259920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:38:40.260657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:38:40.261312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:38:40.261893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:38:40.262485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:38:40.274586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:40.275637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:40.276311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:40.277560 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:40.278240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:40.278914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:40.316826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Getting quotas for project f1c510da44b8420aaefefc62b67f2bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:38:40.326348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Getting quotas for user dcf580f97641423a83eef98acc713946 and project f1c510da44b8420aaefefc62b67f2bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:38:40.342206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:38:40.345048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:38:40.411444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d30c7538-020f-4127-9857-085b75fa6209 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701876 Oct 02 01:38:40.412818 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3041/5908] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:38:40.426572 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:40.427426 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:40.438521 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d373656-276d-4bc9-8716-be89614db35d tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:40.449195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d373656-276d-4bc9-8716-be89614db35d tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:40.695219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d373656-276d-4bc9-8716-be89614db35d tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:40.703026 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d373656-276d-4bc9-8716-be89614db35d tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1214 microversion: 2.1 time: 0.278354 Oct 02 01:38:40.703500 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2868/5909] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:40 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:41.738086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:41.738764 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:41.763614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:41.764124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:41.764558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:41.765272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:41.765724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:41.766833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:41.874914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:41.890183 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5fa24c0-c863-48e6-b24e-06bb00b09e9f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1266 microversion: 2.1 time: 0.156886 Oct 02 01:38:41.900261 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3042/5910] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:41 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:42.919154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:42.920384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:42.943281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:42.946805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:42.948236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:42.954962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:42.957900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:42.958381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:43.130677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:43.145643 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fca40381-77ce-46f2-a298-eac501459d38 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1272 microversion: 2.1 time: 0.233327 Oct 02 01:38:43.151623 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2869/5911] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:42 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:38:44.179151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:44.180086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:44.188755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:44.189514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:44.190047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:44.191025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:44.191951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:44.192595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:44.401379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:44.412231 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6fba95bf-4a5f-4344-b733-e460f1a93bba tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.238508 Oct 02 01:38:44.414291 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3043/5912] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:44 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:44.953772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1d70cae7-49eb-41cb-b872-fcb8944e9297 req-d3b99a44-2006-466d-84c6-021e1f0ad62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e914807a-657b-4989-be78-fae24f438484", "tag": "d92ca346-82d4-4548-b85a-e4709706a6d2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:44.983316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1d70cae7-49eb-41cb-b872-fcb8944e9297 req-d3b99a44-2006-466d-84c6-021e1f0ad62b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:44.988101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1d70cae7-49eb-41cb-b872-fcb8944e9297 req-d3b99a44-2006-466d-84c6-021e1f0ad62b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:44.994329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1d70cae7-49eb-41cb-b872-fcb8944e9297 req-d3b99a44-2006-466d-84c6-021e1f0ad62b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:45.031587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1d70cae7-49eb-41cb-b872-fcb8944e9297 req-d3b99a44-2006-466d-84c6-021e1f0ad62b service nova] Creating event network-changed:d92ca346-82d4-4548-b85a-e4709706a6d2 for instance e914807a-657b-4989-be78-fae24f438484 on n-h1-master-1 Oct 02 01:38:45.045453 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1d70cae7-49eb-41cb-b872-fcb8944e9297 req-d3b99a44-2006-466d-84c6-021e1f0ad62b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095889 Oct 02 01:38:45.050610 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2870/5913] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:45.437737 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:45.438471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:45.449178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:45.456271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:45.456852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:45.457754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:45.458331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:45.459392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:45.706954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:45.719257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f13989c6-c57a-4e8d-94fc-8717769534fa tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.285636 Oct 02 01:38:45.720510 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3044/5914] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:45 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:46.778697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:46.791643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:46.815731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:46.817974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:46.819415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:46.821291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:46.823908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:46.828174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:47.133976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:47.153899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6e6f3e3-9fa7-49fb-8659-338e670675df tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.412965 Oct 02 01:38:47.155142 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2871/5915] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:46 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:48.184053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:48.185670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:48.194883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:48.195671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:48.199133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:48.200160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:48.200846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:48.201895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:48.405668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:48.414940 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e307480-f9a9-46e3-b397-b4a7657f92f5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.236789 Oct 02 01:38:48.414940 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3045/5916] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:48 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:49.438820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:49.439537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:49.470918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:49.485282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:49.488173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:49.491724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:49.493575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:49.494368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:49.784030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:49.796038 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-461185c0-1037-4b77-9dd0-014ea4695543 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.362568 Oct 02 01:38:49.797121 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2872/5917] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:49 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:50.823087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:50.824753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:50.828276 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:50.829279 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:50.837089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:50.837944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:50.838820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:50.839748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:50.840408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:50.840942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:50.999750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:51.009750 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-16f120ac-8b7e-4f4a-af02-2ff838b75cc2 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.193185 Oct 02 01:38:51.010462 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3046/5918] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:50 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:52.030616 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:52.035606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:52.038868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:52.054530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:52.055181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:52.056146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:52.056880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:52.057399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:52.057836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:52.337045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:52.346584 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29d5d2f2-9bfa-485f-a9f4-19b157c0bfa5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.317813 Oct 02 01:38:52.348262 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2873/5919] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:52 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:52.746142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1e05dbec-757f-4f7c-ab2d-205108d9acac req-66a9c603-5759-4d52-bb1f-ec623edfa735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e914807a-657b-4989-be78-fae24f438484", "name": "network-vif-plugged", "status": "completed", "tag": "d92ca346-82d4-4548-b85a-e4709706a6d2"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:52.764907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1e05dbec-757f-4f7c-ab2d-205108d9acac req-66a9c603-5759-4d52-bb1f-ec623edfa735 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:52.765583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1e05dbec-757f-4f7c-ab2d-205108d9acac req-66a9c603-5759-4d52-bb1f-ec623edfa735 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:52.766065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1e05dbec-757f-4f7c-ab2d-205108d9acac req-66a9c603-5759-4d52-bb1f-ec623edfa735 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:52.783729 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1e05dbec-757f-4f7c-ab2d-205108d9acac req-66a9c603-5759-4d52-bb1f-ec623edfa735 service nova] Creating event network-vif-plugged:d92ca346-82d4-4548-b85a-e4709706a6d2 for instance e914807a-657b-4989-be78-fae24f438484 on n-h1-master-1 Oct 02 01:38:52.789623 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1e05dbec-757f-4f7c-ab2d-205108d9acac req-66a9c603-5759-4d52-bb1f-ec623edfa735 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046958 Oct 02 01:38:52.790681 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3047/5920] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:53.373334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:53.373965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:53.402483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:53.403258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:53.403866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:53.404858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:53.405329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:53.405771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:53.580745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:53.590346 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27925584-6818-4179-b4f6-50486227d09a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1314 microversion: 2.1 time: 0.220744 Oct 02 01:38:53.590973 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2874/5921] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:53 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:54.629481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:54.631726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:54.647141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:54.647758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:54.651325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:54.653546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:54.654357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:54.655057 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:54.825809 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:54.854369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6fd8bd00-5813-4940-9586-25e661ccee97 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1497 microversion: 2.1 time: 0.211134 Oct 02 01:38:54.855159 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3048/5922] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:54 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:55.745754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:55.746282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:55.754561 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:38:55.754742 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:38:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 (ip 10.222.0.23) !!! Oct 02 01:38:55.769300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:55.769754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:55.770207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:55.771664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:55.772156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:55.772595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:55.832439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:38:56.037560 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-404836dc-c0d3-4723-8775-26a55e9a27ef tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 204 len: 0 microversion: 2.1 time: 0.294286 Oct 02 01:38:56.041692 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2875/5923] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:38:55 2022] DELETE /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:38:56.047426 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:56.048217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:56.057551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:56.062051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:56.062798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:56.065006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:56.065737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:56.066403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:56.351893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:56.377768 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-30874d19-23ec-4d2a-9f88-1354e93d86de tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1503 microversion: 2.1 time: 0.333020 Oct 02 01:38:56.378714 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3049/5924] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:56 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:57.404231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:57.404950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:57.419627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:57.422822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:57.423453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:57.427981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:57.429281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:57.430775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:57.734078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:57.743651 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b895607f-4fe5-4ad5-ae7e-adad2a239829 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1503 microversion: 2.1 time: 0.344377 Oct 02 01:38:57.764023 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2876/5925] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:57 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:58.512549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-be190f26-0dd0-4a55-ab21-99a64722ef6a req-cfdcc52c-06ff-45e1-97d2-56fd3a1da0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e914807a-657b-4989-be78-fae24f438484", "name": "network-vif-deleted", "tag": "d92ca346-82d4-4548-b85a-e4709706a6d2"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:38:58.538588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-be190f26-0dd0-4a55-ab21-99a64722ef6a req-cfdcc52c-06ff-45e1-97d2-56fd3a1da0e6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:58.539451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-be190f26-0dd0-4a55-ab21-99a64722ef6a req-cfdcc52c-06ff-45e1-97d2-56fd3a1da0e6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:58.541469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-be190f26-0dd0-4a55-ab21-99a64722ef6a req-cfdcc52c-06ff-45e1-97d2-56fd3a1da0e6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:58.570159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:58.571208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:58.589899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:58.590697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:58.591529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:58.592584 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-be190f26-0dd0-4a55-ab21-99a64722ef6a req-cfdcc52c-06ff-45e1-97d2-56fd3a1da0e6 service nova] Creating event network-vif-deleted:d92ca346-82d4-4548-b85a-e4709706a6d2 for instance e914807a-657b-4989-be78-fae24f438484 on n-h1-master-1 Oct 02 01:38:58.593832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:58.595125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:58.597682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:58.609234 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-be190f26-0dd0-4a55-ab21-99a64722ef6a req-cfdcc52c-06ff-45e1-97d2-56fd3a1da0e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098360 Oct 02 01:38:58.611785 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3050/5926] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:38:58.770523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:58.775830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:58.779462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lazy-loading 'services' on Instance uuid 13aa18f3-aad8-4741-8408-aec503106490 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:38:58.806440 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:58.806993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:58.810453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:58.813487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:58.816558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:58.819253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:58.869297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:58.870034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:58.870654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:58.871516 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lazy-loading 'fault' on Instance uuid e914807a-657b-4989-be78-fae24f438484 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:38:58.924514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:38:58.937266 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db24d831-9633-4ff4-abea-de7b51d74433 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 200 len: 1304 microversion: 2.1 time: 0.172750 Oct 02 01:38:58.951476 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3051/5927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:58 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:38:59.043934 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f3f516d4-1067-4105-a4c7-66d9879943d7 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490/os-volume_attachments/d06c8d20-8d82-4616-9610-606eedfcf818" status: 202 len: 0 microversion: 2.1 time: 0.463059 Oct 02 01:38:59.051339 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2877/5928] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 01:38:58 2022] DELETE /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490/os-volume_attachments/d06c8d20-8d82-4616-9610-606eedfcf818 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:38:59.962895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:38:59.963935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: e914807a-657b-4989-be78-fae24f438484] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:38:59.983830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:59.985940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:59.987734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:38:59.988809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:38:59.992086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:38:59.992776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:00.027022 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] HTTP exception thrown: Instance e914807a-657b-4989-be78-fae24f438484 could not be found. Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Request method failure captured: Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 HTTP/1.1 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOuda2QelLmvVuzAAtWGWv7SEWwSKbJ1xFij-peFwGEhAAiYHYqK10OYUjwNvc1CI0apI0BNpnmllwUXu0lMYRszZUkkDNHUCegyIIXjJkqu-r9ShFVlj7NEvi7xymESj5p2Sj6ArNudy6-wdpT_neLizeKH632DOpb6P4g0EP_Mrr0 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: f1c510da44b8420aaefefc62b67f2bec Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesActionsTest-880391718 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f1c510da44b8420aaefefc62b67f2bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f1c510da44b8420aaefefc62b67f2bec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f1c510da44b8420aaefefc62b67f2bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f1c510da44b8420aaefefc62b67f2bec"}]}] Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesActionsTest-880391718 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: f1c510da44b8420aaefefc62b67f2bec Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesActionsTest-880391718 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesActionsTest-880391718-project Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: dcf580f97641423a83eef98acc713946 Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesActionsTest-880391718-project Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: exception: Instance e914807a-657b-4989-be78-fae24f438484 could not be found. Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'e914807a-657b-4989-be78-fae24f438484'} Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e914807a-657b-4989-be78-fae24f438484 could not be found. Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e914807a-657b-4989-be78-fae24f438484 could not be found. Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:00.035647 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e914807a-657b-4989-be78-fae24f438484 could not be found. Oct 02 01:39:00.040281 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:00.042831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Returning 404 to user: Instance e914807a-657b-4989-be78-fae24f438484 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:39:00.045922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9ac0866c-a055-4b52-8e45-c53caa38a653 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484" status: 404 len: 111 microversion: 2.1 time: 0.087039 Oct 02 01:39:00.046769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3052/5929] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:38:59 2022] GET /compute/v2.1/servers/e914807a-657b-4989-be78-fae24f438484 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:00.237906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-657398524", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "00a6ad3b-57bc-4e74-b144-76a3289fdb1a"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:00.356814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] validate_networks() for [('00a6ad3b-57bc-4e74-b144-76a3289fdb1a', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:39:00.830227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:39:00.830822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:39:00.831378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:39:00.832093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:39:00.832639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:39:00.843091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:00.843583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:00.844179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:00.844927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:00.845385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:00.845813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:00.865980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Getting quotas for project f1c510da44b8420aaefefc62b67f2bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:39:00.873171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Getting quotas for user dcf580f97641423a83eef98acc713946 and project f1c510da44b8420aaefefc62b67f2bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:39:00.887527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:39:00.890272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:39:00.982712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d385ef9-2d8c-4499-8ac0-0a98e70e77f7 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758069 Oct 02 01:39:00.983394 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2878/5930] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:39:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:39:00.994837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9fe62ea2-ae3f-4fa3-928a-c8e2bda155d9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:00.995680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9fe62ea2-ae3f-4fa3-928a-c8e2bda155d9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:01.093225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9fe62ea2-ae3f-4fa3-928a-c8e2bda155d9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:01.104595 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9fe62ea2-ae3f-4fa3-928a-c8e2bda155d9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1213 microversion: 2.1 time: 0.113699 Oct 02 01:39:01.106612 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3053/5931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:00 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:02.131698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:02.132339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:02.148646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:02.149197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:02.150050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:02.150622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:02.151089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:02.151513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:02.253494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:02.265980 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4383aca1-75bc-47ac-83f6-232353ce554f tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1265 microversion: 2.1 time: 0.139515 Oct 02 01:39:02.266837 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2879/5932] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:02 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:03.289915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:03.291456 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:03.309661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:03.310335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:03.310826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:03.311549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:03.314905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:03.315534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:03.449604 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:03.460793 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-073bebfa-f647-424d-b33b-3c9e4e6baf72 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1271 microversion: 2.1 time: 0.175245 Oct 02 01:39:03.465285 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3054/5933] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:03 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:04.491328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:04.492528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:04.506747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:04.507395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:04.507941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:04.508937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:04.509393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:04.509929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:04.812933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:04.821719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f816da4a-16f7-4af7-8d16-cbc0f748bc76 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.334988 Oct 02 01:39:04.834958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2880/5934] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:04 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:04.916303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9ba91768-68dc-44fc-8ce2-5be93409af61 req-9715856f-69d2-4854-8920-1357db35b5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404a9731-01a6-44de-8b98-6185a180b612", "tag": "70826058-f8c0-4b19-b5f7-32f65a2c69ee"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:04.928373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9ba91768-68dc-44fc-8ce2-5be93409af61 req-9715856f-69d2-4854-8920-1357db35b5c4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:04.929239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9ba91768-68dc-44fc-8ce2-5be93409af61 req-9715856f-69d2-4854-8920-1357db35b5c4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:04.929904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9ba91768-68dc-44fc-8ce2-5be93409af61 req-9715856f-69d2-4854-8920-1357db35b5c4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:04.945915 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9ba91768-68dc-44fc-8ce2-5be93409af61 req-9715856f-69d2-4854-8920-1357db35b5c4 service nova] Creating event network-changed:70826058-f8c0-4b19-b5f7-32f65a2c69ee for instance 404a9731-01a6-44de-8b98-6185a180b612 on n-h1-master-1 Oct 02 01:39:04.955221 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9ba91768-68dc-44fc-8ce2-5be93409af61 req-9715856f-69d2-4854-8920-1357db35b5c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044253 Oct 02 01:39:04.956059 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3055/5935] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:39:05.845798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:05.846336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:05.854508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:05.854978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:05.855422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:05.856149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:05.856608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:05.857038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:06.015577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:06.024840 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f70127e-460f-4506-b2ac-c127ad594230 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.183269 Oct 02 01:39:06.025448 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2881/5936] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:05 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:06.268954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:06.272451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:06.280132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:06.280834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:06.281442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:06.282309 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:06.282993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:06.283573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:06.314692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:39:06.452545 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4d706370-ba0b-4633-917b-037532f88d25 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 204 len: 0 microversion: 2.1 time: 0.187249 Oct 02 01:39:06.454637 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3056/5937] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:39:06 2022] DELETE /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:39:06.465935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:06.469397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:06.479772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:06.480395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:06.480716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:06.481492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:06.482068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:06.482504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:06.665511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:06.675488 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45dd0696-7617-41bf-93c2-22a96d0e4a96 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1512 microversion: 2.1 time: 0.215077 Oct 02 01:39:06.676994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2882/5938] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:06 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:07.050303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:07.051047 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:07.059640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:07.060698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:07.061087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:07.062325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:07.062988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:07.063679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:07.217120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:07.228123 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-532c9d3d-6c9f-4a9a-8bc2-2b920f690914 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.182263 Oct 02 01:39:07.235214 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3057/5939] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:07 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:07.718368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:07.727309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:07.767063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:07.806464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:07.807766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:07.812172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:07.812907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:07.813503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:08.096120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:08.107368 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1ce8134-4852-466b-9da6-124e4aefbadc tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1512 microversion: 2.1 time: 0.406296 Oct 02 01:39:08.108582 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2883/5940] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:07 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:08.252429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:08.253848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:08.263011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:08.263520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:08.264136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:08.265312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:08.265924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:08.266540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:08.461817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:08.474042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f92ad949-c1b1-497b-adb8-6098f3466832 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.225297 Oct 02 01:39:08.492142 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3058/5941] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:08 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:09.052990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0b3d2113-e2b2-4120-9609-5e0a0428f26e req-427f666b-8a9f-4162-bbe8-8ccc33eec86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13aa18f3-aad8-4741-8408-aec503106490", "name": "network-vif-deleted", "tag": "92f206f6-ab48-473f-9cab-529cc9d4076a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:09.086732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0b3d2113-e2b2-4120-9609-5e0a0428f26e req-427f666b-8a9f-4162-bbe8-8ccc33eec86e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:09.087285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0b3d2113-e2b2-4120-9609-5e0a0428f26e req-427f666b-8a9f-4162-bbe8-8ccc33eec86e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:09.087989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0b3d2113-e2b2-4120-9609-5e0a0428f26e req-427f666b-8a9f-4162-bbe8-8ccc33eec86e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:09.102660 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0b3d2113-e2b2-4120-9609-5e0a0428f26e req-427f666b-8a9f-4162-bbe8-8ccc33eec86e service nova] Creating event network-vif-deleted:92f206f6-ab48-473f-9cab-529cc9d4076a for instance 13aa18f3-aad8-4741-8408-aec503106490 on n-h2-master-1 Oct 02 01:39:09.117810 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0b3d2113-e2b2-4120-9609-5e0a0428f26e req-427f666b-8a9f-4162-bbe8-8ccc33eec86e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066086 Oct 02 01:39:09.134394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:09.136587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:09.137221 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2884/5942] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:39:09.147614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:09.149618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:09.154847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:09.158498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:09.158498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:09.158498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:09.261538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1352ee9dbe4587800e17d8b3287252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:09.267966 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:09.287267 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c09721f2-f1c0-443d-a2b5-5e0ef4408320 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 200 len: 1303 microversion: 2.1 time: 0.148063 Oct 02 01:39:09.287267 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3059/5943] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:09 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:39:09.509688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:09.510700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:09.535210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:09.536077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:09.540661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:09.544465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:09.545795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:09.546469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:09.563081 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:09.850279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:09.863521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf6a2542-0373-4eb6-a87c-ad2e2dee9e9a tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.358223 Oct 02 01:39:09.865696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2885/5944] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:09 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:10.301687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:10.303045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] [instance: 13aa18f3-aad8-4741-8408-aec503106490] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:10.314928 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:10.318512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:10.319500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:10.321479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:10.322574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:10.324796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:10.325517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:10.365503 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] HTTP exception thrown: Instance 13aa18f3-aad8-4741-8408-aec503106490 could not be found. Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Request method failure captured: Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 HTTP/1.1 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOqsyirPlYZMAS9bIeKXaM_uwwd5jP6s7ihFE9JFXilF2Qx7DvdLmXXucI3d_kOlmA0fARR0eI2g8akxOhHvu6Z5dM-DHN__tZAmTJpkjmc9Uhbu-ttRNZp4MRm5x5fqbhVbhWJpud0etAUjmFZRq6OWfnzXIpS8_aFF-Vtrq0rUH-w Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e3d1b3bb7d3e4d6e9ac2e77cd77a4642 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-VolumesSnapshotTestJSON-97049679 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3d1b3bb7d3e4d6e9ac2e77cd77a4642"}]}] Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-VolumesSnapshotTestJSON-97049679 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e3d1b3bb7d3e4d6e9ac2e77cd77a4642 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-97049679 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-VolumesSnapshotTestJSON-97049679-project Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 6a1352ee9dbe4587800e17d8b3287252 Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-VolumesSnapshotTestJSON-97049679-project Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 13aa18f3-aad8-4741-8408-aec503106490 could not be found. Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '13aa18f3-aad8-4741-8408-aec503106490'} Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13aa18f3-aad8-4741-8408-aec503106490 could not be found. Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13aa18f3-aad8-4741-8408-aec503106490 could not be found. Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:10.367533 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13aa18f3-aad8-4741-8408-aec503106490 could not be found. Oct 02 01:39:10.372638 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:39:10.374244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] Returning 404 to user: Instance 13aa18f3-aad8-4741-8408-aec503106490 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:39:10.375686 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ea882e8e-7f6a-4b45-9db8-830ed0ddfab4 tempest-VolumesSnapshotTestJSON-97049679 tempest-VolumesSnapshotTestJSON-97049679-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490" status: 404 len: 111 microversion: 2.1 time: 0.078176 Oct 02 01:39:10.376783 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3060/5945] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:10 2022] GET /compute/v2.1/servers/13aa18f3-aad8-4741-8408-aec503106490 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:10.908384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:10.909002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:10.912657 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:10.913536 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:10.920400 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:10.958058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:10.961241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:10.966789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:10.967797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:10.969892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:10.973652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:11.450876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:11.465173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e40a2ba1-fb75-47b4-9bf4-0ea324c7d2c9 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.558298 Oct 02 01:39:11.466124 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2886/5946] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:10 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:12.494366 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:12.503097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:12.503633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:12.529808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:12.530551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:12.531203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:12.532150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:12.532558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:12.533158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:12.888907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:12.898834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f52293bf-8b21-40d1-9978-1f1f1019c7ee tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.405648 Oct 02 01:39:12.899802 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3061/5947] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:12 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:13.008943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f1f87fb1-4f6a-486a-a272-98daa799790b req-a22cf244-10c0-40f5-91b0-57b54b5aab15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a9731-01a6-44de-8b98-6185a180b612", "name": "network-vif-plugged", "status": "completed", "tag": "70826058-f8c0-4b19-b5f7-32f65a2c69ee"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:13.032019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f1f87fb1-4f6a-486a-a272-98daa799790b req-a22cf244-10c0-40f5-91b0-57b54b5aab15 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:13.032699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f1f87fb1-4f6a-486a-a272-98daa799790b req-a22cf244-10c0-40f5-91b0-57b54b5aab15 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:13.037175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f1f87fb1-4f6a-486a-a272-98daa799790b req-a22cf244-10c0-40f5-91b0-57b54b5aab15 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:13.098753 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f1f87fb1-4f6a-486a-a272-98daa799790b req-a22cf244-10c0-40f5-91b0-57b54b5aab15 service nova] Creating event network-vif-plugged:70826058-f8c0-4b19-b5f7-32f65a2c69ee for instance 404a9731-01a6-44de-8b98-6185a180b612 on n-h1-master-1 Oct 02 01:39:13.108017 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f1f87fb1-4f6a-486a-a272-98daa799790b req-a22cf244-10c0-40f5-91b0-57b54b5aab15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102734 Oct 02 01:39:13.111578 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2887/5948] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:39:13.935155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:13.935831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:13.947824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:13.948514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:13.949101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:13.949980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:13.950587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:13.951992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:14.124959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:14.134856 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9490f4e6-3d6d-4557-9cbd-e2a6352eb353 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1313 microversion: 2.1 time: 0.210620 Oct 02 01:39:14.137079 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3062/5949] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:13 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:39:15.162262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:15.167584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:15.188372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:15.188904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:15.189356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:15.190436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:15.190866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:15.191305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:15.450629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:15.461627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2a7ed55f-9a69-4ba1-8fe6-d53b6dbab845 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1497 microversion: 2.1 time: 0.304134 Oct 02 01:39:15.475310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2888/5950] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:15 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:16.210376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:16.212244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:16.221417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:16.222148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:16.222587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:16.223757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:16.224219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:16.224646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:16.257165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:39:16.377431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb9e89b5-3e88-46e3-b765-a341ab0e4c87 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "DELETE /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 204 len: 0 microversion: 2.1 time: 0.171647 Oct 02 01:39:16.380173 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3063/5951] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:39:16 2022] DELETE /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:39:16.388735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:16.389362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:16.397633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:16.398133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:16.398584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:16.401032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:16.401506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:16.401941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:16.560123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:16.568887 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-313097d3-195b-4651-aa47-b61b911dc6b5 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1503 microversion: 2.1 time: 0.184310 Oct 02 01:39:16.569478 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2889/5952] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:16 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:17.460575 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2079091995", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:17.524738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] validate_networks() for None {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:39:17.593050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:17.594351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:17.608345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:17.609984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:17.610437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:17.612355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:17.614000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:17.614445 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:17.957491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:17.965808 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-803e6d36-4078-414b-8d35-6043c602a9c0 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1503 microversion: 2.1 time: 0.376715 Oct 02 01:39:17.982768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2890/5953] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:17 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:39:18.026216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:39:18.026850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:39:18.027488 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:39:18.028265 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:39:18.028842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:39:18.039565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:18.040556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:18.041178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:18.042065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:18.042703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:18.043308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:18.082894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Getting quotas for project 99b3208974714002ad7e4237b1f343d6. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:39:18.090145 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Getting quotas for user ca07218a78254a05ba3f52a3a6109a3c and project 99b3208974714002ad7e4237b1f343d6. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:39:18.108938 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:39:18.111679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:39:18.175417 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-de35f565-9572-4d63-afad-b0a6937c3bf7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720847 Oct 02 01:39:18.189180 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3064/5954] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:39:18.189985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1717c2fa-bf84-4b0c-8c80-e74ae3b4b32a tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:18.191012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1717c2fa-bf84-4b0c-8c80-e74ae3b4b32a tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:18.291093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1717c2fa-bf84-4b0c-8c80-e74ae3b4b32a tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:18.298866 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1717c2fa-bf84-4b0c-8c80-e74ae3b4b32a tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1215 microversion: 2.1 time: 0.112658 Oct 02 01:39:18.300183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2891/5955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:18 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:18.990982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:18.991631 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:18.999972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:19.000593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:19.001155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:19.001968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:19.002541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:19.003099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:19.190559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8aa3d839-b95e-4095-b9d8-8b555f7de81a req-ac1a5255-76d9-4eeb-9b5a-8003a764a003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a9731-01a6-44de-8b98-6185a180b612", "name": "network-vif-deleted", "tag": "70826058-f8c0-4b19-b5f7-32f65a2c69ee"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:19.203548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8aa3d839-b95e-4095-b9d8-8b555f7de81a req-ac1a5255-76d9-4eeb-9b5a-8003a764a003 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:19.204045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8aa3d839-b95e-4095-b9d8-8b555f7de81a req-ac1a5255-76d9-4eeb-9b5a-8003a764a003 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:19.204487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8aa3d839-b95e-4095-b9d8-8b555f7de81a req-ac1a5255-76d9-4eeb-9b5a-8003a764a003 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:19.217032 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8aa3d839-b95e-4095-b9d8-8b555f7de81a req-ac1a5255-76d9-4eeb-9b5a-8003a764a003 service nova] Creating event network-vif-deleted:70826058-f8c0-4b19-b5f7-32f65a2c69ee for instance 404a9731-01a6-44de-8b98-6185a180b612 on n-h1-master-1 Oct 02 01:39:19.218824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf580f97641423a83eef98acc713946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c510da44b8420aaefefc62b67f2bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:19.232446 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0842904-2e88-4327-b157-2084226a64a4 tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 200 len: 1503 microversion: 2.1 time: 0.246605 Oct 02 01:39:19.233335 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3065/5956] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:18 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:19.243745 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8aa3d839-b95e-4095-b9d8-8b555f7de81a req-ac1a5255-76d9-4eeb-9b5a-8003a764a003 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055639 Oct 02 01:39:19.245744 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2892/5957] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:39:19.325345 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:19.326085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:19.333047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:19.333623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:19.334304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:19.335343 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:19.335949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:19.336457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:19.403349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:19.415425 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06120063-f181-4f3c-94ed-5be7551dcd28 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1267 microversion: 2.1 time: 0.093996 Oct 02 01:39:19.427779 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3066/5958] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:19 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:20.261144 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:20.263687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] [instance: 404a9731-01a6-44de-8b98-6185a180b612] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:20.295406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:20.302616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:20.303829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:20.305023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:20.306131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:20.308286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:20.354697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] HTTP exception thrown: Instance 404a9731-01a6-44de-8b98-6185a180b612 could not be found. Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Request method failure captured: Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 HTTP/1.1 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOuda2QelLmvVuzAAtWGWv7SEWwSKbJ1xFij-peFwGEhAAiYHYqK10OYUjwNvc1CI0apI0BNpnmllwUXu0lMYRszZUkkDNHUCegyIIXjJkqu-r9ShFVlj7NEvi7xymESj5p2Sj6ArNudy6-wdpT_neLizeKH632DOpb6P4g0EP_Mrr0 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: f1c510da44b8420aaefefc62b67f2bec Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesActionsTest-880391718 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f1c510da44b8420aaefefc62b67f2bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f1c510da44b8420aaefefc62b67f2bec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f1c510da44b8420aaefefc62b67f2bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f1c510da44b8420aaefefc62b67f2bec"}]}] Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesActionsTest-880391718 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: f1c510da44b8420aaefefc62b67f2bec Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesActionsTest-880391718 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesActionsTest-880391718-project Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: dcf580f97641423a83eef98acc713946 Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesActionsTest-880391718-project Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 404a9731-01a6-44de-8b98-6185a180b612 could not be found. Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '404a9731-01a6-44de-8b98-6185a180b612'} Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404a9731-01a6-44de-8b98-6185a180b612 could not be found. Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404a9731-01a6-44de-8b98-6185a180b612 could not be found. Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:20.356611 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404a9731-01a6-44de-8b98-6185a180b612 could not be found. Oct 02 01:39:20.360860 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:20.362432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] Returning 404 to user: Instance 404a9731-01a6-44de-8b98-6185a180b612 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:39:20.364511 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95af90cd-816d-4b20-a6d7-d84a546c3b9c tempest-VolumesActionsTest-880391718 tempest-VolumesActionsTest-880391718-project] 10.222.0.23 "GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612" status: 404 len: 111 microversion: 2.1 time: 0.108809 Oct 02 01:39:20.370779 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2893/5959] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:20 2022] GET /compute/v2.1/servers/404a9731-01a6-44de-8b98-6185a180b612 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:20.448084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:20.452473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:20.469179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:20.469684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:20.470135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:20.470899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:20.471407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:20.471845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:20.630801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:20.639070 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1c932cdb-b108-4a94-8fb9-8c70e46b5e4e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1273 microversion: 2.1 time: 0.198267 Oct 02 01:39:20.642923 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3067/5960] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:20 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:21.664173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:21.665399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:21.677536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:21.678409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:21.678968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:21.679940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:21.685956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:21.686822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:22.164706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:22.173538 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-787ee89e-6ef6-4fd4-8451-4867d3c96df3 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.514007 Oct 02 01:39:22.190623 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2894/5961] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:21 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:22.775871 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a628cd25-4a3d-4906-9657-c572c28f32e0 req-f8857121-ffaf-4a94-b1fb-84589b19a554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb03a71-3724-4381-985e-621a1145095c", "tag": "ca01f784-3d55-496e-8d8b-93aa87708f5b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:22.800289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a628cd25-4a3d-4906-9657-c572c28f32e0 req-f8857121-ffaf-4a94-b1fb-84589b19a554 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:22.815406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a628cd25-4a3d-4906-9657-c572c28f32e0 req-f8857121-ffaf-4a94-b1fb-84589b19a554 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:22.815854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a628cd25-4a3d-4906-9657-c572c28f32e0 req-f8857121-ffaf-4a94-b1fb-84589b19a554 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:22.828008 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a628cd25-4a3d-4906-9657-c572c28f32e0 req-f8857121-ffaf-4a94-b1fb-84589b19a554 service nova] Creating event network-changed:ca01f784-3d55-496e-8d8b-93aa87708f5b for instance 3eb03a71-3724-4381-985e-621a1145095c on n-h2-master-1 Oct 02 01:39:22.854999 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a628cd25-4a3d-4906-9657-c572c28f32e0 req-f8857121-ffaf-4a94-b1fb-84589b19a554 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082082 Oct 02 01:39:22.859379 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3068/5962] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:39:23.227213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:23.227859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:23.256964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:23.257935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:23.262817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:23.264310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:23.265135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:23.265695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:23.596884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:23.611774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12e7b8ee-6803-4edb-8bb0-a590cc9bebad tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.408612 Oct 02 01:39:23.627913 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2895/5963] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:23 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:24.640946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:24.642435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:24.661796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:24.672027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:24.673409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:24.674525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:24.679404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:24.680181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:25.074853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:25.085329 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc37d299-d742-4988-aeed-356a629900f9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.448604 Oct 02 01:39:25.107525 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3069/5964] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:24 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:26.134322 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:26.142684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:26.198898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:26.205215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:26.206109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:26.209595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:26.212086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:26.213903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:26.510880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:26.529958 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63d06c8a-6593-480f-ab4d-a732b9b5cb1c tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.418471 Oct 02 01:39:26.549769 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2896/5965] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:26 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:27.558321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:27.559679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:27.588158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:27.589692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:27.593220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:27.598111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:27.599509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:27.600337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:28.061725 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:28.081120 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:28.100647 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36003aad-d236-4acc-b0c1-3efa38520a8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.543642 Oct 02 01:39:28.101346 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3070/5966] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:27 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:29.123866 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:29.134770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:29.141902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:29.183751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:29.189800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:29.192801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:29.194416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:29.200606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:29.201360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:29.426770 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7de28615-cf96-4b2e-9038-7564553fc24b req-74b1f3b0-61cb-4506-9ed0-dcf84f149a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb03a71-3724-4381-985e-621a1145095c", "name": "network-vif-plugged", "status": "completed", "tag": "ca01f784-3d55-496e-8d8b-93aa87708f5b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:29.459009 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:29.468842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7de28615-cf96-4b2e-9038-7564553fc24b req-74b1f3b0-61cb-4506-9ed0-dcf84f149a4d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:29.472549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7de28615-cf96-4b2e-9038-7564553fc24b req-74b1f3b0-61cb-4506-9ed0-dcf84f149a4d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:29.473241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7de28615-cf96-4b2e-9038-7564553fc24b req-74b1f3b0-61cb-4506-9ed0-dcf84f149a4d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:29.551173 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7de28615-cf96-4b2e-9038-7564553fc24b req-74b1f3b0-61cb-4506-9ed0-dcf84f149a4d service nova] Creating event network-vif-plugged:ca01f784-3d55-496e-8d8b-93aa87708f5b for instance 3eb03a71-3724-4381-985e-621a1145095c on n-h2-master-1 Oct 02 01:39:29.580019 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7de28615-cf96-4b2e-9038-7564553fc24b req-74b1f3b0-61cb-4506-9ed0-dcf84f149a4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157190 Oct 02 01:39:29.585435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3071/5967] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:39:29.689637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:29.700108 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82dfd9c7-d17b-4399-ac52-8f0b028325d9 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.578804 Oct 02 01:39:29.700741 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2897/5968] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:29 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:30.725763 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:30.727200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:30.743288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:30.745948 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:30.746639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:30.747558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:30.748625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:30.749662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:31.054267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:31.065037 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-daf4ab35-0a3b-4d24-ab8e-4635989192f5 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1315 microversion: 2.1 time: 0.343781 Oct 02 01:39:31.066162 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3072/5969] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:30 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:32.088723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:32.089487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:32.101054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:32.104016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:32.105212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:32.106660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:32.108510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:32.109026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:32.412137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:32.420163 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e8b900eb-41d3-45c2-bb98-e7dd4761b8d7 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1464 microversion: 2.1 time: 0.335735 Oct 02 01:39:32.438388 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2898/5970] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:32 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:32.484495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:32.486140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:32.502550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:32.504167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:32.506285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:32.507971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:32.509541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:32.511130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:32.571955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:39:32.760726 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-40874563-0580-45f1-bb25-3fddd90de69e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 204 len: 0 microversion: 2.1 time: 0.280895 Oct 02 01:39:32.761739 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3073/5971] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:39:32 2022] DELETE /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:39:32.771736 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:32.773578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:32.781667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:32.782227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:32.782956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:32.783891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:32.784458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:32.785254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:32.991264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:33.001759 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-092756c8-d4e1-45f7-b062-9bed6ef2aa8e tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1470 microversion: 2.1 time: 0.235499 Oct 02 01:39:33.002646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2899/5972] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:32 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:39:34.027943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:34.029263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:34.042089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:34.044492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:34.045110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:34.048017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:34.048705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:34.049492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:34.257956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:34.266991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-161265d2-5ae4-44c7-ade6-f31ae9a353aa tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1470 microversion: 2.1 time: 0.243541 Oct 02 01:39:34.267806 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3074/5973] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:34 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:34.826858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7dd025f6-e6ab-46bc-ad01-5e93c0e5d896 req-29975eb9-d97b-4ea6-83bf-6a07816aac95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb03a71-3724-4381-985e-621a1145095c", "name": "network-vif-deleted", "tag": "ca01f784-3d55-496e-8d8b-93aa87708f5b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:34.872558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7dd025f6-e6ab-46bc-ad01-5e93c0e5d896 req-29975eb9-d97b-4ea6-83bf-6a07816aac95 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:34.873345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7dd025f6-e6ab-46bc-ad01-5e93c0e5d896 req-29975eb9-d97b-4ea6-83bf-6a07816aac95 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:34.873970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7dd025f6-e6ab-46bc-ad01-5e93c0e5d896 req-29975eb9-d97b-4ea6-83bf-6a07816aac95 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:34.926133 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7dd025f6-e6ab-46bc-ad01-5e93c0e5d896 req-29975eb9-d97b-4ea6-83bf-6a07816aac95 service nova] Creating event network-vif-deleted:ca01f784-3d55-496e-8d8b-93aa87708f5b for instance 3eb03a71-3724-4381-985e-621a1145095c on n-h2-master-1 Oct 02 01:39:34.937151 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7dd025f6-e6ab-46bc-ad01-5e93c0e5d896 req-29975eb9-d97b-4ea6-83bf-6a07816aac95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114584 Oct 02 01:39:34.945584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2900/5974] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:39:35.291544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:35.292889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:35.301780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:35.303142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:35.303589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:35.304318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:35.304791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:35.305225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:35.340291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:35.340767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:35.341207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:35.341663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lazy-loading 'fault' on Instance uuid 3eb03a71-3724-4381-985e-621a1145095c {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:39:35.344774 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:35.395130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca07218a78254a05ba3f52a3a6109a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b3208974714002ad7e4237b1f343d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:39:35.406834 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cca16a12-f3c8-4a79-b163-85f8f321f8b6 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 200 len: 1305 microversion: 2.1 time: 0.119099 Oct 02 01:39:35.407947 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3075/5975] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:35 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:39:36.432585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:36.433542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] [instance: 3eb03a71-3724-4381-985e-621a1145095c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:36.441229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:36.442663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:36.443112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:36.443828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:36.444288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:36.444719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:36.460679 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] HTTP exception thrown: Instance 3eb03a71-3724-4381-985e-621a1145095c could not be found. Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Request method failure captured: Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c HTTP/1.1 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOvCtdvcVttvkwMZtCWL1ZnrKXPzprBRFNNK0vq2hpnnkpSZU96Dc8q-YJAXIiAvf_EVb0LXJon3K_Y5hjMLD8QYakQsOFN7tvYGX93sO6B7o0MTOctx9QStd5r-SC85e_3ZfsiLJ7-kt4vJ85q32cvGl3znPCbD-FndxjZQCvDWQLM Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 99b3208974714002ad7e4237b1f343d6 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-VolumesNegativeTest-1845947777 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b3208974714002ad7e4237b1f343d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b3208974714002ad7e4237b1f343d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b3208974714002ad7e4237b1f343d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b3208974714002ad7e4237b1f343d6"}]}] Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-VolumesNegativeTest-1845947777 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 99b3208974714002ad7e4237b1f343d6 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-VolumesNegativeTest-1845947777 Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-VolumesNegativeTest-1845947777-project Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: ca07218a78254a05ba3f52a3a6109a3c Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-VolumesNegativeTest-1845947777-project Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3eb03a71-3724-4381-985e-621a1145095c could not be found. Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3eb03a71-3724-4381-985e-621a1145095c'} Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb03a71-3724-4381-985e-621a1145095c could not be found. Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb03a71-3724-4381-985e-621a1145095c could not be found. Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:39:36.463111 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb03a71-3724-4381-985e-621a1145095c could not be found. Oct 02 01:39:36.467417 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:39:36.470097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] Returning 404 to user: Instance 3eb03a71-3724-4381-985e-621a1145095c could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:39:36.471366 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdbcafeb-bd51-41fa-81d4-8f180dc441f8 tempest-VolumesNegativeTest-1845947777 tempest-VolumesNegativeTest-1845947777-project] 10.222.0.23 "GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c" status: 404 len: 111 microversion: 2.1 time: 0.043223 Oct 02 01:39:36.473585 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2901/5976] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:36 2022] GET /compute/v2.1/servers/3eb03a71-3724-4381-985e-621a1145095c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:45.874141 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:45.875379 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:46.278294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31249c28-90d7-4cd3-a5ac-76f35ea16d34 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: .version_select at 0x7fb8807601f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1154936408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuh7wr3KqbMK36cZNY6kLwhvLEcQoX+EJ54emnqZKOUHc52wou1+XowP4MLRRCNhu3Q/fqvvMyzzJzvZi9CrNAVXecFHDdG0BWf8rwVWrbdp2UNLF4lKHOTnql4VRlKXw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:46.298480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-31249c28-90d7-4cd3-a5ac-76f35ea16d34 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:39:46.305184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-31249c28-90d7-4cd3-a5ac-76f35ea16d34 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:39:46.357441 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31249c28-90d7-4cd3-a5ac-76f35ea16d34 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.489042 Oct 02 01:39:46.367056 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3076/5977] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:39:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:39:57.624304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1365816865", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "4dd43e69-2bd1-42e7-a559-b01f65a795b3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1154936408", "security_groups": [{"name": "tempest-secgroup-smoke-1597474719"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:39:57.681796 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=33 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:57.682871 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=74 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:58.495455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] validate_networks() for [('4dd43e69-2bd1-42e7-a559-b01f65a795b3', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:39:59.633812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:39:59.645991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:39:59.648123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:39:59.648754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:39:59.649345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:39:59.674297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:59.675134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:59.677785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:59.678864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:39:59.683152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:39:59.683806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:39:59.741762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:39:59.784798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:39:59.836890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:39:59.839631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:39:59.906412 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5447d055-6b8f-4260-a8e3-46f837e0dadf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.284740 Oct 02 01:39:59.916259 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2902/5978] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:39:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:39:59.922155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a51e328-978d-45f4-b8bd-f62daa60dead tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:39:59.922914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a51e328-978d-45f4-b8bd-f62daa60dead tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:39:59.927620 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:59.935025 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:00.212466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a51e328-978d-45f4-b8bd-f62daa60dead tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:00.227120 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a51e328-978d-45f4-b8bd-f62daa60dead tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1267 microversion: 2.1 time: 0.308937 Oct 02 01:40:00.232998 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3077/5979] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:39:59 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:01.259297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:01.260870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:01.315142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:01.318862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:01.320441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:01.320994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:01.338443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:01.339721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:01.573724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:01.585106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5622a57-a511-408e-945a-61dfffaf8e1f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1271 microversion: 2.1 time: 0.333141 Oct 02 01:40:01.606589 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2903/5980] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:01 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1271 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:02.619907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:02.622218 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:02.640511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:02.641303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:02.642539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:02.651852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:02.652882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:02.653597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:02.797400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:02.826630 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f2930f95-3d7e-4acb-bbd9-06391edf87e5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1337 microversion: 2.1 time: 0.201388 Oct 02 01:40:02.832336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3078/5981] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:02 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1337 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:03.858041 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:03.859345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:03.876586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:03.877486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:03.878387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:03.881629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:03.882278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:03.882929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:03.982996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:03.993919 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b672c41-8706-4a58-9ba6-397cae4468d2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1325 microversion: 2.1 time: 0.140458 Oct 02 01:40:03.996794 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2904/5982] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:03 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1325 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:05.021630 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:05.023512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:05.036835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:05.038340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:05.039122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:05.041770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:05.043346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:05.044020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:05.422118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:05.434468 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ca9e73a-3e49-44df-817e-40e697f743ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1393 microversion: 2.1 time: 0.417579 Oct 02 01:40:05.435541 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3079/5983] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:05 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1393 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:05.827280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3818b196-89bd-4a0c-b06e-3714764a75fa req-1cf90fc6-a1e1-415e-9483-456ea875fdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:05.851926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3818b196-89bd-4a0c-b06e-3714764a75fa req-1cf90fc6-a1e1-415e-9483-456ea875fdb1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:05.852809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3818b196-89bd-4a0c-b06e-3714764a75fa req-1cf90fc6-a1e1-415e-9483-456ea875fdb1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:05.854015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3818b196-89bd-4a0c-b06e-3714764a75fa req-1cf90fc6-a1e1-415e-9483-456ea875fdb1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:05.894926 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3818b196-89bd-4a0c-b06e-3714764a75fa req-1cf90fc6-a1e1-415e-9483-456ea875fdb1 service nova] Creating event network-changed:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h2-master-1 Oct 02 01:40:05.894926 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3818b196-89bd-4a0c-b06e-3714764a75fa req-1cf90fc6-a1e1-415e-9483-456ea875fdb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067322 Oct 02 01:40:05.894926 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2905/5984] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:06.458175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:06.459061 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:06.467403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:06.468116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:06.468758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:06.469715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:06.471361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:06.471960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:06.736266 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:06.747605 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a997ddb6-419b-4908-be27-8799eda5f8ae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1393 microversion: 2.1 time: 0.293824 Oct 02 01:40:06.748128 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3080/5985] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:06 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1393 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:07.780494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:07.782472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:07.811294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:07.814361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:07.815905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:07.817226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:07.818536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:07.819607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:08.218078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:08.229999 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01c9bb66-917f-4ee1-bdef-e3cc99b5ac5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1393 microversion: 2.1 time: 0.455206 Oct 02 01:40:08.244653 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2906/5986] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:07 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1393 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:09.255969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:09.257365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:09.269889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:09.274216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:09.276484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:09.283038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:09.283956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:09.284608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:09.511354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:09.521045 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e7a703a-b035-4a6b-b203-bffbc9a0b963 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1393 microversion: 2.1 time: 0.269306 Oct 02 01:40:09.521645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3081/5987] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:09 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:10.543754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:10.546463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:10.550165 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:10.550900 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:10.555249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:10.555751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:10.556198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:10.557575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:10.558216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:10.558689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:10.734075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:10.751532 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e55965b1-f3e5-4cc2-915b-37431c2f43ba tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1393 microversion: 2.1 time: 0.210987 Oct 02 01:40:10.752158 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2907/5988] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:10 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:11.519807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d7b93f9d-28a4-437c-bfcb-5fdf33160218 req-dffe6cb9-eeec-4bd8-bc42-9a372c954a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "name": "network-vif-plugged", "status": "completed", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:11.532764 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:11.536257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d7b93f9d-28a4-437c-bfcb-5fdf33160218 req-dffe6cb9-eeec-4bd8-bc42-9a372c954a4e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:11.536743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d7b93f9d-28a4-437c-bfcb-5fdf33160218 req-dffe6cb9-eeec-4bd8-bc42-9a372c954a4e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:11.537421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d7b93f9d-28a4-437c-bfcb-5fdf33160218 req-dffe6cb9-eeec-4bd8-bc42-9a372c954a4e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:11.555399 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d7b93f9d-28a4-437c-bfcb-5fdf33160218 req-dffe6cb9-eeec-4bd8-bc42-9a372c954a4e service nova] Creating event network-vif-plugged:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h2-master-1 Oct 02 01:40:11.567750 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d7b93f9d-28a4-437c-bfcb-5fdf33160218 req-dffe6cb9-eeec-4bd8-bc42-9a372c954a4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053944 Oct 02 01:40:11.568618 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3082/5989] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:40:11.777535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:11.778152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:11.792641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:11.793047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:11.793472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:11.794194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:11.798806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:11.799605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:12.108157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:12.117371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bde31163-ad68-4707-91c0-88b489ce15a5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1393 microversion: 2.1 time: 0.343739 Oct 02 01:40:12.122421 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2908/5990] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:11 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1393 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:13.146741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:13.147455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:13.153995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:13.154511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:13.155086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:13.155791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:13.156254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:13.156684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:13.326021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:13.338451 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0c77e235-8052-4ce4-ae53-f2f029982ac2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1564 microversion: 2.1 time: 0.197495 Oct 02 01:40:13.351164 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3083/5991] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:13 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:13.364319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:13.364951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:13.374499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:13.375027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:13.375470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:13.376882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:13.377348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:13.377778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:13.593943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:13.607973 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-706ca78b-a889-4c19-98e6-b9cc5295eb16 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1564 microversion: 2.1 time: 0.244762 Oct 02 01:40:13.622893 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2909/5992] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:13 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1564 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:16.368285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:16.369016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:16.392918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:16.393513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:16.394018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:16.394899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:16.395456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:16.395897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:16.571541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f0f60bce-ec67-4158-af58-6228428f17ad req-acb7355b-bfc4-412b-9524-2364a31a7e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:16.593988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f0f60bce-ec67-4158-af58-6228428f17ad req-acb7355b-bfc4-412b-9524-2364a31a7e12 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:16.596277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f0f60bce-ec67-4158-af58-6228428f17ad req-acb7355b-bfc4-412b-9524-2364a31a7e12 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:16.597818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f0f60bce-ec67-4158-af58-6228428f17ad req-acb7355b-bfc4-412b-9524-2364a31a7e12 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:16.619650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f0f60bce-ec67-4158-af58-6228428f17ad req-acb7355b-bfc4-412b-9524-2364a31a7e12 service nova] Creating event network-changed:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h2-master-1 Oct 02 01:40:16.632016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f0f60bce-ec67-4158-af58-6228428f17ad req-acb7355b-bfc4-412b-9524-2364a31a7e12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261386 Oct 02 01:40:16.632787 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2910/5993] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:40:16.674930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:16.683378 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8fa02022-7a36-4f43-a69e-de37c703663c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1564 microversion: 2.1 time: 0.319367 Oct 02 01:40:16.683973 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3084/5994] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:16 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1564 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:34.207074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-670b4459-e58b-4a58-889b-d63e68d3b1e8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'create', calling method: .version_select at 0x7fb8856083a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2101670972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVoqSsudKOK8Qo9hPXAxuMhqjQDoKT2WRt5Tg7u+ZeteGwZbNAUF0R6otFruQkB3oOLloWk/3oolV8StbbWbwqXqCHshUBI+d1RTuw74s4/xZQ47/eJeBtYPLCse6DNPg=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:34.219175 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:34.221791 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=42 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:34.256830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-670b4459-e58b-4a58-889b-d63e68d3b1e8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:40:34.269633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-670b4459-e58b-4a58-889b-d63e68d3b1e8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for user 97cb465affcf4b328550d1f7b4dfeddf and project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:40:34.327308 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-670b4459-e58b-4a58-889b-d63e68d3b1e8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.126092 Oct 02 01:40:34.335297 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2911/5995] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:40:34 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:36.276837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1598993248", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "2453b370-5684-4c78-8f93-694a1dc8ad6c"}], "key_name": "tempest-TestNetworkBasicOps-2101670972", "security_groups": [{"name": "tempest-secgroup-smoke-1828276191"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:36.300565 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=18 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:36.302428 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=38 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:36.832042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:36.851978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:36.899573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:36.906512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:36.908326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:36.910173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:36.913405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:36.914232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:37.017814 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e583559e-f04f-4bae-89da-05fad9af0bb9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action" status: 200 len: 24575 microversion: 2.1 time: 0.193160 Oct 02 01:40:37.018524 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2912/5996] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:40:36 2022] POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action => generated 24575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:40:37.107720 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] validate_networks() for [('2453b370-5684-4c78-8f93-694a1dc8ad6c', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:40:37.668786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:40:37.670005 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:40:37.670829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:40:37.671845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:40:37.672756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:40:37.683182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:37.684006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:37.684602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:37.685514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:37.686290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:37.687463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:37.726491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:40:37.741308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for user 97cb465affcf4b328550d1f7b4dfeddf and project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:40:37.761531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:40:37.765798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:40:37.847742 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-062e8a15-1775-4b23-8533-c76ce205269f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.569473 Oct 02 01:40:37.848896 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3085/5997] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:40:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:40:37.870265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93bce51c-9d9c-491a-9f04-09c347073e9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:37.871797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93bce51c-9d9c-491a-9f04-09c347073e9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:38.026449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93bce51c-9d9c-491a-9f04-09c347073e9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:38.036698 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93bce51c-9d9c-491a-9f04-09c347073e9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1249 microversion: 2.1 time: 0.179376 Oct 02 01:40:38.046095 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2913/5998] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:37 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1249 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:39.072049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:39.072674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:39.081897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:39.083775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:39.084855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:39.086349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:39.086952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:39.087611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:39.244884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:39.260042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2a658941-25d0-4ca8-a4a3-9fac08356aae tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1301 microversion: 2.1 time: 0.192158 Oct 02 01:40:39.276139 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3086/5999] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:39 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1301 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:40.287434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:40.288907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:40.300868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:40.301667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:40.315937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:40.317388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:40.318153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:40.318867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:40.464489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:40.475409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29063c46-a9d6-493e-a979-f313cd72a2d0 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1307 microversion: 2.1 time: 0.193574 Oct 02 01:40:40.476982 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2914/6000] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:40 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:41.506590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:41.507759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:41.522279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:41.523004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:41.523915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:41.526016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:41.535827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:41.537101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:42.411655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:42.423038 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e8e6dbca-c279-47fa-8689-001ce2f71cc8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.921201 Oct 02 01:40:42.457366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3087/6001] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:41 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:43.349446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-519c96e5-583d-47f7-899e-8113a76048a6 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1954992233", "availability_zone": "foo_zone"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:43.380776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.aggregate [None req-519c96e5-583d-47f7-899e-8113a76048a6 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Generated uuid 21c4d82b-f150-4be3-b3d0-1162824f6e13 for aggregate {{(pid=122354) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 02 01:40:43.429413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-dd79fcad-5ca3-427e-b923-0264283a59a2 req-961e1da3-8df1-4bff-a8ed-617d4f097103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0940e3a4-9bcd-464b-ad4d-d81998e98724", "tag": "c0cd7af5-808e-439c-a694-8e39f3858072"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:43.465157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dd79fcad-5ca3-427e-b923-0264283a59a2 req-961e1da3-8df1-4bff-a8ed-617d4f097103 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:43.465902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dd79fcad-5ca3-427e-b923-0264283a59a2 req-961e1da3-8df1-4bff-a8ed-617d4f097103 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:43.466517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dd79fcad-5ca3-427e-b923-0264283a59a2 req-961e1da3-8df1-4bff-a8ed-617d4f097103 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:43.468353 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-519c96e5-583d-47f7-899e-8113a76048a6 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.230966 Oct 02 01:40:43.481289 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2915/6002] 10.222.0.23 () {60 vars in 1164 bytes} [Sun Oct 2 01:40:43 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:43.488447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dd79fcad-5ca3-427e-b923-0264283a59a2 req-961e1da3-8df1-4bff-a8ed-617d4f097103 service nova] Creating event network-changed:c0cd7af5-808e-439c-a694-8e39f3858072 for instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 on n-h1-master-1 Oct 02 01:40:43.494532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:43.495264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:43.509591 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-dd79fcad-5ca3-427e-b923-0264283a59a2 req-961e1da3-8df1-4bff-a8ed-617d4f097103 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084036 Oct 02 01:40:43.510247 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3088/6003] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:40:43.514990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:43.515493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:43.517260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:43.518178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:43.518832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:43.519538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:43.519926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e867ffa7-9efa-4b6a-9875-83432a64441f tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:43.559328 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e867ffa7-9efa-4b6a-9875-83432a64441f tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.047733 Oct 02 01:40:43.560449 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3089/6004] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:40:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:43.577786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:43.584179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:43.587059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:43.587765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:43.588972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:43.589725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:43.595673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:43.661509 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-719cc890-4d80-45e8-a800-87bde1d50372 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092190 Oct 02 01:40:43.662190 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3090/6005] 10.222.0.23 () {58 vars in 1176 bytes} [Sun Oct 2 01:40:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:43.690765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1f6b6e00-a09c-4d80-b996-5baa5d5ec6d0 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:43.690765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1f6b6e00-a09c-4d80-b996-5baa5d5ec6d0 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.018103 Oct 02 01:40:43.690765 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3091/6006] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:40:43 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:43.704295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cdafd437-eada-4821-aa57-d64084dc8563 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:43.718969 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdafd437-eada-4821-aa57-d64084dc8563 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:43.719490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdafd437-eada-4821-aa57-d64084dc8563 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:43.719947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdafd437-eada-4821-aa57-d64084dc8563 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:43.808497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:43.818062 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee896507-06ad-45f8-92b7-4a4846fd51ee tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.335360 Oct 02 01:40:43.821271 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2916/6007] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:43 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:44.196474 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cdafd437-eada-4821-aa57-d64084dc8563 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.497829 Oct 02 01:40:44.197131 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3092/6008] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:40:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:40:44.209747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b10822ce-32e4-4d37-bb87-82677569cffe tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:44.219601 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b10822ce-32e4-4d37-bb87-82677569cffe tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.014070 Oct 02 01:40:44.220352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2917/6009] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:40:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:44.234015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2c73d42-292f-4dee-bba6-b3c0cdad39c2 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1126894841", "availability_zone": "foo_zone"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:44.297888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2c73d42-292f-4dee-bba6-b3c0cdad39c2 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.068817 Oct 02 01:40:44.310836 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3093/6010] 10.222.0.23 () {60 vars in 1173 bytes} [Sun Oct 2 01:40:44 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:44.311026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1531eaf9-cfbe-4299-9280-ca6c1bb30aad tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:44.339300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1531eaf9-cfbe-4299-9280-ca6c1bb30aad tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.032537 Oct 02 01:40:44.340019 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2918/6011] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:40:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:44.351596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d8877291-069a-40f5-b0d2-d5f1c746328b tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:44.360661 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d8877291-069a-40f5-b0d2-d5f1c746328b tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.012855 Oct 02 01:40:44.361417 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3094/6012] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:40:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:44.372936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3eb86f2e-ee93-4e45-b022-8efefa2a55d1 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:44.391557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3eb86f2e-ee93-4e45-b022-8efefa2a55d1 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:44.392151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3eb86f2e-ee93-4e45-b022-8efefa2a55d1 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:44.392595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3eb86f2e-ee93-4e45-b022-8efefa2a55d1 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:44.611257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3eb86f2e-ee93-4e45-b022-8efefa2a55d1 tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.242296 Oct 02 01:40:44.611866 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2919/6013] 10.222.0.23 () {60 vars in 1194 bytes} [Sun Oct 2 01:40:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:44.623056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-75cd6ce2-3d26-491c-b8c3-d2dece610efc tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:44.647988 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-75cd6ce2-3d26-491c-b8c3-d2dece610efc tempest-TestAggregatesBasicOps-1940985646 tempest-TestAggregatesBasicOps-1940985646-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.028483 Oct 02 01:40:44.648564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3095/6014] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:40:44 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 02 01:40:44.858334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:44.859499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:44.868061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:44.868978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:44.869809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:44.871011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:44.871582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:44.872119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:45.111246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:45.146855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0ae7025-b45f-4e4a-b998-166d5835104a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.301897 Oct 02 01:40:45.162638 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2920/6015] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:44 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:46.173300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:46.174195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:46.194627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:46.195547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:46.196429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:46.197565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:46.198578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:46.213579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:46.484658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:46.492837 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ec2e77c7-29ac-4a44-a70d-723ee8ac931c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.325353 Oct 02 01:40:46.494970 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3096/6016] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:46 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:47.521054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:47.523798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:47.536536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:47.537335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:47.537772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:47.538485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:47.538975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:47.539401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:47.712387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:47.737788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b117b77b-eb25-4c9b-be8e-89d9d361857b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.220455 Oct 02 01:40:47.744253 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2921/6017] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:47 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:48.065065 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:48.065900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:48.069196 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:48.077036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:48.077630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:48.078644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:48.079081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:48.079543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:48.080515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:48.604150 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1d53b156-7eaa-4571-b0ca-1d157a121bdb tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1833 microversion: 2.1 time: 0.544771 Oct 02 01:40:48.608297 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3097/6018] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:48 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1833 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:48.632553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:48.633619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:48.649861 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:48.652480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:48.656087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:48.657414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:48.658557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:48.659425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:48.660032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:48.768623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:48.769437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:48.775787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:48.776285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:48.783318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:48.784102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:48.784593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:48.785034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:49.583840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:49.587529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:49.594710 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-145342a4-06ee-4cab-a6e0-d8fba3b01aac tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.830229 Oct 02 01:40:49.596150 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3098/6019] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:48 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:49.597868 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-80c8acc8-ceee-4c57-b855-a424a6392866 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1682 microversion: 2.1 time: 0.969363 Oct 02 01:40:49.598584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2922/6020] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:48 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1682 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:49.781220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:49.791788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:49.815472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:49.818418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:49.821582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:49.848432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:49.849673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:49.851792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:50.176237 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-895f701b-28db-42c8-b355-39526ea65cd7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action" status: 200 len: 32648 microversion: 2.1 time: 0.404855 Oct 02 01:40:50.177731 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3099/6021] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:40:49 2022] POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action => generated 32648 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:40:50.323590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:50.324933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:50.336774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:50.338302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:50.338967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:50.340971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:50.343876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:50.344669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:50.482997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '78162c558ced44a9991f777185a2dfcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3001c93c94c45fe9cd98aabdae3af9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:50.485115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] flavor_id is None. Assuming migration. {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 02 01:40:50.485679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:40:50.620446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:50.621365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:50.630977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:50.631807 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:50.632776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:50.633971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:50.634653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:50.635306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:50.663124 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b3e0710-5d6c-4509-a99b-faf957222332 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action" status: 202 len: 0 microversion: 2.1 time: 0.344202 Oct 02 01:40:50.663747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2923/6022] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:40:50 2022] POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:40:50.677528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:50.678465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:50.694701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:50.697447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:50.697934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:50.698712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:50.700475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:50.700918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:51.102229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:51.112093 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3361b808-50c7-49ef-815c-a6a3f17316ec tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.497117 Oct 02 01:40:51.113253 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3100/6023] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:50 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:51.208108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:51.235762 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7fdf225-f7bd-4e19-9c55-fcf4885c2c4d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1691 microversion: 2.1 time: 0.565123 Oct 02 01:40:51.240057 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2924/6024] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:50 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1691 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:51.394928 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fce428d9-afaf-4529-a022-eb6161f9038c req-071c1dbc-6a29-462e-bf2f-7faafbf032c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0940e3a4-9bcd-464b-ad4d-d81998e98724", "name": "network-vif-plugged", "status": "completed", "tag": "c0cd7af5-808e-439c-a694-8e39f3858072"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:51.415693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fce428d9-afaf-4529-a022-eb6161f9038c req-071c1dbc-6a29-462e-bf2f-7faafbf032c8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:51.416174 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fce428d9-afaf-4529-a022-eb6161f9038c req-071c1dbc-6a29-462e-bf2f-7faafbf032c8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:51.421373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fce428d9-afaf-4529-a022-eb6161f9038c req-071c1dbc-6a29-462e-bf2f-7faafbf032c8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:51.445561 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fce428d9-afaf-4529-a022-eb6161f9038c req-071c1dbc-6a29-462e-bf2f-7faafbf032c8 service nova] Creating event network-vif-plugged:c0cd7af5-808e-439c-a694-8e39f3858072 for instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 on n-h1-master-1 Oct 02 01:40:51.451518 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fce428d9-afaf-4529-a022-eb6161f9038c req-071c1dbc-6a29-462e-bf2f-7faafbf032c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060571 Oct 02 01:40:51.452916 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3101/6025] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:52.138048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:52.138703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:52.147890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:52.148622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:52.149295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:52.150364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:52.151073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:52.151831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:52.262695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:52.263520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:52.274315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:52.279187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:52.280169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:52.282732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:52.284361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:52.285919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:52.326437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:52.338925 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6fdd75b3-5f24-4f1a-a5e2-b626aea53d1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1375 microversion: 2.1 time: 0.205725 Oct 02 01:40:52.340778 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2925/6026] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:52 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1375 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:52.487064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:52.496980 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5803476e-dd88-4a9b-a7da-10cb951f069c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1691 microversion: 2.1 time: 0.239332 Oct 02 01:40:52.498150 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3102/6027] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:52 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:53.367582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:53.369512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:53.377112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:53.378193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:53.378658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:53.379841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:53.380188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:53.380561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:53.536831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:53.538011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:53.538639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:53.547205 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:53.547873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:53.548623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:53.549710 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:53.550237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:53.550775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:53.551509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3071da0b-2869-4831-8d3f-4c611ca5cb19 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1548 microversion: 2.1 time: 0.188213 Oct 02 01:40:53.552465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2926/6028] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:53 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:53.576631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:53.578231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:53.586625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:53.587475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:53.588181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:53.589109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:53.589779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:53.590418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:53.627816 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:53.854954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:53.865964 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3816e2ee-d1c0-488b-8b1b-d0b9b4e3c1b2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1691 microversion: 2.1 time: 0.332701 Oct 02 01:40:53.879333 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3103/6029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:53 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1691 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:53.928980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:53.942760 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3bfd6c34-ba7a-4378-92c2-691507df8706 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1548 microversion: 2.1 time: 0.371074 Oct 02 01:40:53.943374 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2927/6030] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:53 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1548 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:54.892568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:54.893198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:54.902382 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:54.903214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:54.903996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:54.905424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:54.906042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:54.906658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:55.685495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:55.696458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb561a40-fa69-4878-9220-85967172a065 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.808825 Oct 02 01:40:55.697239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3104/6031] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:54 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:56.721621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:56.723364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:56.741640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:56.744242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:56.744897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:56.748117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:56.749113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:56.749813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:56.957027 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:56.979240 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99f0e877-8f8c-4759-878d-1bbde7649269 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.261655 Oct 02 01:40:56.979850 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3105/6032] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:56 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:40:57.092883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-28a6ae5c-22ce-46ba-ad22-b82222ca0ccd req-a1e8933b-3d4a-4608-847d-52c2c8f14b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0940e3a4-9bcd-464b-ad4d-d81998e98724", "tag": "c0cd7af5-808e-439c-a694-8e39f3858072"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:57.132324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-28a6ae5c-22ce-46ba-ad22-b82222ca0ccd req-a1e8933b-3d4a-4608-847d-52c2c8f14b3e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:57.133198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-28a6ae5c-22ce-46ba-ad22-b82222ca0ccd req-a1e8933b-3d4a-4608-847d-52c2c8f14b3e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:57.133844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-28a6ae5c-22ce-46ba-ad22-b82222ca0ccd req-a1e8933b-3d4a-4608-847d-52c2c8f14b3e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:57.148909 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-28a6ae5c-22ce-46ba-ad22-b82222ca0ccd req-a1e8933b-3d4a-4608-847d-52c2c8f14b3e service nova] Creating event network-changed:c0cd7af5-808e-439c-a694-8e39f3858072 for instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 on n-h1-master-1 Oct 02 01:40:57.155324 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-28a6ae5c-22ce-46ba-ad22-b82222ca0ccd req-a1e8933b-3d4a-4608-847d-52c2c8f14b3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.469092 Oct 02 01:40:57.157629 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2928/6033] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:40:58.010314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:58.011695 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:58.031385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:58.032194 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:58.032827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:58.034912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:58.035671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:58.036604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:58.301901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:58.311683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad725f64-d1dc-4df7-807f-abf93aa010d6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.306590 Oct 02 01:40:58.313716 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3106/6034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:58 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:59.340200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:40:59.340879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:40:59.350501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:59.351044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:59.351823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:59.352695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:40:59.353158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:40:59.353585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:40:59.516646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:40:59.525332 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5fdcc52c-ef69-432d-834f-95b08a8bcf7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.189701 Oct 02 01:40:59.525934 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3107/6035] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:40:59 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:40:59.528104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d10a4599-35b2-4373-84a6-c8ba8bc073b2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Action: 'create', calling method: .version_select at 0x7fb880917820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-144094215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8Ba0AGkxc8Oxa8XTlw/hLHmabO9sV6HmBj6uI38AFVUQ7v9360iDWueRo10aB1xsywGRu4YIsps/3/9Gko1W1EkFjzLtXmVqRTqDubxknRTkv/FRosb9Q1tXsrSW81OA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:40:59.544167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d10a4599-35b2-4373-84a6-c8ba8bc073b2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Getting quotas for project 24fa631aa4214c399af20711a739f128. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:40:59.550265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-d10a4599-35b2-4373-84a6-c8ba8bc073b2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Getting quotas for user a4554021870a4d6b9f7deca8ebfd3142 and project 24fa631aa4214c399af20711a739f128. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:40:59.575788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d10a4599-35b2-4373-84a6-c8ba8bc073b2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.265418 Oct 02 01:40:59.577148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2929/6036] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:40:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:41:00.549364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:00.549988 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:00.557292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:00.557783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:00.558221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:00.559143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:00.559605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:00.560033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:00.757103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:00.765580 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c4caee64-60a5-4d18-ac55-24f406db288c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.220155 Oct 02 01:41:00.766662 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3108/6037] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:00 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:01.791798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:01.792758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:01.800433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:01.801081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:01.801611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:01.802546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:01.803263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:01.803574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:01.978952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:01.991393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f6207e5-3933-4d71-8257-c67b2a643af5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.204453 Oct 02 01:41:01.993142 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2930/6038] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:01 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:03.021479 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:03.022159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:03.033955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:03.034381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:03.034861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:03.040013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:03.040588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:03.043133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:03.348698 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:03.352668 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:03.360392 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f2823f9-c1b4-4ae1-9085-1c88ea872636 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.343281 Oct 02 01:41:03.370664 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3109/6039] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:03 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:04.384916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:04.386523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:04.400566 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:04.402981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:04.403823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:04.405119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:04.406460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:04.407131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:04.407730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:04.431871 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:04.602001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:04.610470 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-267afb63-6fa6-42f6-aa64-667fba8b1545 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.230266 Oct 02 01:41:04.628608 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2931/6040] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:04 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:05.641856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:05.643738 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:05.652317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:05.654071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:05.657906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:05.658978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:05.660251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:05.660708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:05.879825 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:05.890940 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eae33fb5-dd40-4877-9cf9-4c29660aa39b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1696 microversion: 2.1 time: 0.258185 Oct 02 01:41:05.891561 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3110/6041] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:05 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:06.315784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1397492024-access_point-2052280785", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "eb24726b-7fa1-4b5e-ae87-4325229dc3a1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-144094215", "security_groups": [{"name": "tempest-secgroup_access--1918797126"}, {"name": "tempest-secgroup_general--1919122423"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:06.550146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] validate_networks() for [('eb24726b-7fa1-4b5e-ae87-4325229dc3a1', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:41:06.918437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:06.919721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:06.927536 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:06.929247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:06.930063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:06.930799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:06.931972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:06.932643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:06.933277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:07.231092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:41:07.231799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:41:07.232454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:41:07.233238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:41:07.234133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:41:07.252717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:07.253269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:07.254042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:07.255138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:07.256167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:07.256872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:07.257566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:07.272844 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91aecc31-9794-450c-8b9c-01fa88ba3ebb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1695 microversion: 2.1 time: 0.357629 Oct 02 01:41:07.275611 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3111/6042] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:06 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1695 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:07.296021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "name": "network-vif-unplugged", "status": "completed", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:07.314057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Getting quotas for project 24fa631aa4214c399af20711a739f128. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:41:07.325672 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:07.327808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:07.328264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:07.330073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Getting quotas for user a4554021870a4d6b9f7deca8ebfd3142 and project 24fa631aa4214c399af20711a739f128. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:41:07.347977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:41:07.350205 n-d-master-1 devstack@n-api.service[122354]: WARNING nova.utils [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1397492024-access_point-2052280785 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1397492024-ac Oct 02 01:41:07.351344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:41:07.375653 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] Creating event network-vif-unplugged:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h1-master-1 Oct 02 01:41:07.383545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:41:07.408745 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7ea83999-7540-41a7-957b-5e8fa65ccc32 req-d56a8a84-70f4-479d-9ef0-1575f690035a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130346 Oct 02 01:41:07.411461 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3112/6043] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:41:07.458393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84f2f508-fcd6-4011-90a2-bacaa9c3a621 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.148970 Oct 02 01:41:07.460070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2932/6044] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:41:06 2022] POST /compute/v2.1/servers => generated 458 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:41:07.471741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96303b7a-782c-47a4-a61a-36aa73e5cd63 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:07.472471 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96303b7a-782c-47a4-a61a-36aa73e5cd63 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:07.594842 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96303b7a-782c-47a4-a61a-36aa73e5cd63 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:07.603704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96303b7a-782c-47a4-a61a-36aa73e5cd63 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1294 microversion: 2.1 time: 0.136363 Oct 02 01:41:07.604852 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3113/6045] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:07 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:08.307511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:08.308696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:08.318874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:08.319639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:08.320214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:08.321046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:08.321619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:08.322353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:08.551574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:08.561027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47e22b6b-4ffe-4b63-8ae6-c889bf21c49c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1695 microversion: 2.1 time: 0.259925 Oct 02 01:41:08.561753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2933/6046] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:08 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:08.629752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:08.631295 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:08.640323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:08.641068 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:08.641706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:08.642636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:08.643093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:08.643531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:08.734916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:08.744284 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-33149e4b-28f8-4b5b-96d6-cd1e9d9ed3eb tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1346 microversion: 2.1 time: 0.118277 Oct 02 01:41:08.745713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3114/6047] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:08 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:09.441616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:09.456631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:09.457187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:09.457631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:09.477284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] Creating event network-changed:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h1-master-1 Oct 02 01:41:09.490721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:41:09.503493 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-aaae96d5-853d-49aa-bbfc-c3e4e29ba04e req-bebe64f5-153c-4db7-a474-8fbba75c5019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066361 Oct 02 01:41:09.504755 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2934/6048] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:41:09.587611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:09.593610 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:09.602927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:09.603432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:09.603885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:09.604610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:09.605083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:09.605519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:09.770082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:09.770565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:09.776781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:09.777486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:09.778095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:09.779517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:09.780138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:09.780808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:09.950522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:09.960013 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-95f76e55-3b9d-4afa-bec2-5b931452f801 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1693 microversion: 2.1 time: 0.378453 Oct 02 01:41:09.975231 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3115/6049] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:09 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1693 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:10.141250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:10.157237 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a4a1e1a-acd2-4503-b54e-17bc1cb4e62b tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.390661 Oct 02 01:41:10.159090 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2935/6050] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:09 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:41:10.986791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:10.987555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:10.996687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:10.997544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:10.998795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:10.999767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:11.000622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:11.001548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:11.175543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:11.181047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:11.182469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:11.189760 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc751066-d681-442b-b636-663b4462f280 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1693 microversion: 2.1 time: 0.208517 Oct 02 01:41:11.190080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:11.190370 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3116/6051] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:10 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:11.190580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:11.191233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:11.192114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:11.192741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:11.193169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:11.352346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:11.361354 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0358f452-ca41-459c-9b9d-39148256f301 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.183990 Oct 02 01:41:11.361819 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2936/6052] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:11 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:41:11.539404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8029b293-1eb6-43a2-a09d-a481ec84b81e req-80b05429-81e1-4320-9f95-c44460a47873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6800957c-372b-491b-a82e-bbea6856e628", "tag": "f7b922ba-17b0-44e9-89d0-929217e24250"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:11.552006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8029b293-1eb6-43a2-a09d-a481ec84b81e req-80b05429-81e1-4320-9f95-c44460a47873 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:11.552753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8029b293-1eb6-43a2-a09d-a481ec84b81e req-80b05429-81e1-4320-9f95-c44460a47873 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:11.553513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8029b293-1eb6-43a2-a09d-a481ec84b81e req-80b05429-81e1-4320-9f95-c44460a47873 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:11.568379 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8029b293-1eb6-43a2-a09d-a481ec84b81e req-80b05429-81e1-4320-9f95-c44460a47873 service nova] Creating event network-changed:f7b922ba-17b0-44e9-89d0-929217e24250 for instance 6800957c-372b-491b-a82e-bbea6856e628 on n-h2-master-1 Oct 02 01:41:11.575374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8029b293-1eb6-43a2-a09d-a481ec84b81e req-80b05429-81e1-4320-9f95-c44460a47873 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039790 Oct 02 01:41:11.577069 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3117/6053] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:41:12.215567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:12.217162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:12.229440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.229932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.230442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.231297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.231791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.232810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.384802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:12.385523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:12.389294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:12.397224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.398151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.399167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.400028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.400641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.401128 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44e615d8-c7d7-4843-8998-a5435e663651 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1690 microversion: 2.1 time: 0.188816 Oct 02 01:41:12.401547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.402395 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2937/6054] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:12 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:12.425246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:12.426004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:12.448175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.448844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.450130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.452401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.453148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.455841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.580027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1a985a04-cd9e-43fa-ab4f-c17f33541647 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action" status: 204 len: 0 microversion: 2.1 time: 0.158243 Oct 02 01:41:12.586068 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2938/6055] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:41:12 2022] POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:41:12.593550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:12.595924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:12.605719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.606398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.607324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.608473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:12.609045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:12.609614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:12.635796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:12.647013 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8f0fd975-b8b2-4ffc-9c5a-c7639e4ee143 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.265703 Oct 02 01:41:12.648640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3118/6056] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:12 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:41:13.239573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:13.248193 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8dc07d08-e1ad-4d49-871a-25179af27363 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1690 microversion: 2.1 time: 0.659924 Oct 02 01:41:13.249636 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2939/6057] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:12 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1690 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:13.673551 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:13.675354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:13.683794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:13.684501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:13.685987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:13.686932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:13.687591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:13.688828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:13.957441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:13.971765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f3b873a7-291e-48af-aabb-370ac25d9ec2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.303118 Oct 02 01:41:13.984916 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3119/6058] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:13 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:14.272535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:14.273259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:14.280845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:14.281248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:14.281697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:14.282386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:14.282889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:14.283335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:14.421172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:14.429549 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47804418-7ecf-4d0a-ae03-6bc741ca339f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1690 microversion: 2.1 time: 0.160939 Oct 02 01:41:14.430136 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2940/6059] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:14 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:14.999365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:14.999987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:15.007589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:15.008083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:15.008520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:15.009220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:15.009675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:15.010108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:15.164098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:15.173746 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5984fe59-605a-42b3-9244-6a867156526a tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.178269 Oct 02 01:41:15.182410 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3120/6060] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:14 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:15.301965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6f5810df-d8fb-4e02-8b6f-991939bc3e75 req-f55b8ef7-0d87-4bdd-83c4-5ce787b984bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "name": "network-vif-plugged", "status": "completed", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:15.312698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6f5810df-d8fb-4e02-8b6f-991939bc3e75 req-f55b8ef7-0d87-4bdd-83c4-5ce787b984bb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:15.313182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6f5810df-d8fb-4e02-8b6f-991939bc3e75 req-f55b8ef7-0d87-4bdd-83c4-5ce787b984bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:15.313610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6f5810df-d8fb-4e02-8b6f-991939bc3e75 req-f55b8ef7-0d87-4bdd-83c4-5ce787b984bb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:15.325292 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6f5810df-d8fb-4e02-8b6f-991939bc3e75 req-f55b8ef7-0d87-4bdd-83c4-5ce787b984bb service nova] Creating event network-vif-plugged:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h1-master-1 Oct 02 01:41:15.330720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6f5810df-d8fb-4e02-8b6f-991939bc3e75 req-f55b8ef7-0d87-4bdd-83c4-5ce787b984bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032517 Oct 02 01:41:15.331328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2941/6061] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:41:15.454722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:15.455352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:15.461611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:15.462221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:15.462706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:15.463417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:15.463912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:15.464345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:15.617385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:15.626471 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-711f261e-5af9-434e-afc5-e78f736ec7d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1682 microversion: 2.1 time: 0.176255 Oct 02 01:41:15.627103 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3121/6062] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:15 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:16.205103 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:16.205821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:16.212869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:16.213370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:16.213811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:16.214802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:16.215365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:16.215794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:16.375122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:16.386404 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b73abf61-bdc9-4d1a-8960-737e642b6211 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.192615 Oct 02 01:41:16.387385 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2942/6063] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:16 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:17.349541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4135db69-3576-4028-97a8-3cbb8d80ff7d req-8298b2a9-4a6b-4361-8af5-37e855286243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6800957c-372b-491b-a82e-bbea6856e628", "name": "network-vif-plugged", "status": "completed", "tag": "f7b922ba-17b0-44e9-89d0-929217e24250"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:17.360627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4135db69-3576-4028-97a8-3cbb8d80ff7d req-8298b2a9-4a6b-4361-8af5-37e855286243 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:17.361099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4135db69-3576-4028-97a8-3cbb8d80ff7d req-8298b2a9-4a6b-4361-8af5-37e855286243 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:17.361527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4135db69-3576-4028-97a8-3cbb8d80ff7d req-8298b2a9-4a6b-4361-8af5-37e855286243 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:17.373365 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4135db69-3576-4028-97a8-3cbb8d80ff7d req-8298b2a9-4a6b-4361-8af5-37e855286243 service nova] Creating event network-vif-plugged:f7b922ba-17b0-44e9-89d0-929217e24250 for instance 6800957c-372b-491b-a82e-bbea6856e628 on n-h2-master-1 Oct 02 01:41:17.378254 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4135db69-3576-4028-97a8-3cbb8d80ff7d req-8298b2a9-4a6b-4361-8af5-37e855286243 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032456 Oct 02 01:41:17.379052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3122/6064] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:41:17.409273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:17.409917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:17.411958 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:17.413795 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:17.426938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:17.427442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:17.428071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:17.429677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:17.430864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:17.431556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:17.657563 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:17.665522 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-236f4ccc-5ea7-4ed4-b1ac-26493e4a7006 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1472 microversion: 2.1 time: 0.260077 Oct 02 01:41:17.666110 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2943/6065] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:17 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:18.692283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:18.697713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:18.714471 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:18.727933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:18.728429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:18.729126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:18.730591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:18.731152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:18.731590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:18.902949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:18.911993 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e2235bc-3384-421f-9fa5-4bfbe0645def tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1645 microversion: 2.1 time: 0.225494 Oct 02 01:41:18.912674 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3123/6066] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:18 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1645 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:18.934677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:18.936221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:18.943109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:18.943725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:18.944247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:18.945012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:18.945581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:18.946078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:19.119964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:41:19.130825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-514b7ffd-0cc4-44dc-b6ae-8b57c854a396 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1645 microversion: 2.1 time: 0.200256 Oct 02 01:41:19.131426 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2944/6067] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:18 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1645 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:19.152324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:41:19.152943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:19.159248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:19.159733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:19.160172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:19.160870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:19.161326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:19.161748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:19.411933 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ca3d4e9-cf06-4d2e-ab82-8bc5361f5b94 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1796 microversion: 2.1 time: 0.263209 Oct 02 01:41:19.412532 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3124/6068] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:41:19 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1796 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:41:21.372020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d40d29b5-1a79-485c-9802-aea5017c8513 req-a183dd75-b866-4937-b76f-aad43301e967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6800957c-372b-491b-a82e-bbea6856e628", "tag": "f7b922ba-17b0-44e9-89d0-929217e24250"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:21.392086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d40d29b5-1a79-485c-9802-aea5017c8513 req-a183dd75-b866-4937-b76f-aad43301e967 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:21.392833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d40d29b5-1a79-485c-9802-aea5017c8513 req-a183dd75-b866-4937-b76f-aad43301e967 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:21.393438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d40d29b5-1a79-485c-9802-aea5017c8513 req-a183dd75-b866-4937-b76f-aad43301e967 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:21.406229 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d40d29b5-1a79-485c-9802-aea5017c8513 req-a183dd75-b866-4937-b76f-aad43301e967 service nova] Creating event network-changed:f7b922ba-17b0-44e9-89d0-929217e24250 for instance 6800957c-372b-491b-a82e-bbea6856e628 on n-h2-master-1 Oct 02 01:41:21.412445 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d40d29b5-1a79-485c-9802-aea5017c8513 req-a183dd75-b866-4937-b76f-aad43301e967 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043663 Oct 02 01:41:21.413598 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2945/6069] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:41:31.188268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:31.190623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:31.193689 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=29 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:31.194370 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=74 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:31.200455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:31.201042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:31.201607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:31.202325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:31.202878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:31.203276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:31.271260 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8441a216-3747-421a-a762-b46dd8d0bc9a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724/action" status: 200 len: 24572 microversion: 2.1 time: 0.087387 Oct 02 01:41:31.272233 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3125/6070] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:41:31 2022] POST /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724/action => generated 24572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:41:47.931896 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:47.932654 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:47.936973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:41:47.939959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:41:47.948062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:47.948551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:47.948991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:47.949687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:41:47.950147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:41:47.950577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:41:48.014420 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ddee04d0-44d1-4f9c-8f72-074db905d19e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action" status: 200 len: 24576 microversion: 2.1 time: 0.084770 Oct 02 01:41:48.015363 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2946/6071] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:41:47 2022] POST /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97/action => generated 24576 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:42:00.754042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2095288085", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "2b4b3aa7-c1d5-4ce6-8bac-d92630ca5d8b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-144094215", "security_groups": []}, "os:scheduler_hints": {"different_host": ["6800957c-372b-491b-a82e-bbea6856e628"]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:00.763663 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:00.764360 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:00.838495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] validate_networks() for [('2b4b3aa7-c1d5-4ce6-8bac-d92630ca5d8b', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:42:01.341641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:42:01.342072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:42:01.342553 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:42:01.343220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:42:01.343639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:42:01.353158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:01.353645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:01.354083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:01.354887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:01.355346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:01.355771 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:01.375776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Getting quotas for project 24fa631aa4214c399af20711a739f128. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:42:01.381492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Getting quotas for user a4554021870a4d6b9f7deca8ebfd3142 and project 24fa631aa4214c399af20711a739f128. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:42:01.397680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:42:01.400229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:42:01.456161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cdb2ff82-37c7-443a-b992-a70c6b60f986 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.705696 Oct 02 01:42:01.458336 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3126/6072] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:42:00 2022] POST /compute/v2.1/servers => generated 361 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:42:01.470624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6708802f-b98c-4ae0-be33-8eb718a776f3 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:01.472084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6708802f-b98c-4ae0-be33-8eb718a776f3 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:01.478330 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:01.479416 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:01.925036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6708802f-b98c-4ae0-be33-8eb718a776f3 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:01.935657 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6708802f-b98c-4ae0-be33-8eb718a776f3 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1241 microversion: 2.1 time: 0.469614 Oct 02 01:42:01.937827 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2947/6073] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:01 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1241 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:02.959413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:02.960833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:02.969676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:02.970492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:02.970976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:02.971707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:02.972163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:02.972788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:03.089814 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:03.099569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2e6d114-948a-491e-9950-c258057fdfb6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.143445 Oct 02 01:42:03.100140 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3127/6074] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:02 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:04.123355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:04.124132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:04.131777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:04.132267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:04.132702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:04.133406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:04.133855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:04.134462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:04.254179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:04.262049 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b2aa6706-733e-4fae-a2a7-309dfb2208ae tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.142662 Oct 02 01:42:04.262736 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2948/6075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:04 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:04.651318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d70669da-fb72-42a4-84f6-d0dd71e5e296 req-1b37aaa5-232b-4e07-8546-d2d5a681a0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97eb3955-1570-465d-b695-2351e3b0dbf9", "tag": "c592edce-f360-4c44-a9d4-279b9e207159"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:04.664177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d70669da-fb72-42a4-84f6-d0dd71e5e296 req-1b37aaa5-232b-4e07-8546-d2d5a681a0f7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:04.664671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d70669da-fb72-42a4-84f6-d0dd71e5e296 req-1b37aaa5-232b-4e07-8546-d2d5a681a0f7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:04.665113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d70669da-fb72-42a4-84f6-d0dd71e5e296 req-1b37aaa5-232b-4e07-8546-d2d5a681a0f7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:04.677614 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d70669da-fb72-42a4-84f6-d0dd71e5e296 req-1b37aaa5-232b-4e07-8546-d2d5a681a0f7 service nova] Creating event network-changed:c592edce-f360-4c44-a9d4-279b9e207159 for instance 97eb3955-1570-465d-b695-2351e3b0dbf9 on n-h1-master-1 Oct 02 01:42:04.682922 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d70669da-fb72-42a4-84f6-d0dd71e5e296 req-1b37aaa5-232b-4e07-8546-d2d5a681a0f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035954 Oct 02 01:42:04.683843 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3128/6076] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:05.285332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:05.285891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:05.292892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:05.293379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:05.293815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:05.294503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:05.294986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:05.295413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:05.705197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:05.712853 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24410766-ea7b-4d22-9ed8-64626e130dcf tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.431501 Oct 02 01:42:05.713435 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2949/6077] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:05 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:06.736955 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:06.737664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:06.743885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:06.744371 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:06.744811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:06.745505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:06.745959 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:06.746390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:06.831724 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:06.840287 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9292e3c8-f99c-4d0c-ada2-bce4ec24b38d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.108630 Oct 02 01:42:06.841089 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3129/6078] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:06 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:07.863897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:07.864446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:07.871526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:07.872014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:07.872455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:07.873161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:07.873620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:07.874714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:07.957680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:07.967912 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-640deec9-a964-4088-b3ba-a9c1dfed2321 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.107270 Oct 02 01:42:07.968713 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2950/6079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:07 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:08.995271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:08.995894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:09.003776 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:09.004267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:09.004712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:09.005412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:09.005877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:09.006312 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:09.088058 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:09.096139 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-25c33b96-f93a-4c47-a75c-9ded4ec4e34d tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.104852 Oct 02 01:42:09.096716 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3130/6080] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:08 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:10.119244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:10.119770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:10.126647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:10.127135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:10.127572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:10.128258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:10.128719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:10.129144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:10.213204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:10.221525 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39b7e4ca-29d4-4eac-b2fd-76affdfa1561 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.106216 Oct 02 01:42:10.222104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2951/6081] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:10 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:10.697918 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:10.698657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:10.706212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:10.706739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:10.707179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:10.707874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:10.708339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:10.708767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:10.838181 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ed55638-34f6-49dd-86f6-5e1ea0c27ca8 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1833 microversion: 2.1 time: 0.144032 Oct 02 01:42:10.838794 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3131/6082] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:10 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1833 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:11.246011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:11.246625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:11.255359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.255857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.256295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.257015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.257483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.257920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.388980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:11.397186 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ea12804-64d7-43d9-b471-2eec8f94f763 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.155425 Oct 02 01:42:11.397774 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2952/6083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:11 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:11.615285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-3ed73921-eede-4507-90c9-0d273931b9a6 req-f8fdaca2-ed19-4aab-a092-00b1a93b05b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97eb3955-1570-465d-b695-2351e3b0dbf9", "name": "network-vif-plugged", "status": "completed", "tag": "c592edce-f360-4c44-a9d4-279b9e207159"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:11.625760 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:11.626830 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:11.633978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3ed73921-eede-4507-90c9-0d273931b9a6 req-f8fdaca2-ed19-4aab-a092-00b1a93b05b5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.634495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3ed73921-eede-4507-90c9-0d273931b9a6 req-f8fdaca2-ed19-4aab-a092-00b1a93b05b5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.635281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3ed73921-eede-4507-90c9-0d273931b9a6 req-f8fdaca2-ed19-4aab-a092-00b1a93b05b5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.653353 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-3ed73921-eede-4507-90c9-0d273931b9a6 req-f8fdaca2-ed19-4aab-a092-00b1a93b05b5 service nova] Creating event network-vif-plugged:c592edce-f360-4c44-a9d4-279b9e207159 for instance 97eb3955-1570-465d-b695-2351e3b0dbf9 on n-h1-master-1 Oct 02 01:42:11.662181 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-3ed73921-eede-4507-90c9-0d273931b9a6 req-f8fdaca2-ed19-4aab-a092-00b1a93b05b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052975 Oct 02 01:42:11.663582 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3132/6084] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:42:11.784163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:11.784674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:11.787025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a06e6e49-d7de-4d29-8e72-8c94efc1c3ca req-c71ba025-b9a4-4158-bb62-7d0dc6234448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:11.791414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.797436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.798392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.801347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a06e6e49-d7de-4d29-8e72-8c94efc1c3ca req-c71ba025-b9a4-4158-bb62-7d0dc6234448 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.802251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a06e6e49-d7de-4d29-8e72-8c94efc1c3ca req-c71ba025-b9a4-4158-bb62-7d0dc6234448 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.802561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.803263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a06e6e49-d7de-4d29-8e72-8c94efc1c3ca req-c71ba025-b9a4-4158-bb62-7d0dc6234448 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.803876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.807268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.821924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a06e6e49-d7de-4d29-8e72-8c94efc1c3ca req-c71ba025-b9a4-4158-bb62-7d0dc6234448 service nova] Creating event network-changed:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h1-master-1 Oct 02 01:42:11.828342 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a06e6e49-d7de-4d29-8e72-8c94efc1c3ca req-c71ba025-b9a4-4158-bb62-7d0dc6234448 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045503 Oct 02 01:42:11.829746 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3133/6085] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:11.846321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:42:11.926246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bd940e4-cb57-4ed5-8147-ff89371ab75a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 204 len: 0 microversion: 2.1 time: 0.146245 Oct 02 01:42:11.926932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2953/6086] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:42:11 2022] DELETE /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:42:11.935989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:11.936757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:11.942873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.943379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.943825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:11.944522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:11.944980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:11.945403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:12.085741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:12.094179 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-22587e17-db83-4451-9707-8d04b018fd58 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1688 microversion: 2.1 time: 0.162390 Oct 02 01:42:12.094795 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3134/6087] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:11 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:12.420793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:12.421640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:12.423675 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:12.430464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:12.431227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:12.431659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:12.432353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:12.432805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:12.433228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:12.520424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:12.528556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a2aaa12-6a85-4b99-b844-1c905c57c0c2 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.112122 Oct 02 01:42:12.529179 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2954/6088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:12 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:13.119840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:13.120451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:13.128144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:13.128626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:13.129064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:13.129755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:13.130208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:13.130652 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:13.265678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:13.273505 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cd7f2552-10ca-4e75-ac0d-54dc9d98fd5e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1688 microversion: 2.1 time: 0.157786 Oct 02 01:42:13.274083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3135/6089] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:13 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:13.552069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:13.552606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:13.559714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:13.560199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:13.560642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:13.561863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:13.562323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:13.562785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:13.654139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:13.662527 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9ff30da-7617-4309-b7f5-0cf052c79dce tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1299 microversion: 2.1 time: 0.114472 Oct 02 01:42:13.663140 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2955/6090] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:13 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:14.298082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:14.298807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:14.305946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:14.306688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:14.307132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:14.307840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:14.308298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:14.308727 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:14.616769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:14.626258 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2c60156e-40b3-4fd2-9617-07517d5cbdb5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1688 microversion: 2.1 time: 0.332780 Oct 02 01:42:14.627302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3136/6091] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:14 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1688 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:14.688714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:14.689390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:14.696862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:14.697350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:14.697780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:14.698473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:14.698974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:14.699600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:14.830665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:14.838852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84ddd887-eed4-44af-aeba-cbec40ed609c tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1472 microversion: 2.1 time: 0.154150 Oct 02 01:42:14.840166 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2956/6092] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:14 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:14.863158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:14.863781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:14.869837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:14.870319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:14.870968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:14.871668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:14.872306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:14.872735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:14.988957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:14.997658 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-366a6fdb-25bd-4a88-94fb-492fe95068dc tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1472 microversion: 2.1 time: 0.138378 Oct 02 01:42:15.001812 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3137/6093] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:14 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1472 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:15.023561 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:15.024340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:15.031409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.031857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.032478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.033771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.034400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.035032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.040741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7100a759-a6e1-491f-b83f-09707910fe02 req-d7b1cd0f-efdf-4dbe-9dbc-3f7781d6c452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b81a4a-2726-4be4-a0a1-be096140bf97", "name": "network-vif-deleted", "tag": "95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:15.052438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7100a759-a6e1-491f-b83f-09707910fe02 req-d7b1cd0f-efdf-4dbe-9dbc-3f7781d6c452 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.053842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7100a759-a6e1-491f-b83f-09707910fe02 req-d7b1cd0f-efdf-4dbe-9dbc-3f7781d6c452 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.054673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7100a759-a6e1-491f-b83f-09707910fe02 req-d7b1cd0f-efdf-4dbe-9dbc-3f7781d6c452 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.070219 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7100a759-a6e1-491f-b83f-09707910fe02 req-d7b1cd0f-efdf-4dbe-9dbc-3f7781d6c452 service nova] Creating event network-vif-deleted:95c2fed7-d6b9-4cbb-bcc8-78ca17f1b8be for instance 88b81a4a-2726-4be4-a0a1-be096140bf97 on n-h1-master-1 Oct 02 01:42:15.076334 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7100a759-a6e1-491f-b83f-09707910fe02 req-d7b1cd0f-efdf-4dbe-9dbc-3f7781d6c452 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038934 Oct 02 01:42:15.078012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3138/6094] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:15.132393 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9098724-1fcb-461b-83d6-db10e9bf79fe tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1623 microversion: 2.1 time: 0.112508 Oct 02 01:42:15.132995 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2957/6095] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:15 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1623 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:15.156793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:15.157933 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:15.164842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.165391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.165835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.167470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.168182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.168570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.324115 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-623af533-45bc-4bfa-9fcc-3cfc915004d0 tempest-TestSecurityGroupsBasicOps-1978588556 tempest-TestSecurityGroupsBasicOps-1978588556-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1915 microversion: 2.1 time: 0.171679 Oct 02 01:42:15.324722 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3139/6096] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:15 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1915 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:15.404289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:15.404698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:15.412260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.413033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.413520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.414352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.414842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.415280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.451101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:42:15.477155 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-18db766d-ba20-4c76-952b-9f6cc15772dc tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'create', calling method: .version_select at 0x7fb87bffc430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2006708913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUgM3nVzEoe3ocDxiQA1ls4cYQh+31iv5J1xW9OY92hQOxtqBJp2VQmNPhm4suCIBDvfn1OF0bPuq5kipcJ2I3syJhTwQLfb+oHI5oTbC5tgyxVxkllIhH9qHs6SChiRQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:15.496946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-18db766d-ba20-4c76-952b-9f6cc15772dc tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:42:15.505088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-18db766d-ba20-4c76-952b-9f6cc15772dc tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for user 97cb465affcf4b328550d1f7b4dfeddf and project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:42:15.540763 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-18db766d-ba20-4c76-952b-9f6cc15772dc tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.069656 Oct 02 01:42:15.541424 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3140/6097] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:42:15 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:15.578523 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6297637-54fb-490b-af5c-17c95948ce75 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 204 len: 0 microversion: 2.1 time: 0.176980 Oct 02 01:42:15.581019 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2958/6098] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:42:15 2022] DELETE /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:42:15.589975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:15.590837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:15.599596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.603370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.604266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.605246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.605774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.606467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.650293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:15.651163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:15.658403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.659347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.659846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.660612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.661075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.661512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.701147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:15.701825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:15.702282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:15.702974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lazy-loading 'fault' on Instance uuid 88b81a4a-2726-4be4-a0a1-be096140bf97 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:42:15.772539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:15.779320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:15.781304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e5636a42-9d28-41d6-a255-06a0113b8fda tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1478 microversion: 2.1 time: 0.195364 Oct 02 01:42:15.781974 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3141/6099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:15 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1478 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:15.794560 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b5d1e98-bfb4-4ee7-8aa5-4e749cafa481 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 200 len: 1357 microversion: 2.1 time: 0.148926 Oct 02 01:42:15.806786 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2959/6100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:15 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:16.781414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1287855222", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "bddb2900-8de8-435b-b880-8cc9ca17a02e"}], "key_name": "tempest-TestNetworkBasicOps-2006708913", "security_groups": [{"name": "tempest-secgroup-smoke-1313765943"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:16.805917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:16.806530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:16.815617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:16.816329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:16.816951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:16.817756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:16.818899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:16.819756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:16.963159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:16.963708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] validate_networks() for [('bddb2900-8de8-435b-b880-8cc9ca17a02e', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:42:16.967246 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:16.972990 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1eb3285e-465a-4435-ad2d-c2ed486cdc09 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1478 microversion: 2.1 time: 0.171623 Oct 02 01:42:16.973588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2960/6101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:16 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:16.990316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:16.991516 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 88b81a4a-2726-4be4-a0a1-be096140bf97] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:16.998125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:16.999224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:16.999660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:17.000370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:17.000962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:17.001393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:17.018170 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] HTTP exception thrown: Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 could not be found. Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Request method failure captured: Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 HTTP/1.1 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOvg5Zmg9o_TDtbUvRXpqYE-3VU_epo8elpy_IlxV4Q6QbiFkzGK_scNqAy5NJuR5MFpAkMXv_wLKz-bjQomO3KR5D5dHY-NfrddVaFcktSN8lq_k0vMyudFZYsqdExvX-vWxG4ITF45xgcPnDsqSYSybUEQKvJNs-ZJ5siFXDAfuZ8 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7955fc0f32784de19c7e0bd32b5afe1b"}]}] Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 4ac7b60e4e094354a9692bb46c3ebf8d Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 could not be found. Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '88b81a4a-2726-4be4-a0a1-be096140bf97'} Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 could not be found. Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 could not be found. Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:17.020017 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 could not be found. Oct 02 01:42:17.024800 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:17.026927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Returning 404 to user: Instance 88b81a4a-2726-4be4-a0a1-be096140bf97 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:42:17.028020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-72b0ff16-4f70-46e9-938c-f76dae2fc948 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97" status: 404 len: 111 microversion: 2.1 time: 0.052072 Oct 02 01:42:17.028812 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2961/6102] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:16 2022] GET /compute/v2.1/servers/88b81a4a-2726-4be4-a0a1-be096140bf97 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:42:17.667667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:42:17.668360 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:42:17.669841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:42:17.671804 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:42:17.678194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:42:17.706702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:17.710576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:17.712325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:17.713475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:17.715131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:17.716227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:17.745973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:42:17.756319 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for user 97cb465affcf4b328550d1f7b4dfeddf and project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:42:17.779394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:42:17.783840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:42:17.843985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8724db35-cd09-41fa-896f-02382c22cd72 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.066300 Oct 02 01:42:17.851382 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3142/6103] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:42:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:42:17.863969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d218f23b-8595-42a2-a6b9-584c5468ccfa tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:17.865306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d218f23b-8595-42a2-a6b9-584c5468ccfa tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:17.929439 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8e26ce40-bbe4-4358-9b4d-661f20dcb154 req-62b52356-3ad5-43e9-a4f2-41ea1326c495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97eb3955-1570-465d-b695-2351e3b0dbf9", "name": "network-vif-deleted", "tag": "c592edce-f360-4c44-a9d4-279b9e207159"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:17.953365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e26ce40-bbe4-4358-9b4d-661f20dcb154 req-62b52356-3ad5-43e9-a4f2-41ea1326c495 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:17.953890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e26ce40-bbe4-4358-9b4d-661f20dcb154 req-62b52356-3ad5-43e9-a4f2-41ea1326c495 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:17.954338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e26ce40-bbe4-4358-9b4d-661f20dcb154 req-62b52356-3ad5-43e9-a4f2-41ea1326c495 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:17.982382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d218f23b-8595-42a2-a6b9-584c5468ccfa tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:17.989507 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8e26ce40-bbe4-4358-9b4d-661f20dcb154 req-62b52356-3ad5-43e9-a4f2-41ea1326c495 service nova] Creating event network-vif-deleted:c592edce-f360-4c44-a9d4-279b9e207159 for instance 97eb3955-1570-465d-b695-2351e3b0dbf9 on n-h1-master-1 Oct 02 01:42:17.995969 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d218f23b-8595-42a2-a6b9-584c5468ccfa tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1249 microversion: 2.1 time: 0.136593 Oct 02 01:42:17.997302 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2962/6104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:17 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:18.003071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:18.003892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:18.010919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:18.011630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:18.012312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:18.013453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:18.015010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:18.016243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:18.027146 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8e26ce40-bbe4-4358-9b4d-661f20dcb154 req-62b52356-3ad5-43e9-a4f2-41ea1326c495 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101355 Oct 02 01:42:18.032725 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3143/6105] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:18.156001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:18.164879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3a3224b-30bf-4484-92ef-eaf8de996817 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 200 len: 1326 microversion: 2.1 time: 0.166264 Oct 02 01:42:18.165794 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2963/6106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:17 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 1326 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:19.026015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:19.027396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:19.035146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:19.036003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:19.037675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:19.037675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:19.037675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:19.038124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:19.111230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:19.119218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44c80622-1afb-4ae2-9f1c-449e07f0e700 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1301 microversion: 2.1 time: 0.099544 Oct 02 01:42:19.119975 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3144/6107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:19 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:19.194552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:19.195972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 97eb3955-1570-465d-b695-2351e3b0dbf9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:19.204953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:19.205454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:19.206327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:19.207336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:19.209666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:19.210195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:19.228161 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] HTTP exception thrown: Instance 97eb3955-1570-465d-b695-2351e3b0dbf9 could not be found. Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Request method failure captured: Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 HTTP/1.1 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOwpFP2o6ZWp-RHWtkxljGJxWHjW34TNfWRHKI1j5orAC7rusOfxyqRg7xDbGNeeR3FoqjgNkcJahECKP7lMtgt1HoYHtgAtxfONQsdUli_2OeXP5XdbkPyMBf_i7XzVmpxQlnrIPRrVJQxikCfSmotor-FWsHgjE7E_EmY7TyXwQKY Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 24fa631aa4214c399af20711a739f128 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1397492024 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/24fa631aa4214c399af20711a739f128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24fa631aa4214c399af20711a739f128"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24fa631aa4214c399af20711a739f128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_24fa631aa4214c399af20711a739f128"}]}] Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1397492024 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 24fa631aa4214c399af20711a739f128 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1397492024 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestSecurityGroupsBasicOps-1397492024-project Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a4554021870a4d6b9f7deca8ebfd3142 Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1397492024-project Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 97eb3955-1570-465d-b695-2351e3b0dbf9 could not be found. Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '97eb3955-1570-465d-b695-2351e3b0dbf9'} Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97eb3955-1570-465d-b695-2351e3b0dbf9 could not be found. Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97eb3955-1570-465d-b695-2351e3b0dbf9 could not be found. Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:19.235633 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97eb3955-1570-465d-b695-2351e3b0dbf9 could not be found. Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Returning 404 to user: Instance 97eb3955-1570-465d-b695-2351e3b0dbf9 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ecdf017-6430-42e5-8e51-7c4cbe7ae6aa tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9" status: 404 len: 111 microversion: 2.1 time: 0.048964 Oct 02 01:42:19.244387 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2964/6108] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:19 2022] GET /compute/v2.1/servers/97eb3955-1570-465d-b695-2351e3b0dbf9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:42:20.141389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:20.142009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:20.149537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:20.150279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:20.150986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:20.151914 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:20.152586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:20.153226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:20.290879 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:20.304257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a9e7589-bf5f-4e06-ab23-90ae3aa56a1a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1307 microversion: 2.1 time: 0.166763 Oct 02 01:42:20.315734 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3145/6109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:20 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:21.330753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:21.331369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:21.341479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:21.343407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:21.344276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:21.345196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:21.345828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:21.346539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:21.513183 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2e461c8d-ae19-4587-a28d-641aa055356f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '.version_select at 0x7fb8855983a0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:21.533567 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2e461c8d-ae19-4587-a28d-641aa055356f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1154936408" status: 202 len: 0 microversion: 2.1 time: 0.030184 Oct 02 01:42:21.538154 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3146/6110] 10.222.0.23 () {58 vars in 1284 bytes} [Sun Oct 2 01:42:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1154936408 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:42:21.573109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9300b0fe-88d7-4e99-9f1a-15a18ac1ff7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: .version_select at 0x7fb88557fb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-48284013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByixRqBU5x3odQQAFo59fwQEdCGOHw98IDNJD6vBJt044bAUEpLv3ZIEnpU9onJX09QCfpTy1JJ3ywqQglkK43g5LO9pICyJCGeF0u7DbMZgdUoL1QbPNVNQulFlaOraA=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:21.593645 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9300b0fe-88d7-4e99-9f1a-15a18ac1ff7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:42:21.600327 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-9300b0fe-88d7-4e99-9f1a-15a18ac1ff7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:42:21.634293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9300b0fe-88d7-4e99-9f1a-15a18ac1ff7b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069498 Oct 02 01:42:21.642249 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3147/6111] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:42:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:42:21.773006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:21.783592 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-625579c8-f4b8-4aa6-8319-bb6b3c1bcfc1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.457808 Oct 02 01:42:21.802053 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2965/6112] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:21 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:22.809450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:22.810046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:22.817145 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:22.819239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:22.819942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:22.820547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:22.821431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:22.822034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:22.822621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:23.146899 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:23.155280 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-efe651a0-17d4-48d9-b9a1-ab351cb459c8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.349724 Oct 02 01:42:23.156000 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3148/6113] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:22 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:23.384101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b0e0c884-0a90-49a8-bd2e-97e96622d72d req-68cc8188-db73-454f-bcbf-28d9fc2a8c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177f5120-17fb-48d8-858a-3699143d1934", "tag": "55fe60e8-7b85-4aa2-b043-d08c9ac8858f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:23.402303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b0e0c884-0a90-49a8-bd2e-97e96622d72d req-68cc8188-db73-454f-bcbf-28d9fc2a8c1c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:23.402965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b0e0c884-0a90-49a8-bd2e-97e96622d72d req-68cc8188-db73-454f-bcbf-28d9fc2a8c1c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:23.403470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b0e0c884-0a90-49a8-bd2e-97e96622d72d req-68cc8188-db73-454f-bcbf-28d9fc2a8c1c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:23.444968 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b0e0c884-0a90-49a8-bd2e-97e96622d72d req-68cc8188-db73-454f-bcbf-28d9fc2a8c1c service nova] Creating event network-changed:55fe60e8-7b85-4aa2-b043-d08c9ac8858f for instance 177f5120-17fb-48d8-858a-3699143d1934 on n-h2-master-1 Oct 02 01:42:23.452359 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b0e0c884-0a90-49a8-bd2e-97e96622d72d req-68cc8188-db73-454f-bcbf-28d9fc2a8c1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075917 Oct 02 01:42:23.453572 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2966/6114] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:42:24.180405 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:24.182390 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:24.194706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:24.195736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:24.197637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:24.200276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:24.203553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:24.204180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:24.498373 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:24.506482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24521f41-a50b-49aa-9e85-e5260be94876 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.332448 Oct 02 01:42:24.507113 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3149/6115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:24 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:25.530677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:25.532334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:25.550362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:25.551193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:25.552364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:25.553255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:25.553890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:25.554640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:25.795724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:25.812006 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac025e82-ea3f-419e-a8aa-e7b0f9f8e576 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.285643 Oct 02 01:42:25.813018 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2967/6116] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:25 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:26.837325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:26.837950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:26.859055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:26.859862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:26.860488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:26.861666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:26.862692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:26.863456 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:26.908468 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:27.114102 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:27.128532 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-adc96968-607b-48af-b6b5-b5e97f3b0e2c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.294737 Oct 02 01:42:27.129976 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3150/6117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:26 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:27.616293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:27.616884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:27.624163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b36e0c6a-9f29-48e6-8047-302577fe6bd2 req-7d2716cd-2629-4576-a8e8-4fec8cd21680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6800957c-372b-491b-a82e-bbea6856e628", "tag": "f7b922ba-17b0-44e9-89d0-929217e24250"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:27.642907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b36e0c6a-9f29-48e6-8047-302577fe6bd2 req-7d2716cd-2629-4576-a8e8-4fec8cd21680 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:27.644314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:27.644937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:27.650263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b36e0c6a-9f29-48e6-8047-302577fe6bd2 req-7d2716cd-2629-4576-a8e8-4fec8cd21680 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:27.651357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:27.652015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b36e0c6a-9f29-48e6-8047-302577fe6bd2 req-7d2716cd-2629-4576-a8e8-4fec8cd21680 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:27.656591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:27.657081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:27.657525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:27.682760 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b36e0c6a-9f29-48e6-8047-302577fe6bd2 req-7d2716cd-2629-4576-a8e8-4fec8cd21680 service nova] Creating event network-changed:f7b922ba-17b0-44e9-89d0-929217e24250 for instance 6800957c-372b-491b-a82e-bbea6856e628 on n-h2-master-1 Oct 02 01:42:27.690520 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b36e0c6a-9f29-48e6-8047-302577fe6bd2 req-7d2716cd-2629-4576-a8e8-4fec8cd21680 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070783 Oct 02 01:42:27.693038 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3151/6118] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:27.717364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:42:27.861888 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-30db1a26-6668-40ce-8e7e-e61be0a6e1d4 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 204 len: 0 microversion: 2.1 time: 0.254698 Oct 02 01:42:27.863096 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2968/6119] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:42:27 2022] DELETE /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:42:27.885059 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:27.885883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:27.891734 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:27.905950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:27.907601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:27.908231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:27.909266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:27.909956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:27.910557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:28.157887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:28.158884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:28.162058 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:28.167923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:28.176747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:28.177463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:28.178370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:28.179014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:28.180318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:28.244343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:28.258097 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7dfafa2d-66ce-49a3-ac8a-54c04e5f1c21 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1770 microversion: 2.1 time: 0.389876 Oct 02 01:42:28.259255 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3152/6120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:27 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1770 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:28.422668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:28.432517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43875af3-84b8-4129-aa71-fa37a629328d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.279966 Oct 02 01:42:28.443747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2969/6121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:28 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:29.289768 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:29.290322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:29.306660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:29.307156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:29.307595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:29.308482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:29.308935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:29.309534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:29.457403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:29.458021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:29.468917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:29.469415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:29.469853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:29.470567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:29.471054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:29.471480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:29.753503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:29.762008 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da1b2db6-98f8-41ff-aa4c-a11d05f1a6c5 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1770 microversion: 2.1 time: 0.483669 Oct 02 01:42:29.772445 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3153/6122] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:29 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1770 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:29.808218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:29.825652 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5bd63c0a-e559-4e7c-9414-3ca0d050d1f4 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.372127 Oct 02 01:42:29.831793 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2970/6123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:29 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:29.972311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1890789702", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "b5ed614a-aa07-4166-91f3-1631b4b690ad"}], "key_name": "tempest-TestNetworkAdvancedServerOps-48284013", "security_groups": [{"name": "tempest-secgroup-smoke-1807898846"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:30.122506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] validate_networks() for [('b5ed614a-aa07-4166-91f3-1631b4b690ad', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:42:30.200397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-706c58d5-e784-4768-9548-4b7dc67c1a77 req-d39cb3d0-078f-45b5-a879-d83cd9d2b005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177f5120-17fb-48d8-858a-3699143d1934", "name": "network-vif-plugged", "status": "completed", "tag": "55fe60e8-7b85-4aa2-b043-d08c9ac8858f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:30.228490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-706c58d5-e784-4768-9548-4b7dc67c1a77 req-d39cb3d0-078f-45b5-a879-d83cd9d2b005 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.230337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-706c58d5-e784-4768-9548-4b7dc67c1a77 req-d39cb3d0-078f-45b5-a879-d83cd9d2b005 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.233117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-706c58d5-e784-4768-9548-4b7dc67c1a77 req-d39cb3d0-078f-45b5-a879-d83cd9d2b005 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.267589 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-706c58d5-e784-4768-9548-4b7dc67c1a77 req-d39cb3d0-078f-45b5-a879-d83cd9d2b005 service nova] Creating event network-vif-plugged:55fe60e8-7b85-4aa2-b043-d08c9ac8858f for instance 177f5120-17fb-48d8-858a-3699143d1934 on n-h2-master-1 Oct 02 01:42:30.277002 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-706c58d5-e784-4768-9548-4b7dc67c1a77 req-d39cb3d0-078f-45b5-a879-d83cd9d2b005 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077831 Oct 02 01:42:30.280208 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2971/6124] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:30.299597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-46e3ea4a-b91d-4d67-adcd-a4560df0b9b9 req-fc7b0125-1413-4fb5-be9e-2961a303cdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6800957c-372b-491b-a82e-bbea6856e628", "name": "network-vif-deleted", "tag": "f7b922ba-17b0-44e9-89d0-929217e24250"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:30.334790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-46e3ea4a-b91d-4d67-adcd-a4560df0b9b9 req-fc7b0125-1413-4fb5-be9e-2961a303cdc8 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.337489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-46e3ea4a-b91d-4d67-adcd-a4560df0b9b9 req-fc7b0125-1413-4fb5-be9e-2961a303cdc8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.337958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-46e3ea4a-b91d-4d67-adcd-a4560df0b9b9 req-fc7b0125-1413-4fb5-be9e-2961a303cdc8 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.370763 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-46e3ea4a-b91d-4d67-adcd-a4560df0b9b9 req-fc7b0125-1413-4fb5-be9e-2961a303cdc8 service nova] Creating event network-vif-deleted:f7b922ba-17b0-44e9-89d0-929217e24250 for instance 6800957c-372b-491b-a82e-bbea6856e628 on n-h2-master-1 Oct 02 01:42:30.376460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-46e3ea4a-b91d-4d67-adcd-a4560df0b9b9 req-fc7b0125-1413-4fb5-be9e-2961a303cdc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081942 Oct 02 01:42:30.377617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2972/6125] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:30.597105 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:42:30.597544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:42:30.597823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:42:30.598710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:42:30.599072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:42:30.609035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.609873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.610524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.611546 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.612019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.612451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.631686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:42:30.637245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:42:30.651092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:42:30.653435 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:42:30.709632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4c2d89ad-4f14-4bed-9e0c-35ce9b8ea7b3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741794 Oct 02 01:42:30.710540 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3154/6126] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:42:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:42:30.722150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ff0a9a0-0524-4175-93f1-88e413d891cf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:30.723475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ff0a9a0-0524-4175-93f1-88e413d891cf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:30.783515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ff0a9a0-0524-4175-93f1-88e413d891cf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:30.793472 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ff0a9a0-0524-4175-93f1-88e413d891cf tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1265 microversion: 2.1 time: 0.073931 Oct 02 01:42:30.799543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:30.800211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:30.820256 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2973/6127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:30 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:30.821816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.822323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.824888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.825532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.826590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.827734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.859513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:30.860424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:30.869358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.870340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.870989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.872139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.876303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:30.877099 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.877552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.878014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lazy-loading 'fault' on Instance uuid 6800957c-372b-491b-a82e-bbea6856e628 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:42:30.879615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:30.880347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:30.985453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4554021870a4d6b9f7deca8ebfd3142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fa631aa4214c399af20711a739f128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:31.011182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4f4fa84b-26c5-4fc9-ada1-dd58ba0b9df6 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 200 len: 1384 microversion: 2.1 time: 0.216397 Oct 02 01:42:31.011800 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3155/6128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:30 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 1384 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:31.099456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:31.109680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01ab90b8-3f7d-4ca0-a23d-b859050afa9f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1375 microversion: 2.1 time: 0.254295 Oct 02 01:42:31.122073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2974/6129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:30 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1375 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:31.833687 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:31.834312 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:31.841241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:31.842504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:31.842504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:31.843568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:31.844033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:31.844462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:31.913826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:31.925957 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c66db8eb-77e0-4353-8f14-5fcc4077750e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1317 microversion: 2.1 time: 0.096260 Oct 02 01:42:31.927069 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3156/6130] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:31 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:32.035168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:32.036532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] [instance: 6800957c-372b-491b-a82e-bbea6856e628] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:32.044268 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:32.047020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.047767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.048449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.049420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.049944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.050574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.067465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] HTTP exception thrown: Instance 6800957c-372b-491b-a82e-bbea6856e628 could not be found. Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Request method failure captured: Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 HTTP/1.1 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOwpFP2o6ZWp-RHWtkxljGJxWHjW34TNfWRHKI1j5orAC7rusOfxyqRg7xDbGNeeR3FoqjgNkcJahECKP7lMtgt1HoYHtgAtxfONQsdUli_2OeXP5XdbkPyMBf_i7XzVmpxQlnrIPRrVJQxikCfSmotor-FWsHgjE7E_EmY7TyXwQKY Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 24fa631aa4214c399af20711a739f128 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1397492024 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/24fa631aa4214c399af20711a739f128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24fa631aa4214c399af20711a739f128"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24fa631aa4214c399af20711a739f128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_24fa631aa4214c399af20711a739f128"}]}] Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1397492024 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 24fa631aa4214c399af20711a739f128 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1397492024 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestSecurityGroupsBasicOps-1397492024-project Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a4554021870a4d6b9f7deca8ebfd3142 Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1397492024-project Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 6800957c-372b-491b-a82e-bbea6856e628 could not be found. Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '6800957c-372b-491b-a82e-bbea6856e628'} Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6800957c-372b-491b-a82e-bbea6856e628 could not be found. Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6800957c-372b-491b-a82e-bbea6856e628 could not be found. Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:32.069472 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6800957c-372b-491b-a82e-bbea6856e628 could not be found. Oct 02 01:42:32.073784 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:42:32.075741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Returning 404 to user: Instance 6800957c-372b-491b-a82e-bbea6856e628 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:42:32.076860 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5814a63-0110-4c69-97e1-85095e984987 tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628" status: 404 len: 111 microversion: 2.1 time: 0.045615 Oct 02 01:42:32.077439 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2975/6131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:32 2022] GET /compute/v2.1/servers/6800957c-372b-491b-a82e-bbea6856e628 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:42:32.133254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:32.133882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:32.141389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.142154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.142802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.143715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.144344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.144941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.436352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:32.444525 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24ddea37-ab99-4780-9570-d97f5617adea tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1548 microversion: 2.1 time: 0.315145 Oct 02 01:42:32.458988 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3157/6132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:32 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1548 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:32.473257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:32.474643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:32.483467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.484054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.484572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.485626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.486345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.487483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.949427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:32.950048 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:32.964236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.964752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.965197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:32.966156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:32.968071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:32.968071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:33.103845 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:33.115023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36d7a7a2-7eb4-4418-a284-3c8c2ba4be05 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1323 microversion: 2.1 time: 0.169397 Oct 02 01:42:33.116292 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3158/6133] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:32 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:33.150660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:33.167839 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3aed01d6-3a5e-4cf3-a8e7-38c8d140d57b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1548 microversion: 2.1 time: 0.702606 Oct 02 01:42:33.168950 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2976/6134] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:32 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1548 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:34.137815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:34.139067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:34.147313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:34.148098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:34.148536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:34.149244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:34.149701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:34.150130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:34.271245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-03e2d08c-c01f-467b-93a9-2c8650ef1f57 req-8944cc77-0c1e-4daa-99d8-e4e6ec0be1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:34.287531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03e2d08c-c01f-467b-93a9-2c8650ef1f57 req-8944cc77-0c1e-4daa-99d8-e4e6ec0be1c1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:34.288091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03e2d08c-c01f-467b-93a9-2c8650ef1f57 req-8944cc77-0c1e-4daa-99d8-e4e6ec0be1c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:34.288640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-03e2d08c-c01f-467b-93a9-2c8650ef1f57 req-8944cc77-0c1e-4daa-99d8-e4e6ec0be1c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:34.300774 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-03e2d08c-c01f-467b-93a9-2c8650ef1f57 req-8944cc77-0c1e-4daa-99d8-e4e6ec0be1c1 service nova] Creating event network-changed:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:42:34.306214 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-03e2d08c-c01f-467b-93a9-2c8650ef1f57 req-8944cc77-0c1e-4daa-99d8-e4e6ec0be1c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039448 Oct 02 01:42:34.306940 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2977/6135] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:42:34.408884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:34.418266 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-03379a20-670a-4869-a4b0-9f384ae44bdc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.284328 Oct 02 01:42:34.419368 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3159/6136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:34 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:35.447025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:35.448517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:35.457981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:35.459494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:35.460791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:35.461900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:35.462772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:35.463581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:35.799966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:35.809086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09ddd7ca-d9e4-4aa2-b69f-46f41bdc4e24 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.366320 Oct 02 01:42:35.810438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2978/6137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:35 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:36.152438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a03fa25-a61f-4b03-b908-bff8caf4628f tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] Calling method '.version_select at 0x7fb8811a2d30>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:36.185098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a03fa25-a61f-4b03-b908-bff8caf4628f tempest-TestSecurityGroupsBasicOps-1397492024 tempest-TestSecurityGroupsBasicOps-1397492024-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-144094215" status: 202 len: 0 microversion: 2.1 time: 0.036365 Oct 02 01:42:36.186868 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3160/6138] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-144094215 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:42:36.831882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:36.832497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:36.840028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:36.840729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:36.841883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:36.842984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:36.844052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:36.845250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:37.226469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:37.236955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99dc805c-b4e3-4737-ac7d-015566eb3593 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.408832 Oct 02 01:42:37.247278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2979/6139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:36 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:38.265671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:38.266815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:38.274861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:38.275365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:38.275815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:38.276533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:38.276998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:38.277480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:38.422469 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:38.430948 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b965e2e2-e880-46d0-ac56-13981ad1e271 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.171658 Oct 02 01:42:38.431928 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3161/6140] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:38 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:42:39.454342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:39.455102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:39.463929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:39.464579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:39.465306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:39.466155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:39.467653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:39.467887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:39.619613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:39.628460 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-040c15b6-7f92-4a25-8e60-662c549f41f5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.178636 Oct 02 01:42:39.629340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2980/6141] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:39 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:40.653304 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:40.654524 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:40.657780 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:40.660330 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=20 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:40.668430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:40.670492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:40.671020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:40.671789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:40.672261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:40.672696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:40.883576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:40.910944 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6c9f3d62-d06c-4a53-843c-5c0dbf124db2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.261414 Oct 02 01:42:40.917440 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3162/6142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:40 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:41.938714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:41.940205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:41.944150 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:41.952004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:41.952267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:41.952609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:41.953560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:41.954031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:41.954591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:42.066464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-227f4635-1f79-4e9a-a44f-28570350ee0c req-b49ba13c-2e30-48cd-9823-43ffcc29c0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "name": "network-vif-plugged", "status": "completed", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:42.077501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-227f4635-1f79-4e9a-a44f-28570350ee0c req-b49ba13c-2e30-48cd-9823-43ffcc29c0ba service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:42.077991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-227f4635-1f79-4e9a-a44f-28570350ee0c req-b49ba13c-2e30-48cd-9823-43ffcc29c0ba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:42.078681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-227f4635-1f79-4e9a-a44f-28570350ee0c req-b49ba13c-2e30-48cd-9823-43ffcc29c0ba service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:42.102311 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-227f4635-1f79-4e9a-a44f-28570350ee0c req-b49ba13c-2e30-48cd-9823-43ffcc29c0ba service nova] Creating event network-vif-plugged:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:42:42.111431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-227f4635-1f79-4e9a-a44f-28570350ee0c req-b49ba13c-2e30-48cd-9823-43ffcc29c0ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048214 Oct 02 01:42:42.112781 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3163/6143] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:42.390579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:42.399533 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f6be888-fde0-4d7c-acf3-9403a356d1f2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.466186 Oct 02 01:42:42.400282 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2981/6144] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:41 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:43.424124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:43.425014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:43.432549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:43.433045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:43.433687 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:43.434426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:43.435223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:43.436010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:43.657563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:43.670295 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a519abbf-083e-4cdf-ab57-7dc140425127 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1391 microversion: 2.1 time: 0.250098 Oct 02 01:42:43.671846 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3164/6145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:43 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:44.698694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:44.699330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:44.707698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:44.708434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:44.708873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:44.709583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:44.710043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:44.710474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:44.731345 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:44.863717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:44.871943 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63ce9234-9666-4937-9b8e-4bd41ccd65f7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1562 microversion: 2.1 time: 0.177637 Oct 02 01:42:44.873827 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2982/6146] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:44 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:44.895801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:44.896419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:44.904543 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:44.905247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:44.905700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:44.906841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:44.907555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:44.908103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:45.092060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:45.103433 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4a0968f7-e917-465a-a99a-39a4f96710d8 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1562 microversion: 2.1 time: 0.211234 Oct 02 01:42:45.104908 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3165/6147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:44 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1562 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:47.221469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:47.222532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:47.235804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:47.236391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:47.236838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:47.237548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:47.238005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:47.238580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:47.239323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f91bd3c6-d38c-4b4a-b54f-663802684593 req-c60d1b47-7acb-41a7-a1a6-9caa7074d03f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:47.261268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f91bd3c6-d38c-4b4a-b54f-663802684593 req-c60d1b47-7acb-41a7-a1a6-9caa7074d03f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:47.261753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f91bd3c6-d38c-4b4a-b54f-663802684593 req-c60d1b47-7acb-41a7-a1a6-9caa7074d03f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:47.262188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f91bd3c6-d38c-4b4a-b54f-663802684593 req-c60d1b47-7acb-41a7-a1a6-9caa7074d03f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:47.306808 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f91bd3c6-d38c-4b4a-b54f-663802684593 req-c60d1b47-7acb-41a7-a1a6-9caa7074d03f service nova] Creating event network-changed:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:42:47.324687 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f91bd3c6-d38c-4b4a-b54f-663802684593 req-c60d1b47-7acb-41a7-a1a6-9caa7074d03f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089396 Oct 02 01:42:47.325956 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3166/6148] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:47.508116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:47.533373 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2a941cb-2648-4f23-8495-392830b2014a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1562 microversion: 2.1 time: 0.317489 Oct 02 01:42:47.540126 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2983/6149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:47 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1562 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:51.764364 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1651576563", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9e0facae-f9dc-4e23-adb9-74629bc75e79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:51.830289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:42:52.322396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:42:52.322885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:42:52.323370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:42:52.323786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:42:52.324203 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:42:52.333357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:52.333845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:52.334367 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:52.335129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:52.335600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:52.336017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:52.354322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:42:52.360655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:42:52.417112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:42:52.419907 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e0facae-f9dc-4e23-adb9-74629bc75e79',volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:42:52.548654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2a9d830-d6d7-4286-bf12-cc48bb1914de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788598 Oct 02 01:42:52.549321 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3167/6150] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:42:52.560936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-950c70fd-f189-407c-ac27-3b73592bccf6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:52.561870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-950c70fd-f189-407c-ac27-3b73592bccf6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:52.623526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-950c70fd-f189-407c-ac27-3b73592bccf6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:52.631844 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-950c70fd-f189-407c-ac27-3b73592bccf6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1057 microversion: 2.1 time: 0.074834 Oct 02 01:42:52.632803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2984/6151] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:52 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:53.657001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:53.657774 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:53.659871 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:53.682660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:53.683257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:53.683722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:53.684467 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:53.684930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:53.685363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:53.772098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:53.782107 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f33828b-3d02-488b-a427-467095cd0d92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1099 microversion: 2.1 time: 0.130527 Oct 02 01:42:53.782633 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3168/6152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:53 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1099 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:54.805760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:54.806680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:54.816802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:54.818444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:54.818444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:54.819426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:54.820053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:54.820686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:55.074333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:55.087611 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb2e1b2f-3729-45d1-925e-833c3e721b08 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1215 microversion: 2.1 time: 0.285874 Oct 02 01:42:55.098379 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2985/6153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:54 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:56.124308 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:56.125921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:56.133289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:56.134181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:56.134904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:56.136332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:56.137051 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:56.137834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:56.296513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:56.305062 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7595e556-7b11-4ed9-92ee-fa7fabead2a1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1215 microversion: 2.1 time: 0.185541 Oct 02 01:42:56.305907 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3169/6154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:56 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:56.563113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-60f7fbd7-0161-4f55-a204-451b6eaf3493 req-918aad69-7902-45fd-aaad-d4d582e25c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252c8da8-df46-4dd8-8980-f3310008edfb", "tag": "6d4a9709-b506-44e8-ad06-33e5c75eb0b5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:42:56.574980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60f7fbd7-0161-4f55-a204-451b6eaf3493 req-918aad69-7902-45fd-aaad-d4d582e25c88 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:56.576546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60f7fbd7-0161-4f55-a204-451b6eaf3493 req-918aad69-7902-45fd-aaad-d4d582e25c88 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:56.577170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-60f7fbd7-0161-4f55-a204-451b6eaf3493 req-918aad69-7902-45fd-aaad-d4d582e25c88 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:56.594899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-60f7fbd7-0161-4f55-a204-451b6eaf3493 req-918aad69-7902-45fd-aaad-d4d582e25c88 service nova] Creating event network-changed:6d4a9709-b506-44e8-ad06-33e5c75eb0b5 for instance 252c8da8-df46-4dd8-8980-f3310008edfb on n-h2-master-1 Oct 02 01:42:56.610510 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-60f7fbd7-0161-4f55-a204-451b6eaf3493 req-918aad69-7902-45fd-aaad-d4d582e25c88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054982 Oct 02 01:42:56.611712 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2986/6155] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:42:57.328517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:57.329754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:57.337158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:57.337903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:57.338510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:57.339438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:57.340063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:57.340748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:57.343946 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=95 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:57.490121 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:57.499346 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0e0fc885-7208-4131-a0a0-76b605f2ab77 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1215 microversion: 2.1 time: 0.174819 Oct 02 01:42:57.511583 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3170/6156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:57 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:58.524952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:58.525658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:58.537246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:58.538285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:58.538956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:58.539848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:58.540479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:58.541080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:58.774685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:58.786044 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c4187df3-8408-4e8f-9eff-70352592419c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1215 microversion: 2.1 time: 0.265358 Oct 02 01:42:58.802432 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2987/6157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:58 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:58.948546 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:58.948993 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:58.957529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:58.958032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:58.958471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:58.959226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:58.959686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:58.960113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:59.000127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:42:59.109198 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3a709021-0b75-4828-b39d-01ba1198e9a7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "DELETE /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 204 len: 0 microversion: 2.1 time: 0.164075 Oct 02 01:42:59.110689 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3171/6158] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:42:58 2022] DELETE /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:42:59.126862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:59.128235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:59.143539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:59.144071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:59.144512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:59.145239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:59.145697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:59.146434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:59.346733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:59.356883 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99e06a0b-0ef7-45cb-b7f8-df492af7f19c tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1554 microversion: 2.1 time: 0.237256 Oct 02 01:42:59.368694 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2988/6159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:59 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:42:59.811324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:42:59.812036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:42:59.818228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:59.818753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:59.820233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:59.821457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:42:59.822094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:42:59.822713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:42:59.964903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:42:59.973228 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-17d2ff4b-177e-46ad-8cf0-82be7786ebae tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1215 microversion: 2.1 time: 0.167436 Oct 02 01:42:59.973818 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3172/6160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:42:59 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:00.381330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:00.381878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:00.389026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:00.389507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:00.389941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:00.390735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:00.391196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:00.391621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:00.556065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:00.563897 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53dfccf2-6dde-45ea-8a87-f15a3bd4f26a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1554 microversion: 2.1 time: 0.186694 Oct 02 01:43:00.564483 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2989/6161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:00 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:00.995686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:00.996440 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:01.003576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:01.004060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:01.004512 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:01.005255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:01.005731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:01.006172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:01.145922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:01.154577 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d2d943da-3983-47ee-8856-8684d4507305 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.162753 Oct 02 01:43:01.155281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3173/6162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:00 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:01.524768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cfcb7e03-66d1-4be6-ac79-79aa3d786b28 req-5932dfec-2221-4857-a590-3283ce76e653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177f5120-17fb-48d8-858a-3699143d1934", "name": "network-vif-deleted", "tag": "55fe60e8-7b85-4aa2-b043-d08c9ac8858f"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:01.535722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cfcb7e03-66d1-4be6-ac79-79aa3d786b28 req-5932dfec-2221-4857-a590-3283ce76e653 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:01.536207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cfcb7e03-66d1-4be6-ac79-79aa3d786b28 req-5932dfec-2221-4857-a590-3283ce76e653 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:01.536636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cfcb7e03-66d1-4be6-ac79-79aa3d786b28 req-5932dfec-2221-4857-a590-3283ce76e653 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:01.548579 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cfcb7e03-66d1-4be6-ac79-79aa3d786b28 req-5932dfec-2221-4857-a590-3283ce76e653 service nova] Creating event network-vif-deleted:55fe60e8-7b85-4aa2-b043-d08c9ac8858f for instance 177f5120-17fb-48d8-858a-3699143d1934 on n-h2-master-1 Oct 02 01:43:01.553456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cfcb7e03-66d1-4be6-ac79-79aa3d786b28 req-5932dfec-2221-4857-a590-3283ce76e653 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 Oct 02 01:43:01.554085 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2990/6163] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:01.589202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:01.589901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:01.596475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:01.596972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:01.597415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:01.598129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:01.598591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:01.599079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:01.667288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:01.675754 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-29068507-88bb-4953-a749-a0146c631b1b tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 200 len: 1334 microversion: 2.1 time: 0.091857 Oct 02 01:43:01.676362 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3174/6164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:01 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:02.179134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:02.179880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:02.182087 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=34 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:02.188191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:02.188682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:02.189196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:02.190083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:02.190840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:02.191381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:02.327675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:02.335501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-452c92f9-8318-4b2b-a682-0f45862e532a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.160669 Oct 02 01:43:02.336066 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2991/6165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:02 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:02.700598 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:02.701215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 177f5120-17fb-48d8-858a-3699143d1934] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:02.703672 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:02.704347 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:02.710544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:02.711135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:02.711605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:02.712308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:02.712761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:02.713185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:02.727323 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] HTTP exception thrown: Instance 177f5120-17fb-48d8-858a-3699143d1934 could not be found. Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Request method failure captured: Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 HTTP/1.1 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOwIiEqtW-ToDSUxBioiXIm1J2ASp6rbslBfSobFbIC7S8wBm_hKv-oWRzYa3Z45hSxuOOJvFPjrobfT63BEbu3tB7FzEes-ylUbXp33RCEZ6XPX1ZRQSf1D7vtHhrvcbie8NwINecGMZ4rp4MrwNNCgJHHvKVeZbZqF8KJYjT5E3DU Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 8ef9725c71164a6d9a8f39ec80a73748 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ef9725c71164a6d9a8f39ec80a73748"}]}] Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 8ef9725c71164a6d9a8f39ec80a73748 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestNetworkBasicOps-1116002528-project Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 97cb465affcf4b328550d1f7b4dfeddf Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestNetworkBasicOps-1116002528-project Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 177f5120-17fb-48d8-858a-3699143d1934 could not be found. Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '177f5120-17fb-48d8-858a-3699143d1934'} Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177f5120-17fb-48d8-858a-3699143d1934 could not be found. Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177f5120-17fb-48d8-858a-3699143d1934 could not be found. Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:02.728959 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177f5120-17fb-48d8-858a-3699143d1934 could not be found. Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Returning 404 to user: Instance 177f5120-17fb-48d8-858a-3699143d1934 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-560d5006-8e28-4119-9cca-774079db176d tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934" status: 404 len: 111 microversion: 2.1 time: 0.033730 Oct 02 01:43:02.735528 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3175/6166] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:02 2022] GET /compute/v2.1/servers/177f5120-17fb-48d8-858a-3699143d1934 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:43:02.896293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5673383a-f617-43a0-9c9c-7ddde7277980 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '.version_select at 0x7fb88014b040>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:02.901618 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:02.918310 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5673383a-f617-43a0-9c9c-7ddde7277980 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2006708913" status: 202 len: 0 microversion: 2.1 time: 0.025776 Oct 02 01:43:02.919610 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2992/6167] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:43:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2006708913 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:43:03.358748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:03.360042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:03.366072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:03.366566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:03.367042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:03.367749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:03.368213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:03.368642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:03.517932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:03.527074 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-093b2c2e-7161-4f06-87d4-ad6b79607e25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.172317 Oct 02 01:43:03.528393 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3176/6168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:03 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:04.552349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:04.552987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:04.560041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.560530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.560973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:04.561687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.562148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.562582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:04.694117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:04.694652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:04.703228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.704268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.705041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:04.705899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.706585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.707035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:04.734654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:43:04.738562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:04.746813 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-86d9bd5c-e7e6-4b39-9a64-eb206932a8f6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.199547 Oct 02 01:43:04.747659 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2993/6169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:04 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:04.753766 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8295c364-55a4-497d-a412-ee3c7efe7b12 req-31f16fde-0533-47fb-a956-ed89e951b9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0940e3a4-9bcd-464b-ad4d-d81998e98724", "tag": "c0cd7af5-808e-439c-a694-8e39f3858072"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:04.764811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8295c364-55a4-497d-a412-ee3c7efe7b12 req-31f16fde-0533-47fb-a956-ed89e951b9e1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.765342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8295c364-55a4-497d-a412-ee3c7efe7b12 req-31f16fde-0533-47fb-a956-ed89e951b9e1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.766037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8295c364-55a4-497d-a412-ee3c7efe7b12 req-31f16fde-0533-47fb-a956-ed89e951b9e1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:04.781230 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8295c364-55a4-497d-a412-ee3c7efe7b12 req-31f16fde-0533-47fb-a956-ed89e951b9e1 service nova] Creating event network-changed:c0cd7af5-808e-439c-a694-8e39f3858072 for instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 on n-h1-master-1 Oct 02 01:43:04.786206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8295c364-55a4-497d-a412-ee3c7efe7b12 req-31f16fde-0533-47fb-a956-ed89e951b9e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Oct 02 01:43:04.787183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2994/6170] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:04.825238 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc78eed2-56f0-4cbe-af55-da85a0af244a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 204 len: 0 microversion: 2.1 time: 0.133499 Oct 02 01:43:04.826692 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3177/6171] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:43:04 2022] DELETE /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:43:04.835978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:04.836890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:04.846349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.847112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.847858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:04.848853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:04.849535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:04.849957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:05.017959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:05.025805 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f24ce349-308c-4f20-96a2-c127464eea32 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1672 microversion: 2.1 time: 0.194551 Oct 02 01:43:05.026376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2995/6172] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:04 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:05.771460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:05.772181 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:05.780085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:05.780939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:05.781400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:05.782283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:05.782920 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:05.783365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:05.914747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:05.922776 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7532dad5-1704-4fce-bbf9-818e61ab898d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.155838 Oct 02 01:43:05.923365 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3178/6173] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:05 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:06.051229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:06.051979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:06.059429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:06.060013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:06.060549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:06.061361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:06.061889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:06.062388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:06.241913 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:06.250043 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-549a0bb1-d266-4f9b-a46f-5bce30b98873 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1672 microversion: 2.1 time: 0.202884 Oct 02 01:43:06.250646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2996/6174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:06 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:06.946069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:06.946726 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:06.955564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b9f88dd6-1648-4d7c-b2aa-f20ad39e8ade req-9d6a873c-3714-4b6d-9687-edb8f3dc13f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0940e3a4-9bcd-464b-ad4d-d81998e98724", "name": "network-vif-deleted", "tag": "c0cd7af5-808e-439c-a694-8e39f3858072"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:06.959262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:06.960015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:06.960700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:06.961633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:06.963622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:06.964264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:06.966407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b9f88dd6-1648-4d7c-b2aa-f20ad39e8ade req-9d6a873c-3714-4b6d-9687-edb8f3dc13f5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:06.966923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b9f88dd6-1648-4d7c-b2aa-f20ad39e8ade req-9d6a873c-3714-4b6d-9687-edb8f3dc13f5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:06.967561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b9f88dd6-1648-4d7c-b2aa-f20ad39e8ade req-9d6a873c-3714-4b6d-9687-edb8f3dc13f5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:06.981325 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b9f88dd6-1648-4d7c-b2aa-f20ad39e8ade req-9d6a873c-3714-4b6d-9687-edb8f3dc13f5 service nova] Creating event network-vif-deleted:c0cd7af5-808e-439c-a694-8e39f3858072 for instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 on n-h1-master-1 Oct 02 01:43:06.986274 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b9f88dd6-1648-4d7c-b2aa-f20ad39e8ade req-9d6a873c-3714-4b6d-9687-edb8f3dc13f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Oct 02 01:43:06.987162 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2997/6175] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:07.114230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:07.124295 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9dbd24a9-c25e-4601-bea2-270d7845d445 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.182467 Oct 02 01:43:07.125052 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3179/6176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:06 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:07.275376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:07.276083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:07.282390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:07.282914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:07.283349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:07.284049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:07.284694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:07.284912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:07.323494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:07.323987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:07.325160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:07.325771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lazy-loading 'fault' on Instance uuid 0940e3a4-9bcd-464b-ad4d-d81998e98724 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:43:07.367662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:07.376270 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49d3c652-b291-4b1a-9ded-899b20297ba3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 200 len: 1339 microversion: 2.1 time: 0.105954 Oct 02 01:43:07.376861 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2998/6177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:07 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:08.148036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:08.148663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:08.155764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:08.156251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:08.156689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:08.157387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:08.157839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:08.158265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:08.297950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:08.306495 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-15ef6da0-c09c-4019-bb48-6204260a09a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.162525 Oct 02 01:43:08.307133 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3180/6178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:08 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:08.400293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:08.400947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 0940e3a4-9bcd-464b-ad4d-d81998e98724] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:08.408289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:08.408779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:08.409221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:08.409926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:08.410391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:08.410843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:08.425437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] HTTP exception thrown: Instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 could not be found. Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Request method failure captured: Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 HTTP/1.1 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOwIiEqtW-ToDSUxBioiXIm1J2ASp6rbslBfSobFbIC7S8wBm_hKv-oWRzYa3Z45hSxuOOJvFPjrobfT63BEbu3tB7FzEes-ylUbXp33RCEZ6XPX1ZRQSf1D7vtHhrvcbie8NwINecGMZ4rp4MrwNNCgJHHvKVeZbZqF8KJYjT5E3DU Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8ef9725c71164a6d9a8f39ec80a73748 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ef9725c71164a6d9a8f39ec80a73748"}]}] Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8ef9725c71164a6d9a8f39ec80a73748 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestNetworkBasicOps-1116002528-project Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 97cb465affcf4b328550d1f7b4dfeddf Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestNetworkBasicOps-1116002528-project Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 could not be found. Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0940e3a4-9bcd-464b-ad4d-d81998e98724'} Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 could not be found. Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 could not be found. Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:08.427140 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 could not be found. Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Returning 404 to user: Instance 0940e3a4-9bcd-464b-ad4d-d81998e98724 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0bcfe6a-290e-4ec1-bec9-69e79e632a98 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724" status: 404 len: 111 microversion: 2.1 time: 0.032219 Oct 02 01:43:08.432102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 2999/6179] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:08 2022] GET /compute/v2.1/servers/0940e3a4-9bcd-464b-ad4d-d81998e98724 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:43:08.596095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66138e62-6af2-4013-b3af-d363a6a71ed8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '.version_select at 0x7fb8813821f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:08.616355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66138e62-6af2-4013-b3af-d363a6a71ed8 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2101670972" status: 202 len: 0 microversion: 2.1 time: 0.024215 Oct 02 01:43:08.620484 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3181/6180] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2101670972 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:43:09.330893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:09.331616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:09.337686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:09.338247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:09.338748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:09.339446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:09.340521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:09.341083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:09.545583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:09.554891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6ea75228-d63b-4320-9b0f-97e7d295b892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.227751 Oct 02 01:43:09.555736 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3000/6181] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:09 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:10.434472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-59a233d5-7a19-4af6-aadd-aba9c2ccfbc3 req-f45745dc-dd28-4aa5-8a96-23cee3004e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252c8da8-df46-4dd8-8980-f3310008edfb", "name": "network-vif-plugged", "status": "completed", "tag": "6d4a9709-b506-44e8-ad06-33e5c75eb0b5"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:10.445263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-59a233d5-7a19-4af6-aadd-aba9c2ccfbc3 req-f45745dc-dd28-4aa5-8a96-23cee3004e3b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:10.445820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-59a233d5-7a19-4af6-aadd-aba9c2ccfbc3 req-f45745dc-dd28-4aa5-8a96-23cee3004e3b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:10.446447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-59a233d5-7a19-4af6-aadd-aba9c2ccfbc3 req-f45745dc-dd28-4aa5-8a96-23cee3004e3b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:10.457138 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-59a233d5-7a19-4af6-aadd-aba9c2ccfbc3 req-f45745dc-dd28-4aa5-8a96-23cee3004e3b service nova] Creating event network-vif-plugged:6d4a9709-b506-44e8-ad06-33e5c75eb0b5 for instance 252c8da8-df46-4dd8-8980-f3310008edfb on n-h2-master-1 Oct 02 01:43:10.462192 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-59a233d5-7a19-4af6-aadd-aba9c2ccfbc3 req-f45745dc-dd28-4aa5-8a96-23cee3004e3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168525 Oct 02 01:43:10.463097 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3182/6182] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:10.582001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:10.582656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:10.592371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:10.593938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:10.594557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:10.596257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:10.596808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:10.597257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:10.802450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:10.812086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-224714fc-7ebd-4fe8-80c5-9cdd7b414618 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1203 microversion: 2.1 time: 0.237190 Oct 02 01:43:10.812782 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3001/6183] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:10 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1203 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:11.837191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:11.837972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:11.845817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:11.846226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:11.846684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:11.847392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:11.847847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:11.848274 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.009023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:12.017326 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6b1b9f71-fa24-456b-9de9-e4647525e713 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1390 microversion: 2.1 time: 0.185446 Oct 02 01:43:12.018252 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3183/6184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:11 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:12.040725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:12.041279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:12.050738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.051235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.051671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.052466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.053023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.053457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.302645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:12.312772 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a4718b1-6849-4919-bf62-3595c734d69c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1390 microversion: 2.1 time: 0.275900 Oct 02 01:43:12.326939 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3002/6185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:12 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:12.336773 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:12.337441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:12.347218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.347980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.348418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.349136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.349595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.350078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.488596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:12.497384 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-62471469-98e8-496a-8698-503ce0729027 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1390 microversion: 2.1 time: 0.164888 Oct 02 01:43:12.497966 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3184/6186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:12 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:12.519258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:12.519757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:12.525987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.526498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.526973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.528510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.529957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.530392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.557055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:43:12.571479 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:12.640709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6a985c8-0297-48bc-bbce-be13c11685c4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 204 len: 0 microversion: 2.1 time: 0.124978 Oct 02 01:43:12.641259 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3003/6187] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:43:12 2022] DELETE /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:43:12.649771 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:12.650400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:12.657787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.658283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.658780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.659716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:12.660179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:12.660607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:12.807567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:12.810798 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:12.818223 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4434145a-ac45-4399-9125-6e761f711058 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1396 microversion: 2.1 time: 0.172458 Oct 02 01:43:12.818857 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3185/6188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:12 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1396 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:13.842476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:13.843373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:13.850299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:13.850834 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:13.851278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:13.851979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:13.852443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:13.852870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:13.989134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:13.997781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0cb03d9-719b-4f38-ae2c-6e1498761a54 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1396 microversion: 2.1 time: 0.160124 Oct 02 01:43:13.998561 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3004/6189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:13 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:15.020985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:15.021613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:15.029410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:15.030338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:15.030984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:15.032062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:15.032682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:15.033261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:15.077091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-80d6b804-a3b1-4d01-90d8-496ec147b889 req-b72de0c5-c650-4c8a-8700-a9a9d0548161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252c8da8-df46-4dd8-8980-f3310008edfb", "name": "network-vif-deleted", "tag": "6d4a9709-b506-44e8-ad06-33e5c75eb0b5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:15.099848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80d6b804-a3b1-4d01-90d8-496ec147b889 req-b72de0c5-c650-4c8a-8700-a9a9d0548161 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:15.100677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80d6b804-a3b1-4d01-90d8-496ec147b889 req-b72de0c5-c650-4c8a-8700-a9a9d0548161 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:15.101170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80d6b804-a3b1-4d01-90d8-496ec147b889 req-b72de0c5-c650-4c8a-8700-a9a9d0548161 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:15.128557 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:15.135003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-80d6b804-a3b1-4d01-90d8-496ec147b889 req-b72de0c5-c650-4c8a-8700-a9a9d0548161 service nova] Creating event network-vif-deleted:6d4a9709-b506-44e8-ad06-33e5c75eb0b5 for instance 252c8da8-df46-4dd8-8980-f3310008edfb on n-h2-master-1 Oct 02 01:43:15.140289 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ef46bd39-2f8e-423d-8bd1-b69c40720388 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1354 microversion: 2.1 time: 0.123758 Oct 02 01:43:15.140914 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3186/6190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:15 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:15.158781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-80d6b804-a3b1-4d01-90d8-496ec147b889 req-b72de0c5-c650-4c8a-8700-a9a9d0548161 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085587 Oct 02 01:43:15.160454 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3005/6191] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:43:16.165675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:16.166143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:16.179688 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:16.181291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:16.181752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:16.182489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:16.183024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:16.183542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:16.319089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:16.328003 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6bb2055e-af24-4fae-9749-5587da72e6c1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1188 microversion: 2.1 time: 0.167392 Oct 02 01:43:16.345141 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3187/6192] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:16 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1188 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:17.354068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:17.355507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:17.366183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:17.366712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:17.367163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:17.367882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:17.368346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:17.378187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:17.495077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:17.504688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af7863ca-6006-44e9-9adf-1fd3a761f409 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1188 microversion: 2.1 time: 0.155317 Oct 02 01:43:17.506925 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3006/6193] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:17 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1188 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:18.357460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-feb1a45e-3a8a-439c-9fbe-f1408cb31ac3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'create', calling method: .version_select at 0x7fb880a21e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1263451084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOk3zCf7CXVUUx+R54HjYmw6eNd1TbnkeZoMbcBUaa+iIZfDnIclG29rLYqN2BZrmB62Xtnb71FxMVFJjA9N3lcj0iey6i3nGvSUOK3n25sBwIT4sNGfFL3fctjIMxx3g=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:18.381441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-feb1a45e-3a8a-439c-9fbe-f1408cb31ac3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:43:18.388830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-feb1a45e-3a8a-439c-9fbe-f1408cb31ac3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for user 97cb465affcf4b328550d1f7b4dfeddf and project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:43:18.425562 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-feb1a45e-3a8a-439c-9fbe-f1408cb31ac3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.072429 Oct 02 01:43:18.427454 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3188/6194] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:43:18 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:18.530350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:18.531043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:18.547946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:18.548440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:18.549090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:18.550006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:18.550495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:18.551013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:18.658707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:18.696996 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05d3244d-c328-4533-b887-e5335644adec tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1188 microversion: 2.1 time: 0.171001 Oct 02 01:43:18.701064 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3007/6195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:18 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1188 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:19.726484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:19.727922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:19.735293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:19.736049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:19.736664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:19.737569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:19.738187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:19.738870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:19.823165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:19.832452 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80069350-c1f4-4002-b7e5-a82081ef47d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 200 len: 1188 microversion: 2.1 time: 0.111871 Oct 02 01:43:19.833046 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3189/6196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:19 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:19.893046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1059758118", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "0dc86a96-f135-4fb1-acbc-9d9fdeca677f"}], "key_name": "tempest-TestNetworkBasicOps-1263451084", "security_groups": [{"name": "tempest-secgroup-smoke-421308433"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:20.054066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] validate_networks() for [('0dc86a96-f135-4fb1-acbc-9d9fdeca677f', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:43:20.111367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:20.113963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:20.121591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:20.122404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:20.123053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:20.123988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:20.124642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:20.125076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:20.188923 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-697dfc61-c675-45e9-89c1-d9cc70f6d869 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action" status: 200 len: 24568 microversion: 2.1 time: 0.082122 Oct 02 01:43:20.196532 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3190/6197] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:43:20 2022] POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action => generated 24568 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:43:20.499531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:43:20.499961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:43:20.500506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:43:20.500924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:43:20.501342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:43:20.510536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:20.511849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:20.512345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:20.513093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:20.513551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:20.513985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:20.532710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:43:20.538270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Getting quotas for user 97cb465affcf4b328550d1f7b4dfeddf and project 8ef9725c71164a6d9a8f39ec80a73748. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:43:20.551689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:43:20.554069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:43:20.604165 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [63d7ff48-bdc8-4d35-bd10-24583cd97a28] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:43:20.855889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:20.856601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 252c8da8-df46-4dd8-8980-f3310008edfb] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:20.864847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:20.865365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:20.865978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:20.867031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:20.868267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:20.868868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:20.885380 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 252c8da8-df46-4dd8-8980-f3310008edfb could not be found. Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb HTTP/1.1 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 252c8da8-df46-4dd8-8980-f3310008edfb could not be found. Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '252c8da8-df46-4dd8-8980-f3310008edfb'} Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252c8da8-df46-4dd8-8980-f3310008edfb could not be found. Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252c8da8-df46-4dd8-8980-f3310008edfb could not be found. Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:20.887999 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252c8da8-df46-4dd8-8980-f3310008edfb could not be found. Oct 02 01:43:20.893156 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:20.895171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 252c8da8-df46-4dd8-8980-f3310008edfb could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:43:20.896061 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6729272e-5ce9-49a6-a2b5-75acbb8c053d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb" status: 404 len: 111 microversion: 2.1 time: 0.044605 Oct 02 01:43:20.896651 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3191/6198] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:20 2022] GET /compute/v2.1/servers/252c8da8-df46-4dd8-8980-f3310008edfb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:43:21.611866 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [63d7ff48-bdc8-4d35-bd10-24583cd97a28] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 51360. Oct 02 01:43:21.615881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9901eede-a3e0-40db-874b-c48b8a7531e1 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.732162 Oct 02 01:43:21.616971 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3008/6199] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:43:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:43:21.628619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c71dfd2a-d879-4678-85b7-278cfcac12f7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:21.629235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c71dfd2a-d879-4678-85b7-278cfcac12f7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:21.698492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c71dfd2a-d879-4678-85b7-278cfcac12f7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:21.706551 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c71dfd2a-d879-4678-85b7-278cfcac12f7 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1249 microversion: 2.1 time: 0.081810 Oct 02 01:43:21.707185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3192/6200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:21 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:22.732292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:22.733540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:22.744584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:22.745539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:22.746706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:22.748408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:22.749153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:22.749745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:22.834416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:22.844721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c69516db-c45f-4859-a520-ac0555d19bab tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1309 microversion: 2.1 time: 0.118223 Oct 02 01:43:22.846133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3009/6201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:22 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:23.873433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:23.874051 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:23.880332 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:23.882459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:23.883188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:23.883845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:23.884562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:23.885199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:23.885629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:24.038802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:24.047884 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e71ae891-6ee8-4a12-a023-f7113abfa52f tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.178893 Oct 02 01:43:24.048630 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3193/6202] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:23 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:24.380716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c68ffe88-12b0-4406-9216-abab57e062ec req-e96e7156-24c0-4d7a-b8a8-d5f450b0ce41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e0e7d-21c4-456e-8acd-380a10c63830", "tag": "4a8206b3-72c7-4972-b311-875c9489a917"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:24.394036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c68ffe88-12b0-4406-9216-abab57e062ec req-e96e7156-24c0-4d7a-b8a8-d5f450b0ce41 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:24.394959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c68ffe88-12b0-4406-9216-abab57e062ec req-e96e7156-24c0-4d7a-b8a8-d5f450b0ce41 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:24.395720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c68ffe88-12b0-4406-9216-abab57e062ec req-e96e7156-24c0-4d7a-b8a8-d5f450b0ce41 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:24.421394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c68ffe88-12b0-4406-9216-abab57e062ec req-e96e7156-24c0-4d7a-b8a8-d5f450b0ce41 service nova] Creating event network-changed:4a8206b3-72c7-4972-b311-875c9489a917 for instance 666e0e7d-21c4-456e-8acd-380a10c63830 on n-h2-master-1 Oct 02 01:43:24.429027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c68ffe88-12b0-4406-9216-abab57e062ec req-e96e7156-24c0-4d7a-b8a8-d5f450b0ce41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055918 Oct 02 01:43:24.429656 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3010/6203] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:25.076787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:25.078172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:25.086356 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:25.087047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:25.087586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:25.088373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:25.088905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:25.089439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:25.234156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:25.241990 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ed47bd1-28b3-425b-b2f3-9c221659a5eb tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.170513 Oct 02 01:43:25.254760 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3194/6204] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:25 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:25.974319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1070853351", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3e93663b-6d52-47c7-8e7e-e73f72cc7c8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:26.037999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:43:26.265981 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:26.266740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:26.273661 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:26.274223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:26.274765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:26.275530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:26.275995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:26.276437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:26.482581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:43:26.483098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:43:26.483643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:43:26.484113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:43:26.484593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:43:26.493497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:26.493988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:26.494416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:26.495173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:26.495625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:26.495905 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:26.496033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:26.504406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4e1f3ace-dcfe-4368-ac80-eebb306bc3a5 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.242944 Oct 02 01:43:26.504999 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3195/6205] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:26 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:26.513403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:43:26.518501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:43:26.581092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:43:26.583216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e93663b-6d52-47c7-8e7e-e73f72cc7c8b',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:43:26.713261 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee113907-f8c2-4a0b-a70d-d664e15bd156 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743510 Oct 02 01:43:26.714616 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3011/6206] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:43:26.727952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87a3e8d4-b004-48ad-9ca5-60cbd7a209a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:26.728573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87a3e8d4-b004-48ad-9ca5-60cbd7a209a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:26.788093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-87a3e8d4-b004-48ad-9ca5-60cbd7a209a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:26.796216 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87a3e8d4-b004-48ad-9ca5-60cbd7a209a5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1057 microversion: 2.1 time: 0.074349 Oct 02 01:43:26.796830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3196/6207] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:26 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:27.528173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:27.528768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:27.535039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:27.535518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:27.535955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:27.536638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:27.537092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:27.537516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:27.670220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:27.677825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed592272-5ff0-4695-af13-33adb3fcc9ff tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.154891 Oct 02 01:43:27.678401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3012/6208] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:27 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:27.821816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:27.822707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:27.830632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:27.831261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:27.831712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:27.832460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:27.832922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:27.833351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:27.897610 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:27.906312 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7ff65e5-d467-4ef5-aab7-344d2e2214bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1163 microversion: 2.1 time: 0.088528 Oct 02 01:43:27.906939 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3197/6209] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:27 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1163 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:28.702763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:28.704471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:28.712908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:28.713685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:28.714885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:28.715913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:28.716569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:28.717188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:28.867897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:28.877520 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6769fb6-8fb8-4dfb-9825-449397de1cdd tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.179782 Oct 02 01:43:28.891203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3013/6210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:28 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:28.930730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:28.932023 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:28.939712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:28.940434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:28.941065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:28.942013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:28.942655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:28.943244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:29.107257 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:29.115695 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ef78039-17f8-466d-88f4-3953e35a86f9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1215 microversion: 2.1 time: 0.190284 Oct 02 01:43:29.116294 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3198/6211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:28 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:29.340150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-fb9ab1cc-7b5e-451e-b924-22f02cd9b25e req-93759af7-136d-4d38-835f-f4d60b4b8b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb5b506-6aa2-472e-ba80-013dfadd8d84", "tag": "22e80e7c-064a-408f-9428-54f74b71629e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:29.351133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fb9ab1cc-7b5e-451e-b924-22f02cd9b25e req-93759af7-136d-4d38-835f-f4d60b4b8b2a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:29.352104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fb9ab1cc-7b5e-451e-b924-22f02cd9b25e req-93759af7-136d-4d38-835f-f4d60b4b8b2a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:29.352621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-fb9ab1cc-7b5e-451e-b924-22f02cd9b25e req-93759af7-136d-4d38-835f-f4d60b4b8b2a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:29.365463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-fb9ab1cc-7b5e-451e-b924-22f02cd9b25e req-93759af7-136d-4d38-835f-f4d60b4b8b2a service nova] Creating event network-changed:22e80e7c-064a-408f-9428-54f74b71629e for instance adb5b506-6aa2-472e-ba80-013dfadd8d84 on n-h1-master-1 Oct 02 01:43:29.372095 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-fb9ab1cc-7b5e-451e-b924-22f02cd9b25e req-93759af7-136d-4d38-835f-f4d60b4b8b2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035160 Oct 02 01:43:29.373310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3014/6212] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:29.903340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:29.904096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:29.910234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:29.910832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:29.911357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:29.912154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:29.912685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:29.913188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:30.061365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:30.070890 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c98cee6e-55ac-4b31-a719-8e7e0c2416be tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.171929 Oct 02 01:43:30.071654 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3199/6213] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:29 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:30.139603 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:30.140547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:30.148737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:30.149488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:30.149938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:30.150659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:30.151126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:30.152081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:30.311207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:30.320318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1431245-0420-4d02-952f-cf3e63ab4078 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1215 microversion: 2.1 time: 0.184736 Oct 02 01:43:30.321246 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3015/6214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:30 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:30.400725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0cbeb4cd-a89b-4641-a6d6-5c503e57059e req-0cdb1c89-676a-4eb9-8925-bcde3c2406a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e0e7d-21c4-456e-8acd-380a10c63830", "name": "network-vif-plugged", "status": "completed", "tag": "4a8206b3-72c7-4972-b311-875c9489a917"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:30.413396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0cbeb4cd-a89b-4641-a6d6-5c503e57059e req-0cdb1c89-676a-4eb9-8925-bcde3c2406a0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:30.413937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0cbeb4cd-a89b-4641-a6d6-5c503e57059e req-0cdb1c89-676a-4eb9-8925-bcde3c2406a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:30.414372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0cbeb4cd-a89b-4641-a6d6-5c503e57059e req-0cdb1c89-676a-4eb9-8925-bcde3c2406a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:30.428226 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0cbeb4cd-a89b-4641-a6d6-5c503e57059e req-0cdb1c89-676a-4eb9-8925-bcde3c2406a0 service nova] Creating event network-vif-plugged:4a8206b3-72c7-4972-b311-875c9489a917 for instance 666e0e7d-21c4-456e-8acd-380a10c63830 on n-h2-master-1 Oct 02 01:43:30.434357 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0cbeb4cd-a89b-4641-a6d6-5c503e57059e req-0cdb1c89-676a-4eb9-8925-bcde3c2406a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039887 Oct 02 01:43:30.435687 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3200/6215] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:31.096424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:31.097049 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:31.103600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:31.104094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:31.104664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:31.105994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:31.106428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:31.106886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:31.247613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:31.255673 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-215e68e2-82a7-4d8f-b056-91b8001b4347 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1374 microversion: 2.1 time: 0.163171 Oct 02 01:43:31.256462 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3016/6216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:31 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:31.344696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:31.345537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:31.351821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:31.352307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:31.352754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:31.353472 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:31.353934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:31.354364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:31.486620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:31.494462 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-514439df-8feb-428e-bd34-22cbca1ab01d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1215 microversion: 2.1 time: 0.155827 Oct 02 01:43:31.506663 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3201/6217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:31 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:32.280770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:32.281384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:32.284159 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:32.289462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:32.289950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:32.290385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:32.291120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:32.291577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:32.292110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:32.427383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:32.437503 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bcf7f775-2218-45a5-a6f3-704a591ffd69 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1546 microversion: 2.1 time: 0.161288 Oct 02 01:43:32.438091 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3017/6218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:32 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:32.460582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:32.461211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:32.468059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:32.468562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:32.469011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:32.469723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:32.470261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:32.470733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:32.519450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:32.520497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:32.526939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:32.527733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:32.528269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:32.529074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:32.529772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:32.530422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:32.669389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:32.678357 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2bb38fb2-c8d2-479e-9503-9a543a030d20 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1546 microversion: 2.1 time: 0.221720 Oct 02 01:43:32.679278 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3202/6219] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:32 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1546 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:32.707755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:32.717449 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-484a57cd-fc0e-4606-8748-7117671e352b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1215 microversion: 2.1 time: 0.201937 Oct 02 01:43:32.718237 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3018/6220] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:32 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:33.740175 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:33.741466 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:33.748369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:33.748856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:33.749289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:33.750019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:33.751079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:33.751524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:34.007314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:34.015925 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1e888088-7ead-4b8b-b485-0bc2a18594f2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.279591 Oct 02 01:43:34.016512 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3203/6221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:33 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:34.707993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3c603eb2-bbe9-4700-89a5-837198ddb4a7 req-82b913db-3344-46b0-bbbc-6cbe39445737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e0e7d-21c4-456e-8acd-380a10c63830", "tag": "4a8206b3-72c7-4972-b311-875c9489a917"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:34.720713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3c603eb2-bbe9-4700-89a5-837198ddb4a7 req-82b913db-3344-46b0-bbbc-6cbe39445737 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:34.721201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3c603eb2-bbe9-4700-89a5-837198ddb4a7 req-82b913db-3344-46b0-bbbc-6cbe39445737 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:34.721794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3c603eb2-bbe9-4700-89a5-837198ddb4a7 req-82b913db-3344-46b0-bbbc-6cbe39445737 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:34.737240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3c603eb2-bbe9-4700-89a5-837198ddb4a7 req-82b913db-3344-46b0-bbbc-6cbe39445737 service nova] Creating event network-changed:4a8206b3-72c7-4972-b311-875c9489a917 for instance 666e0e7d-21c4-456e-8acd-380a10c63830 on n-h2-master-1 Oct 02 01:43:34.743116 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3c603eb2-bbe9-4700-89a5-837198ddb4a7 req-82b913db-3344-46b0-bbbc-6cbe39445737 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038797 Oct 02 01:43:34.744319 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3019/6222] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:35.039887 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:35.040593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:35.048645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:35.049463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:35.049966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:35.050945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:35.051473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:35.052023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:35.199294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:35.209205 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2c6ca203-58b8-4057-a6a8-62bc895ea144 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.173448 Oct 02 01:43:35.209832 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3204/6223] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:35 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:36.233975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:36.234701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:36.240863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:36.241341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:36.241776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:36.242523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:36.243140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:36.243586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:36.374174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:36.384041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9eb0e1d-9de1-404d-be20-049342f7b2fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.154938 Oct 02 01:43:36.385090 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3020/6224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:36 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:37.408518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:37.409128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:37.411954 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:37.417357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:37.417929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:37.418369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:37.419103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:37.419563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:37.419990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:37.554114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:37.562786 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8caff216-9286-4bd1-a549-6a9963f2834e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.158215 Oct 02 01:43:37.563375 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3205/6225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:37 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:38.585550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:38.586155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:38.588142 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:38.588893 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:38.595579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:38.596068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:38.596507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:38.597202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:38.597658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:38.598089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:38.724792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:38.733498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3fd50e5b-b6e3-4d36-8379-ca554ecdfeee tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.151822 Oct 02 01:43:38.734076 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3021/6226] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:38 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:39.756385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:39.757009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:39.763991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:39.764501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:39.764929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:39.765635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:39.766098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:39.766531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:39.895167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:39.904760 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-71ca4600-506b-4dba-bded-f925443603cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.152287 Oct 02 01:43:39.905381 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3206/6227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:39 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:40.931537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:40.932155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:40.939706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:40.940196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:40.940643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:40.941334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:40.941792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:40.942221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:41.073671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:41.081415 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-89234b7d-9add-49c8-98df-2e8e33593d7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.154084 Oct 02 01:43:41.081988 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3022/6228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:40 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:42.103949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:42.104946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:42.111537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:42.112023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:42.112463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:42.113159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:42.113619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:42.114048 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:42.117970 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:42.244006 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:42.252727 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4b060ec-c3e1-4ce2-8708-7a9c16572ca0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.152740 Oct 02 01:43:42.253326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3207/6229] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:42 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:43.276091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:43.277241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:43.284145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:43.284634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:43.285073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:43.285770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:43.286225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:43.286681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:43.290560 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:43.421266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:43.429146 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9ced115-56cd-427e-8d71-65f2baa47962 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.157026 Oct 02 01:43:43.429788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3023/6230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:43 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:43.969922 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-08d89822-84d4-4b2c-b3a8-7bb1c44cd7b4 req-470f112b-6d7e-47fb-9455-c3cac295a232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb5b506-6aa2-472e-ba80-013dfadd8d84", "name": "network-vif-plugged", "status": "completed", "tag": "22e80e7c-064a-408f-9428-54f74b71629e"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:43.982008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-08d89822-84d4-4b2c-b3a8-7bb1c44cd7b4 req-470f112b-6d7e-47fb-9455-c3cac295a232 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:43.982574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-08d89822-84d4-4b2c-b3a8-7bb1c44cd7b4 req-470f112b-6d7e-47fb-9455-c3cac295a232 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:43.983118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-08d89822-84d4-4b2c-b3a8-7bb1c44cd7b4 req-470f112b-6d7e-47fb-9455-c3cac295a232 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:43.998587 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-08d89822-84d4-4b2c-b3a8-7bb1c44cd7b4 req-470f112b-6d7e-47fb-9455-c3cac295a232 service nova] Creating event network-vif-plugged:22e80e7c-064a-408f-9428-54f74b71629e for instance adb5b506-6aa2-472e-ba80-013dfadd8d84 on n-h1-master-1 Oct 02 01:43:44.003590 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-08d89822-84d4-4b2c-b3a8-7bb1c44cd7b4 req-470f112b-6d7e-47fb-9455-c3cac295a232 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037606 Oct 02 01:43:44.004198 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3208/6231] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:44.452570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:44.453188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:44.459947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:44.460429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:44.460859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:44.461545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:44.461999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:44.462422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:44.592878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:44.602902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ddb9b68a-33c9-4e57-a4f1-b244cc26efc0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1203 microversion: 2.1 time: 0.154663 Oct 02 01:43:44.603566 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3024/6232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:44 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:45.626386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:45.627116 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:45.633248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:45.633731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:45.634163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:45.634881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:45.635339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:45.635764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:45.768191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:45.776028 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88d1f78c-bdca-4d71-b907-b27598269c02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1389 microversion: 2.1 time: 0.154939 Oct 02 01:43:45.777193 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3209/6233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:45 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:45.799134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:45.799741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:45.806859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:45.807355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:45.807912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:45.808624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:45.809119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:45.809560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:45.945669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:45.957038 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-15bdb2f2-1ed1-4cd3-ae51-638f10bdc341 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1389 microversion: 2.1 time: 0.161326 Oct 02 01:43:45.957987 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3025/6234] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:45 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:45.980792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:45.981421 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:45.987674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:45.988166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:45.989039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:45.989323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:45.989788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:45.990219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:46.124683 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:46.132576 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-99c92926-167b-4896-8079-ffefdb269e52 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1389 microversion: 2.1 time: 0.155815 Oct 02 01:43:46.133151 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3210/6235] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:45 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:46.155152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:46.155645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:46.161573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:46.162039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:46.162472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:46.163187 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:46.163638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:46.164059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:46.188596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:43:46.265005 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1166c16d-95f9-481a-89e6-bddf3c422275 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 204 len: 0 microversion: 2.1 time: 0.113600 Oct 02 01:43:46.265854 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3026/6236] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:43:46 2022] DELETE /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:43:46.274109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:46.274772 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:46.281527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:46.282005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:46.282441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:46.283156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:46.283609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:46.284032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:46.419707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:46.427620 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aaf33d74-8b8f-4059-bbd1-b48d61312bb5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1395 microversion: 2.1 time: 0.157417 Oct 02 01:43:46.428212 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3211/6237] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:46 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:47.452703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:47.453405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:47.460174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:47.460661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:47.461097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:47.461777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:47.462229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:47.462673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:47.593473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:47.601404 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afa18645-475f-4d4a-a609-e3d434aa8a02 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1395 microversion: 2.1 time: 0.153782 Oct 02 01:43:47.601980 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3027/6238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:47 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:48.625233 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:48.625946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:48.633222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:48.633802 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:48.634332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:48.635074 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:48.635566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:48.635991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:48.701590 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:48.709613 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50cc0e33-ba6f-4cef-8522-68f30c6090f1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1353 microversion: 2.1 time: 0.088617 Oct 02 01:43:48.710204 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3212/6239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:48 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:48.756233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-719ee534-5c4f-4df1-b552-35ce9fd71437 req-a092f902-5ce6-4ad6-8e88-04adb10d574d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb5b506-6aa2-472e-ba80-013dfadd8d84", "name": "network-vif-deleted", "tag": "22e80e7c-064a-408f-9428-54f74b71629e"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:48.767456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-719ee534-5c4f-4df1-b552-35ce9fd71437 req-a092f902-5ce6-4ad6-8e88-04adb10d574d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:48.767939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-719ee534-5c4f-4df1-b552-35ce9fd71437 req-a092f902-5ce6-4ad6-8e88-04adb10d574d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:48.768368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-719ee534-5c4f-4df1-b552-35ce9fd71437 req-a092f902-5ce6-4ad6-8e88-04adb10d574d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:48.780035 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-719ee534-5c4f-4df1-b552-35ce9fd71437 req-a092f902-5ce6-4ad6-8e88-04adb10d574d service nova] Creating event network-vif-deleted:22e80e7c-064a-408f-9428-54f74b71629e for instance adb5b506-6aa2-472e-ba80-013dfadd8d84 on n-h1-master-1 Oct 02 01:43:48.785118 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-719ee534-5c4f-4df1-b552-35ce9fd71437 req-a092f902-5ce6-4ad6-8e88-04adb10d574d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032509 Oct 02 01:43:48.785721 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3028/6240] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:43:49.732861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:49.733512 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:49.740593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:49.741083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:49.741527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:49.742225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:49.742711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:49.743152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:49.809823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:49.817985 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1e7cc06-5025-41ce-ac10-5c9549dd1d9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1188 microversion: 2.1 time: 0.089110 Oct 02 01:43:49.818577 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3213/6241] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:49 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:50.606909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:50.608230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:50.614476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:50.614996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:50.615430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:50.616154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:50.616608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:50.617029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:50.749166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ac3a127-4422-4f11-addf-b79ff54b4ef9 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1831 microversion: 2.1 time: 0.147270 Oct 02 01:43:50.749760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3029/6242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:50 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1831 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:50.772582 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:50.773196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:50.780499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:50.780989 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:50.781430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:50.782134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:50.782592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:50.783053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:50.841654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:50.842270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:50.848673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:50.849162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:50.849597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:50.850290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:50.850784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:50.851209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:50.932107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:50.941138 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-375ea725-8a72-427a-9bd6-9cc1b1b8c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1188 microversion: 2.1 time: 0.103485 Oct 02 01:43:50.941858 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3030/6243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:50 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:43:50.959670 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:50.969206 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-35ffd01f-7c52-4b42-b363-0552a24e5f9c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1680 microversion: 2.1 time: 0.200345 Oct 02 01:43:50.969814 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3214/6244] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:50 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:51.065951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:51.068254 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:51.074468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.074852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.075409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.076119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.076584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.077020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.142252 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-681a39d1-af30-45c4-902b-b0d783ee2304 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action" status: 200 len: 32640 microversion: 2.1 time: 0.080023 Oct 02 01:43:51.142980 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3031/6245] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:43:51 2022] POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action => generated 32640 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:43:51.333629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:51.334213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:51.340586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.341080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.341523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.342230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.342722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.343195 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.438476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '78162c558ced44a9991f777185a2dfcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3001c93c94c45fe9cd98aabdae3af9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:51.439126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] flavor_id is None. Assuming migration. {{(pid=122355) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 02 01:43:51.439567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122355) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:43:51.602304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c324c212-9237-41e4-95f2-d0478a7437b5 tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action" status: 202 len: 0 microversion: 2.1 time: 0.272520 Oct 02 01:43:51.606831 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3215/6246] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:43:51 2022] POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:43:51.612597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:51.613315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:51.621696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.622297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.623149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.623807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.624362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.624988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.783265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:51.792411 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b982caa8-62a2-439d-830c-66a0a0cec386 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1689 microversion: 2.1 time: 0.183847 Oct 02 01:43:51.793144 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3032/6247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:51 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:51.964365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:51.965036 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:51.972224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.972720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.973161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:51.973858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:51.974311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:51.974787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:52.045990 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:52.056367 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c81b1947-0cff-4d17-92b9-f5587229f771 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1188 microversion: 2.1 time: 0.096916 Oct 02 01:43:52.056978 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3216/6248] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:51 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:52.817099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:52.817832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:52.825523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:52.826037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:52.826462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:52.827203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:52.827669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:52.828096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:52.983010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:52.992191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e8aaaab8-6838-48c5-bbb2-abcc9940a77e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1689 microversion: 2.1 time: 0.179062 Oct 02 01:43:52.992799 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3033/6249] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:52 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:53.080414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:53.081150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:53.088816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:53.089311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:53.089821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:53.090774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:53.091243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:53.091813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:53.125298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:53.125708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:53.126226 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:53.126798 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lazy-loading 'fault' on Instance uuid adb5b506-6aa2-472e-ba80-013dfadd8d84 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:43:53.169465 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:53.177658 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c4245c83-6f0c-4bc5-8db9-fdf1af329171 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 200 len: 1193 microversion: 2.1 time: 0.101186 Oct 02 01:43:53.178247 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3217/6250] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:53 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:54.017786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:54.018400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:54.025209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:54.025690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:54.026121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:54.026833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:54.027854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:54.028278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:54.161914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:54.169822 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d06f80d9-f6b3-4d14-887e-7ceaf8b66125 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.155884 Oct 02 01:43:54.170406 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3034/6251] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:54 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:54.201734 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:54.202368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: adb5b506-6aa2-472e-ba80-013dfadd8d84] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:54.205230 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=56 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:54.210468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:54.211003 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:54.211447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:54.212148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:54.212620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:54.213055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:54.226629 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance adb5b506-6aa2-472e-ba80-013dfadd8d84 could not be found. Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 HTTP/1.1 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: exception: Instance adb5b506-6aa2-472e-ba80-013dfadd8d84 could not be found. Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'adb5b506-6aa2-472e-ba80-013dfadd8d84'} Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb5b506-6aa2-472e-ba80-013dfadd8d84 could not be found. Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb5b506-6aa2-472e-ba80-013dfadd8d84 could not be found. Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:43:54.228225 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb5b506-6aa2-472e-ba80-013dfadd8d84 could not be found. Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance adb5b506-6aa2-472e-ba80-013dfadd8d84 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7dcac177-7c0e-47d5-a765-bbdc65788904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84" status: 404 len: 111 microversion: 2.1 time: 0.032485 Oct 02 01:43:54.234182 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3218/6252] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:54 2022] GET /compute/v2.1/servers/adb5b506-6aa2-472e-ba80-013dfadd8d84 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:43:55.193670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:55.194403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:55.201659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:55.202153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:55.202631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:55.203333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:55.203799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:55.204229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:55.338468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:55.347015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe17d381-3b93-4bd5-a504-0bb598f99115 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.157224 Oct 02 01:43:55.347605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3035/6253] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:55 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:56.371476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:56.372096 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:56.379521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:56.380154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:56.380587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:56.381375 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:56.381836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:56.382314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:56.530564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:56.538873 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d4db9087-e6f1-427d-ba9c-82a3b1027947 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.172090 Oct 02 01:43:56.539526 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3219/6254] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:56 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:57.000057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:43:57.002243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:57.009773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:57.010270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:57.010738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:57.011989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:57.012620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:57.013056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:57.081352 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7d13dc5f-4aa6-405c-9129-a0933913d21e tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830/action" status: 200 len: 24567 microversion: 2.1 time: 0.085444 Oct 02 01:43:57.082015 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3036/6255] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:43:56 2022] POST /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:43:57.563018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:57.563548 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:57.573413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:57.574864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:57.575443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:57.576357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:57.576990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:57.577618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:57.754423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:57.765462 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e837d948-0cd8-4b1d-9258-1ef05450290e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.205972 Oct 02 01:43:57.766655 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3220/6256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:57 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:58.789906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:58.790763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:58.798580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:58.799095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:58.799532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:58.800231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:58.800686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:58.801112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:58.949520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:43:58.957944 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6790589-06a4-4c5c-9af5-84360b0a2aae tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.172455 Oct 02 01:43:58.959401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3037/6257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:58 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:43:59.981949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:43:59.983210 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:43:59.990311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:59.990835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:59.991277 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:43:59.991977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:43:59.992434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:43:59.992872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:00.133837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:00.143122 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47de7dfd-41f2-4743-93b0-669c720bd61a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.165663 Oct 02 01:44:00.143713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3221/6258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:43:59 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:01.166201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:01.166860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:01.173863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:01.174481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:01.174950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:01.175863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:01.176330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:01.176759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:01.332235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:01.340294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca85b9a8-7afd-4ad8-9cbd-821da0ad3426 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.177814 Oct 02 01:44:01.341089 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3038/6259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:01 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:02.364037 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:02.365321 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:02.372924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:02.373413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:02.373853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:02.374555 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:02.375044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:02.375484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:02.515297 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:02.523575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6e450fcb-4b41-4023-94b5-decf181de2e0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.163303 Oct 02 01:44:02.524221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3222/6260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:02 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:03.547385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:03.548139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:03.550984 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:03.557155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:03.557650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:03.558212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:03.558971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:03.559448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:03.559876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:03.577735 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:03.592739 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:03.595974 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:03.604697 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:03.605864 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:03.606318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:03.607104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:03.607564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:03.608186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:03.612860 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:03.694211 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-972b67ea-4662-4654-b95b-43abdad6615a tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "POST /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830/action" status: 200 len: 32631 microversion: 2.1 time: 0.105911 Oct 02 01:44:03.702649 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3223/6261] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:44:03 2022] POST /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830/action => generated 32631 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:44:03.713373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:03.722184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc75bf8d-acbe-4ac1-8288-f14000a5c952 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.178617 Oct 02 01:44:03.723349 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3039/6262] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:03 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:04.749241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:04.751803 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:04.760275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.761183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.762246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:04.763276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.763843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.764351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:04.788823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:04.789321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:04.797442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.797934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.798369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:04.799103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.799850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.800288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:04.840947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:44:04.949130 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:04.958053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0fa1e5da-7ffd-4f25-9c00-1c467d5c0bcd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1694 microversion: 2.1 time: 0.214706 Oct 02 01:44:04.971806 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3224/6263] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:04 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:04.977435 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b984984-c972-4c91-b64c-9ceb610db022 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "DELETE /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 204 len: 0 microversion: 2.1 time: 0.192148 Oct 02 01:44:04.978331 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3040/6264] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:44:04 2022] DELETE /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:44:04.983413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-70301516-878d-47b1-b636-6a279d927d42 req-18cb493c-f4a4-43cc-b679-1c8ea7d2af19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e0e7d-21c4-456e-8acd-380a10c63830", "tag": "4a8206b3-72c7-4972-b311-875c9489a917"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:04.989035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:04.989762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:04.995631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70301516-878d-47b1-b636-6a279d927d42 req-18cb493c-f4a4-43cc-b679-1c8ea7d2af19 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.996523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.997010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.997459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:04.998110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70301516-878d-47b1-b636-6a279d927d42 req-18cb493c-f4a4-43cc-b679-1c8ea7d2af19 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.998250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:04.998621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:04.999137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:04.999263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-70301516-878d-47b1-b636-6a279d927d42 req-18cb493c-f4a4-43cc-b679-1c8ea7d2af19 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:05.018141 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-70301516-878d-47b1-b636-6a279d927d42 req-18cb493c-f4a4-43cc-b679-1c8ea7d2af19 service nova] Creating event network-changed:4a8206b3-72c7-4972-b311-875c9489a917 for instance 666e0e7d-21c4-456e-8acd-380a10c63830 on n-h2-master-1 Oct 02 01:44:05.028710 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-70301516-878d-47b1-b636-6a279d927d42 req-18cb493c-f4a4-43cc-b679-1c8ea7d2af19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052166 Oct 02 01:44:05.029749 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3225/6265] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:05.144077 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:05.154481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85ce8c84-e15f-4645-b65b-3617ac2cdb80 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1671 microversion: 2.1 time: 0.170737 Oct 02 01:44:05.162872 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3041/6266] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:04 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:05.986629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:05.987761 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:05.994433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:05.994887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:05.995332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:05.996919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:05.997388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:05.998250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:06.139817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:06.157650 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6713df16-a32c-4c76-ad49-e071f5dde174 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1693 microversion: 2.1 time: 0.175966 Oct 02 01:44:06.158564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3226/6267] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:05 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:06.179915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:06.180788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:06.192447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:06.193041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:06.193854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:06.194688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:06.195240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:06.195882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:06.357382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:06.365361 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-041c7a94-6460-484f-b050-4786fbf704a3 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1671 microversion: 2.1 time: 0.189605 Oct 02 01:44:06.377753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3042/6268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:06 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:07.052837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "name": "network-vif-unplugged", "status": "completed", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:07.101625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:07.102629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:07.103335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:07.131792 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] Creating event network-vif-unplugged:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h2-master-1 Oct 02 01:44:07.145904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:44:07.160518 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-91d2da03-a5aa-43c8-a6d9-4e33e0f03ccf req-3ab889d6-280d-484c-8cab-37d824b6a9f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117555 Oct 02 01:44:07.161493 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3227/6269] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:07.184469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:07.185887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:07.193136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:07.193622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:07.194801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:07.195746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:07.196365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:07.196957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:07.389766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:07.390472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:07.407578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:07.408333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:07.408777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:07.409525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:07.409984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:07.410415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:07.458544 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:07.468977 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfb037f4-07a8-4d54-94bf-bb69b8e120a0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1693 microversion: 2.1 time: 0.291024 Oct 02 01:44:07.471318 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3043/6270] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:07 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1693 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:07.480264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-49e7a9f2-e3b9-4ca7-8b8f-27baff8c74b7 req-7fb7c489-56c9-448a-aa23-4f61d70b3fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e0e7d-21c4-456e-8acd-380a10c63830", "name": "network-vif-deleted", "tag": "4a8206b3-72c7-4972-b311-875c9489a917"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:07.493743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cb465affcf4b328550d1f7b4dfeddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef9725c71164a6d9a8f39ec80a73748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:07.498750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-49e7a9f2-e3b9-4ca7-8b8f-27baff8c74b7 req-7fb7c489-56c9-448a-aa23-4f61d70b3fd9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:07.499539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-49e7a9f2-e3b9-4ca7-8b8f-27baff8c74b7 req-7fb7c489-56c9-448a-aa23-4f61d70b3fd9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:07.499990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-49e7a9f2-e3b9-4ca7-8b8f-27baff8c74b7 req-7fb7c489-56c9-448a-aa23-4f61d70b3fd9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:07.506936 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1b95838-ef85-4d6d-93d0-5608af11c256 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 200 len: 1485 microversion: 2.1 time: 0.121360 Oct 02 01:44:07.524091 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3228/6271] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:07 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 1485 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:07.524307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-49e7a9f2-e3b9-4ca7-8b8f-27baff8c74b7 req-7fb7c489-56c9-448a-aa23-4f61d70b3fd9 service nova] Creating event network-vif-deleted:4a8206b3-72c7-4972-b311-875c9489a917 for instance 666e0e7d-21c4-456e-8acd-380a10c63830 on n-h2-master-1 Oct 02 01:44:07.531149 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-49e7a9f2-e3b9-4ca7-8b8f-27baff8c74b7 req-7fb7c489-56c9-448a-aa23-4f61d70b3fd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055842 Oct 02 01:44:07.532328 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3044/6272] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:08.499473 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:08.500101 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:08.506951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:08.507433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:08.507867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:08.508628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:08.509062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:08.509492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:08.538871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:08.540183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] [instance: 666e0e7d-21c4-456e-8acd-380a10c63830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:08.551238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:08.552104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:08.552887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:08.554177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:08.555529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:08.556348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:08.588128 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] HTTP exception thrown: Instance 666e0e7d-21c4-456e-8acd-380a10c63830 could not be found. Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Request method failure captured: Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 HTTP/1.1 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOwIiEqtW-ToDSUxBioiXIm1J2ASp6rbslBfSobFbIC7S8wBm_hKv-oWRzYa3Z45hSxuOOJvFPjrobfT63BEbu3tB7FzEes-ylUbXp33RCEZ6XPX1ZRQSf1D7vtHhrvcbie8NwINecGMZ4rp4MrwNNCgJHHvKVeZbZqF8KJYjT5E3DU Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8ef9725c71164a6d9a8f39ec80a73748 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ef9725c71164a6d9a8f39ec80a73748"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ef9725c71164a6d9a8f39ec80a73748"}]}] Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8ef9725c71164a6d9a8f39ec80a73748 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestNetworkBasicOps-1116002528 Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestNetworkBasicOps-1116002528-project Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 97cb465affcf4b328550d1f7b4dfeddf Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestNetworkBasicOps-1116002528-project Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 666e0e7d-21c4-456e-8acd-380a10c63830 could not be found. Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '666e0e7d-21c4-456e-8acd-380a10c63830'} Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666e0e7d-21c4-456e-8acd-380a10c63830 could not be found. Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666e0e7d-21c4-456e-8acd-380a10c63830 could not be found. Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:44:08.592912 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666e0e7d-21c4-456e-8acd-380a10c63830 could not be found. Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Returning 404 to user: Instance 666e0e7d-21c4-456e-8acd-380a10c63830 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-360a338a-07ab-477b-989d-c32feada0e56 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830" status: 404 len: 111 microversion: 2.1 time: 0.063068 Oct 02 01:44:08.599405 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3045/6273] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:08 2022] GET /compute/v2.1/servers/666e0e7d-21c4-456e-8acd-380a10c63830 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:44:08.688117 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:08.696803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-780b9c9b-f121-4162-bcd0-fa893a5e90fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1691 microversion: 2.1 time: 0.201591 Oct 02 01:44:08.700300 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3229/6274] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:08 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1691 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:08.784114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a32f3a1-e7d5-41a8-85c3-49e835713b57 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] Calling method '.version_select at 0x7fb88003a5e0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:08.810886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a32f3a1-e7d5-41a8-85c3-49e835713b57 tempest-TestNetworkBasicOps-1116002528 tempest-TestNetworkBasicOps-1116002528-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1263451084" status: 202 len: 0 microversion: 2.1 time: 0.030638 Oct 02 01:44:08.815903 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3046/6275] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1263451084 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:44:09.200370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:09.209822 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:09.210403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:09.210938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:09.223307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] Creating event network-changed:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h2-master-1 Oct 02 01:44:09.228756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:44:09.241117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b33a1770-7db9-426c-ab95-51f839f811d8 req-d5f02190-b816-4d03-9831-514ac276bccd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045980 Oct 02 01:44:09.242033 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3230/6276] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:09.726558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:09.727880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:09.765386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:09.766207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:09.766899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:09.767870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:09.768582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:09.769229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:10.462258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:10.470915 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fe041e66-f9a2-4f17-8f3f-f6741f77192e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1691 microversion: 2.1 time: 0.750568 Oct 02 01:44:10.483516 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3047/6277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:09 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1691 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:11.496957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:11.498962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:11.506345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:11.506872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:11.507521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:11.508431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:11.509059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:11.509657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:11.799298 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:11.808665 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ad1898f-3f50-49bc-8a25-e3f786cffe95 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1688 microversion: 2.1 time: 0.317018 Oct 02 01:44:11.824755 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3231/6278] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:11 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1688 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:11.833601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:11.836488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:11.844746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:11.845554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:11.846212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:11.847246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:11.848162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:11.848668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:12.052846 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aaa056cd-6cc2-4dc4-9bb0-e9ab9f4a4297 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action" status: 202 len: 0 microversion: 2.1 time: 0.222899 Oct 02 01:44:12.053872 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3048/6279] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:44:11 2022] POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:44:12.065273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:12.066084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:12.077578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:12.078432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:12.079419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:12.080848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:12.081927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:12.082663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:12.553829 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:12.567733 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4949fe88-beee-44d5-9a8c-1bd1e87b7349 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.506197 Oct 02 01:44:12.569189 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3232/6280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:12 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:12.712336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "name": "network-vif-plugged", "status": "completed", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:12.759024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:12.759508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:12.760169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:12.778401 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] Creating event network-vif-plugged:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h2-master-1 Oct 02 01:44:12.787509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:44:12.808596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-caa25188-7dc3-492e-a733-e51715cf8f19 req-18f7f116-717a-4b34-b712-932a815b1c3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104742 Oct 02 01:44:12.809962 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3049/6281] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:13.595957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:13.598538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:13.637553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:13.639748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:13.642810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:13.643677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:13.644268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:13.645215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:13.899828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:13.914020 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06495bf9-1b56-4ed7-8c36-c173db6f5cc2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.325310 Oct 02 01:44:13.926696 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3233/6282] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:13 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:14.942730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:14.943619 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:14.951653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:14.951994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:14.952590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:14.953485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:14.953947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:14.954378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:15.095333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:15.104192 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bd2336f-5178-484b-a1c0-1e9dfcc1f8be tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.167030 Oct 02 01:44:15.104834 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3050/6283] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:14 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:16.130283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:16.130971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:16.142639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:16.143198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:16.143820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:16.144451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:16.144977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:16.145424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:16.397066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:16.413256 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89694d90-3110-4d80-82e6-812086fabd9f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.286590 Oct 02 01:44:16.438713 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3234/6284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:16 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:16.696281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "name": "network-vif-unplugged", "status": "completed", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:16.707783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:16.708179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:16.708762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:16.728900 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] Creating event network-vif-unplugged:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:44:16.737301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:44:16.781818 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9c444e7d-292c-4899-a0ae-e9d6805057ec req-0f834a60-56e2-42b2-aaf3-d7c4d486eb06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089292 Oct 02 01:44:16.783062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3051/6285] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:17.443650 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:17.444595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:17.452716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:17.453439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:17.453878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:17.455007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:17.455814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:17.456432 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:17.669672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:17.694700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3e68d4be-d586-4d3b-b7e9-5590ad46fe9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.253486 Oct 02 01:44:17.695470 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3235/6286] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:17 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:17.811908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2052087640", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2df2a2fc-77f0-4a51-9b6f-2c5d83613021", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:17.903738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:44:18.314465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:44:18.314922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:44:18.315398 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:44:18.315808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:44:18.316251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:44:18.325678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:18.326147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:18.326580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:18.327334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:18.327819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:18.328245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:18.346652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:44:18.352341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:44:18.367074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:44:18.369499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2df2a2fc-77f0-4a51-9b6f-2c5d83613021',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:44:18.445386 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1089f58-1b38-4644-b963-3e46a1c5430b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638678 Oct 02 01:44:18.450755 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3052/6287] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:44:18.457985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ab4454b7-6788-466b-80ce-c9d0047a2dc4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:18.458792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ab4454b7-6788-466b-80ce-c9d0047a2dc4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:18.524190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ab4454b7-6788-466b-80ce-c9d0047a2dc4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:18.533320 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ab4454b7-6788-466b-80ce-c9d0047a2dc4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1057 microversion: 2.1 time: 0.079686 Oct 02 01:44:18.533989 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3236/6288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:18 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1057 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:18.721153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:18.722389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:18.731293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:18.731293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:18.731801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:18.732537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:18.732999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:18.733429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:18.804622 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:18.815634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:18.817450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:18.818089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:18.832515 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] Creating event network-changed:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:44:18.839957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:44:18.852888 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-dab9999e-769d-4e2b-8e8e-badb6b7cfa05 req-42cedb14-32c9-4e28-b5db-5b4e1857ab93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051850 Oct 02 01:44:18.854140 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3237/6289] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:44:18.925988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:18.944408 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-92e6db73-36e1-4916-a4a0-42b824a8e95c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.229063 Oct 02 01:44:18.944998 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3053/6290] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:18 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:19.558968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:19.559554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:19.569882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:19.570704 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:19.571125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:19.571834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:19.572286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:19.572888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:19.682860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:19.699288 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-beedb503-9fbc-4af4-a61b-1e9b108f8ae3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1109 microversion: 2.1 time: 0.146605 Oct 02 01:44:19.710930 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3238/6291] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:19 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1109 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:19.968350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:19.968976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:19.976111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:19.976603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:19.977039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:19.977742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:19.978197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:19.978647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:20.239205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:20.252019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7bc2790-3390-4ad0-9996-6ecd045d1d5a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1687 microversion: 2.1 time: 0.288112 Oct 02 01:44:20.254907 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3054/6292] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:19 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1687 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:20.724741 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:20.725443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:20.744285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:20.745886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:20.749518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:20.754391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:20.757731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:20.775085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:21.285801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:21.287109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:21.301005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:21.301500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:21.305416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:21.308280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:21.310673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:21.313767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:21.422374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:21.432108 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-43bb1907-d5e7-49be-a740-7d71963c77a9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.712297 Oct 02 01:44:21.436382 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3239/6293] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:20 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:21.638559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:21.647184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b397910-cded-4f05-b619-8cf686917322 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1680 microversion: 2.1 time: 0.370062 Oct 02 01:44:21.650293 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3055/6294] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:21 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1680 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:22.460341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:22.460966 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:22.476385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:22.476923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:22.478708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:22.482465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:22.482997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:22.483444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:22.506493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-caf50be9-ddc1-4404-ad7f-d54c8d74d778 req-4af3b2ef-6218-4b3a-a0a4-da2e895efe13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81115f5f-c4ed-4e5f-8ac5-081dedff0daa", "tag": "d19e8e10-eed7-4488-8b6c-5e1373c65331"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:22.533691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-caf50be9-ddc1-4404-ad7f-d54c8d74d778 req-4af3b2ef-6218-4b3a-a0a4-da2e895efe13 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:22.534505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-caf50be9-ddc1-4404-ad7f-d54c8d74d778 req-4af3b2ef-6218-4b3a-a0a4-da2e895efe13 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:22.535135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-caf50be9-ddc1-4404-ad7f-d54c8d74d778 req-4af3b2ef-6218-4b3a-a0a4-da2e895efe13 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:22.551778 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:22.561615 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-caf50be9-ddc1-4404-ad7f-d54c8d74d778 req-4af3b2ef-6218-4b3a-a0a4-da2e895efe13 service nova] Creating event network-changed:d19e8e10-eed7-4488-8b6c-5e1373c65331 for instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa on n-h2-master-1 Oct 02 01:44:22.580193 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-caf50be9-ddc1-4404-ad7f-d54c8d74d778 req-4af3b2ef-6218-4b3a-a0a4-da2e895efe13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077240 Oct 02 01:44:22.581586 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3056/6295] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:22.848585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:22.859654 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-56e4ae91-71a1-4bac-9f7b-e9d099e6af92 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.403615 Oct 02 01:44:22.876218 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3240/6296] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:22 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:23.896555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:23.897994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:23.911348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:23.912203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:23.912907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:23.913863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:23.914629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:23.915616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:24.254352 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:24.267658 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e7227ce-164c-470a-bdea-4087a2ee0216 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.381987 Oct 02 01:44:24.269579 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3057/6297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:23 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:24.375368 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-147e0ab3-722e-4b22-a0ae-dc34c82137a3 req-0d16d54c-dc73-434e-bcbb-9f8a678ca472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "name": "network-vif-plugged", "status": "completed", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:24.392162 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=48 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:24.397858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-147e0ab3-722e-4b22-a0ae-dc34c82137a3 req-0d16d54c-dc73-434e-bcbb-9f8a678ca472 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:24.398422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-147e0ab3-722e-4b22-a0ae-dc34c82137a3 req-0d16d54c-dc73-434e-bcbb-9f8a678ca472 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:24.403242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-147e0ab3-722e-4b22-a0ae-dc34c82137a3 req-0d16d54c-dc73-434e-bcbb-9f8a678ca472 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:24.421012 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-147e0ab3-722e-4b22-a0ae-dc34c82137a3 req-0d16d54c-dc73-434e-bcbb-9f8a678ca472 service nova] Creating event network-vif-plugged:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:44:24.438292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-147e0ab3-722e-4b22-a0ae-dc34c82137a3 req-0d16d54c-dc73-434e-bcbb-9f8a678ca472 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068057 Oct 02 01:44:24.439483 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3241/6298] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:25.306208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:25.308918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:25.349388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:25.352596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:25.352926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:25.353989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:25.359588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:25.361138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:25.609420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:25.625058 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b060292f-6301-40a1-9684-497c544ec869 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.333477 Oct 02 01:44:25.625898 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3058/6299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:25 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:26.670513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:26.673086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:26.691007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:26.693363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:26.694483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:26.698763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:26.699445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:26.699886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:26.915352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:26.934125 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f140c88-40af-4581-b1ca-87333b52d11f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.279858 Oct 02 01:44:26.939101 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3242/6300] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:26 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:27.990058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:27.990968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:27.999551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:28.000701 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:28.001535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:28.002984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:28.002984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:28.003554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:28.202296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:28.213948 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd21b4a2-ceab-40a9-87e7-f47803c8f057 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.228708 Oct 02 01:44:28.215799 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3059/6301] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:27 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:29.250536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:29.257164 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:29.273219 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:29.277179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:29.277943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:29.278625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:29.279552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:29.280043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:29.280856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:29.301972 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:29.572031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:29.581201 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-73731864-b07c-4f63-93c7-0cf8f8f1fdad tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.343251 Oct 02 01:44:29.582311 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3243/6302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:29 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:30.611930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:30.613517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:30.615953 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:30.616838 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:30.642717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:30.643670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:30.649150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:30.649982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:30.650460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:30.652205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:31.044093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:31.058155 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0c1eca9-b071-4b8d-bb24-aa75ce39e939 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.449993 Oct 02 01:44:31.071073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3060/6303] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:30 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:32.082930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:32.083776 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:32.095753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:32.096396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:32.098265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:32.100267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:32.112658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:32.115856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:32.360424 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:32.370763 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0f053c3-5443-41d6-83cc-7e368c029688 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.292026 Oct 02 01:44:32.372162 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3244/6304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:32 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:33.397702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:33.398326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:33.417050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:33.418168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:33.418852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:33.419765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:33.420543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:33.421142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:33.607402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:33.616081 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a53ea35b-39ab-41c0-92c5-b1ff98c61113 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.222320 Oct 02 01:44:33.617064 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3061/6305] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:33 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:33.883204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-971f4614-ab28-40ea-b5ee-615f1db51a05 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Action: 'create', calling method: .version_select at 0x7fb8811fc9d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-900716902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/gy6ierFCfQ213WNcjFyBidVeZy4KDhcI1u1ctiqJUZykpobaliOLKb0ciGL1E9zH1GJyro8oVYoJifzkj2WJ1Eb5ZEz2Q+Jize20kCduT1XSSy/LITL5g1vGHrN2dfw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:33.900532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-971f4614-ab28-40ea-b5ee-615f1db51a05 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Getting quotas for project 5d7ab191bb4e4b21a8a4011d8cd93f86. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:44:33.912393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-971f4614-ab28-40ea-b5ee-615f1db51a05 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Getting quotas for user 73a7c1c4929d49aea6e4e492e32ccafd and project 5d7ab191bb4e4b21a8a4011d8cd93f86. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:44:33.941668 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-971f4614-ab28-40ea-b5ee-615f1db51a05 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.247853 Oct 02 01:44:33.942894 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3245/6306] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:44:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:34.642957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:34.643587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:34.651542 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:34.653251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:34.653924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:34.654798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:34.655720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:34.656360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:34.656963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:34.832133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:34.841456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b89343f-2551-48c9-98ec-7c3cff9512de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.203122 Oct 02 01:44:34.842476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3062/6307] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:34 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:35.072176 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2084467693", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-900716902", "security_groups": [{"name": "tempest-secgroup-smoke-1716912786"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7b5a7ae2-54ea-46b1-8511-596318301a2a"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:35.195393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] validate_networks() for [('7b5a7ae2-54ea-46b1-8511-596318301a2a', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:44:35.629381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Getting quotas for project 5d7ab191bb4e4b21a8a4011d8cd93f86. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:44:35.634710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Getting quotas for user 73a7c1c4929d49aea6e4e492e32ccafd and project 5d7ab191bb4e4b21a8a4011d8cd93f86. Resources: dict_keys(['metadata_items']) {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:44:35.648849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:44:35.649275 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:44:35.649756 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:44:35.650167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:44:35.650640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:44:35.662455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:35.663412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:35.663853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:35.664592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:35.665056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:35.665502 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:35.690853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Getting quotas for project 5d7ab191bb4e4b21a8a4011d8cd93f86. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:44:35.696343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Getting quotas for user 73a7c1c4929d49aea6e4e492e32ccafd and project 5d7ab191bb4e4b21a8a4011d8cd93f86. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:44:35.710412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:44:35.712730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:44:35.770117 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-026d0a9d-70a3-4e0c-8243-1389280a2006 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704041 Oct 02 01:44:35.771281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3246/6308] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:44:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:44:35.782348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f39f886a-96a1-4b88-878c-e49f4508a5bf tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:35.783122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f39f886a-96a1-4b88-878c-e49f4508a5bf tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:35.844788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f39f886a-96a1-4b88-878c-e49f4508a5bf tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:35.854562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f39f886a-96a1-4b88-878c-e49f4508a5bf tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1302 microversion: 2.1 time: 0.075506 Oct 02 01:44:35.855322 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3063/6309] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:35 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1302 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:35.870984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:35.871862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:35.879101 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:35.879592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:35.881141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:35.881870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:35.882331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:35.882795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:36.101655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:36.111928 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-890bd417-0b64-44fe-8b7e-5a17dd91e6cf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.247243 Oct 02 01:44:36.112910 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3247/6310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:35 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:36.878743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:36.879368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:36.887400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:36.887935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:36.888382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:36.889112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:36.889578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:36.890013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:36.986176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:36.998435 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e06154cf-fce6-4c09-98b3-2be2d8fe9722 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1354 microversion: 2.1 time: 0.123484 Oct 02 01:44:37.003251 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3064/6311] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:36 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:37.143586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:37.143986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:37.167109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:37.167955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:37.169738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:37.171777 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:37.172387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:37.172935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:37.376791 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:37.387784 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-585fd603-a0f2-4522-8873-875e392fabc5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1169 microversion: 2.1 time: 0.248317 Oct 02 01:44:37.388691 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3248/6312] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:37 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1169 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:38.025935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:38.026759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:38.036522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:38.037586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:38.040035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:38.041721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:38.043225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:38.044267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:38.272735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:38.290407 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed6a2f96-e263-48a2-9058-6499162a9f2a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.268419 Oct 02 01:44:38.298726 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3065/6313] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:38 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:38.417894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:38.418539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:38.426513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:38.427032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:38.428010 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:38.430338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:38.431248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:38.433621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:38.591792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:38.602170 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-98f62a3b-3978-4679-b2c9-d4b433691246 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1215 microversion: 2.1 time: 0.193475 Oct 02 01:44:38.603318 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3249/6314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:38 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:38.945635 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-07586b28-c1ee-48f0-a6f4-66b32232621f req-a3ec9780-a619-416e-ba6f-095eb8960160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87bb0b2-6b83-47f7-860b-e631a4e894dd", "tag": "e5b5609a-4abe-42af-86b6-4a5076181904"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:38.956240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-07586b28-c1ee-48f0-a6f4-66b32232621f req-a3ec9780-a619-416e-ba6f-095eb8960160 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:38.957023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-07586b28-c1ee-48f0-a6f4-66b32232621f req-a3ec9780-a619-416e-ba6f-095eb8960160 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:38.957456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-07586b28-c1ee-48f0-a6f4-66b32232621f req-a3ec9780-a619-416e-ba6f-095eb8960160 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:38.969624 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-07586b28-c1ee-48f0-a6f4-66b32232621f req-a3ec9780-a619-416e-ba6f-095eb8960160 service nova] Creating event network-changed:e5b5609a-4abe-42af-86b6-4a5076181904 for instance d87bb0b2-6b83-47f7-860b-e631a4e894dd on n-h2-master-1 Oct 02 01:44:38.976955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-07586b28-c1ee-48f0-a6f4-66b32232621f req-a3ec9780-a619-416e-ba6f-095eb8960160 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033843 Oct 02 01:44:38.978170 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3066/6315] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:39.317025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:39.317554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:39.323905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:39.324399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:39.324835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:39.325545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:39.325998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:39.326419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:39.466849 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:39.474756 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4d349cd-52d2-49d7-83f6-389ae36c3788 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.161678 Oct 02 01:44:39.475425 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3250/6316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:39 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:39.627758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:39.628452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:39.660386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:39.660879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:39.661439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:39.662151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:39.662622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:39.663047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:39.800082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:39.808693 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd405877-f114-4316-b2c8-d0a027c16a15 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.186170 Oct 02 01:44:39.809276 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3067/6317] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:39 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:40.498052 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:40.498693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:40.505559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:40.506044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:40.506482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:40.507199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:40.507655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:40.508080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:40.642885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:40.651003 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ff63846-84a0-4fd3-8616-6deb91a33e9f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.157063 Oct 02 01:44:40.651583 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3251/6318] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:40 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:40.831431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:40.831976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:40.838809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:40.839290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:40.839722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:40.840427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:40.840880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:40.841301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:40.973113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:40.981409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3e604c9-ae83-4074-86f5-6f3d705b147b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.154006 Oct 02 01:44:40.981991 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3068/6319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:40 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:41.673279 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:41.673915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:41.680946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:41.681446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:41.681923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:41.682734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:41.683192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:41.683615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:41.821039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:41.829254 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ad878d70-48bb-43f2-846e-a521c4a3d485 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.159815 Oct 02 01:44:41.829834 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3252/6320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:41 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:42.004642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:42.005263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:42.012733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:42.013223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:42.013660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:42.014411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:42.014846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:42.015276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:42.148090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:42.155886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8035a38-48de-4fc2-891f-3031877e5935 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.155210 Oct 02 01:44:42.156470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3069/6321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:41 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:42.852707 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:42.853380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:42.860968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:42.861459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:42.861952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:42.862689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:42.863150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:42.863583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:42.997380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:43.005329 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-50bb4878-b4e2-489a-b1f0-8fe9203f58e1 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.156517 Oct 02 01:44:43.005934 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3253/6322] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:42 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:43.178387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:43.179040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:43.186409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:43.186938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:43.187355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:43.188054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:43.188504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:43.188953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:43.325512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:43.333342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b1fc12e-c551-4df4-8495-e3e26b45bff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.158871 Oct 02 01:44:43.333920 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3070/6323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:43 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:44.028914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:44.029534 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:44.036388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:44.036878 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:44.037317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:44.038016 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:44.038477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:44.038935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:44.169799 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:44.177639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3372c87b-5787-49d4-8eb8-4c756eaa0d21 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.153185 Oct 02 01:44:44.178221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3254/6324] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:44 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:44.356036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:44.356666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:44.363895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:44.364388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:44.364824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:44.365521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:44.365982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:44.366411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:44.501015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:44.509371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ec5a7b1-d163-49aa-88e9-d6d7b699e778 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.157290 Oct 02 01:44:44.510511 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3071/6325] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:44 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:44.800723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-3ff5e450-1be2-4cad-87ab-8a732bcabee1 req-2d9055f6-6e5e-4b69-92f8-dd781908793e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87bb0b2-6b83-47f7-860b-e631a4e894dd", "name": "network-vif-plugged", "status": "completed", "tag": "e5b5609a-4abe-42af-86b6-4a5076181904"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:44.811390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3ff5e450-1be2-4cad-87ab-8a732bcabee1 req-2d9055f6-6e5e-4b69-92f8-dd781908793e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:44.811954 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3ff5e450-1be2-4cad-87ab-8a732bcabee1 req-2d9055f6-6e5e-4b69-92f8-dd781908793e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:44.812387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3ff5e450-1be2-4cad-87ab-8a732bcabee1 req-2d9055f6-6e5e-4b69-92f8-dd781908793e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:44.824357 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-3ff5e450-1be2-4cad-87ab-8a732bcabee1 req-2d9055f6-6e5e-4b69-92f8-dd781908793e service nova] Creating event network-vif-plugged:e5b5609a-4abe-42af-86b6-4a5076181904 for instance d87bb0b2-6b83-47f7-860b-e631a4e894dd on n-h2-master-1 Oct 02 01:44:44.829298 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-3ff5e450-1be2-4cad-87ab-8a732bcabee1 req-2d9055f6-6e5e-4b69-92f8-dd781908793e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032365 Oct 02 01:44:44.830078 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3255/6326] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:44:45.201661 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:45.202307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:45.208308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:45.208785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:45.209219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:45.209900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:45.210348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:45.210816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:45.341556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:45.349208 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfd095c0-0095-43f4-93f5-061a0bfecc44 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1428 microversion: 2.1 time: 0.152187 Oct 02 01:44:45.349777 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3072/6327] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:45 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:45.536311 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:45.536927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:45.543608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:45.544090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:45.544524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:45.545207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:45.545660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:45.546085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:45.675365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:45.682195 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:45.684959 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1fb84e76-8af7-4388-8b26-50a99c4b2fd5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.153875 Oct 02 01:44:45.685541 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3256/6328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:45 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:46.372583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:46.373212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:46.376266 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:46.383488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.384195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.385107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.385824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.386284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.386740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.524878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:46.533317 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-799962e3-0bcd-4aae-b2ad-0c1825a95ff7 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1608 microversion: 2.1 time: 0.165691 Oct 02 01:44:46.533886 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3073/6329] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:46 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1608 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:46.557098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:46.557717 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:46.559880 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:46.566256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.566768 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.567209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.567893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.568346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.568767 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.703038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:46.707608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:46.707794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:46.712268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4ef694a-4bb4-4506-8dc7-36a71060f74a tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1608 microversion: 2.1 time: 0.159829 Oct 02 01:44:46.714192 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3257/6330] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:46 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1608 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:46.714343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.714850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.715306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.716023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.716484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.716920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.738132 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:46.739376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:46.747298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.748286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.748800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.749577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:46.750744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:46.751958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:46.910996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:46.920579 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9bda9dca-9e07-4d3b-85d1-44e5e08b40b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.217122 Oct 02 01:44:46.921174 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3074/6331] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:46 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:46.939628 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:46.947548 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72640881-f9d9-4081-9ad0-2b9a0e83ee1b tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1608 microversion: 2.1 time: 0.214689 Oct 02 01:44:46.948128 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3258/6332] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:46 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1608 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:47.943615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:47.944213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:47.951908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:47.952470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:47.952975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:47.953739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:47.954265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:47.954794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:47.960776 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:48.164484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:48.173169 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-87d0fe89-b042-4a37-8e52-16593f70a915 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.233357 Oct 02 01:44:48.173770 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3075/6333] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:47 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:48.727696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b47721c4-e6f0-4120-ba71-e51e71d15390 req-fe0f3ee0-26e3-4408-9836-045ee57f4680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87bb0b2-6b83-47f7-860b-e631a4e894dd", "tag": "e5b5609a-4abe-42af-86b6-4a5076181904"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:48.739002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b47721c4-e6f0-4120-ba71-e51e71d15390 req-fe0f3ee0-26e3-4408-9836-045ee57f4680 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:48.739531 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b47721c4-e6f0-4120-ba71-e51e71d15390 req-fe0f3ee0-26e3-4408-9836-045ee57f4680 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:48.740001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b47721c4-e6f0-4120-ba71-e51e71d15390 req-fe0f3ee0-26e3-4408-9836-045ee57f4680 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:48.755077 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b47721c4-e6f0-4120-ba71-e51e71d15390 req-fe0f3ee0-26e3-4408-9836-045ee57f4680 service nova] Creating event network-changed:e5b5609a-4abe-42af-86b6-4a5076181904 for instance d87bb0b2-6b83-47f7-860b-e631a4e894dd on n-h2-master-1 Oct 02 01:44:48.760207 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b47721c4-e6f0-4120-ba71-e51e71d15390 req-fe0f3ee0-26e3-4408-9836-045ee57f4680 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035935 Oct 02 01:44:48.761350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3259/6334] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:48.867347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9a7d7da5-7694-46e1-89c3-9194c1fb4279 req-446ee179-4eb5-43cd-9179-646c7a76e1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81115f5f-c4ed-4e5f-8ac5-081dedff0daa", "name": "network-vif-plugged", "status": "completed", "tag": "d19e8e10-eed7-4488-8b6c-5e1373c65331"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:48.882316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9a7d7da5-7694-46e1-89c3-9194c1fb4279 req-446ee179-4eb5-43cd-9179-646c7a76e1d9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:48.883167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9a7d7da5-7694-46e1-89c3-9194c1fb4279 req-446ee179-4eb5-43cd-9179-646c7a76e1d9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:48.883833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9a7d7da5-7694-46e1-89c3-9194c1fb4279 req-446ee179-4eb5-43cd-9179-646c7a76e1d9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:48.897787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9a7d7da5-7694-46e1-89c3-9194c1fb4279 req-446ee179-4eb5-43cd-9179-646c7a76e1d9 service nova] Creating event network-vif-plugged:d19e8e10-eed7-4488-8b6c-5e1373c65331 for instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa on n-h2-master-1 Oct 02 01:44:48.906347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9a7d7da5-7694-46e1-89c3-9194c1fb4279 req-446ee179-4eb5-43cd-9179-646c7a76e1d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043411 Oct 02 01:44:48.907494 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3076/6335] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:49.198652 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:49.199843 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:49.207100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:49.208029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:49.208730 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:49.209719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:49.210459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:49.211170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:49.531474 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:49.539443 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2194c84-7bd4-451a-bc89-b906decee0e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1203 microversion: 2.1 time: 0.345482 Oct 02 01:44:49.540121 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3260/6336] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:49 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1203 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:50.566980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:50.567681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:50.576389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:50.576888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:50.577331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:50.578039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:50.578583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:50.579123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:50.714031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:50.721781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfc114b7-7270-405f-b95f-d6fce6719558 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1390 microversion: 2.1 time: 0.160025 Oct 02 01:44:50.722346 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3077/6337] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:50 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:50.744574 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:50.745299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:50.752121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:50.752597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:50.753032 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:50.753719 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:50.754172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:50.754628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:50.886867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:50.894779 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0763d590-bba8-4206-968c-2eecac21cf50 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1390 microversion: 2.1 time: 0.154630 Oct 02 01:44:50.895396 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3261/6338] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:50 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:50.916855 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:50.917342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:50.923427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:50.923903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:50.924331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:50.925014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:50.925468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:50.925890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:51.060305 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:51.068001 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b99a920e-1c47-46c8-8697-bcc5f3639e0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1390 microversion: 2.1 time: 0.155749 Oct 02 01:44:51.068637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3078/6339] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:50 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:51.153343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:51.153841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:51.159812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:51.160299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:51.160740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:51.161430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:51.161887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:51.162316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:51.187861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:44:51.204304 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:51.265199 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2f716eda-1dc1-46e3-80d3-05f90be0d272 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 204 len: 0 microversion: 2.1 time: 0.115466 Oct 02 01:44:51.265812 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3262/6340] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:44:51 2022] DELETE /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:44:51.279285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:51.279989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:51.286252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:51.286769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:51.287202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:51.287890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:51.288361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:51.288762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:51.417745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:51.425632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-baef39aa-377b-4fed-a383-7aef71dfec14 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1396 microversion: 2.1 time: 0.152355 Oct 02 01:44:51.426227 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3079/6341] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:51 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:52.449902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:52.450655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:52.457534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:52.458021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:52.458507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:52.459349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:52.459797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:52.460217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:52.595288 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:52.603064 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4d9a1fb0-65d5-48fe-9e9f-cbdfa06c80d0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1396 microversion: 2.1 time: 0.157877 Oct 02 01:44:52.603695 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3263/6342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:52 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:53.476178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-680144aa-2a5d-4b4d-9498-61627cbd7366 req-cb835b7d-5e31-4335-8c7f-4828c88ce583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81115f5f-c4ed-4e5f-8ac5-081dedff0daa", "name": "network-vif-deleted", "tag": "d19e8e10-eed7-4488-8b6c-5e1373c65331"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:53.488454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-680144aa-2a5d-4b4d-9498-61627cbd7366 req-cb835b7d-5e31-4335-8c7f-4828c88ce583 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:53.488861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-680144aa-2a5d-4b4d-9498-61627cbd7366 req-cb835b7d-5e31-4335-8c7f-4828c88ce583 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:53.489297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-680144aa-2a5d-4b4d-9498-61627cbd7366 req-cb835b7d-5e31-4335-8c7f-4828c88ce583 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:53.503898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-680144aa-2a5d-4b4d-9498-61627cbd7366 req-cb835b7d-5e31-4335-8c7f-4828c88ce583 service nova] Creating event network-vif-deleted:d19e8e10-eed7-4488-8b6c-5e1373c65331 for instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa on n-h2-master-1 Oct 02 01:44:53.510940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-680144aa-2a5d-4b4d-9498-61627cbd7366 req-cb835b7d-5e31-4335-8c7f-4828c88ce583 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037748 Oct 02 01:44:53.512152 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3080/6343] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:44:53.625704 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:53.626376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:53.633458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:53.633947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:53.634386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:53.635567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:53.636387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:53.636824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:53.700136 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:53.708256 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-34322ee9-a112-409b-a10f-4153ddb4afe1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1188 microversion: 2.1 time: 0.086397 Oct 02 01:44:53.708848 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3264/6344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:53 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:54.732998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:54.733739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:54.741208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:54.741810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:54.742304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:54.743065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:54.743525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:54.743952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:54.810790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:54.818812 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d1941a3a-9658-4bfb-962a-063c4163da5f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1188 microversion: 2.1 time: 0.090889 Oct 02 01:44:54.819393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3081/6345] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:54 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:55.841836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:55.842462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:55.845253 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:55.850996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:55.851496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:55.851945 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:55.852649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:55.853109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:55.853541 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:55.926119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:55.936431 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3208ebe6-3aeb-4e8a-9fe4-108bad6b7d59 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1188 microversion: 2.1 time: 0.098978 Oct 02 01:44:55.937076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3265/6346] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:55 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:56.053807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:44:56.056416 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:56.063310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:56.063807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:56.064249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:56.064958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:56.065422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:56.065861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:56.139229 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-50f99ef2-7a0c-4246-97f6-8ec51fdbb429 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action" status: 200 len: 63102 microversion: 2.1 time: 0.214238 Oct 02 01:44:56.147466 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3082/6347] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:44:55 2022] POST /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7/action => generated 63102 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:44:56.960591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:56.961352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:56.969550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:56.970133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:56.970676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:56.971495 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:56.972111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:56.972720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:57.037878 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:57.045889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ef4f405-8278-46da-a935-9cb89521f028 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1188 microversion: 2.1 time: 0.089244 Oct 02 01:44:57.046473 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3266/6348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:56 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:44:58.070055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:58.070983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:58.078418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:58.078925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:58.079373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:58.080061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:58.081037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:58.081469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:58.116476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:58.117599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:58.118014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:58.118469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lazy-loading 'fault' on Instance uuid 81115f5f-c4ed-4e5f-8ac5-081dedff0daa {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:44:58.178133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:44:58.203201 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47944386-fd3f-4a67-97e6-31e810377c70 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 200 len: 1193 microversion: 2.1 time: 0.137900 Oct 02 01:44:58.207675 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3083/6349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:58 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 1193 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:44:59.227423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:44:59.228071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:44:59.235443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:59.235933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:59.236369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:59.237062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:44:59.237515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:44:59.237943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:44:59.252355 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa HTTP/1.1 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '81115f5f-c4ed-4e5f-8ac5-081dedff0daa'} Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:44:59.254259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5e4a25d1-d950-4c79-b873-4096544155a8 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 404 len: 111 microversion: 2.1 time: 0.032251 Oct 02 01:44:59.263322 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3267/6350] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:44:59 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:45:01.405508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:01.406083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:01.413783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:01.414305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:01.414776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:01.415517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:01.416500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:01.416941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:01.431280 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa HTTP/1.1 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '81115f5f-c4ed-4e5f-8ac5-081dedff0daa'} Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:45:01.433853 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29c6ca76-553f-4e00-93db-0660d5595fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 404 len: 111 microversion: 2.1 time: 0.033727 Oct 02 01:45:01.438567 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3084/6351] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:45:01 2022] DELETE /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:45:01.444099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:01.445151 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 81115f5f-c4ed-4e5f-8ac5-081dedff0daa] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:01.452358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:01.452856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:01.453302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:01.454012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:01.454481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:01.454946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:01.469882 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa HTTP/1.1 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '81115f5f-c4ed-4e5f-8ac5-081dedff0daa'} Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:45:01.471748 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 81115f5f-c4ed-4e5f-8ac5-081dedff0daa could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6522891e-59c4-42ce-956f-aa1c4feae452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa" status: 404 len: 111 microversion: 2.1 time: 0.032894 Oct 02 01:45:01.482492 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3268/6352] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:01 2022] GET /compute/v2.1/servers/81115f5f-c4ed-4e5f-8ac5-081dedff0daa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:45:12.554566 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=49 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:12.555574 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=46 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:12.690222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:12.690869 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:12.697016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:12.697509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:12.697969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:12.698935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:12.699413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:12.699836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:12.833258 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ee8269f-7c54-4a68-bd53-e680c9e9317b tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1831 microversion: 2.1 time: 0.284275 Oct 02 01:45:12.833827 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3085/6353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:12 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1831 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:13.794413 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:13.799788 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:13.802930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-89cf0941-f27a-4b6b-b467-b7863ce6dc9b req-78f87d02-1aea-4e29-82ae-372fe63e10b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:13.813032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:13.813593 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:13.825870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:13.826509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:13.826986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:13.829473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89cf0941-f27a-4b6b-b467-b7863ce6dc9b req-78f87d02-1aea-4e29-82ae-372fe63e10b6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:13.830238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89cf0941-f27a-4b6b-b467-b7863ce6dc9b req-78f87d02-1aea-4e29-82ae-372fe63e10b6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:13.830698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-89cf0941-f27a-4b6b-b467-b7863ce6dc9b req-78f87d02-1aea-4e29-82ae-372fe63e10b6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:13.835525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:13.836024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:13.836600 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:13.851900 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-89cf0941-f27a-4b6b-b467-b7863ce6dc9b req-78f87d02-1aea-4e29-82ae-372fe63e10b6 service nova] Creating event network-changed:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:45:13.862209 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-89cf0941-f27a-4b6b-b467-b7863ce6dc9b req-78f87d02-1aea-4e29-82ae-372fe63e10b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064900 Oct 02 01:45:13.874055 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3086/6354] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:13.879853 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:45:14.076803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-48925de2-ed92-48b8-a9e2-f405e5aa7568 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 204 len: 0 microversion: 2.1 time: 0.283996 Oct 02 01:45:14.077568 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3269/6355] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:45:13 2022] DELETE /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:45:14.092796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:14.093942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:14.105085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:14.106005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:14.106795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:14.107870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:14.108770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:14.109451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:14.270393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:14.280039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1dd55968-e949-461c-8926-3e9882c2ab96 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1686 microversion: 2.1 time: 0.197810 Oct 02 01:45:14.296136 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3087/6356] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:14 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:15.303921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:15.304636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:15.312588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:15.313368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:15.314047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:15.315004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:15.315463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:15.316131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:15.471657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:15.479738 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-860ab218-2afd-4861-818e-6756f5fc853e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1686 microversion: 2.1 time: 0.180140 Oct 02 01:45:15.493737 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3270/6357] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:15 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:16.115868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4ed81f64-4f3b-4c42-802c-a9374abc7890 req-50ac75ab-8921-4fd9-8bb7-d1e89cfa51c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34219362-2a7a-49de-8def-cc7f0c01afa7", "name": "network-vif-deleted", "tag": "05732da5-5cd5-4cef-9711-531a92198092"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:16.127887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4ed81f64-4f3b-4c42-802c-a9374abc7890 req-50ac75ab-8921-4fd9-8bb7-d1e89cfa51c5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:16.128367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4ed81f64-4f3b-4c42-802c-a9374abc7890 req-50ac75ab-8921-4fd9-8bb7-d1e89cfa51c5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:16.128797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4ed81f64-4f3b-4c42-802c-a9374abc7890 req-50ac75ab-8921-4fd9-8bb7-d1e89cfa51c5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:16.141608 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4ed81f64-4f3b-4c42-802c-a9374abc7890 req-50ac75ab-8921-4fd9-8bb7-d1e89cfa51c5 service nova] Creating event network-vif-deleted:05732da5-5cd5-4cef-9711-531a92198092 for instance 34219362-2a7a-49de-8def-cc7f0c01afa7 on n-h1-master-1 Oct 02 01:45:16.146890 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4ed81f64-4f3b-4c42-802c-a9374abc7890 req-50ac75ab-8921-4fd9-8bb7-d1e89cfa51c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034596 Oct 02 01:45:16.147473 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3088/6358] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:16.503489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:16.504980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:16.512963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:16.513459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:16.513906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:16.514796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:16.515260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:16.515689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:16.554330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:16.554855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:16.555557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:16.556011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lazy-loading 'fault' on Instance uuid 34219362-2a7a-49de-8def-cc7f0c01afa7 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:45:16.599835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:16.609624 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc50c1cf-dd88-4817-b671-7945f2ad16b7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 200 len: 1355 microversion: 2.1 time: 0.109954 Oct 02 01:45:16.610643 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3271/6359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:16 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 1355 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:17.634683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:17.635390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 34219362-2a7a-49de-8def-cc7f0c01afa7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:17.642390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:17.642908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:17.643352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:17.644045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:17.644504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:17.644931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:17.660283 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] HTTP exception thrown: Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 could not be found. Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Request method failure captured: Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 HTTP/1.1 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOvg5Zmg9o_TDtbUvRXpqYE-3VU_epo8elpy_IlxV4Q6QbiFkzGK_scNqAy5NJuR5MFpAkMXv_wLKz-bjQomO3KR5D5dHY-NfrddVaFcktSN8lq_k0vMyudFZYsqdExvX-vWxG4ITF45xgcPnDsqSYSybUEQKvJNs-ZJ5siFXDAfuZ8 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7955fc0f32784de19c7e0bd32b5afe1b"}]}] Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 4ac7b60e4e094354a9692bb46c3ebf8d Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 could not be found. Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '34219362-2a7a-49de-8def-cc7f0c01afa7'} Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 could not be found. Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 could not be found. Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:17.661914 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 could not be found. Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Returning 404 to user: Instance 34219362-2a7a-49de-8def-cc7f0c01afa7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53bf5306-7a47-4fd7-9383-d0e1431828cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7" status: 404 len: 111 microversion: 2.1 time: 0.034194 Oct 02 01:45:17.671938 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3089/6360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:17 2022] GET /compute/v2.1/servers/34219362-2a7a-49de-8def-cc7f0c01afa7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:45:21.513012 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-03b3ec21-d037-4fce-921c-9c77b029eaa0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '.version_select at 0x7fb88103f700>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:21.533441 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-03b3ec21-d037-4fce-921c-9c77b029eaa0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-48284013" status: 202 len: 0 microversion: 2.1 time: 0.024937 Oct 02 01:45:21.534043 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3272/6361] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-48284013 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:45:21.571245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-adfb854d-7cc8-42f5-ba15-ec3243faef8c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: .version_select at 0x7fb87bfe0940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2030827957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHL5VmmEXYNN6NUlNfGs5u9wJYkqL5zSDIjBzGP3rC14ig4xGn19l+dYjTb4hdYqmEo6VCZtbP1t33sDZwl9YgY6Mux4+pi2MqvbDz/QeS1IdXbIPpbz2zRKLg43Os+sw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:21.588368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-adfb854d-7cc8-42f5-ba15-ec3243faef8c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:45:21.595048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-adfb854d-7cc8-42f5-ba15-ec3243faef8c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:45:21.618274 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-adfb854d-7cc8-42f5-ba15-ec3243faef8c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050894 Oct 02 01:45:21.618924 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3090/6362] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:45:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:22.389545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-38174727", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "266e8829-34a0-4f1b-8257-f4caa765799d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:22.457653 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:45:22.955859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:45:22.957198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:45:22.957876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:45:22.958613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:45:22.960303 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:45:22.972122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:22.972897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:22.973520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:22.974451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:22.974941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:22.975552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:23.004513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:45:23.010194 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:45:23.070018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:45:23.072235 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='266e8829-34a0-4f1b-8257-f4caa765799d',volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:45:23.208257 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b05bf931-0e14-4e22-b515-400340949727 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823361 Oct 02 01:45:23.209246 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3273/6363] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:45:23.220255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e7a1009-1289-4495-9039-79bc7ad0ce24 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:23.221469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e7a1009-1289-4495-9039-79bc7ad0ce24 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:23.346233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e7a1009-1289-4495-9039-79bc7ad0ce24 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:23.353626 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e7a1009-1289-4495-9039-79bc7ad0ce24 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1069 microversion: 2.1 time: 0.137251 Oct 02 01:45:23.369924 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3091/6364] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:23 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1069 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:24.380561 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:24.381135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:24.392134 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:24.392907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:24.393478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:24.394298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:24.394892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:24.395738 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:24.492668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:24.514460 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-93c7d2fa-3f86-4f55-b18a-5df314ed49de tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1185 microversion: 2.1 time: 0.134572 Oct 02 01:45:24.515097 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3274/6365] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:24 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:25.537403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:25.538460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:25.538989 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:25.539276 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:25.550644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:25.551084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:25.553677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:25.553969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:25.554471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:25.554877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:25.555035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:25.555877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:25.556759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:25.556936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:25.558206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:25.559010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:25.616391 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91dbb0f6-5a51-4a97-82d7-fead33b8c0f3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.078792 Oct 02 01:45:25.618889 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3275/6366] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:45:25 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd/os-server-password => generated 116 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:45:25.826296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:25.837388 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c2681b6a-0d97-468a-a500-915f100b392b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1227 microversion: 2.1 time: 0.303870 Oct 02 01:45:25.839272 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3092/6367] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:25 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1227 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:26.696956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8e804a61-e571-40d3-bb8f-5099d96de2ba req-4aa7cd14-75ca-4b35-b8d2-b3b8ffda9a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0106bc48-2f18-4fcf-b73d-284c905d40b0", "tag": "08972e19-036b-48f1-ac15-6082e5927819"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:26.718171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e804a61-e571-40d3-bb8f-5099d96de2ba req-4aa7cd14-75ca-4b35-b8d2-b3b8ffda9a85 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:26.725204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e804a61-e571-40d3-bb8f-5099d96de2ba req-4aa7cd14-75ca-4b35-b8d2-b3b8ffda9a85 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:26.725883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e804a61-e571-40d3-bb8f-5099d96de2ba req-4aa7cd14-75ca-4b35-b8d2-b3b8ffda9a85 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:26.758356 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8e804a61-e571-40d3-bb8f-5099d96de2ba req-4aa7cd14-75ca-4b35-b8d2-b3b8ffda9a85 service nova] Creating event network-changed:08972e19-036b-48f1-ac15-6082e5927819 for instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 on n-h1-master-1 Oct 02 01:45:26.776832 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8e804a61-e571-40d3-bb8f-5099d96de2ba req-4aa7cd14-75ca-4b35-b8d2-b3b8ffda9a85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211292 Oct 02 01:45:26.777809 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3276/6368] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:26.865100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:26.865662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:26.891736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:26.892230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:26.892667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:26.893384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:26.893844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:26.896902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:27.406867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:27.423375 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12cbc5e4-fa14-401b-8c0c-79c2f606050d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1227 microversion: 2.1 time: 0.563307 Oct 02 01:45:27.424574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3093/6369] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:26 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1227 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:28.451944 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:28.452662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:28.469641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:28.470342 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:28.471091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:28.471993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:28.472623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:28.473221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:28.746397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:28.754559 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-996e4c8d-e11d-4959-b1a3-1d7a148cb7c2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1227 microversion: 2.1 time: 0.307419 Oct 02 01:45:28.755768 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3277/6370] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:28 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1227 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:29.120853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-865367990", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "9ad9b6d3-73d1-4fcf-9975-879f017e02aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2030827957", "security_groups": [{"name": "tempest-secgroup-smoke-97451034"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:29.286431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] validate_networks() for [('9ad9b6d3-73d1-4fcf-9975-879f017e02aa', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:45:29.777374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:29.778856 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:29.790702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:29.792012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:29.792633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:29.794339 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:29.795255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:29.795995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:30.060206 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:30.071528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d52debbe-d7e8-43c7-a159-cff1571ee820 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1227 microversion: 2.1 time: 0.298739 Oct 02 01:45:30.086745 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3278/6371] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:29 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1227 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:30.277068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:45:30.278032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:45:30.278697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:45:30.279419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:45:30.280005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:45:30.290694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:30.291793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:30.292601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:30.293734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:30.294504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:30.295171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:30.316173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:45:30.321752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:45:30.336616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:45:30.339317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:45:30.391440 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8ca81682-4a06-49c4-8507-03a89c2504cb tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.274427 Oct 02 01:45:30.392173 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3094/6372] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:45:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:45:30.404009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc2010bf-d183-4973-af88-a9defbfd9160 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:30.405074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc2010bf-d183-4973-af88-a9defbfd9160 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:30.480510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc2010bf-d183-4973-af88-a9defbfd9160 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:30.492294 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc2010bf-d183-4973-af88-a9defbfd9160 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1266 microversion: 2.1 time: 0.092880 Oct 02 01:45:30.493522 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3279/6373] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:30 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:45:31.094438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:31.095095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:31.101831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:31.102334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:31.102840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:31.103732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:31.104266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:31.104789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:31.308739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:31.320678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b351cd4c-a1f1-4b9f-ace4-08be41d869be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.229940 Oct 02 01:45:31.336611 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3095/6374] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:31 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:31.516420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:31.517015 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:31.524780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:31.525273 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:31.525714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:31.527161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:31.527622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:31.528054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:31.595310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:31.603264 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a846a805-dff8-4a2c-beba-b674a2e0b08c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1318 microversion: 2.1 time: 0.090669 Oct 02 01:45:31.603861 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3280/6375] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:31 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:32.344610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:32.345141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:32.352037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:32.352533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:32.352974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:32.353680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:32.354265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:32.354796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:32.568345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:32.576708 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95a74216-c5e8-452e-a343-00b37c756a55 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.236118 Oct 02 01:45:32.577643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3096/6376] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:32 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:32.628294 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:32.628939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:32.637537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:32.640716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:32.641235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:32.641980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:32.642714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:32.642944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:32.873065 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:32.880762 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fed4bd01-0b1b-402c-a72d-e61fcf51605f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.256812 Oct 02 01:45:32.881365 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3281/6377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:32 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:45:33.448738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7a5edd5f-e79b-4fcc-9548-db1b1b0cd4a5 req-348b9742-fe90-4eb0-9f1c-7391768de370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:33.461220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7a5edd5f-e79b-4fcc-9548-db1b1b0cd4a5 req-348b9742-fe90-4eb0-9f1c-7391768de370 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:33.461711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7a5edd5f-e79b-4fcc-9548-db1b1b0cd4a5 req-348b9742-fe90-4eb0-9f1c-7391768de370 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:33.462156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7a5edd5f-e79b-4fcc-9548-db1b1b0cd4a5 req-348b9742-fe90-4eb0-9f1c-7391768de370 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:33.474103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7a5edd5f-e79b-4fcc-9548-db1b1b0cd4a5 req-348b9742-fe90-4eb0-9f1c-7391768de370 service nova] Creating event network-changed:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h2-master-1 Oct 02 01:45:33.479111 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7a5edd5f-e79b-4fcc-9548-db1b1b0cd4a5 req-348b9742-fe90-4eb0-9f1c-7391768de370 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034684 Oct 02 01:45:33.479952 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3097/6378] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:33.600241 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:33.600897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:33.603565 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:33.610718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:33.611221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:33.611660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:33.612370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:33.612834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:33.613267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:33.836668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:33.844424 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc1d104f-fada-48f0-9d3f-3cdec9062c23 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.248082 Oct 02 01:45:33.845012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3282/6379] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:33 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:33.904903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:33.905622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:33.911854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:33.912356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:33.912800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:33.913507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:33.913973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:33.914410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:34.059771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:34.067618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8b62e2a5-daab-4d16-b093-057422e757c2 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.167192 Oct 02 01:45:34.068195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3098/6380] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:33 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:34.867417 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:34.868064 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:34.874997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:34.875489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:34.875934 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:34.876636 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:34.877097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:34.877529 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:35.091027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:35.092664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:35.094554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:35.101188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:35.101770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:35.102412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:35.103359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:35.104765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:35.105416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:35.107076 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9fbb255-8682-49dc-a9b0-4cf1249b0455 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.243351 Oct 02 01:45:35.122592 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3283/6381] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:34 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:35.331812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:35.340184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a15ec071-0028-4c97-b5b9-050d5bd516ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.253261 Oct 02 01:45:35.341447 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3099/6382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:35 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:45:36.130498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:36.131165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:36.139218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:36.139711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:36.140154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:36.140852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:36.141314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:36.141751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:36.331637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:36.339829 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7f427136-56f7-4521-8440-848a354b80fb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.213399 Oct 02 01:45:36.340415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3284/6383] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:36 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:45:36.365058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:36.365676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:36.372653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:36.373139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:36.373577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:36.374272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:36.374766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:36.375199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:36.504065 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:36.512179 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-400f5180-81a8-4564-a28b-be6e73e74219 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.151067 Oct 02 01:45:36.512750 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3100/6384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:36 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:37.363310 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:37.363962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:37.371422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:37.371915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:37.372359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:37.373060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:37.373522 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:37.373951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:37.507402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:37.516688 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fbe1687c-5e0d-4b64-ab51-b85ae9356d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.157215 Oct 02 01:45:37.517302 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3285/6385] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:37 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:37.538979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:37.539608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:37.547944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:37.548433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:37.548882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:37.549590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:37.550050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:37.550482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:37.683952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:37.691737 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-92f26110-a46c-444e-a06b-e3d32e59f5db tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.159941 Oct 02 01:45:37.692312 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3101/6386] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:37 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:38.541411 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:38.542230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:38.549225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:38.549716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:38.550153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:38.550895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:38.551357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:38.551786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:38.691453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:38.699319 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-20ee4377-2bfe-4755-9394-c66c78260892 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.161889 Oct 02 01:45:38.699899 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3286/6387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:38 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:38.713753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:38.714452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:38.721194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:38.721674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:38.722111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:38.722852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:38.723309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:38.723736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:38.862620 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:38.871055 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83d396c9-9c65-4fae-ab35-f63d3c4a432a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.161139 Oct 02 01:45:38.871625 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3102/6388] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:38 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:39.149094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-d6cda5b7-850a-4d8b-9f37-bb3ac008e0a9 req-c5f31ea5-192c-4e54-bcbd-409cb0816a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "name": "network-vif-plugged", "status": "completed", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:39.160482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d6cda5b7-850a-4d8b-9f37-bb3ac008e0a9 req-c5f31ea5-192c-4e54-bcbd-409cb0816a4c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:39.160966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d6cda5b7-850a-4d8b-9f37-bb3ac008e0a9 req-c5f31ea5-192c-4e54-bcbd-409cb0816a4c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:39.161584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-d6cda5b7-850a-4d8b-9f37-bb3ac008e0a9 req-c5f31ea5-192c-4e54-bcbd-409cb0816a4c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:39.165758 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:39.174924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-d6cda5b7-850a-4d8b-9f37-bb3ac008e0a9 req-c5f31ea5-192c-4e54-bcbd-409cb0816a4c service nova] Creating event network-vif-plugged:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h2-master-1 Oct 02 01:45:39.179961 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-d6cda5b7-850a-4d8b-9f37-bb3ac008e0a9 req-c5f31ea5-192c-4e54-bcbd-409cb0816a4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034725 Oct 02 01:45:39.180836 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3287/6389] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:39.721074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:39.721676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:39.729303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:39.729773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:39.730202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:39.730906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:39.731387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:39.731811 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:39.865700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:39.873665 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6f48b34-a879-4975-8d42-fa0fc7d3eb69 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.156428 Oct 02 01:45:39.874250 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3103/6390] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:39 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:39.895276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:39.895973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:39.902903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:39.903381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:39.903814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:39.904499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:39.904953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:39.905374 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:40.038073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:40.046548 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9478d26f-4bdb-41d2-9f3c-b76e866df3bd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1390 microversion: 2.1 time: 0.157018 Oct 02 01:45:40.047334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3288/6391] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:39 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:40.896779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:40.897849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:40.899595 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:40.900319 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:40.908407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:40.909073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:40.909488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:40.910343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:40.910666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:40.911260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:41.044604 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:41.052806 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8f79efb-d1dd-4f77-8878-e9a3a6e67032 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.159950 Oct 02 01:45:41.053384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3104/6392] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:40 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:41.070518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:41.071179 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:41.074761 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:41.080843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:41.081338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:41.081783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:41.082481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:41.083000 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:41.083437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:41.203767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-04f66c6c-4d76-4bdf-8c3f-9605e11f7960 req-c969e3e3-ea7d-4494-bf5c-879bb4005efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0106bc48-2f18-4fcf-b73d-284c905d40b0", "name": "network-vif-plugged", "status": "completed", "tag": "08972e19-036b-48f1-ac15-6082e5927819"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:41.214171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-04f66c6c-4d76-4bdf-8c3f-9605e11f7960 req-c969e3e3-ea7d-4494-bf5c-879bb4005efb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:41.215237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-04f66c6c-4d76-4bdf-8c3f-9605e11f7960 req-c969e3e3-ea7d-4494-bf5c-879bb4005efb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:41.215674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-04f66c6c-4d76-4bdf-8c3f-9605e11f7960 req-c969e3e3-ea7d-4494-bf5c-879bb4005efb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:41.217591 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:41.225396 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-02dee22a-546f-466a-a0a6-f43f1e605848 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1563 microversion: 2.1 time: 0.158789 Oct 02 01:45:41.226057 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3289/6393] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:41 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:41.226809 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-04f66c6c-4d76-4bdf-8c3f-9605e11f7960 req-c969e3e3-ea7d-4494-bf5c-879bb4005efb service nova] Creating event network-vif-plugged:08972e19-036b-48f1-ac15-6082e5927819 for instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 on n-h1-master-1 Oct 02 01:45:41.232141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-04f66c6c-4d76-4bdf-8c3f-9605e11f7960 req-c969e3e3-ea7d-4494-bf5c-879bb4005efb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Oct 02 01:45:41.232734 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3105/6394] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:41.247810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:41.248433 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:41.254757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:41.255411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:41.255919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:41.256866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:41.257471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:41.257941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:41.403438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:41.412003 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5fb1e514-938b-4387-ba84-02cd67fb7ee9 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1563 microversion: 2.1 time: 0.168329 Oct 02 01:45:41.412524 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3290/6395] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:41 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:45:42.077583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:42.078451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:42.084926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:42.085423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:42.085869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:42.086574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:42.087136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:42.087565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:42.554749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:42.563752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23161115-0530-45dd-a2f8-cba78c652adf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1215 microversion: 2.1 time: 0.491968 Oct 02 01:45:42.564340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3106/6396] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:42 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1215 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:43.363193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:43.363985 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:43.366922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f81fe7c6-39ec-4512-923d-64a260d04613 req-85765c68-f563-4bf2-b44c-2d74814f42ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:43.371943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.372591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.373288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:43.374113 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.374673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.375179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:43.378418 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:43.381053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f81fe7c6-39ec-4512-923d-64a260d04613 req-85765c68-f563-4bf2-b44c-2d74814f42ab service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.381805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f81fe7c6-39ec-4512-923d-64a260d04613 req-85765c68-f563-4bf2-b44c-2d74814f42ab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.382414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f81fe7c6-39ec-4512-923d-64a260d04613 req-85765c68-f563-4bf2-b44c-2d74814f42ab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:43.386134 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:43.398109 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f81fe7c6-39ec-4512-923d-64a260d04613 req-85765c68-f563-4bf2-b44c-2d74814f42ab service nova] Creating event network-changed:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h2-master-1 Oct 02 01:45:43.404711 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f81fe7c6-39ec-4512-923d-64a260d04613 req-85765c68-f563-4bf2-b44c-2d74814f42ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042957 Oct 02 01:45:43.406247 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3107/6397] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:43.585602 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:43.594506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:43.595353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:43.601848 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0fe44e3d-92ca-492d-ba0f-f38d2bf59f90 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1563 microversion: 2.1 time: 0.241412 Oct 02 01:45:43.604896 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3291/6398] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:43 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:43.623667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.624521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.625156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:43.625919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.626761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.627383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:43.875171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:43.883668 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7542e5fc-f8ca-4e74-a9f6-75f8376e962d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1402 microversion: 2.1 time: 0.296022 Oct 02 01:45:43.884621 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3108/6399] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:43 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1402 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:45:43.906414 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:43.907060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:43.909005 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:43.914701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.915193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.915631 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:43.917128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:43.917597 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:43.918023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:44.138072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:44.146548 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ebe1053b-9b4b-484c-9d0d-bf933a638518 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1402 microversion: 2.1 time: 0.243947 Oct 02 01:45:44.147386 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3292/6400] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:43 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1402 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:44.169455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-425800922"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:44.172255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:44.177821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:44.178312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:44.178785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:44.180026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:44.180026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:44.180616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:44.282738 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Attempting to quiesce instance before volume snapshot. Oct 02 01:45:44.348015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 02 01:45:44.425434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Creating snapshot from volume 266e8829-34a0-4f1b-8257-f4caa765799d. {{(pid=122354) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 02 01:45:45.275729 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d89d5f9b-0378-44e3-b9ad-836a53b53809 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0/action" status: 202 len: 0 microversion: 2.1 time: 1.110103 Oct 02 01:45:45.279092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3109/6401] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:45:44 2022] POST /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 01:45:46.434296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-391448293", "imageRef": "016ea0a1-d79e-471c-8c64-7ba30f79bf5c", "flavorRef": "452", "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:46.490154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:45:46.860765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:45:46.861185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:45:46.861659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:45:46.862067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:45:46.862477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:45:46.871865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:46.872285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:46.872720 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:46.873439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:46.873892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:46.874314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:46.891125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:45:46.896416 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:45:46.908484 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:45:46.911053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='29854e4b-4b4d-40fd-9151-3aa194663d3e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:45:46.986971 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ee11cb63-31d2-48e4-8e69-1ca600d4a073 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557419 Oct 02 01:45:46.987640 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3293/6402] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:45:46.999660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02ec3e7c-1e1d-42d5-85fe-5e750f790680 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:47.000394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-02ec3e7c-1e1d-42d5-85fe-5e750f790680 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:47.055589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-02ec3e7c-1e1d-42d5-85fe-5e750f790680 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:47.063869 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02ec3e7c-1e1d-42d5-85fe-5e750f790680 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1229 microversion: 2.1 time: 0.068225 Oct 02 01:45:47.064568 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3110/6403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:46 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1229 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:48.088954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:48.089710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:48.096221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:48.096877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:48.097388 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:48.098167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:48.098731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:48.099223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:48.169324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:48.178360 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fb68a5f4-1565-4aaf-8912-fbc5aace75b0 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1299 microversion: 2.1 time: 0.095102 Oct 02 01:45:48.179058 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3294/6404] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:48 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:49.203407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:49.204048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:49.211250 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:49.211762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:49.212221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:49.213643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:49.214156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:49.214784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:49.377487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:49.391655 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c716c51e-d8fb-48b3-9187-5f7ea6b7a87d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.192016 Oct 02 01:45:49.392427 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3111/6405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:49 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:49.554493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-87911b12-0eb3-4623-a708-3e256ac4a799 req-57a0b476-c917-4e90-a302-17fc1d6e481e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91415fac-08ae-416d-8ba5-2fb677c545f3", "tag": "a918f117-b40e-4631-b50a-65c035d1a37d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:45:49.577018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-87911b12-0eb3-4623-a708-3e256ac4a799 req-57a0b476-c917-4e90-a302-17fc1d6e481e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:49.577469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-87911b12-0eb3-4623-a708-3e256ac4a799 req-57a0b476-c917-4e90-a302-17fc1d6e481e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:49.578115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-87911b12-0eb3-4623-a708-3e256ac4a799 req-57a0b476-c917-4e90-a302-17fc1d6e481e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:49.600042 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-87911b12-0eb3-4623-a708-3e256ac4a799 req-57a0b476-c917-4e90-a302-17fc1d6e481e service nova] Creating event network-changed:a918f117-b40e-4631-b50a-65c035d1a37d for instance 91415fac-08ae-416d-8ba5-2fb677c545f3 on n-h1-master-1 Oct 02 01:45:49.605467 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-87911b12-0eb3-4623-a708-3e256ac4a799 req-57a0b476-c917-4e90-a302-17fc1d6e481e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055472 Oct 02 01:45:49.606430 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3295/6406] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:45:50.417745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:50.418723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:50.425873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:50.426373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:50.426855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:50.427561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:50.428205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:50.428679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:50.580159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:50.588786 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-11ed97cf-11a6-4022-9e78-e0aea3383a85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.175339 Oct 02 01:45:50.589383 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3112/6407] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:50 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:51.613821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:51.614715 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:51.622184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:51.622786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:51.623307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:51.624086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:51.624607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:51.625359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:51.811972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:51.819851 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc8a01cb-696a-4cca-abcd-3b7e165d94a4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.210363 Oct 02 01:45:51.826465 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3296/6408] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:51 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:52.848821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:52.851024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:52.872787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:52.873711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:52.874167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:52.874915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:52.875391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:52.875829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:53.095451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:53.107190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb229e7e-0e84-4d47-b239-dc40ff3359bd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.266389 Oct 02 01:45:53.124025 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3113/6409] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:52 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:54.133819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:54.135221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:54.142818 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:54.143881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:54.143881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:54.146565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:54.146565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:54.146565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:54.331765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:54.342930 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e127b7c6-7050-43b8-9998-656761b9ec25 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.214040 Oct 02 01:45:54.343544 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3297/6410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:54 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:55.367428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:55.368085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:55.376397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:55.376883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:55.377330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:55.378038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:55.378488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:55.378952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:55.517658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:55.526937 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0861974f-32ff-4977-bfaa-7d7cb12e7fd7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.163709 Oct 02 01:45:55.540065 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3114/6411] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:55 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:56.551091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:56.551705 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:56.558942 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:56.559422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:56.559857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:56.560545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:56.561001 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:56.561421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:56.691351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:56.699574 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-756dd184-c2a1-4d01-9515-f65b220026be tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.152652 Oct 02 01:45:56.700148 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3298/6412] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:56 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:57.722558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:57.723228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:57.726088 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:57.732334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:57.732847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:57.733303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:57.734114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:57.734614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:57.735093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:57.890449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:57.899074 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28465b5c-d32e-4c4e-ba13-48ffcb1ddda9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.180203 Oct 02 01:45:57.899661 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3115/6413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:57 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:45:58.922517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:45:58.923160 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:45:58.925385 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:58.926229 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:58.936210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:58.936714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:58.937731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:58.937868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:45:58.938321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:45:58.938794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:45:59.162093 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:45:59.170991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7d971885-8d0b-4b3b-b319-3a80d159ba7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.252295 Oct 02 01:45:59.171915 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3299/6414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:45:58 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:00.194623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:00.195242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:00.203253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:00.203759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:00.204213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:00.204946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:00.205423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:00.205867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:00.356657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:00.364693 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b0ac90a3-cb19-4e28-90df-f8ddfde0f403 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.174115 Oct 02 01:46:00.365172 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3116/6415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:00 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:01.388934 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:01.389491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:01.396879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:01.397379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:01.397825 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:01.398588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:01.399055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:01.399488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:01.536943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:01.544873 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dce496ae-b199-40af-9cb4-d2794c2749dd tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.161068 Oct 02 01:46:01.545459 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3300/6416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:01 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:02.567644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:02.568281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:02.575353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:02.575860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:02.576314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:02.577028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:02.577502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:02.577947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:02.722623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:02.731316 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f44fd433-857f-4c28-82b1-8bf1659feb7b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1341 microversion: 2.1 time: 0.167617 Oct 02 01:46:02.731931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3117/6417] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:02 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:03.754855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:03.755504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:03.762071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:03.762558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:03.763029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:03.763731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:03.764191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:03.764615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:03.901244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:03.909046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-183075d7-72e9-441d-83e3-af63b69cd03d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.158451 Oct 02 01:46:03.909636 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3301/6418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:03 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:04.867606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:04.870425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:04.877472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:04.877972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:04.878424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:04.879214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:04.879689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:04.880131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:04.934654 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:04.935245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:04.942041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:04.942515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:04.942976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:04.943662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:04.944115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:04.944539 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:04.948564 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1fbdc906-0190-4aa7-aae3-1932807d0b50 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action" status: 200 len: 24565 microversion: 2.1 time: 0.084717 Oct 02 01:46:04.949260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3118/6419] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:46:04 2022] POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action => generated 24565 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:46:05.080095 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:05.088626 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-31a9d1da-9c28-45f2-a8e3-73b473a1c3d1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.158936 Oct 02 01:46:05.089207 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3302/6420] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:04 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:06.113291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:06.114124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:06.122717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:06.123265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:06.123715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:06.124430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:06.124940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:06.125396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:06.267741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:06.276036 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99bc573a-f5b1-47ae-b68a-953288d4a6cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.166708 Oct 02 01:46:06.276708 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3119/6421] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:06 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:07.299926 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:07.300861 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:07.310909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:07.311507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:07.311986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:07.312783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:07.313392 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:07.313835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:07.455718 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:07.466933 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-090650c7-6430-4a6b-ba4b-55bc6f876473 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.171286 Oct 02 01:46:07.467829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3303/6422] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:07 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:08.490334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:08.491015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:08.499314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:08.499821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:08.500279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:08.500992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:08.501468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:08.501914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:08.646392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:08.655344 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc072620-48e3-4e0f-b3a9-569bcaf48468 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.168736 Oct 02 01:46:08.655950 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3120/6423] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:08 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:09.684930 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:09.685544 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:09.692890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:09.693391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:09.693840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:09.694548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:09.695118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:09.695593 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:09.836315 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:09.846423 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bea9e2ba-92dd-4816-80a9-945a217acc0a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.166467 Oct 02 01:46:09.847047 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3304/6424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:09 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:10.871467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:10.872908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:10.880166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:10.880602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:10.881078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:10.881776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:10.882281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:10.882742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:11.024643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:11.032864 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d03cb5a-9f62-4f17-bb5f-587efa85160e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.165974 Oct 02 01:46:11.033552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3121/6425] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:10 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:12.057987 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:12.058894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:12.067233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:12.067763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:12.068238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:12.068908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:12.069372 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:12.069911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:12.072497 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=95 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:12.206134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:12.213998 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-46a6c1f5-8716-4676-a58e-03186436c858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.161312 Oct 02 01:46:12.214583 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3305/6426] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:12 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:12.812221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d0ab8970-48a1-476b-95ba-0ff79c084e68 req-ea31b7fd-a8fc-4365-add0-636e788c8630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91415fac-08ae-416d-8ba5-2fb677c545f3", "name": "network-vif-plugged", "status": "completed", "tag": "a918f117-b40e-4631-b50a-65c035d1a37d"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:12.823285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d0ab8970-48a1-476b-95ba-0ff79c084e68 req-ea31b7fd-a8fc-4365-add0-636e788c8630 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:12.823883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d0ab8970-48a1-476b-95ba-0ff79c084e68 req-ea31b7fd-a8fc-4365-add0-636e788c8630 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:12.824341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d0ab8970-48a1-476b-95ba-0ff79c084e68 req-ea31b7fd-a8fc-4365-add0-636e788c8630 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:12.835583 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d0ab8970-48a1-476b-95ba-0ff79c084e68 req-ea31b7fd-a8fc-4365-add0-636e788c8630 service nova] Creating event network-vif-plugged:a918f117-b40e-4631-b50a-65c035d1a37d for instance 91415fac-08ae-416d-8ba5-2fb677c545f3 on n-h1-master-1 Oct 02 01:46:12.841371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d0ab8970-48a1-476b-95ba-0ff79c084e68 req-ea31b7fd-a8fc-4365-add0-636e788c8630 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033267 Oct 02 01:46:12.842809 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3122/6427] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:13.239568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:13.240346 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:13.247329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:13.247845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:13.248366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:13.249093 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:13.249551 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:13.249967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:13.383195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:13.392948 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ebcc88b7-2bfb-44f3-b681-e049fe0b9787 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1375 microversion: 2.1 time: 0.157508 Oct 02 01:46:13.393641 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3306/6428] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:13 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:14.420428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:14.421432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:14.424066 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=34 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:14.429900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:14.430847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:14.431302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:14.432005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:14.432473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:14.432907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:14.435551 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:14.855060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:14.863271 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38e946e1-1a4f-4485-8483-d6889d54c73e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1561 microversion: 2.1 time: 0.449995 Oct 02 01:46:14.863855 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3123/6429] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:14 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1561 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:14.885129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:14.885751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:14.889079 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:14.894641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:14.895135 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:14.895581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:14.896278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:14.896739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:14.897173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:15.031358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:15.039182 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b255f07-932a-4664-badc-dd2bce2fa7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1561 microversion: 2.1 time: 0.157855 Oct 02 01:46:15.039778 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3307/6430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:14 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:15.121902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:15.122420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:15.128537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:15.129039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:15.129491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:15.130196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:15.130700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:15.131144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:15.157088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:46:15.235653 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-80eea4a3-72b6-41d0-b177-d19be90c5c99 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 204 len: 0 microversion: 2.1 time: 0.117169 Oct 02 01:46:15.236434 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3124/6431] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:46:15 2022] DELETE /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:46:15.246134 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:15.246854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:15.252910 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:15.253393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:15.253835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:15.254526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:15.255042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:15.255511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:15.386625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:15.395409 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-029108bc-5a9d-491b-93c4-8b6816eb5328 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1567 microversion: 2.1 time: 0.154398 Oct 02 01:46:15.395991 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3308/6432] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:15 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:15.975076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:15.975748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:15.984225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:15.984796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:15.985253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:15.985977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:15.986454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:15.986933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.121250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:16.129015 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c4ca184a-b351-4e65-865b-ca0abbcc40d7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1681 microversion: 2.1 time: 0.158419 Oct 02 01:46:16.129592 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3125/6433] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:15 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:16.234423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:16.236603 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:16.243488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.243967 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.244401 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.245084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.245537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.245966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.317189 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8105a1b0-feb6-4bd9-b712-776582120b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action" status: 200 len: 32636 microversion: 2.1 time: 0.086898 Oct 02 01:46:16.317843 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3309/6434] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:46:16 2022] POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action => generated 32636 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:46:16.419114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:16.420017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:16.426215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.426760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.427213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.427929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.428397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.428840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.495673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:16.496351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:16.504537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.505216 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.505663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.506363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.506866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.507272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.597916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:16.605952 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d04d4f12-1ad2-4df8-922f-22a21c6224e6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1567 microversion: 2.1 time: 0.190774 Oct 02 01:46:16.606787 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3126/6435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:16 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:16.659995 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7238f4b6-4405-4665-ba66-b922e927116f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1832 microversion: 2.1 time: 0.168399 Oct 02 01:46:16.660572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3310/6436] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:16 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1832 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:16.690680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:16.693209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:16.699228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.699722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.700167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.701003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:16.701567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:16.702010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:16.728640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lazy-loading 'flavor' on Instance uuid 61bdc161-b150-4565-9f4c-61f9486ce8ca {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:46:16.741079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Going to try to live migrate instance to another host {{(pid=122354) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 02 01:46:17.530314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2a33e119-0e5c-4341-8406-06ef211b5c51 req-32521fbf-251d-4aae-a4ae-5aba3c16ade0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91415fac-08ae-416d-8ba5-2fb677c545f3", "name": "network-vif-deleted", "tag": "a918f117-b40e-4631-b50a-65c035d1a37d"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:17.556110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a33e119-0e5c-4341-8406-06ef211b5c51 req-32521fbf-251d-4aae-a4ae-5aba3c16ade0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:17.557444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a33e119-0e5c-4341-8406-06ef211b5c51 req-32521fbf-251d-4aae-a4ae-5aba3c16ade0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:17.558073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2a33e119-0e5c-4341-8406-06ef211b5c51 req-32521fbf-251d-4aae-a4ae-5aba3c16ade0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:17.571392 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2a33e119-0e5c-4341-8406-06ef211b5c51 req-32521fbf-251d-4aae-a4ae-5aba3c16ade0 service nova] Creating event network-vif-deleted:a918f117-b40e-4631-b50a-65c035d1a37d for instance 91415fac-08ae-416d-8ba5-2fb677c545f3 on n-h1-master-1 Oct 02 01:46:17.577411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2a33e119-0e5c-4341-8406-06ef211b5c51 req-32521fbf-251d-4aae-a4ae-5aba3c16ade0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052394 Oct 02 01:46:17.578221 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3311/6437] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:17.632337 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:17.633238 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:17.646155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:17.648649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:17.649224 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:17.650114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:17.650739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:17.651275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:17.728555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:17.738333 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c544f57-ed8d-4cd5-90ab-6b043e71e897 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1360 microversion: 2.1 time: 0.111963 Oct 02 01:46:17.739364 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3312/6438] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:17 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1360 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:18.750478 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2067a807-96bc-4a62-a50a-cee78a27066d tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action" status: 202 len: 0 microversion: 2.1 time: 2.063373 Oct 02 01:46:18.751541 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3127/6439] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:46:16 2022] POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action => generated 0 bytes in 2065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:46:18.763793 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:18.764556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:18.773396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:18.774828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:18.784412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:18.785284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:18.786116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:18.787217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:18.787910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:18.788568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:18.791753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:18.792506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:18.792968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:18.799229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:18.799714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:18.800161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:18.865940 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:18.878164 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ec8e1c5-241b-41f6-a12c-d46986d85c47 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1360 microversion: 2.1 time: 0.115457 Oct 02 01:46:18.886266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3128/6440] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:18 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1360 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:18.983446 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:18.991804 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8d43227-9a9b-43c8-a222-0ae9327faf5d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.234151 Oct 02 01:46:19.000068 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3313/6441] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:18 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:19.903523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:19.904865 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:19.912734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:19.913243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:19.913698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:19.914667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:19.915158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:19.915611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:19.953271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-35b8fd73-d1dd-4631-9e7c-e2a27c106a34 req-b3ae91dd-eccf-48c3-9f7f-2f4662ba8f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "name": "network-vif-unplugged", "status": "completed", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:19.964897 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-35b8fd73-d1dd-4631-9e7c-e2a27c106a34 req-b3ae91dd-eccf-48c3-9f7f-2f4662ba8f29 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:19.965889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-35b8fd73-d1dd-4631-9e7c-e2a27c106a34 req-b3ae91dd-eccf-48c3-9f7f-2f4662ba8f29 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:19.967088 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-35b8fd73-d1dd-4631-9e7c-e2a27c106a34 req-b3ae91dd-eccf-48c3-9f7f-2f4662ba8f29 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:19.980293 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-35b8fd73-d1dd-4631-9e7c-e2a27c106a34 req-b3ae91dd-eccf-48c3-9f7f-2f4662ba8f29 service nova] Creating event network-vif-unplugged:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h2-master-1 Oct 02 01:46:19.986194 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-35b8fd73-d1dd-4631-9e7c-e2a27c106a34 req-b3ae91dd-eccf-48c3-9f7f-2f4662ba8f29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037012 Oct 02 01:46:19.987101 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3314/6442] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:46:20.007477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:20.016302 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-54df9fc2-ca7c-48d6-a831-f6e72ba6535a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1360 microversion: 2.1 time: 0.116416 Oct 02 01:46:20.017594 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3129/6443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:19 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1360 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:20.034022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:20.034819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:20.041451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:20.041950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:20.042635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:20.043410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:20.044014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:20.044836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:20.197379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:20.208317 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a03add57-afc6-4e34-9b7e-0fa5cb06d793 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.193791 Oct 02 01:46:20.209337 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3315/6444] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:20 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:21.044638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:21.045325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:21.052560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:21.053068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:21.053593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:21.054310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:21.054808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:21.055245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:21.123156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:21.131343 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3f1e38e-44ae-45de-9135-27b6a9782b04 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1360 microversion: 2.1 time: 0.090547 Oct 02 01:46:21.132028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3130/6445] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:21 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:21.234097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:21.234659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:21.242254 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:21.242793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:21.243249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:21.243957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:21.244419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:21.244855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:21.392128 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:21.400296 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-db4275bb-738b-4133-9e6a-d0dbe243c9ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.170817 Oct 02 01:46:21.400876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3316/6446] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:21 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:22.019453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-acf4ee94-7a09-4c48-95b2-27542783e9d4 req-2200eb8b-ae4e-4dfc-a4ba-b2ca84e14a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:22.031383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-acf4ee94-7a09-4c48-95b2-27542783e9d4 req-2200eb8b-ae4e-4dfc-a4ba-b2ca84e14a33 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:22.031882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-acf4ee94-7a09-4c48-95b2-27542783e9d4 req-2200eb8b-ae4e-4dfc-a4ba-b2ca84e14a33 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:22.032321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-acf4ee94-7a09-4c48-95b2-27542783e9d4 req-2200eb8b-ae4e-4dfc-a4ba-b2ca84e14a33 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:22.046097 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-acf4ee94-7a09-4c48-95b2-27542783e9d4 req-2200eb8b-ae4e-4dfc-a4ba-b2ca84e14a33 service nova] Creating event network-changed:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h2-master-1 Oct 02 01:46:22.052085 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-acf4ee94-7a09-4c48-95b2-27542783e9d4 req-2200eb8b-ae4e-4dfc-a4ba-b2ca84e14a33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036849 Oct 02 01:46:22.053051 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3131/6447] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:22.157422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:22.158046 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:22.164498 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:22.165265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:22.165887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:22.166849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:22.167628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:22.168015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:22.205423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:22.206220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:22.207042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:22.207696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lazy-loading 'fault' on Instance uuid 91415fac-08ae-416d-8ba5-2fb677c545f3 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:46:22.301920 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:22.316838 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-754b26dc-98f4-46d3-a7c5-b5dfcfa92086 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 200 len: 1365 microversion: 2.1 time: 0.164320 Oct 02 01:46:22.317968 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3317/6448] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:22 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:22.424757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:22.425751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:22.432706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:22.433326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:22.433908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:22.434781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:22.436423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:22.436924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:22.633497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:22.646244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4be3e418-6a83-4b3d-8a02-f1ea8212c0e6 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.226086 Oct 02 01:46:22.647687 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3132/6449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:22 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:23.341685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:23.342316 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:23.349578 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:23.350063 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:23.350504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:23.351251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:23.351778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:23.352169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:23.369538 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 HTTP/1.1 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '91415fac-08ae-416d-8ba5-2fb677c545f3'} Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:23.371624 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a11b8eca-0668-4186-bb63-95712df178d4 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 404 len: 111 microversion: 2.1 time: 0.037249 Oct 02 01:46:23.377372 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3318/6450] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:23 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:46:23.683689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:23.685229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:23.694985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:23.695658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:23.696279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:23.697127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:23.697626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:23.698074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:23.840489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:23.849114 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac407650-c3dc-4c23-953a-2582f2cd9307 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.171962 Oct 02 01:46:23.849714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3133/6451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:23 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:24.872755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:24.873456 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:24.880133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:24.880618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:24.881055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:24.881745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:24.882193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:24.882646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:25.030906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:25.038769 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bed7ee4f-254a-408a-9fcd-6d9c944affab tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.170007 Oct 02 01:46:25.039356 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3319/6452] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:24 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:26.063054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:26.063805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:26.071042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:26.071614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:26.072214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:26.072993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:26.073535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:26.074080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:26.226621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:26.236243 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b867fc2-3122-4522-8cc4-a27a60045c60 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.177297 Oct 02 01:46:26.236961 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3134/6453] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:26 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:27.261231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:27.261904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:27.270490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:27.271005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:27.271445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:27.272145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:27.272606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:27.273419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:27.419835 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:27.428994 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e9b06d39-3985-4752-9c76-201b24be9463 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.172684 Oct 02 01:46:27.429602 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3320/6454] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:27 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:27.684501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:27.685755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:27.692831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:27.693326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:27.693772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:27.694478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:27.694973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:27.695412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:27.721009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:46:27.766892 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:27.798194 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fde0a8ea-2599-4fa5-869e-c83ab3ee5106 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 204 len: 0 microversion: 2.1 time: 0.117488 Oct 02 01:46:27.798945 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3135/6455] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:46:27 2022] DELETE /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:46:27.807769 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:27.808410 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:27.815086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:27.815563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:27.815995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:27.816674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:27.817126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:27.817545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:27.949451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:27.957862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-37082242-fbdf-4b94-a844-3e33454da225 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1408 microversion: 2.1 time: 0.154261 Oct 02 01:46:27.958438 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3321/6456] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:27 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:28.455613 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:28.456335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:28.462303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:28.462819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:28.463270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:28.463970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:28.464438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:28.464878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:28.638279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:28.646298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-671b45c3-2dcb-4374-8ee7-e33d5b92e679 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.195134 Oct 02 01:46:28.646997 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3136/6457] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:28 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:28.980394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:28.981086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:28.990219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:28.991052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:28.991215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:28.991956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:28.992441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:28.992872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:29.270001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:29.277889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d8e5cfdf-c4fe-4ad7-b936-b6385541c75a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1408 microversion: 2.1 time: 0.301457 Oct 02 01:46:29.278480 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3322/6458] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:28 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:29.670310 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:29.670983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:29.677665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:29.678172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:29.678633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:29.679547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:29.680019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:29.680713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:29.910889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:29.919764 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f87858d-d491-48c7-b34a-68fb0ec75fac tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1691 microversion: 2.1 time: 0.252774 Oct 02 01:46:29.920558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3137/6459] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:29 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:30.303187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:30.303824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:30.311725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:30.312242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:30.313051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:30.313773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:30.314279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:30.314752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:30.372812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-391b963d-b6a7-474a-8fb3-f70aa5760424 req-cd6f544d-a784-4ee1-9461-032f4049fb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0106bc48-2f18-4fcf-b73d-284c905d40b0", "name": "network-vif-deleted", "tag": "08972e19-036b-48f1-ac15-6082e5927819"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:30.384220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-391b963d-b6a7-474a-8fb3-f70aa5760424 req-cd6f544d-a784-4ee1-9461-032f4049fb50 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:30.385017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-391b963d-b6a7-474a-8fb3-f70aa5760424 req-cd6f544d-a784-4ee1-9461-032f4049fb50 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:30.385595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-391b963d-b6a7-474a-8fb3-f70aa5760424 req-cd6f544d-a784-4ee1-9461-032f4049fb50 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:30.397768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:30.398053 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-391b963d-b6a7-474a-8fb3-f70aa5760424 req-cd6f544d-a784-4ee1-9461-032f4049fb50 service nova] Creating event network-vif-deleted:08972e19-036b-48f1-ac15-6082e5927819 for instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 on n-h1-master-1 Oct 02 01:46:30.404203 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-391b963d-b6a7-474a-8fb3-f70aa5760424 req-cd6f544d-a784-4ee1-9461-032f4049fb50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129734 Oct 02 01:46:30.405185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3323/6460] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:30.411206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-71f567cd-716c-4dc0-96b0-98fd32793166 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1366 microversion: 2.1 time: 0.113056 Oct 02 01:46:30.411994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3138/6461] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:30 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:30.944722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:30.945444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:30.951861 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:30.952358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:30.952804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:30.954050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:30.954516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:30.954983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:30.980853 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=100 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:31.111008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:31.121176 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-197ceb1c-d2a6-4d23-be0e-b4d43f7b073f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1681 microversion: 2.1 time: 0.180681 Oct 02 01:46:31.122296 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3324/6462] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:30 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:31.144858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:31.145624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:31.153082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.154357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.154892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.155649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.156166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.156616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.318219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b34bf08-dd25-46ce-9d74-f3a3cf9bec6f tempest-TestNetworkAdvancedServerOps-273442568 tempest-TestNetworkAdvancedServerOps-273442568-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1832 microversion: 2.1 time: 0.177015 Oct 02 01:46:31.318843 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3139/6463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:31 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1832 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:31.343580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:31.344202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:31.351225 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.351713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.352154 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.352854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.353316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.353746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.436269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:31.437191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:31.443283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.443974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.444434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.445155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.445628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.446073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.514980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:31.530591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:31.541510 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b371a7c8-db50-4531-ba19-0e77e707f2aa tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1681 microversion: 2.1 time: 0.203043 Oct 02 01:46:31.542415 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3325/6464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:31 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:31.563685 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6184635-7980-474e-bead-4e4a94dabac9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1200 microversion: 2.1 time: 0.127293 Oct 02 01:46:31.564843 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3140/6465] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:31 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1200 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:31.651777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:31.654355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:31.660441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.660930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.661373 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.662094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:31.662549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:31.663070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:31.717549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2f033b2-f8af-474b-98ca-444dc20d626b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action" status: 200 len: 38640 microversion: 2.1 time: 0.069414 Oct 02 01:46:31.718452 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3326/6466] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:46:31 2022] POST /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca/action => generated 38640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:46:32.593081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:32.593718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:32.601358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.601875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.602335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:32.603845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.604334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.604789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:32.675100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:32.685920 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4614048e-c9b5-486c-a645-c123578430ce tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1200 microversion: 2.1 time: 0.097909 Oct 02 01:46:32.686632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3141/6467] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:32 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:32.725191 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:32.725799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ebead7f6-98f0-4272-994a-0caeb660685f req-01b94ba4-f70f-42c2-9504-9c35621d518a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:32.725925 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:32.738067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ebead7f6-98f0-4272-994a-0caeb660685f req-01b94ba4-f70f-42c2-9504-9c35621d518a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.738919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ebead7f6-98f0-4272-994a-0caeb660685f req-01b94ba4-f70f-42c2-9504-9c35621d518a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.739540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ebead7f6-98f0-4272-994a-0caeb660685f req-01b94ba4-f70f-42c2-9504-9c35621d518a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:32.747296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.747569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.748722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:32.750153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.750657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.751107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:32.753835 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ebead7f6-98f0-4272-994a-0caeb660685f req-01b94ba4-f70f-42c2-9504-9c35621d518a service nova] Creating event network-changed:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h1-master-1 Oct 02 01:46:32.761731 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ebead7f6-98f0-4272-994a-0caeb660685f req-01b94ba4-f70f-42c2-9504-9c35621d518a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037829 Oct 02 01:46:32.764601 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3142/6468] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:32.785994 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:46:32.892960 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f7d2cba1-30bd-45fb-8ef0-72ec15d8424d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 204 len: 0 microversion: 2.1 time: 0.172179 Oct 02 01:46:32.897012 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3327/6469] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:46:32 2022] DELETE /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:46:32.904632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:32.905417 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:32.913214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.914286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.914986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:32.916467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:32.917128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:32.918439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:33.104123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:33.113448 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5282de7b-3d7b-45fc-b8a8-22556ee94661 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1687 microversion: 2.1 time: 0.214483 Oct 02 01:46:33.114635 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3143/6470] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:32 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1687 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:33.710221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:33.711184 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:33.717381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:33.717880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:33.718751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:33.720060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:33.720554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:33.720958 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:34.135260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:34.139325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:34.140567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:34.147416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:34.148330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-333893aa-f1e1-478c-98e7-a1ca9c780858 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 200 len: 1200 microversion: 2.1 time: 0.441719 Oct 02 01:46:34.148954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:34.158760 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3328/6471] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:33 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 1200 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:34.159398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:34.160395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:34.161052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:34.161792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:34.361192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:34.369493 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-730c202a-642b-4f21-8fc4-737ad535bf11 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 200 len: 1569 microversion: 2.1 time: 0.234607 Oct 02 01:46:34.382831 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3144/6472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:34 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:34.518972 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6646de2b-18e4-40c1-8a2e-9116afc7bbb9 req-61fb6f45-1fc2-4a6b-ae10-815cd8bf9366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bdc161-b150-4565-9f4c-61f9486ce8ca", "name": "network-vif-deleted", "tag": "416f6a36-aa2e-41cf-9f14-0d92db273f34"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:34.531043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6646de2b-18e4-40c1-8a2e-9116afc7bbb9 req-61fb6f45-1fc2-4a6b-ae10-815cd8bf9366 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:34.531615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6646de2b-18e4-40c1-8a2e-9116afc7bbb9 req-61fb6f45-1fc2-4a6b-ae10-815cd8bf9366 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:34.532121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6646de2b-18e4-40c1-8a2e-9116afc7bbb9 req-61fb6f45-1fc2-4a6b-ae10-815cd8bf9366 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:34.545104 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6646de2b-18e4-40c1-8a2e-9116afc7bbb9 req-61fb6f45-1fc2-4a6b-ae10-815cd8bf9366 service nova] Creating event network-vif-deleted:416f6a36-aa2e-41cf-9f14-0d92db273f34 for instance 61bdc161-b150-4565-9f4c-61f9486ce8ca on n-h1-master-1 Oct 02 01:46:34.550588 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6646de2b-18e4-40c1-8a2e-9116afc7bbb9 req-61fb6f45-1fc2-4a6b-ae10-815cd8bf9366 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035404 Oct 02 01:46:34.551322 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3329/6473] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:35.172463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:35.173727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:35.181446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:35.182213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:35.182688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:35.183431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:35.184081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:35.185101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:35.203277 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 HTTP/1.1 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '0106bc48-2f18-4fcf-b73d-284c905d40b0'} Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:35.205127 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26d28bef-7cd3-435b-b54d-5071ab1026b3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 404 len: 111 microversion: 2.1 time: 0.038693 Oct 02 01:46:35.210000 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3145/6474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:35 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:46:35.396487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:35.397198 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: 61bdc161-b150-4565-9f4c-61f9486ce8ca] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:35.403542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:35.404026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:35.404477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:35.405180 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:35.405642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:35.406072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:35.419688 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] HTTP exception thrown: Instance 61bdc161-b150-4565-9f4c-61f9486ce8ca could not be found. Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Request method failure captured: Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca HTTP/1.1 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOvg5Zmg9o_TDtbUvRXpqYE-3VU_epo8elpy_IlxV4Q6QbiFkzGK_scNqAy5NJuR5MFpAkMXv_wLKz-bjQomO3KR5D5dHY-NfrddVaFcktSN8lq_k0vMyudFZYsqdExvX-vWxG4ITF45xgcPnDsqSYSybUEQKvJNs-ZJ5siFXDAfuZ8 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7955fc0f32784de19c7e0bd32b5afe1b"}]}] Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 4ac7b60e4e094354a9692bb46c3ebf8d Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 61bdc161-b150-4565-9f4c-61f9486ce8ca could not be found. Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '61bdc161-b150-4565-9f4c-61f9486ce8ca'} Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61bdc161-b150-4565-9f4c-61f9486ce8ca could not be found. Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61bdc161-b150-4565-9f4c-61f9486ce8ca could not be found. Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.421362 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61bdc161-b150-4565-9f4c-61f9486ce8ca could not be found. Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Returning 404 to user: Instance 61bdc161-b150-4565-9f4c-61f9486ce8ca could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-59035814-1560-4f0e-907d-9bc0c4cb7368 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca" status: 404 len: 111 microversion: 2.1 time: 0.031499 Oct 02 01:46:35.426529 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3330/6475] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:35 2022] GET /compute/v2.1/servers/61bdc161-b150-4565-9f4c-61f9486ce8ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:46:38.436959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:38.437552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:38.444552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:38.445066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:38.445522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:38.446247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:38.446756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:38.447202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:38.462679 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 HTTP/1.1 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '91415fac-08ae-416d-8ba5-2fb677c545f3'} Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:38.464534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ca4dbbd-9c2c-4400-a7b1-8faa31c57df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 404 len: 111 microversion: 2.1 time: 0.034302 Oct 02 01:46:38.473562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3146/6476] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:46:38 2022] DELETE /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:46:38.480616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:38.481301 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 91415fac-08ae-416d-8ba5-2fb677c545f3] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:38.496353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:38.497424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:38.497867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:38.498588 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:38.499076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:38.499501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:38.515354 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 HTTP/1.1 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '91415fac-08ae-416d-8ba5-2fb677c545f3'} Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:38.516899 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 91415fac-08ae-416d-8ba5-2fb677c545f3 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:38.521419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f564be28-1636-4f0a-85d0-216da507712b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3" status: 404 len: 111 microversion: 2.1 time: 0.042099 Oct 02 01:46:38.532262 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3331/6477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:38 2022] GET /compute/v2.1/servers/91415fac-08ae-416d-8ba5-2fb677c545f3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:46:38.978207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2392d711-e95b-41fb-9e20-c6fe917cf4c7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '.version_select at 0x7fb8808ab8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:39.013484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2392d711-e95b-41fb-9e20-c6fe917cf4c7 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2030827957" status: 202 len: 0 microversion: 2.1 time: 0.038081 Oct 02 01:46:39.018747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3147/6478] 10.222.0.23 () {58 vars in 1284 bytes} [Sun Oct 2 01:46:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2030827957 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:46:39.034538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:39.035026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:39.047449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:39.047871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:39.048308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:39.049007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:39.049463 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:39.049898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:39.050995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-222ef1d0-5947-43e4-9595-02914b431a19 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: .version_select at 0x7fb87bfc2280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-93367561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDTL9Emc85m4P77RjrEXyZnirYNhiJ2T94IiOnQT2nRkMFIxb0JMBLaPG32Oa4sN0z71V9YvyvcUC8FYZ/pIncNylO/b/BHEqqirjCoOkXEQMTzi9hrQaTrV3f+NbNEuw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:39.064401 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 HTTP/1.1 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0106bc48-2f18-4fcf-b73d-284c905d40b0'} Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:39.066113 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0f22a98-8d27-4022-9bba-e8e07e9724a3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 404 len: 111 microversion: 2.1 time: 0.037374 Oct 02 01:46:39.071740 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3332/6479] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:46:39 2022] DELETE /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:46:39.073158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-222ef1d0-5947-43e4-9595-02914b431a19 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:46:39.076063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:39.076674 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: 0106bc48-2f18-4fcf-b73d-284c905d40b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:39.081976 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-222ef1d0-5947-43e4-9595-02914b431a19 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:46:39.083972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:39.084461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:39.084899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:39.086311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:39.086826 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:39.087256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:39.110112 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.112417 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-222ef1d0-5947-43e4-9595-02914b431a19 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.067429 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 HTTP/1.1 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '0106bc48-2f18-4fcf-b73d-284c905d40b0'} Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:46:39.112832 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. Oct 02 01:46:39.118054 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:46:39.118648 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3148/6480] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:46:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:46:39.125035 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance 0106bc48-2f18-4fcf-b73d-284c905d40b0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:46:39.131496 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-42f11cba-228a-4007-a417-ca3b00c1c64c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0" status: 404 len: 111 microversion: 2.1 time: 0.059047 Oct 02 01:46:39.132115 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3333/6481] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:39 2022] GET /compute/v2.1/servers/0106bc48-2f18-4fcf-b73d-284c905d40b0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:46:39.211056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-133e40ed-e797-4238-8a6e-f975e683b81b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: .version_select at 0x7fb8809fb820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1102565841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5bxogoUv7K/ZBK36ow9m+ujEMPIYEjhPeS2OHRMer/p74126figaBc7OGsSafKbfbdjUASfv8m6pJYcN2W6cerSjqxbDdnxCPbEDf36vObKshvDxHBJWcVVTsm0PoBPw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:39.228739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-133e40ed-e797-4238-8a6e-f975e683b81b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:46:39.235101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-133e40ed-e797-4238-8a6e-f975e683b81b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:46:39.262548 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-133e40ed-e797-4238-8a6e-f975e683b81b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055113 Oct 02 01:46:39.266706 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3149/6482] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:46:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:45.480091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2077245464", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "f7a26709-4f9a-4014-84b2-83ed715c015a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-93367561", "security_groups": [{"name": "tempest-secgroup-smoke-1118535301"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:45.495036 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:45.636115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] validate_networks() for [('f7a26709-4f9a-4014-84b2-83ed715c015a', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:46:46.196460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:46:46.197217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:46:46.197700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:46:46.198131 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:46:46.198565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:46:46.209623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:46.210120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:46.213042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:46.213805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:46.214268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:46.214804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:46.235639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:46:46.243099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Getting quotas for user 4ac7b60e4e094354a9692bb46c3ebf8d and project 7955fc0f32784de19c7e0bd32b5afe1b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:46:46.259068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:46:46.262899 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:46:46.355497 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c972660e-e22d-45a2-9653-e77351fa8a71 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.880448 Oct 02 01:46:46.362324 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3334/6483] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:46:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:46:46.372397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ebba5dd-cb76-4de4-8df8-029c931eb4a4 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:46.373143 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ebba5dd-cb76-4de4-8df8-029c931eb4a4 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:46.380394 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:46.465770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ebba5dd-cb76-4de4-8df8-029c931eb4a4 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:46.475391 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ebba5dd-cb76-4de4-8df8-029c931eb4a4 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1265 microversion: 2.1 time: 0.109956 Oct 02 01:46:46.478390 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3150/6484] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:46 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:47.500443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:47.501699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:47.511703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:47.513071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:47.513752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:47.514791 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:47.515905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:47.517434 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:47.600813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:47.609697 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae6c8183-f557-4387-9795-c1533ee075ff tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1317 microversion: 2.1 time: 0.114947 Oct 02 01:46:47.618224 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3335/6485] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:47 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1317 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:48.641567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:48.642530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:48.652101 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:48.664804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:48.669802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:48.670537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:48.671348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:48.671835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:48.672286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:48.968290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:48.980131 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-714f6d94-2303-4815-bd53-0199ffcc74ad tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.342563 Oct 02 01:46:48.987435 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3151/6486] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:48 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:49.466714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-45b93fda-6c6c-4cdd-937f-e4165a1a5376 req-af7cbdab-4686-4d86-be62-af608a76db0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:49.478906 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-45b93fda-6c6c-4cdd-937f-e4165a1a5376 req-af7cbdab-4686-4d86-be62-af608a76db0a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:49.479503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-45b93fda-6c6c-4cdd-937f-e4165a1a5376 req-af7cbdab-4686-4d86-be62-af608a76db0a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:49.480019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-45b93fda-6c6c-4cdd-937f-e4165a1a5376 req-af7cbdab-4686-4d86-be62-af608a76db0a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:49.502814 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-45b93fda-6c6c-4cdd-937f-e4165a1a5376 req-af7cbdab-4686-4d86-be62-af608a76db0a service nova] Creating event network-changed:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:46:49.508611 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-45b93fda-6c6c-4cdd-937f-e4165a1a5376 req-af7cbdab-4686-4d86-be62-af608a76db0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046412 Oct 02 01:46:49.509375 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3336/6487] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:50.007855 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:50.008492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:50.016814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:50.017334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:50.017777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:50.018499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:50.019009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:50.019448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:50.156660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:50.164584 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fbf90c47-dbe8-4657-8799-66d333651418 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.160686 Oct 02 01:46:50.165177 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3152/6488] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:50 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:51.189642 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:51.190423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:51.197232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:51.197731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:51.198173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:51.199002 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:51.199464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:51.200668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:51.365976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:51.374899 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a6fa1c7-b95a-4a48-9611-36bfb89ec83e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.190337 Oct 02 01:46:51.375807 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3337/6489] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:51 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:52.397226 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:52.397834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:52.406446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:52.407118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:52.407847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:52.408719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:52.409449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:52.409896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:52.660342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:52.669363 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8387de5a-43ec-4277-ad72-4967f97998cd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.274820 Oct 02 01:46:52.670278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3153/6490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:52 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:53.693884 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:53.694655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:53.702234 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:53.702752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:53.703192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:53.703927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:53.704384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:53.704811 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:53.844682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:53.852420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-447f5f65-a41f-4564-8fd4-817e8c531837 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.162529 Oct 02 01:46:53.853001 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3338/6491] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:53 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:54.877270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:54.878177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:54.885128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:54.885709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:54.886256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:54.887229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:54.888028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:54.888582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:54.952407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c9c99959-d3ca-4087-807f-ecb35c5c049f req-95388a4d-09b7-42d8-ad3e-ec79c842c03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "name": "network-vif-plugged", "status": "completed", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:54.975330 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c9c99959-d3ca-4087-807f-ecb35c5c049f req-95388a4d-09b7-42d8-ad3e-ec79c842c03a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:54.976078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c9c99959-d3ca-4087-807f-ecb35c5c049f req-95388a4d-09b7-42d8-ad3e-ec79c842c03a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:54.976733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c9c99959-d3ca-4087-807f-ecb35c5c049f req-95388a4d-09b7-42d8-ad3e-ec79c842c03a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:55.000324 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c9c99959-d3ca-4087-807f-ecb35c5c049f req-95388a4d-09b7-42d8-ad3e-ec79c842c03a service nova] Creating event network-vif-plugged:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:46:55.016027 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c9c99959-d3ca-4087-807f-ecb35c5c049f req-95388a4d-09b7-42d8-ad3e-ec79c842c03a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070961 Oct 02 01:46:55.017257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3339/6492] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:46:55.053722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:55.062230 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-280b1b4c-bc82-498f-9b5e-851f5d82bbd5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.188960 Oct 02 01:46:55.062846 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3154/6493] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:54 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:56.087371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:56.087992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:56.097447 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:56.099670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:56.100118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:56.100858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:56.101318 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:56.101751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:56.227048 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:56.254887 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:56.270555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:56.286228 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4cec8cee-b98a-4d89-959b-51ce300952df tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1391 microversion: 2.1 time: 0.203737 Oct 02 01:46:56.295061 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3340/6494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:56 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:57.315414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:57.316493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:57.320312 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:57.327761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:57.328568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:57.329200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:57.330125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:57.330878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:57.331840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:57.475983 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:57.484265 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-00fa60a8-ac52-42b1-8eee-e07e7be44a10 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1563 microversion: 2.1 time: 0.176848 Oct 02 01:46:57.484853 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3155/6495] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:57 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:57.507376 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:57.508612 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:57.517957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:57.518750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:57.519255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:57.519974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:57.520433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:57.520863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:57.662153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:57.671330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-138ffc10-8f70-47c0-aa61-7df00ed7106e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1563 microversion: 2.1 time: 0.167773 Oct 02 01:46:57.672058 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3341/6496] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:57 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:46:59.203610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-305632426", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1102565841", "security_groups": [{"name": "tempest-secgroup-smoke-2117939318"}], "block_device_mapping_v2": [{"uuid": "211f9e7b-2a92-437c-8f8a-446bd3cc5981", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:59.348004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:46:59.446497 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:46:59.447234 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:46:59.454369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:59.454927 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:59.455370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:59.456124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:59.456563 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:59.456993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:59.695758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:46:59.706970 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dcbcb5ac-5e3a-4305-b56b-9136d656b410 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1563 microversion: 2.1 time: 0.264837 Oct 02 01:46:59.723838 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3342/6497] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:46:59 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1563 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:46:59.745963 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6937a783-d456-42b5-8209-42fe868d4f9c req-dadd4c82-a3a5-4224-a450-c8ffe32afd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:46:59.761695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6937a783-d456-42b5-8209-42fe868d4f9c req-dadd4c82-a3a5-4224-a450-c8ffe32afd29 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:46:59.763313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6937a783-d456-42b5-8209-42fe868d4f9c req-dadd4c82-a3a5-4224-a450-c8ffe32afd29 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:46:59.763871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6937a783-d456-42b5-8209-42fe868d4f9c req-dadd4c82-a3a5-4224-a450-c8ffe32afd29 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:46:59.776849 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6937a783-d456-42b5-8209-42fe868d4f9c req-dadd4c82-a3a5-4224-a450-c8ffe32afd29 service nova] Creating event network-changed:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:46:59.782897 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6937a783-d456-42b5-8209-42fe868d4f9c req-dadd4c82-a3a5-4224-a450-c8ffe32afd29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057737 Oct 02 01:46:59.783938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3343/6498] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:47:00.213938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:47:00.215061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:47:00.216171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:47:00.216603 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:47:00.217228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:47:00.227798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:00.228348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:00.228812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:00.229685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:00.230164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:00.230643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:00.253872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:47:00.259527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:47:00.327302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:47:00.329452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='211f9e7b-2a92-437c-8f8a-446bd3cc5981',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:47:00.489159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c8bce0e-ca31-4f21-9a34-2cb132b47270 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.289726 Oct 02 01:47:00.502947 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aaf2c5cf-ae9b-4bc3-948e-f66f4ab65f36 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:00.504380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aaf2c5cf-ae9b-4bc3-948e-f66f4ab65f36 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:00.509226 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3156/6499] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:46:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:47:00.912848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aaf2c5cf-ae9b-4bc3-948e-f66f4ab65f36 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:00.924749 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aaf2c5cf-ae9b-4bc3-948e-f66f4ab65f36 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1094 microversion: 2.1 time: 0.426239 Oct 02 01:47:00.938973 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3344/6500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:00 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1094 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:01.949557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:01.950191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:01.966355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:01.973970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:01.974503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:01.975288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:01.975776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:01.976860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:02.124283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:02.132445 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dd96739a-5c7d-4dbe-8dc6-c2543fee2fb1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1210 microversion: 2.1 time: 0.187621 Oct 02 01:47:02.134104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3157/6501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:01 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:03.132767 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-df7aa456-ead9-4674-98da-72eb0d02b276 req-a9e9bd4a-deea-45d0-9a4c-5a962733ffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a", "tag": "df430fc8-7358-42a2-b269-d41ac3fc4862"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:47:03.145202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-df7aa456-ead9-4674-98da-72eb0d02b276 req-a9e9bd4a-deea-45d0-9a4c-5a962733ffa6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:03.146117 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-df7aa456-ead9-4674-98da-72eb0d02b276 req-a9e9bd4a-deea-45d0-9a4c-5a962733ffa6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:03.146915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-df7aa456-ead9-4674-98da-72eb0d02b276 req-a9e9bd4a-deea-45d0-9a4c-5a962733ffa6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:03.151605 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:03.157804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:03.159266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:03.172274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:03.172878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:03.173582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:03.179178 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-df7aa456-ead9-4674-98da-72eb0d02b276 req-a9e9bd4a-deea-45d0-9a4c-5a962733ffa6 service nova] Creating event network-changed:df430fc8-7358-42a2-b269-d41ac3fc4862 for instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a on n-h2-master-1 Oct 02 01:47:03.183630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:03.184955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:03.185405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:03.197044 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-df7aa456-ead9-4674-98da-72eb0d02b276 req-a9e9bd4a-deea-45d0-9a4c-5a962733ffa6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068075 Oct 02 01:47:03.197978 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3345/6502] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:47:03.419973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:03.428202 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a3e91d4-038f-4058-8d9e-631728679e89 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1278 microversion: 2.1 time: 0.274358 Oct 02 01:47:03.428867 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3158/6503] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:03 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:04.453523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:04.454248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:04.460855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:04.461354 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:04.461794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:04.462733 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:04.463370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:04.463973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:04.688273 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:04.696353 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3aad9c74-8b7e-4a3a-8d80-bb4cc9e5f9b1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1278 microversion: 2.1 time: 0.249064 Oct 02 01:47:04.696938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3346/6504] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:04 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:05.720594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:05.721213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:05.728601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:05.729092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:05.729535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:05.730241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:05.731586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:05.731751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:05.870636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:05.878699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c9b4ed3-da32-41a2-ac7e-3d90f9ed2c82 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1278 microversion: 2.1 time: 0.162005 Oct 02 01:47:05.879280 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3159/6505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:05 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:06.905286 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:06.905831 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:06.912613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:06.913092 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:06.913527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:06.914208 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:06.914691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:06.915112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:07.045576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:07.053274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e2aebdd1-ae6c-4560-8a6b-b441b694ccab tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.152282 Oct 02 01:47:07.053848 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3347/6506] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:06 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:08.077882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:08.078499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:08.085472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:08.085967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:08.086416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:08.087153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:08.087629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:08.088070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:08.218410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:08.226118 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43e58ba2-8498-490f-933e-6e89936a0167 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.152697 Oct 02 01:47:08.226636 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3160/6507] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:08 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:09.248713 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:09.249272 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:09.256213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:09.256696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:09.257126 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:09.257804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:09.258256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:09.258711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:09.392958 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:09.400691 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-875a263f-498c-4252-99d1-37095d195366 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.155939 Oct 02 01:47:09.401268 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3348/6508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:09 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:10.424415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:10.425046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:10.427732 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:10.428419 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:10.434362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:10.434879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:10.435354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:10.436056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:10.436524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:10.436957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:10.571134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:10.580088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9d0f8401-9dfc-473d-8137-41dddd2dde13 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.159533 Oct 02 01:47:10.580667 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3161/6509] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:10 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:11.604324 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:11.604973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:11.608617 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:11.614061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:11.614545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:11.615018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:11.615715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:11.616173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:11.616608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:11.750816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:11.758541 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10f90363-5700-43bc-b7df-f128b0292ed7 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.158107 Oct 02 01:47:11.759147 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3349/6510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:11 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:12.782374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:12.783066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:12.789957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:12.790457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:12.790956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:12.791672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:12.792149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:12.792592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:12.924664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:12.932549 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8056fb62-fa30-4349-8a5e-2979b5013d4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.154752 Oct 02 01:47:12.933125 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3162/6511] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:12 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:13.956135 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:13.956699 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:13.963582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:13.964072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:13.965007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:13.965758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:13.966209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:13.966678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:14.100230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:14.109067 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2202e65d-b41c-463e-9f94-31b05559f7d9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.156953 Oct 02 01:47:14.109642 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3350/6512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:13 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:15.131770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:15.132395 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:15.139749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:15.140242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:15.140690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:15.141396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:15.141893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:15.142329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:15.280960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:15.288771 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e2b177d-2797-4bdb-b967-0734668e353f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.160938 Oct 02 01:47:15.289352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3163/6513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:15 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:47:16.311766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:16.312383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:16.315109 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:16.320553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:16.321042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:16.321484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:16.322179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:16.322700 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:16.323132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:16.457335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:16.465740 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bcc7a077-cd15-431f-a104-aeb2066618e9 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.157962 Oct 02 01:47:16.466329 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3351/6514] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:16 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:17.488638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:17.489275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:17.492027 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:17.497632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:17.498140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:17.498592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:17.499330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:17.499840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:17.500285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:17.579453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6ce4ebc7-f46e-4fc7-895b-a471fbac0278 req-65c3592b-99f8-4e01-ada9-96c166c4dcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a", "name": "network-vif-plugged", "status": "completed", "tag": "df430fc8-7358-42a2-b269-d41ac3fc4862"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:47:17.592750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6ce4ebc7-f46e-4fc7-895b-a471fbac0278 req-65c3592b-99f8-4e01-ada9-96c166c4dcc0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:17.593518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6ce4ebc7-f46e-4fc7-895b-a471fbac0278 req-65c3592b-99f8-4e01-ada9-96c166c4dcc0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:17.593963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6ce4ebc7-f46e-4fc7-895b-a471fbac0278 req-65c3592b-99f8-4e01-ada9-96c166c4dcc0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:17.606818 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6ce4ebc7-f46e-4fc7-895b-a471fbac0278 req-65c3592b-99f8-4e01-ada9-96c166c4dcc0 service nova] Creating event network-vif-plugged:df430fc8-7358-42a2-b269-d41ac3fc4862 for instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a on n-h2-master-1 Oct 02 01:47:17.612504 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6ce4ebc7-f46e-4fc7-895b-a471fbac0278 req-65c3592b-99f8-4e01-ada9-96c166c4dcc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037353 Oct 02 01:47:17.613519 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3352/6515] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:47:17.648988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:17.659360 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3efbada9-aa4e-4f6c-ad33-6a792f883d3c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.174606 Oct 02 01:47:17.660155 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3164/6516] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:17 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:18.685657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:18.686359 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:18.693446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:18.693925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:18.694360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:18.695072 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:18.695525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:18.695947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:18.833910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:18.842945 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7b3647cf-bfea-48a8-8bc4-c307f65adc32 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1266 microversion: 2.1 time: 0.161993 Oct 02 01:47:18.843742 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3353/6517] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:18 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:19.866315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:19.867007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:19.874747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:19.875244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:19.875690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:19.876398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:19.876870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:19.877310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:19.879956 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=81 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:20.008419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:20.016811 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d468e75c-ed3e-4828-b6ce-855ecbac05c6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1452 microversion: 2.1 time: 0.154496 Oct 02 01:47:20.017376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3165/6518] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:19 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:20.038425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:47:20.039166 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:20.046038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:20.046517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:20.046985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:20.047682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:20.048140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:20.048568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:20.190213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:47:20.199514 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9164074e-5fad-404a-bc56-a8042a25110a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1452 microversion: 2.1 time: 0.164849 Oct 02 01:47:20.200097 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3354/6519] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:47:20 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:47:21.809925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-495f4cfe-9dfd-4904-9435-7261f9e03ad7 req-7679ff6f-02c8-4dc8-a863-5b8d51552647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a", "tag": "df430fc8-7358-42a2-b269-d41ac3fc4862"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:47:21.820332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-495f4cfe-9dfd-4904-9435-7261f9e03ad7 req-7679ff6f-02c8-4dc8-a863-5b8d51552647 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:21.820825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-495f4cfe-9dfd-4904-9435-7261f9e03ad7 req-7679ff6f-02c8-4dc8-a863-5b8d51552647 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:21.821270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-495f4cfe-9dfd-4904-9435-7261f9e03ad7 req-7679ff6f-02c8-4dc8-a863-5b8d51552647 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:21.832371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-495f4cfe-9dfd-4904-9435-7261f9e03ad7 req-7679ff6f-02c8-4dc8-a863-5b8d51552647 service nova] Creating event network-changed:df430fc8-7358-42a2-b269-d41ac3fc4862 for instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a on n-h2-master-1 Oct 02 01:47:21.837394 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-495f4cfe-9dfd-4904-9435-7261f9e03ad7 req-7679ff6f-02c8-4dc8-a863-5b8d51552647 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032302 Oct 02 01:47:21.837994 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3166/6520] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:47:33.048581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:47:33.050840 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:47:33.053143 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:33.053799 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=51 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:33.059663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:33.061044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:33.061218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:33.061907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:47:33.062363 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:47:33.062880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:47:33.117419 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d73b30b6-f860-41da-b0f1-d05ab2c12a8e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action" status: 200 len: 24571 microversion: 2.1 time: 0.073334 Oct 02 01:47:33.118270 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3355/6521] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:47:33 2022] POST /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:48:03.455999 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=5 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:03.457344 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:03.462343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d452563b-d97f-4ef2-b927-770421bd0406"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:48:03.465291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:03.473540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:03.474047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:03.474504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:03.475253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:03.475725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:03.476171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:03.555546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:48:03.556231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:48:03.556735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:48:03.557162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:48:03.557589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:48:03.617860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:03.623954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:03.624657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:03.625114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:03.625888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:03.626364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:03.626853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:03.653195 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fca1853e-370b-41cb-aa2c-8b9956c9c12d tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action" status: 202 len: 1137 microversion: 2.1 time: 0.199220 Oct 02 01:48:03.653854 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3167/6522] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:48:03 2022] POST /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action => generated 1137 bytes in 201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 02 01:48:03.674719 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:03.675531 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:03.679899 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:48:03.680124 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 (ip 10.222.0.23) !!! Oct 02 01:48:03.681309 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:03.682558 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:03.688433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:03.688950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:03.689357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:03.690179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:03.690698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:03.691228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:03.827685 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:03.837536 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47e192ae-8186-4f21-b4c8-134a42172f7a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.167191 Oct 02 01:48:03.838118 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3356/6523] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:03 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:04.863286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:04.864009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:04.871033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:04.871538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:04.871992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:04.872708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:04.873391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:04.873835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:05.111695 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:05.120117 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ecfbd375-4e3d-497d-9ba1-ce4b421f851e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.261223 Oct 02 01:48:05.120641 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3168/6524] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:04 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:06.143681 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:06.144848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:06.151839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:06.152338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:06.152782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:06.153520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:06.153963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:06.154407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:06.286666 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:06.294444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3bea2be7-80c6-46c4-9e60-25de78850bf0 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.154743 Oct 02 01:48:06.295044 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3357/6525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:06 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:07.319464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:07.319999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:07.326880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:07.327379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:07.327824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:07.328524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:07.328993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:07.329458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:07.469803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:07.480955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c78eca05-b32c-4202-b5e3-ac7cf7d1ba0b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.166286 Oct 02 01:48:07.481542 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3169/6526] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:07 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:08.504979 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:08.505566 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:08.512378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:08.512851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:08.513280 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:08.513963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:08.514417 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:08.514866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:08.648163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:08.656021 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-aede1dbb-bd70-426c-acc9-6f4a86255d91 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.155388 Oct 02 01:48:08.656604 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3358/6527] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:08 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:09.679961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:09.680573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:09.687934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:09.688430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:09.688884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:09.689588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:09.690059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:09.690499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:09.822896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:09.830577 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eccb8ed3-9c01-448a-951f-439ce339bf22 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.154609 Oct 02 01:48:09.831174 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3170/6528] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:09 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:10.853506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:10.854118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:10.860972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:10.861487 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:10.861923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:10.862625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:10.863089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:10.863508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:10.999616 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:11.008373 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-144c94d4-f7c8-4563-a397-2feec691143c tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.158724 Oct 02 01:48:11.008949 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3359/6529] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:10 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:12.032915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:12.033541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:12.041014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:12.041508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:12.041961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:12.042684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:12.043154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:12.043593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:12.186500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:12.194964 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4838fffa-e7f4-453f-b29c-a9c715ada4d5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.165910 Oct 02 01:48:12.195544 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3171/6530] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:12 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:13.218882 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:13.219495 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:13.227019 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:13.227441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:13.227877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:13.228556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:13.229009 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:13.229431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:13.363594 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:13.371221 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9480d26-7f72-4a6f-9004-75c181ce3c39 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.156323 Oct 02 01:48:13.371797 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3360/6531] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:13 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:14.396133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:14.396758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:14.403722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:14.404215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:14.404663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:14.405362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:14.405830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:14.406268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:14.537786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:14.548362 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70fb1214-39fe-4358-875c-8092ae79da5f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.156749 Oct 02 01:48:14.553777 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3172/6532] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:14 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:15.572454 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:15.573067 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:15.580243 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:15.580762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:15.581872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:15.582574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:15.583056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:15.583482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:15.716349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:15.724824 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c5dbb983-1c2a-4749-a1b8-3d803a04da89 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.156279 Oct 02 01:48:15.725407 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3361/6533] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:15 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:16.748393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:16.749006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:16.756372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:16.757108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:16.757772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:16.758856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:16.759739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:16.760531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:16.897934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:16.905902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-169ed567-d32c-4661-8dcd-10e903382df5 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.161550 Oct 02 01:48:16.906465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3173/6534] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:16 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:17.930422 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:17.931068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:17.938116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:17.938592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:17.939066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:17.939780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:17.940235 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:17.941230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:18.073789 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:18.081582 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-41dadc8e-caf0-404e-8ca0-1427b6780072 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.154978 Oct 02 01:48:18.082165 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3362/6535] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:17 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:19.105124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:19.105749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:19.112698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:19.113216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:19.113663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:19.114393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:19.114892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:19.115329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:19.251669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:19.259618 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ded4a913-27b6-4924-be7b-e8cfef2559fc tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.158286 Oct 02 01:48:19.260201 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3174/6536] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:19 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:20.283897 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:20.284470 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:20.291333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:20.291812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:20.292245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:20.292933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:20.293384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:20.293805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:20.426982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:20.436310 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ac7cea8e-a87d-4000-a405-6566797e8224 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1690 microversion: 2.1 time: 0.156258 Oct 02 01:48:20.437211 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3363/6537] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:20 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:21.460670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:21.462176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:21.469025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:21.469518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:21.469963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:21.470702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:21.471170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:21.471606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:21.609457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:21.617649 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-acf6350d-6055-48bd-b1d9-ec8ddc7b2995 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1696 microversion: 2.1 time: 0.161673 Oct 02 01:48:21.618239 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3175/6538] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:21 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:22.641748 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:22.642356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:22.649130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:22.649612 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:22.650045 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:22.650760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:22.651220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:22.651642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:22.796965 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:22.805427 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96008c8c-0bc8-4973-a3d7-eeaa923583a1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1696 microversion: 2.1 time: 0.167691 Oct 02 01:48:22.806013 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3364/6539] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:22 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:23.497034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cc27d233-cd44-4717-bfa7-8b6451082b38 req-7bd681ee-a55b-430a-9acf-921a016894ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "name": "network-vif-unplugged", "status": "completed", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:48:23.507461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cc27d233-cd44-4717-bfa7-8b6451082b38 req-7bd681ee-a55b-430a-9acf-921a016894ea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:23.508030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cc27d233-cd44-4717-bfa7-8b6451082b38 req-7bd681ee-a55b-430a-9acf-921a016894ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:23.508540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cc27d233-cd44-4717-bfa7-8b6451082b38 req-7bd681ee-a55b-430a-9acf-921a016894ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:23.519685 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cc27d233-cd44-4717-bfa7-8b6451082b38 req-7bd681ee-a55b-430a-9acf-921a016894ea service nova] Creating event network-vif-unplugged:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:48:23.525487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cc27d233-cd44-4717-bfa7-8b6451082b38 req-7bd681ee-a55b-430a-9acf-921a016894ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131577 Oct 02 01:48:23.526098 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3176/6540] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:48:23.829049 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:23.829689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:23.836571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:23.837059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:23.837499 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:23.838191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:23.838707 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:23.839137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:23.972163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:23.984046 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0c9f45b-3e9a-41fe-81b7-b033571eda9a tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1696 microversion: 2.1 time: 0.158791 Oct 02 01:48:23.984641 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3365/6541] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:23 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:25.008723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:48:25.009443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:25.016745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:25.017247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:25.017696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:25.018397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:25.018891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:25.019332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:25.150078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:48:25.157899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-64309622-2345-45ed-b106-1db683c0b78f tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1681 microversion: 2.1 time: 0.153825 Oct 02 01:48:25.158475 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3177/6542] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:48:25 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:48:25.626163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-a4025340-ae9f-47c9-a972-24456d3d31f9 req-06e4581e-a035-49fd-aa3c-f763d3095b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "name": "network-vif-plugged", "status": "completed", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:48:25.636514 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a4025340-ae9f-47c9-a972-24456d3d31f9 req-06e4581e-a035-49fd-aa3c-f763d3095b6a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:25.636998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a4025340-ae9f-47c9-a972-24456d3d31f9 req-06e4581e-a035-49fd-aa3c-f763d3095b6a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:25.637435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-a4025340-ae9f-47c9-a972-24456d3d31f9 req-06e4581e-a035-49fd-aa3c-f763d3095b6a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:25.648967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-a4025340-ae9f-47c9-a972-24456d3d31f9 req-06e4581e-a035-49fd-aa3c-f763d3095b6a service nova] Creating event network-vif-plugged:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:48:25.653978 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-a4025340-ae9f-47c9-a972-24456d3d31f9 req-06e4581e-a035-49fd-aa3c-f763d3095b6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031827 Oct 02 01:48:25.654585 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3366/6543] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:48:59.395474 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:48:59.397756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:48:59.400135 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=26 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:59.400823 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:59.401975 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:48:59.402164 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:48:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action (ip 10.222.0.23) !!! Oct 02 01:48:59.409725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:59.410223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:59.410702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:59.411408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:48:59.411880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:48:59.412316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:48:59.470079 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77faf09f-1b36-4baa-a78e-d82e5cfea2fd tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "POST /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action" status: 200 len: 24562 microversion: 2.1 time: 0.078623 Oct 02 01:48:59.470743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3178/6544] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:48:59 2022] POST /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176/action => generated 24562 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:49:17.058316 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=22 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:17.059081 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=62 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:17.122668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:17.123267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:17.129505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:17.129986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:17.130421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:17.131127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:17.131590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:17.132011 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:17.157146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:49:17.232870 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66fd22a4-2b09-4bc2-9df9-1d2c657b0791 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 204 len: 0 microversion: 2.1 time: 0.176523 Oct 02 01:49:17.233350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3367/6545] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:49:17 2022] DELETE /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:49:17.242658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:17.243387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:17.246290 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:17.247026 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:17.253236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:17.253731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:17.254183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:17.254928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:17.255397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:17.255839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:17.391320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:17.399357 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4757d067-d69b-4ecb-84f6-a5dd7deebf8a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1576 microversion: 2.1 time: 0.161009 Oct 02 01:49:17.399934 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3179/6546] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:17 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:18.423269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:18.424004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:18.431584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:18.432332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:18.432766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:18.433452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:18.433903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:18.434324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:18.566329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:18.575040 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7cc61481-f11e-450a-ab11-2915b7774b4b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1576 microversion: 2.1 time: 0.156032 Oct 02 01:49:18.575624 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3368/6547] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:18 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:19.597440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:19.598010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:19.606230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:19.606768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:19.607223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:19.607995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:19.608472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:19.608917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:19.694931 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:19.703899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c45b4db0-e45f-4476-a7a5-f964f64f8330 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1508 microversion: 2.1 time: 0.110434 Oct 02 01:49:19.704489 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3180/6548] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:19 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1508 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:19.803908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e8df40bc-9f15-4d60-8478-7ebfac47ae80 req-ca7c7cf2-3586-42f4-9b7b-3ac3a64c16e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a", "name": "network-vif-deleted", "tag": "df430fc8-7358-42a2-b269-d41ac3fc4862"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:19.816607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e8df40bc-9f15-4d60-8478-7ebfac47ae80 req-ca7c7cf2-3586-42f4-9b7b-3ac3a64c16e2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:19.817097 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e8df40bc-9f15-4d60-8478-7ebfac47ae80 req-ca7c7cf2-3586-42f4-9b7b-3ac3a64c16e2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:19.817538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e8df40bc-9f15-4d60-8478-7ebfac47ae80 req-ca7c7cf2-3586-42f4-9b7b-3ac3a64c16e2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:19.831862 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e8df40bc-9f15-4d60-8478-7ebfac47ae80 req-ca7c7cf2-3586-42f4-9b7b-3ac3a64c16e2 service nova] Creating event network-vif-deleted:df430fc8-7358-42a2-b269-d41ac3fc4862 for instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a on n-h2-master-1 Oct 02 01:49:19.839788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e8df40bc-9f15-4d60-8478-7ebfac47ae80 req-ca7c7cf2-3586-42f4-9b7b-3ac3a64c16e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039886 Oct 02 01:49:19.841281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3369/6549] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:20.728169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:20.728928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:20.736827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:20.737341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:20.737800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:20.738524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:20.739027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:20.739475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:21.068530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:21.077307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9494b45-c8fb-4fdb-ac31-ba843c6c1450 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1225 microversion: 2.1 time: 0.354124 Oct 02 01:49:21.078260 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3181/6550] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:20 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1225 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:22.101601 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:22.102388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:22.108712 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:22.109193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:22.109627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:22.110310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:22.110793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:22.111218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:22.176893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:22.185487 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0deea0c2-f9ad-4b08-b5ea-c68dba3215cb tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1225 microversion: 2.1 time: 0.089023 Oct 02 01:49:22.186069 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3370/6551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:22 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:23.208499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:23.209271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:23.216131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:23.216626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:23.217079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:23.217787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:23.218264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:23.218735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:23.281602 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:23.290226 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-978624cc-7482-4513-b79d-9252599cae4e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1225 microversion: 2.1 time: 0.085631 Oct 02 01:49:23.290827 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3182/6552] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:23 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:24.313287 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:24.313924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:24.320644 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:24.321128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:24.321574 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:24.322263 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:24.322752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:24.323182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:24.353523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:24.353994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:24.354427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:24.354893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lazy-loading 'fault' on Instance uuid d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:49:24.394413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:24.402842 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-498207a0-6d4e-45d3-95cc-de27dacce502 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 200 len: 1230 microversion: 2.1 time: 0.093332 Oct 02 01:49:24.403435 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3371/6553] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:24 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:25.426780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:25.427450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:25.434806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:25.435305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:25.435757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:25.436465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:25.436933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:25.437370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:25.450667 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a HTTP/1.1 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a'} Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:25.452304 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3306c572-3be9-46b1-8c77-4c3185d69355 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 404 len: 111 microversion: 2.1 time: 0.031377 Oct 02 01:49:25.458298 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3183/6554] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:25 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:49:25.502812 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1597756327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1102565841", "security_groups": [{"name": "tempest-secgroup-smoke-2117939318"}], "block_device_mapping_v2": [{"uuid": "211f9e7b-2a92-437c-8f8a-446bd3cc5981", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:25.616230 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:49:26.109510 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:49:26.109984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:49:26.110468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:49:26.110898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:49:26.111338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:49:26.120736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:26.121217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:26.121649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:26.122362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:26.122851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:26.123272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:26.140264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:49:26.145434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Getting quotas for user 30c3d05e92dd463e81ccc5a557e46fa3 and project 1ff590c5b5cc499386a58d5b84c7462b. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:49:26.203580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:49:26.205696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='211f9e7b-2a92-437c-8f8a-446bd3cc5981',volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:49:26.331881 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [6d816150-16c7-4987-bbfb-07a8c19e4cc2] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:49:27.338375 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [6d816150-16c7-4987-bbfb-07a8c19e4cc2] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 53484. Oct 02 01:49:27.342080 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d1da5c77-b7a0-4afa-8534-9cca207d300c tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.843419 Oct 02 01:49:27.342850 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3372/6555] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:49:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:49:27.354415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c478a07b-12c0-403d-9343-0cdef264ed7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:27.355096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c478a07b-12c0-403d-9343-0cdef264ed7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:27.410713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c478a07b-12c0-403d-9343-0cdef264ed7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:27.419435 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c478a07b-12c0-403d-9343-0cdef264ed7d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1095 microversion: 2.1 time: 0.069359 Oct 02 01:49:27.420005 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3184/6556] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:27 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:49:28.443682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:28.444296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:28.451203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:28.451693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:28.452156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:28.452858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:28.453313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:28.453741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:28.519388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:28.527215 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2fc44d98-4cba-4c75-abd4-4326a2ea4763 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1193 microversion: 2.1 time: 0.088822 Oct 02 01:49:28.527796 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3373/6557] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:28 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:29.006200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:29.007335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:29.014103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:29.014788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:29.015336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:29.016170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:29.016751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:29.017557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:29.057802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:49:29.160332 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-55d018ba-d0a0-4987-9de0-69542c7b0203 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 204 len: 0 microversion: 2.1 time: 0.157333 Oct 02 01:49:29.161822 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3185/6558] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:49:29 2022] DELETE /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:49:29.170558 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:29.171332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:29.177625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:29.178259 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:29.178835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:29.179792 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:29.180345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:29.180888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:29.387487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:29.395639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9ae7a8c-fa7e-439f-a144-943a12fc42a3 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1733 microversion: 2.1 time: 0.228835 Oct 02 01:49:29.396243 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3374/6559] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:29 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:29.552022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:29.552672 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:29.560796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:29.561314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:29.561777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:29.562507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:29.563018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:29.563628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:29.646089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:29.655214 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6e4b28c-2cf0-4ad1-85da-02d2439495fa tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1211 microversion: 2.1 time: 0.107694 Oct 02 01:49:29.656144 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3186/6560] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:29 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:30.421481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:30.422193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:30.434314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:30.435119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:30.436285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:30.438362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:30.439213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:30.440041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:30.685719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:30.687057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:30.694086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:30.695729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:30.696755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:30.697707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:30.698490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:30.699131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:30.915453 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:30.932590 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-becc0163-fe90-4467-8ce4-422849f8994f tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1733 microversion: 2.1 time: 0.515479 Oct 02 01:49:30.933199 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3375/6561] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:30 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1733 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:30.948813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-30a1409e-23d7-4458-b8f0-483178ef7636 req-fdb84763-2a40-4623-9ef5-9bb9f6f73450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59a22a7-0861-4392-b911-d932042720ae", "tag": "42a8ab05-f07c-40f7-8e5b-41864c437cd3"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:30.948813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30a1409e-23d7-4458-b8f0-483178ef7636 req-fdb84763-2a40-4623-9ef5-9bb9f6f73450 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:30.948813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30a1409e-23d7-4458-b8f0-483178ef7636 req-fdb84763-2a40-4623-9ef5-9bb9f6f73450 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:30.948813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-30a1409e-23d7-4458-b8f0-483178ef7636 req-fdb84763-2a40-4623-9ef5-9bb9f6f73450 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:30.973348 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-30a1409e-23d7-4458-b8f0-483178ef7636 req-fdb84763-2a40-4623-9ef5-9bb9f6f73450 service nova] Creating event network-changed:42a8ab05-f07c-40f7-8e5b-41864c437cd3 for instance f59a22a7-0861-4392-b911-d932042720ae on n-h1-master-1 Oct 02 01:49:30.980944 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-30a1409e-23d7-4458-b8f0-483178ef7636 req-fdb84763-2a40-4623-9ef5-9bb9f6f73450 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046527 Oct 02 01:49:30.981734 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3376/6562] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:30.987551 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:30.988971 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:30.998108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:30.998955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:30.999880 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:31.001199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:31.002012 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:31.002685 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:31.040554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:49:31.169067 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5cdc6ea3-9d34-494f-b38e-f97a27818b9e tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 204 len: 0 microversion: 2.1 time: 0.185535 Oct 02 01:49:31.169670 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3377/6563] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:49:30 2022] DELETE /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:49:31.179114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:31.179952 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-8e389729-6c25-4941-8ab2-34e5d749a45f req-0b39e095-a5cf-4090-9003-8718e8a1cb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:31.190367 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f7eccea-308a-4eb6-9e3e-4cd0eadb9091 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1279 microversion: 2.1 time: 0.513216 Oct 02 01:49:31.191845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e389729-6c25-4941-8ab2-34e5d749a45f req-0b39e095-a5cf-4090-9003-8718e8a1cb79 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:31.192524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e389729-6c25-4941-8ab2-34e5d749a45f req-0b39e095-a5cf-4090-9003-8718e8a1cb79 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:31.193170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-8e389729-6c25-4941-8ab2-34e5d749a45f req-0b39e095-a5cf-4090-9003-8718e8a1cb79 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:31.207189 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3187/6564] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:30 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1279 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:49:31.219545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:31.220114 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-8e389729-6c25-4941-8ab2-34e5d749a45f req-0b39e095-a5cf-4090-9003-8718e8a1cb79 service nova] Creating event network-changed:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:49:31.220905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:31.227292 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-8e389729-6c25-4941-8ab2-34e5d749a45f req-0b39e095-a5cf-4090-9003-8718e8a1cb79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052466 Oct 02 01:49:31.227923 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3378/6565] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:31.238480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:31.239941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:31.240651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:31.243942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:31.244730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:31.245412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:31.542537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:31.553007 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed00ef6f-3fac-4a0f-b2e9-ee59f7abf2c1 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1687 microversion: 2.1 time: 0.343263 Oct 02 01:49:31.568340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3188/6566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:31 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1687 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:31.963496 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:31.964808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:31.971559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:31.972319 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:31.972956 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:31.973706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:31.975129 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:31.975430 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:32.083486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a7c1c4929d49aea6e4e492e32ccafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:32.100799 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ead3e84-3aeb-42b3-b4d9-e09c36274f40 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 200 len: 1665 microversion: 2.1 time: 0.142589 Oct 02 01:49:32.102591 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3379/6567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:31 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 1665 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:32.223705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:32.224345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:32.249248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:32.249781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:32.250256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:32.251214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:32.251703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:32.252155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:32.581022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:32.581874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:32.606830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:32.609979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:32.610556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:32.612587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:32.614333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:32.615179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:32.615795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:32.630794 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-43b489ee-f532-49b6-aa13-ab8fd13adff6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1279 microversion: 2.1 time: 0.411484 Oct 02 01:49:32.645560 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3189/6568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:32 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1279 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:32.912307 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:32.938528 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f4571d31-476a-46c3-94a8-496fea7bb225 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1687 microversion: 2.1 time: 0.361780 Oct 02 01:49:32.940083 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3380/6569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:32 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1687 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:33.019340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-efb2c9c5-b0a0-4c54-a96b-20f6b979ca3c req-c0b57ca4-ec65-4d6f-ba52-af81ce66fdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87bb0b2-6b83-47f7-860b-e631a4e894dd", "name": "network-vif-deleted", "tag": "e5b5609a-4abe-42af-86b6-4a5076181904"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:33.055388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-efb2c9c5-b0a0-4c54-a96b-20f6b979ca3c req-c0b57ca4-ec65-4d6f-ba52-af81ce66fdf4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.058386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-efb2c9c5-b0a0-4c54-a96b-20f6b979ca3c req-c0b57ca4-ec65-4d6f-ba52-af81ce66fdf4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.058986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-efb2c9c5-b0a0-4c54-a96b-20f6b979ca3c req-c0b57ca4-ec65-4d6f-ba52-af81ce66fdf4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.075966 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-efb2c9c5-b0a0-4c54-a96b-20f6b979ca3c req-c0b57ca4-ec65-4d6f-ba52-af81ce66fdf4 service nova] Creating event network-vif-deleted:e5b5609a-4abe-42af-86b6-4a5076181904 for instance d87bb0b2-6b83-47f7-860b-e631a4e894dd on n-h2-master-1 Oct 02 01:49:33.085474 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-efb2c9c5-b0a0-4c54-a96b-20f6b979ca3c req-c0b57ca4-ec65-4d6f-ba52-af81ce66fdf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069494 Oct 02 01:49:33.086529 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3190/6570] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:33.126428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:33.127108 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:33.137281 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.139446 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.140460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.141501 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.142214 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.142935 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.160966 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] HTTP exception thrown: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Request method failure captured: Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd HTTP/1.1 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOz6b9dFYw3bQvqDnaN3tgN9I3DOqK1y6CjHX2NtY49KsGJAmoDBq-xACAXyx7QI9Tw2MntO3vTDlzYBKAYu1R27Woavsgwi8mckOup7HL00y9eKrL-m7gUeqashuQ0Tf6scL5mKlzbXNF4G5IoyH5r5b3CZZbG-i-nKxTcGW-j5OIo Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 5d7ab191bb4e4b21a8a4011d8cd93f86 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d7ab191bb4e4b21a8a4011d8cd93f86"}]}] Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 5d7ab191bb4e4b21a8a4011d8cd93f86 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestServerBasicOps-2088130898-project Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 73a7c1c4929d49aea6e4e492e32ccafd Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestServerBasicOps-2088130898-project Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: exception: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'd87bb0b2-6b83-47f7-860b-e631a4e894dd'} Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:33.163026 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.168296 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.171237 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Returning 404 to user: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:49:33.172485 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f77686b1-52d3-4a14-baf3-ab8049280aed tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 404 len: 111 microversion: 2.1 time: 0.051046 Oct 02 01:49:33.178051 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3381/6571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:33 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:49:33.672478 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:33.673214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:33.683646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.684464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.687099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.688162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.691689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.692401 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.867841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:33.868259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:33.874686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.875413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.875638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.876378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.876848 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.877285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.892577 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] HTTP exception thrown: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Request method failure captured: Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd HTTP/1.1 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOz6b9dFYw3bQvqDnaN3tgN9I3DOqK1y6CjHX2NtY49KsGJAmoDBq-xACAXyx7QI9Tw2MntO3vTDlzYBKAYu1R27Woavsgwi8mckOup7HL00y9eKrL-m7gUeqashuQ0Tf6scL5mKlzbXNF4G5IoyH5r5b3CZZbG-i-nKxTcGW-j5OIo Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 5d7ab191bb4e4b21a8a4011d8cd93f86 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d7ab191bb4e4b21a8a4011d8cd93f86"}]}] Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 5d7ab191bb4e4b21a8a4011d8cd93f86 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestServerBasicOps-2088130898-project Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 73a7c1c4929d49aea6e4e492e32ccafd Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestServerBasicOps-2088130898-project Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: exception: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'd87bb0b2-6b83-47f7-860b-e631a4e894dd'} Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:49:33.894153 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Returning 404 to user: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c3c09f33-df2c-46a1-b3c9-133000231831 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 404 len: 111 microversion: 2.1 time: 0.032184 Oct 02 01:49:33.900437 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3382/6572] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:49:33 2022] DELETE /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:49:33.904894 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:33.905729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] [instance: d87bb0b2-6b83-47f7-860b-e631a4e894dd] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:33.911905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.912403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.912849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.914091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.914571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.915095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.931082 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] HTTP exception thrown: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Request method failure captured: Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd HTTP/1.1 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOz6b9dFYw3bQvqDnaN3tgN9I3DOqK1y6CjHX2NtY49KsGJAmoDBq-xACAXyx7QI9Tw2MntO3vTDlzYBKAYu1R27Woavsgwi8mckOup7HL00y9eKrL-m7gUeqashuQ0Tf6scL5mKlzbXNF4G5IoyH5r5b3CZZbG-i-nKxTcGW-j5OIo Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 5d7ab191bb4e4b21a8a4011d8cd93f86 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d7ab191bb4e4b21a8a4011d8cd93f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d7ab191bb4e4b21a8a4011d8cd93f86"}]}] Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 5d7ab191bb4e4b21a8a4011d8cd93f86 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestServerBasicOps-2088130898 Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestServerBasicOps-2088130898-project Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 73a7c1c4929d49aea6e4e492e32ccafd Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestServerBasicOps-2088130898-project Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: exception: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'd87bb0b2-6b83-47f7-860b-e631a4e894dd'} Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:33.933334 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Returning 404 to user: Instance d87bb0b2-6b83-47f7-860b-e631a4e894dd could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:49:33.938637 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0c9fcc32-7fee-4df6-b803-604670cd0fd4 tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd" status: 404 len: 111 microversion: 2.1 time: 0.034254 Oct 02 01:49:33.950404 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3383/6573] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:33 2022] GET /compute/v2.1/servers/d87bb0b2-6b83-47f7-860b-e631a4e894dd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:49:33.967576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:33.968643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:33.979749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.980347 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.980863 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.981656 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:33.982345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:33.982895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:33.990589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:34.003263 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a88ec365-f9cc-4c62-999f-8e2c829a4ee2 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1279 microversion: 2.1 time: 0.352107 Oct 02 01:49:34.004232 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:34.021264 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3191/6574] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:33 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1279 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:34.157405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be5ae6b0-5746-4b26-b592-28e51208f0fc tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] Calling method '.version_select at 0x7fb87875b430>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:34.193912 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be5ae6b0-5746-4b26-b592-28e51208f0fc tempest-TestServerBasicOps-2088130898 tempest-TestServerBasicOps-2088130898-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-900716902" status: 202 len: 0 microversion: 2.1 time: 0.040201 Oct 02 01:49:34.198929 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3192/6575] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-900716902 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:49:34.468504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:34.488450 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d75357e-e768-42f8-9a78-d02dfb9c71a3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1501 microversion: 2.1 time: 0.524830 Oct 02 01:49:34.489972 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3384/6576] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:33 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1501 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:35.031020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:35.031650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:35.038315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:35.039489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:35.040025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:35.040747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:35.041219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:35.041662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:35.122844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5d82b56f-a628-4c75-a1db-8bb563b7aad6 req-66b48c2b-066b-420a-8b2b-c66b19680ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd081e1-52aa-4399-9cde-833ea1393176", "name": "network-vif-deleted", "tag": "ea4424d0-27fd-4233-b8f8-29b3769f64b7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:35.134036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5d82b56f-a628-4c75-a1db-8bb563b7aad6 req-66b48c2b-066b-420a-8b2b-c66b19680ae0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:35.134516 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5d82b56f-a628-4c75-a1db-8bb563b7aad6 req-66b48c2b-066b-420a-8b2b-c66b19680ae0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:35.135186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5d82b56f-a628-4c75-a1db-8bb563b7aad6 req-66b48c2b-066b-420a-8b2b-c66b19680ae0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:35.147722 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-5d82b56f-a628-4c75-a1db-8bb563b7aad6 req-66b48c2b-066b-420a-8b2b-c66b19680ae0 service nova] Creating event network-vif-deleted:ea4424d0-27fd-4233-b8f8-29b3769f64b7 for instance dfd081e1-52aa-4399-9cde-833ea1393176 on n-h1-master-1 Oct 02 01:49:35.154090 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5d82b56f-a628-4c75-a1db-8bb563b7aad6 req-66b48c2b-066b-420a-8b2b-c66b19680ae0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035033 Oct 02 01:49:35.154735 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3385/6577] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:49:35.191654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:35.199720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-acce7c83-2a90-4d29-8854-d2a1cec6e453 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.173499 Oct 02 01:49:35.200298 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3193/6578] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:35 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:35.522084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:35.522908 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:35.529849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:35.530265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:35.530726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:35.531419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:35.531901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:35.532321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:35.571773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:35.572267 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:35.572714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:35.573170 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lazy-loading 'fault' on Instance uuid dfd081e1-52aa-4399-9cde-833ea1393176 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:49:35.621742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7b60e4e094354a9692bb46c3ebf8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7955fc0f32784de19c7e0bd32b5afe1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:35.629738 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-090b7643-c362-4ba1-b13f-4bcecc0485f3 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 200 len: 1355 microversion: 2.1 time: 0.112116 Oct 02 01:49:35.633995 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3386/6579] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:35 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:36.222710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:36.223522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:36.230958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:36.231464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:36.231915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:36.232633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:36.233279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:36.233725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:36.378402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:36.387166 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-adbad6bb-d2c0-4037-93c0-0b28f8d74fea tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.168505 Oct 02 01:49:36.387854 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3194/6580] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:36 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:36.653924 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:36.654673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] [instance: dfd081e1-52aa-4399-9cde-833ea1393176] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:36.656745 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:36.658394 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:36.665146 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:36.665716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:36.666244 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:36.667055 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:36.667583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:36.668075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:36.684632 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] HTTP exception thrown: Instance dfd081e1-52aa-4399-9cde-833ea1393176 could not be found. Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Request method failure captured: Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 HTTP/1.1 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOOvg5Zmg9o_TDtbUvRXpqYE-3VU_epo8elpy_IlxV4Q6QbiFkzGK_scNqAy5NJuR5MFpAkMXv_wLKz-bjQomO3KR5D5dHY-NfrddVaFcktSN8lq_k0vMyudFZYsqdExvX-vWxG4ITF45xgcPnDsqSYSybUEQKvJNs-ZJ5siFXDAfuZ8 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7955fc0f32784de19c7e0bd32b5afe1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7955fc0f32784de19c7e0bd32b5afe1b"}]}] Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 7955fc0f32784de19c7e0bd32b5afe1b Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-607365047 Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 4ac7b60e4e094354a9692bb46c3ebf8d Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestNetworkAdvancedServerOps-607365047-project Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: exception: Instance dfd081e1-52aa-4399-9cde-833ea1393176 could not be found. Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'dfd081e1-52aa-4399-9cde-833ea1393176'} Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd081e1-52aa-4399-9cde-833ea1393176 could not be found. Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd081e1-52aa-4399-9cde-833ea1393176 could not be found. Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:36.686330 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd081e1-52aa-4399-9cde-833ea1393176 could not be found. Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Returning 404 to user: Instance dfd081e1-52aa-4399-9cde-833ea1393176 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f5922f51-3e98-4f84-910f-35a2d983eb53 tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176" status: 404 len: 111 microversion: 2.1 time: 0.038198 Oct 02 01:49:36.691648 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3387/6581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:36 2022] GET /compute/v2.1/servers/dfd081e1-52aa-4399-9cde-833ea1393176 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:49:37.411153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:37.412515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:37.424861 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:37.428475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:37.432468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:37.437109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:37.476857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:37.476857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:37.476857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:37.707794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:37.716000 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebca6c0e-3be1-43d6-87ed-26cd9e66537b tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.308883 Oct 02 01:49:37.727070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3195/6582] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:37 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:38.741407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:38.742943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:38.750188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:38.750714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:38.751158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:38.751867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:38.752329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:38.752827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:39.031436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:39.043741 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d765d307-6c83-45e8-8a72-9fa3679dac72 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.306153 Oct 02 01:49:39.046552 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3388/6583] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:38 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:40.072295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:40.073565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:40.082019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:40.082847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:40.084430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:40.086029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:40.086760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:40.087632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:40.451135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:40.459976 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09bd32b7-d918-421e-a3b6-1d8ada16ac3a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.392647 Oct 02 01:49:40.475171 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3196/6584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:40 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:41.485076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:41.486300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:41.494017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:41.494915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:41.495521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:41.496384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:41.497648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:41.498241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:41.734445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:41.744564 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5d6f12ff-19d6-44e9-964b-b305288254c5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.263483 Oct 02 01:49:41.745763 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3389/6585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:41 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:41.863340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5a8b27b-ec91-4e07-ae97-5e8cf6e08a1b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] Calling method '.version_select at 0x7fb87875bf70>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:41.890989 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5a8b27b-ec91-4e07-ae97-5e8cf6e08a1b tempest-TestNetworkAdvancedServerOps-607365047 tempest-TestNetworkAdvancedServerOps-607365047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-93367561" status: 202 len: 0 microversion: 2.1 time: 0.032046 Oct 02 01:49:41.891521 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3197/6586] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-93367561 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:49:42.769415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:42.771146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:42.781549 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:42.782047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:42.782483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:42.783230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:42.783746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:42.784177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:43.020380 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:43.030325 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-dc7a821a-dd34-45e8-91af-67bd35d26a31 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.265984 Oct 02 01:49:43.031431 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3390/6587] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:42 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:44.057353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:44.057993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:44.067157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:44.067676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:44.068435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:44.069097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:44.069610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:44.070118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:44.074374 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:44.216393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:44.224463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-342ba649-d690-4481-9f83-aa61fab7a0bf tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.172952 Oct 02 01:49:44.225049 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3198/6588] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:44 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:45.248571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:45.249200 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:45.258295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:45.258835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:45.259438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:45.260173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:45.260633 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:45.261265 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:45.498232 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:45.506487 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8ea23489-10cd-485c-8856-6e04901f0b30 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.262476 Oct 02 01:49:45.507236 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3391/6589] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:45 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:46.238301 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bb5cab06-4202-41c7-b6f5-1cb69e0799e6 req-3cd3da6e-0198-469c-a849-08260937bef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59a22a7-0861-4392-b911-d932042720ae", "name": "network-vif-plugged", "status": "completed", "tag": "42a8ab05-f07c-40f7-8e5b-41864c437cd3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:46.253506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb5cab06-4202-41c7-b6f5-1cb69e0799e6 req-3cd3da6e-0198-469c-a849-08260937bef3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:46.254183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb5cab06-4202-41c7-b6f5-1cb69e0799e6 req-3cd3da6e-0198-469c-a849-08260937bef3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:46.255095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb5cab06-4202-41c7-b6f5-1cb69e0799e6 req-3cd3da6e-0198-469c-a849-08260937bef3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:46.269561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bb5cab06-4202-41c7-b6f5-1cb69e0799e6 req-3cd3da6e-0198-469c-a849-08260937bef3 service nova] Creating event network-vif-plugged:42a8ab05-f07c-40f7-8e5b-41864c437cd3 for instance f59a22a7-0861-4392-b911-d932042720ae on n-h1-master-1 Oct 02 01:49:46.276610 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bb5cab06-4202-41c7-b6f5-1cb69e0799e6 req-3cd3da6e-0198-469c-a849-08260937bef3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045519 Oct 02 01:49:46.278021 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3199/6590] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:46.536296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:46.537091 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:46.545213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:46.546090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:46.547200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:46.548482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:46.549449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:46.549955 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:46.783186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:46.797031 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-47f61afb-bd29-4232-9716-0ebf78da5b85 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.264890 Oct 02 01:49:46.797645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3392/6591] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:46 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:47.827958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:47.828942 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:47.832304 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:47.841571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:47.842287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:47.844359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:47.845400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:47.846095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:47.846861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:48.120096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:48.131409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8e37d31-6c51-47ae-93ef-39a424b49df6 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1267 microversion: 2.1 time: 0.307777 Oct 02 01:49:48.132520 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3200/6592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:47 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:49.157205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:49.158451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:49.166964 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:49.177465 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:49.177964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:49.178439 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:49.181673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:49.182639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:49.183519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:49.447828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:49.467027 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8e077a33-3720-4387-8636-d5783ec5e452 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1453 microversion: 2.1 time: 0.316538 Oct 02 01:49:49.477984 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3393/6593] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:49 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1453 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:49.492660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:49.493487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:49.503160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:49.504169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:49.504652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:49.505479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:49.505865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:49.506311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:49.658793 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:49:49.699293 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2048738-dae5-4f88-9dc2-f396d1dee69f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1453 microversion: 2.1 time: 0.211020 Oct 02 01:49:49.699883 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3201/6594] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:49 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1453 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:52.305730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-561a835d-07b2-4874-b7df-c53e270cf47c req-d0f7eb82-1427-4d14-918f-a43d9ca023c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59a22a7-0861-4392-b911-d932042720ae", "tag": "42a8ab05-f07c-40f7-8e5b-41864c437cd3"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:52.317699 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-561a835d-07b2-4874-b7df-c53e270cf47c req-d0f7eb82-1427-4d14-918f-a43d9ca023c9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:52.318461 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-561a835d-07b2-4874-b7df-c53e270cf47c req-d0f7eb82-1427-4d14-918f-a43d9ca023c9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:52.319112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-561a835d-07b2-4874-b7df-c53e270cf47c req-d0f7eb82-1427-4d14-918f-a43d9ca023c9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:52.354030 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-561a835d-07b2-4874-b7df-c53e270cf47c req-d0f7eb82-1427-4d14-918f-a43d9ca023c9 service nova] Creating event network-changed:42a8ab05-f07c-40f7-8e5b-41864c437cd3 for instance f59a22a7-0861-4392-b911-d932042720ae on n-h1-master-1 Oct 02 01:49:52.363374 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-561a835d-07b2-4874-b7df-c53e270cf47c req-d0f7eb82-1427-4d14-918f-a43d9ca023c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062383 Oct 02 01:49:52.364902 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3394/6595] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:55.651009 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:55.652724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:55.653248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:55.653704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:55.654446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:55.655071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:55.655528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:55.680543 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b7b14fd-e926-45c3-a004-d6ae5560ac2c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.188005 Oct 02 01:49:55.681189 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3202/6596] 10.222.0.23 () {58 vars in 1185 bytes} [Sun Oct 2 01:49:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:55.781031 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1270331424", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "e8c61aef-cd14-491e-9e54-a8d600cd0c43"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:55.842802 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] validate_networks() for [('e8c61aef-cd14-491e-9e54-a8d600cd0c43', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:49:56.270520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:49:56.270992 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:49:56.271519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:49:56.271927 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:49:56.272521 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:49:56.282090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:56.282571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:56.283046 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:56.283763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:56.284213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:56.284635 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:56.303686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Getting quotas for project a7f508e656b2402e97a5fda511f38f17. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:49:56.310219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Getting quotas for user 66f3d8f41a7941e09f7b7fcba809ff28 and project a7f508e656b2402e97a5fda511f38f17. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:49:56.323256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:49:56.325696 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:49:56.373299 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b0715ebd-9c07-4207-80ff-e3d24973da83 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597165 Oct 02 01:49:56.374201 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3395/6597] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:49:56.385558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6eb72d6c-44e1-456c-bdde-b9bc08fd8f89 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:56.386196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6eb72d6c-44e1-456c-bdde-b9bc08fd8f89 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:56.448390 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6eb72d6c-44e1-456c-bdde-b9bc08fd8f89 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1329 microversion: 2.1 time: 0.067144 Oct 02 01:49:56.449618 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3203/6598] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:56 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1329 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:57.472932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:57.474634 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:57.485095 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:57.486158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:57.486832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:57.487746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:57.488381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:57.489015 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:57.571448 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cdbcdbb1-c51c-4b18-babd-b31087611c34 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1416 microversion: 2.1 time: 0.103634 Oct 02 01:49:57.572593 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3396/6599] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:57 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1416 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:58.601023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:58.602564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:58.611642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:58.612737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:58.614267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:58.615192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:58.615826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:58.617075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:58.873471 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9233591f-d91c-4e1e-9dfb-aa78044110e2 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.279357 Oct 02 01:49:58.882624 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3204/6600] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:58 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:49:59.602950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6013376a-a99d-46a4-a8dd-26386caee5fb req-4cf2712f-e3f4-4bac-a4a2-b9d1425d2e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4616bd-1e93-4ad7-b743-0346f60cfd59", "tag": "bb8dbb8a-c208-4bd4-a3c4-7ab41c380c25"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:49:59.614266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6013376a-a99d-46a4-a8dd-26386caee5fb req-4cf2712f-e3f4-4bac-a4a2-b9d1425d2e8e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:59.614857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6013376a-a99d-46a4-a8dd-26386caee5fb req-4cf2712f-e3f4-4bac-a4a2-b9d1425d2e8e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:59.615357 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6013376a-a99d-46a4-a8dd-26386caee5fb req-4cf2712f-e3f4-4bac-a4a2-b9d1425d2e8e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:59.627231 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6013376a-a99d-46a4-a8dd-26386caee5fb req-4cf2712f-e3f4-4bac-a4a2-b9d1425d2e8e service nova] Creating event network-changed:bb8dbb8a-c208-4bd4-a3c4-7ab41c380c25 for instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 on n-h1-master-1 Oct 02 01:49:59.632611 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6013376a-a99d-46a4-a8dd-26386caee5fb req-4cf2712f-e3f4-4bac-a4a2-b9d1425d2e8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033979 Oct 02 01:49:59.633660 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3397/6601] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:49:59.898058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:49:59.898648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:49:59.905941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:59.906449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:59.906943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:49:59.907678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:49:59.908159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:49:59.908612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:00.130865 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-745c55fe-2b51-4e58-a0a3-a16698a2c172 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.237005 Oct 02 01:50:00.131484 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3205/6602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:49:59 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:01.154962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:01.155658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:01.162034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:01.162518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:01.162982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:01.163694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:01.164127 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:01.164553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:01.313874 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-86bb436c-313b-4f8d-a83f-381ceed7046f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.163580 Oct 02 01:50:01.314829 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3398/6603] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:01 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:02.340122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:02.340879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:02.348007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:02.348514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:02.348972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:02.349696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:02.350177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:02.350734 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:02.548830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-02b164e4-4c16-4f85-9963-1d6b5e3018d1 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.212503 Oct 02 01:50:02.549519 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3206/6604] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:02 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:50:03.573292 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:03.573900 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:03.580496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:03.580973 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:03.581403 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:03.582085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:03.582537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:03.582987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:03.710991 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bbff5280-b2f7-4e8d-b01f-243ce725032f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.142097 Oct 02 01:50:03.711576 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3399/6605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:03 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:04.734174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:04.734839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:04.742308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:04.742840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:04.743301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:04.744016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:04.744492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:04.744936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:04.874272 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ee2fb1b-0cd3-4c9e-8bc4-6caadefdc00f tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.143874 Oct 02 01:50:04.875102 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3207/6606] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:04 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:05.896663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:05.897332 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:05.904817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:05.905304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:05.905784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:05.906533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:05.907053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:05.907510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:05.912480 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=75 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:05.972256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3cf20cd2-ffa0-4503-b2d9-5f6d8c7cdb3c req-07c29a1c-b012-4a95-9c9b-3978177d9e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4616bd-1e93-4ad7-b743-0346f60cfd59", "name": "network-vif-plugged", "status": "completed", "tag": "bb8dbb8a-c208-4bd4-a3c4-7ab41c380c25"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:50:05.981645 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:05.987359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3cf20cd2-ffa0-4503-b2d9-5f6d8c7cdb3c req-07c29a1c-b012-4a95-9c9b-3978177d9e27 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:05.987902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3cf20cd2-ffa0-4503-b2d9-5f6d8c7cdb3c req-07c29a1c-b012-4a95-9c9b-3978177d9e27 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:05.988460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3cf20cd2-ffa0-4503-b2d9-5f6d8c7cdb3c req-07c29a1c-b012-4a95-9c9b-3978177d9e27 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:06.001851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3cf20cd2-ffa0-4503-b2d9-5f6d8c7cdb3c req-07c29a1c-b012-4a95-9c9b-3978177d9e27 service nova] Creating event network-vif-plugged:bb8dbb8a-c208-4bd4-a3c4-7ab41c380c25 for instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 on n-h1-master-1 Oct 02 01:50:06.008781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3cf20cd2-ffa0-4503-b2d9-5f6d8c7cdb3c req-07c29a1c-b012-4a95-9c9b-3978177d9e27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041778 Oct 02 01:50:06.009660 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3208/6607] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:50:06.060073 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-37333c15-e492-449e-a543-b4d7a83d5890 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.167446 Oct 02 01:50:06.060662 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3400/6608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:05 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:07.080886 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:07.086334 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:07.087082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:07.093721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:07.094524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:07.094676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:07.095389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:07.095857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:07.096298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:07.228151 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6323cd6-b03c-47c6-9af4-8e8663df7f5b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1464 microversion: 2.1 time: 0.147995 Oct 02 01:50:07.228739 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3209/6609] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:07 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:08.252844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:08.253542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:08.255546 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:08.256283 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:08.263418 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:08.263899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:08.264331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:08.265182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:08.265638 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:08.266062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:08.427935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-218701e5-13ba-422e-823b-0cab293fad23 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1648 microversion: 2.1 time: 0.179265 Oct 02 01:50:08.428557 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3401/6610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:08 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1648 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:08.450246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:08.450928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:08.458240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:08.458822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:08.459292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:08.460027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:08.460572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:08.461117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:08.702755 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3e2d0af-1868-4ec2-b895-e4e63df12e0b tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1648 microversion: 2.1 time: 0.256170 Oct 02 01:50:08.703351 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3210/6611] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:08 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1648 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:08.725407 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:08.726021 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:08.731975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:08.732459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:08.733133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:08.734071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:08.734530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:08.735220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:08.961901 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eb8cf2c9-a79e-4f50-9496-de91af3fd1bc tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1648 microversion: 2.1 time: 0.240322 Oct 02 01:50:08.963182 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3402/6612] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:08 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1648 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:50:09.027249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-830339264", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "e8c61aef-cd14-491e-9e54-a8d600cd0c43"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:50:09.088315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] validate_networks() for [('e8c61aef-cd14-491e-9e54-a8d600cd0c43', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:50:09.459438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:50:09.460031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:50:09.460761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:50:09.461332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:50:09.461933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:50:09.471749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:09.472253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:09.472703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:09.473435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:09.473906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:09.474367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:09.498958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Getting quotas for project a7f508e656b2402e97a5fda511f38f17. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:50:09.504400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Getting quotas for user 66f3d8f41a7941e09f7b7fcba809ff28 and project a7f508e656b2402e97a5fda511f38f17. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:50:09.517624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:50:09.520084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:50:09.565409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05a49bc1-e166-4b21-ac0e-d81f3beee65e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541965 Oct 02 01:50:09.566246 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3211/6613] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:50:09.578115 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c090a936-250e-456a-8e88-dc3ac12c1e68 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:09.578752 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c090a936-250e-456a-8e88-dc3ac12c1e68 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:09.651552 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c090a936-250e-456a-8e88-dc3ac12c1e68 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1328 microversion: 2.1 time: 0.077619 Oct 02 01:50:09.652129 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3403/6614] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:09 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1328 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:50:10.676315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:10.677367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:10.685549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:10.686214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:10.686695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:10.687640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:10.688119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:10.688615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:10.777246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f6a5d2e-1855-4142-b036-e5048372391c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1423 microversion: 2.1 time: 0.105082 Oct 02 01:50:10.778016 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3212/6615] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:10 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:50:11.802808 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:11.803476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:11.812765 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:11.813260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:11.813794 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:11.814779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:11.815285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:11.816087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:12.040375 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1d5a955f-3121-4e00-b13d-195e1c8f34a7 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1463 microversion: 2.1 time: 0.241390 Oct 02 01:50:12.041565 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3404/6616] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:11 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:12.054514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c63ceaaa-4e28-489e-a012-30fa63dfd81c req-0ca344fa-2aff-4b6b-b3ce-fbd8bb94e201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db52ebe6-e949-400e-ad27-aa998ce9b9a7", "tag": "446a0dc9-1484-473c-a776-01d0574da1fb"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:50:12.066590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c63ceaaa-4e28-489e-a012-30fa63dfd81c req-0ca344fa-2aff-4b6b-b3ce-fbd8bb94e201 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:12.067194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c63ceaaa-4e28-489e-a012-30fa63dfd81c req-0ca344fa-2aff-4b6b-b3ce-fbd8bb94e201 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:12.067643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c63ceaaa-4e28-489e-a012-30fa63dfd81c req-0ca344fa-2aff-4b6b-b3ce-fbd8bb94e201 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:12.079329 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c63ceaaa-4e28-489e-a012-30fa63dfd81c req-0ca344fa-2aff-4b6b-b3ce-fbd8bb94e201 service nova] Creating event network-changed:446a0dc9-1484-473c-a776-01d0574da1fb for instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 on n-h2-master-1 Oct 02 01:50:12.084587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c63ceaaa-4e28-489e-a012-30fa63dfd81c req-0ca344fa-2aff-4b6b-b3ce-fbd8bb94e201 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037142 Oct 02 01:50:12.085485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3213/6617] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:50:13.066074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:13.066619 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:13.074108 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:13.074586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:13.075050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:13.075737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:13.076190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:13.076613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:13.198376 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a72e4026-5282-484c-91ad-c4c5f47f5edb tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1463 microversion: 2.1 time: 0.136080 Oct 02 01:50:13.199049 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3405/6618] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:13 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1463 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:14.221928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:14.222764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:14.230537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:14.231065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:14.231502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:14.232217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:14.232689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:14.233127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:14.235959 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=69 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:14.364456 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6b46161f-b20f-4672-b308-71fe33d8617c tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1463 microversion: 2.1 time: 0.146569 Oct 02 01:50:14.365045 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3214/6619] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:14 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:15.388177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:15.388729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:15.395567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:15.396050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:15.396481 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:15.397166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:15.397619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:15.398047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:15.522205 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e93f29dc-29a7-4d72-bce7-8f8220050417 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1463 microversion: 2.1 time: 0.137811 Oct 02 01:50:15.522812 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3406/6620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:15 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:16.397038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-5a3c6af2-2bf3-4b27-b700-61ef1b023e01 req-3bb5932a-f8cd-48bc-983d-54bd6fce3179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db52ebe6-e949-400e-ad27-aa998ce9b9a7", "name": "network-vif-plugged", "status": "completed", "tag": "446a0dc9-1484-473c-a776-01d0574da1fb"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:50:16.408679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5a3c6af2-2bf3-4b27-b700-61ef1b023e01 req-3bb5932a-f8cd-48bc-983d-54bd6fce3179 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:16.409180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5a3c6af2-2bf3-4b27-b700-61ef1b023e01 req-3bb5932a-f8cd-48bc-983d-54bd6fce3179 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:16.409694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5a3c6af2-2bf3-4b27-b700-61ef1b023e01 req-3bb5932a-f8cd-48bc-983d-54bd6fce3179 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:16.423318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5a3c6af2-2bf3-4b27-b700-61ef1b023e01 req-3bb5932a-f8cd-48bc-983d-54bd6fce3179 service nova] Creating event network-vif-plugged:446a0dc9-1484-473c-a776-01d0574da1fb for instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 on n-h2-master-1 Oct 02 01:50:16.428346 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-5a3c6af2-2bf3-4b27-b700-61ef1b023e01 req-3bb5932a-f8cd-48bc-983d-54bd6fce3179 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035097 Oct 02 01:50:16.428942 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3215/6621] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:50:16.544648 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:16.545289 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:16.552747 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:16.553349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:16.553816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:16.554542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:16.555181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:16.555614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:16.706693 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06ec8e5e-b0bc-49c8-ba53-93f5845cc73d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1463 microversion: 2.1 time: 0.165996 Oct 02 01:50:16.707289 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3407/6622] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:16 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:17.729949 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:17.730688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:17.737742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:17.738260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:17.738744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:17.739460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:17.739935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:17.740372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:17.867965 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-864d16da-b5be-4738-afa7-c32436622934 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1647 microversion: 2.1 time: 0.142231 Oct 02 01:50:17.868852 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3216/6623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:17 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:17.890208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:17.890844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:17.897508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:17.898023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:17.898457 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:17.899192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:17.899647 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:17.900275 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.028717 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-571fb3aa-e354-415b-83c6-bc7449471795 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1647 microversion: 2.1 time: 0.142070 Oct 02 01:50:18.029323 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3408/6624] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:17 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1647 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:18.051222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:18.051851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:18.053798 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:18.059487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:18.059985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:18.060434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.061141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:18.061610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:18.062051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.184933 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0ce3f637-fb36-4d6a-90cf-fb969deb5495 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1647 microversion: 2.1 time: 0.137372 Oct 02 01:50:18.185510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3217/6625] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:18 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1647 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:18.207042 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:18.207542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:18.214052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:18.214542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:18.215013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.215711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:18.216167 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:18.216596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.241207 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:50:18.317286 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81ded412-cac4-405e-b3e5-b2d5931c9025 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 204 len: 0 microversion: 2.1 time: 0.113541 Oct 02 01:50:18.317912 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3409/6626] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:50:18 2022] DELETE /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:50:18.326868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:18.327592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:18.333637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:18.334138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:18.334593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.335334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:18.335807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:18.336248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:18.464370 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c617d41d-2aea-4ba6-975b-40c98e6b34ba tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1653 microversion: 2.1 time: 0.141572 Oct 02 01:50:18.464947 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3218/6627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:18 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1653 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:19.488708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:19.489408 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:19.492646 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:19.498580 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:19.499100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:19.499567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:19.500391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:19.500859 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:19.501289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:19.630401 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-285ab263-f3e2-4520-ba5c-b96014bf68da tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1653 microversion: 2.1 time: 0.146210 Oct 02 01:50:19.631020 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3410/6628] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:19 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:20.160759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-50aad7b5-9fdd-4428-8611-63d066b28434 req-b9369157-63d4-4779-9516-06ae53a570c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db52ebe6-e949-400e-ad27-aa998ce9b9a7", "name": "network-vif-deleted", "tag": "446a0dc9-1484-473c-a776-01d0574da1fb"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:50:20.169194 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:20.169988 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:20.174746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-50aad7b5-9fdd-4428-8611-63d066b28434 req-b9369157-63d4-4779-9516-06ae53a570c1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:20.175289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-50aad7b5-9fdd-4428-8611-63d066b28434 req-b9369157-63d4-4779-9516-06ae53a570c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:20.175912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-50aad7b5-9fdd-4428-8611-63d066b28434 req-b9369157-63d4-4779-9516-06ae53a570c1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:20.196267 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-50aad7b5-9fdd-4428-8611-63d066b28434 req-b9369157-63d4-4779-9516-06ae53a570c1 service nova] Creating event network-vif-deleted:446a0dc9-1484-473c-a776-01d0574da1fb for instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 on n-h2-master-1 Oct 02 01:50:20.202167 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-50aad7b5-9fdd-4428-8611-63d066b28434 req-b9369157-63d4-4779-9516-06ae53a570c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045461 Oct 02 01:50:20.203174 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3219/6629] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:50:20.653626 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:20.654248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:20.656162 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:20.662764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:20.663256 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:20.663696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:20.664399 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:20.664890 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:20.665351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:20.700059 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:20.700548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:20.700993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:20.701436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lazy-loading 'fault' on Instance uuid db52ebe6-e949-400e-ad27-aa998ce9b9a7 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:50:20.750727 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e8a2524-21c9-49a7-a03e-c52bc28195c3 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 200 len: 1453 microversion: 2.1 time: 0.100877 Oct 02 01:50:20.751316 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3411/6630] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:20 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:21.777080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:21.777815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: db52ebe6-e949-400e-ad27-aa998ce9b9a7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:21.784095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:21.784601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:21.785053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:21.785758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:21.786235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:21.786712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:21.802770 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] HTTP exception thrown: Instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 could not be found. Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Request method failure captured: Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 HTTP/1.1 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO5DRPm_6yMasyOQmMKpiIRbvzZFAmTk2SeCUdNBRbTtGgOVe_3keMuFg3znt_1DnZAKO1KVkb5ldF9f5LYo7haRc3o7uvnFtk2c1Wm5UspVhO7_CFiBRSiNYzpI6L5h5Pg5pznXs4EU55pungna-0BpV0UL7gCftWO6dxoVG_yptbo Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: a7f508e656b2402e97a5fda511f38f17 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestServerMultinode-1393427542 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a7f508e656b2402e97a5fda511f38f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7f508e656b2402e97a5fda511f38f17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7f508e656b2402e97a5fda511f38f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a7f508e656b2402e97a5fda511f38f17"}]}] Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestServerMultinode-1393427542 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: a7f508e656b2402e97a5fda511f38f17 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestServerMultinode-1393427542 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestServerMultinode-1393427542-project-admin Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66f3d8f41a7941e09f7b7fcba809ff28 Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestServerMultinode-1393427542-project-admin Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: exception: Instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 could not be found. Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'db52ebe6-e949-400e-ad27-aa998ce9b9a7'} Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 could not be found. Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 could not be found. Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:50:21.804411 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 could not be found. Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Returning 404 to user: Instance db52ebe6-e949-400e-ad27-aa998ce9b9a7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08a128e5-8cb8-461f-b70d-20a68c203cd5 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7" status: 404 len: 111 microversion: 2.1 time: 0.034674 Oct 02 01:50:21.808998 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3220/6631] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:21 2022] GET /compute/v2.1/servers/db52ebe6-e949-400e-ad27-aa998ce9b9a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:50:21.815038 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:21.815543 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:21.822815 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:21.823306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:21.823752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:21.824448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:21.824909 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:21.825340 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:21.850335 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:50:21.924107 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-400c4121-56d5-4c6f-9427-84b3919ab528 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 204 len: 0 microversion: 2.1 time: 0.112476 Oct 02 01:50:21.924657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3412/6632] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:50:21 2022] DELETE /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:50:21.933687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:21.934325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:21.940449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:21.940954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:21.941406 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:21.942116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:21.942592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:21.943065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:22.067600 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b8287f8-1b09-4e9f-a60d-811731522862 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1654 microversion: 2.1 time: 0.138484 Oct 02 01:50:22.068192 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3221/6633] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:21 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1654 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:23.091730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:23.092432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:23.099260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:23.099741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:23.100177 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:23.100866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:23.101326 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:23.103725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:23.234500 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a0ced886-14af-4991-b6f9-49fbcb19411e tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1654 microversion: 2.1 time: 0.147012 Oct 02 01:50:23.235114 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3413/6634] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:23 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:23.918632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-11546b6a-80b8-45ec-a903-088773dd3f39 req-b000bbeb-8a5a-4b61-9a05-d920e96c305d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4616bd-1e93-4ad7-b743-0346f60cfd59", "name": "network-vif-deleted", "tag": "bb8dbb8a-c208-4bd4-a3c4-7ab41c380c25"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:50:23.932270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-11546b6a-80b8-45ec-a903-088773dd3f39 req-b000bbeb-8a5a-4b61-9a05-d920e96c305d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:23.933374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-11546b6a-80b8-45ec-a903-088773dd3f39 req-b000bbeb-8a5a-4b61-9a05-d920e96c305d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:23.933927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-11546b6a-80b8-45ec-a903-088773dd3f39 req-b000bbeb-8a5a-4b61-9a05-d920e96c305d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:23.947821 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-11546b6a-80b8-45ec-a903-088773dd3f39 req-b000bbeb-8a5a-4b61-9a05-d920e96c305d service nova] Creating event network-vif-deleted:bb8dbb8a-c208-4bd4-a3c4-7ab41c380c25 for instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 on n-h1-master-1 Oct 02 01:50:23.954031 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-11546b6a-80b8-45ec-a903-088773dd3f39 req-b000bbeb-8a5a-4b61-9a05-d920e96c305d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039485 Oct 02 01:50:23.954683 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3222/6635] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:50:24.256859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:24.257489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:24.264625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:24.265112 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:24.265550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:24.266262 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:24.266755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:24.267191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:24.271001 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:24.301323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:24.301798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:24.302233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:24.302837 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lazy-loading 'fault' on Instance uuid aa4616bd-1e93-4ad7-b743-0346f60cfd59 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:50:24.352569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-36e1ea1c-e64b-4f7c-9c1b-a95164b8c26d tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 200 len: 1454 microversion: 2.1 time: 0.099304 Oct 02 01:50:24.353563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3414/6636] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:24 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:50:25.376989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:50:25.377650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] [instance: aa4616bd-1e93-4ad7-b743-0346f60cfd59] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:50:25.385082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:25.385582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:25.386032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:25.386772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:50:25.387252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:50:25.387691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:50:25.401619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] HTTP exception thrown: Instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 could not be found. Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Request method failure captured: Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 HTTP/1.1 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO5DRPm_6yMasyOQmMKpiIRbvzZFAmTk2SeCUdNBRbTtGgOVe_3keMuFg3znt_1DnZAKO1KVkb5ldF9f5LYo7haRc3o7uvnFtk2c1Wm5UspVhO7_CFiBRSiNYzpI6L5h5Pg5pznXs4EU55pungna-0BpV0UL7gCftWO6dxoVG_yptbo Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: a7f508e656b2402e97a5fda511f38f17 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestServerMultinode-1393427542 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a7f508e656b2402e97a5fda511f38f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7f508e656b2402e97a5fda511f38f17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7f508e656b2402e97a5fda511f38f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a7f508e656b2402e97a5fda511f38f17"}]}] Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestServerMultinode-1393427542 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: a7f508e656b2402e97a5fda511f38f17 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestServerMultinode-1393427542 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestServerMultinode-1393427542-project-admin Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66f3d8f41a7941e09f7b7fcba809ff28 Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestServerMultinode-1393427542-project-admin Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: exception: Instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 could not be found. Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'aa4616bd-1e93-4ad7-b743-0346f60cfd59'} Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 could not be found. Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 could not be found. Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:50:25.403291 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 could not be found. Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] Returning 404 to user: Instance aa4616bd-1e93-4ad7-b743-0346f60cfd59 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c948381-cba0-4f9c-bab6-ae11645e0a70 tempest-TestServerMultinode-1393427542 tempest-TestServerMultinode-1393427542-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59" status: 404 len: 111 microversion: 2.1 time: 0.032120 Oct 02 01:50:25.406926 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3223/6637] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:50:25 2022] GET /compute/v2.1/servers/aa4616bd-1e93-4ad7-b743-0346f60cfd59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:51:31.378482 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:51:31.379331 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:51:31.381147 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:51:31.381371 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:51:31.387573 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-336595107", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1102565841", "security_groups": [{"name": "tempest-secgroup-smoke-2117939318"}], "block_device_mapping_v2": [{"uuid": "3a8e1516-9d2f-4a14-b87b-910d43d1ff80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d17114f5-1e9e-4d1c-b8b9-822bb167a3b7"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:51:31.736256 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] validate_networks() for [('d17114f5-1e9e-4d1c-b8b9-822bb167a3b7', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:51:41.411510 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:33.817170 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 01:52:33.818116 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=13 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:33.819485 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=39 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:33.823469 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:52:33.823856 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:52:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Oct 02 01:52:33.825485 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:52:33.825819 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:52:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Oct 02 01:52:33.837632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d25d1c7-6cee-403e-b6b3-234478dd9f2f tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Action: 'create', calling method: .version_select at 0x7fb88014b820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-235884454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHoDfvOvUrvwAAmH0m4JE00sTEbeOMi2Ep0q2ixUx1JXVi9aqITCnXjmjTr0Ydx4f56OcfsfaXRjJFmCWb2hRq7JfW37i+JBFENXp98bEXEh+ayPhL4S2GAMmmRgVhaCw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:33.877889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8d25d1c7-6cee-403e-b6b3-234478dd9f2f tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Getting quotas for project 0f53e04ccec74d66a5775d25aebc3689. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:52:33.883749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-8d25d1c7-6cee-403e-b6b3-234478dd9f2f tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Getting quotas for user 5929ff3d530a49948e4485ad032924b7 and project 0f53e04ccec74d66a5775d25aebc3689. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:52:33.920222 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d25d1c7-6cee-403e-b6b3-234478dd9f2f tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.106245 Oct 02 01:52:33.920839 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3224/6638] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:52:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:52:35.058106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1078971730", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c8df9a81-8bfb-4b93-b7bf-c18265e22e8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-235884454", "security_groups": [{"name": "tempest-secgroup-smoke-785090802"}], "networks": [{"uuid": "aa15fc3a-d2af-4011-8e09-29e8feb5d63e"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:35.092098 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55108. Oct 02 01:52:35.275909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] validate_networks() for [('aa15fc3a-d2af-4011-8e09-29e8feb5d63e', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:52:35.720800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:52:35.721238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:52:35.721731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:52:35.722155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:52:35.722639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:52:35.732161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:35.732669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:35.733119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:35.733854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:35.734323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:35.734796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:35.752333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Getting quotas for project 0f53e04ccec74d66a5775d25aebc3689. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:52:35.757522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Getting quotas for user 5929ff3d530a49948e4485ad032924b7 and project 0f53e04ccec74d66a5775d25aebc3689. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:52:35.815617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:52:35.817786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8df9a81-8bfb-4b93-b7bf-c18265e22e8d',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:52:35.959246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58c1705c-09e9-4268-ae8b-fda4c086ffa9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.911136 Oct 02 01:52:35.966959 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3225/6639] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:52:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:52:35.973234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aea6ab17-863c-4030-890b-675632663fb2 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:35.974080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aea6ab17-863c-4030-890b-675632663fb2 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:36.036237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aea6ab17-863c-4030-890b-675632663fb2 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:36.044687 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aea6ab17-863c-4030-890b-675632663fb2 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1098 microversion: 2.1 time: 0.076331 Oct 02 01:52:36.045290 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3226/6640] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:35 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1098 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:36.786074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:36.786686 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:36.794848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:36.795370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:36.795833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:36.796566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:36.797047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:36.797497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:36.823085 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:52:36.904203 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c17e2c1c-5730-4029-bb64-7e62ada23f1d tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 204 len: 0 microversion: 2.1 time: 0.122082 Oct 02 01:52:36.908092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3227/6641] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:52:36 2022] DELETE /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:52:36.981251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-5cf28afc-2764-4984-925b-af9e5d8f4342 req-5eacc287-107f-4492-9dd6-e5c31eeac61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59a22a7-0861-4392-b911-d932042720ae", "tag": "42a8ab05-f07c-40f7-8e5b-41864c437cd3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:36.991307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5cf28afc-2764-4984-925b-af9e5d8f4342 req-5eacc287-107f-4492-9dd6-e5c31eeac61e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:36.992148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5cf28afc-2764-4984-925b-af9e5d8f4342 req-5eacc287-107f-4492-9dd6-e5c31eeac61e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:36.992752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5cf28afc-2764-4984-925b-af9e5d8f4342 req-5eacc287-107f-4492-9dd6-e5c31eeac61e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:37.005063 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5cf28afc-2764-4984-925b-af9e5d8f4342 req-5eacc287-107f-4492-9dd6-e5c31eeac61e service nova] Creating event network-changed:42a8ab05-f07c-40f7-8e5b-41864c437cd3 for instance f59a22a7-0861-4392-b911-d932042720ae on n-h1-master-1 Oct 02 01:52:37.011351 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-5cf28afc-2764-4984-925b-af9e5d8f4342 req-5eacc287-107f-4492-9dd6-e5c31eeac61e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104869 Oct 02 01:52:37.011973 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3228/6642] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:52:37.017567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:37.018558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:37.026452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:37.026985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:37.027423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:37.028137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:37.028827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:37.029263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:37.278031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:37.288845 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2e4f1b6-a332-41a5-83df-11a7c2469cc3 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1577 microversion: 2.1 time: 0.274737 Oct 02 01:52:37.291439 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3229/6643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:37 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1577 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:37.303066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:37.303882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:37.319755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:37.321575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:37.322420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:37.323447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:37.324687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:37.325142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:37.437053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:37.445282 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e98587d-820a-471b-a4d3-725826333f8e tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1214 microversion: 2.1 time: 0.148243 Oct 02 01:52:37.446269 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3230/6644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:37 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:38.316413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:38.317807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:38.325410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:38.326034 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:38.326748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:38.327573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:38.328122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:38.328638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:38.583486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:38.593217 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a05cb7e-e922-4c29-8d54-be6f801a3743 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1577 microversion: 2.1 time: 0.281006 Oct 02 01:52:38.594064 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3231/6645] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:38 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1577 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:38.599272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:38.600164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:38.611261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:38.611771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:38.612227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:38.612955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:38.613456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:38.613963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:39.004724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:39.014299 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97095d0e-5db1-45c4-87d6-379646eea431 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.418824 Oct 02 01:52:39.015401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3232/6646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:38 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:39.632298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0876b71b-3432-48d6-b84b-748ebe0750bf req-ce17d188-7e5e-4f5d-a897-e3d5ea9a7af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:39.642823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0876b71b-3432-48d6-b84b-748ebe0750bf req-ce17d188-7e5e-4f5d-a897-e3d5ea9a7af7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:39.643335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0876b71b-3432-48d6-b84b-748ebe0750bf req-ce17d188-7e5e-4f5d-a897-e3d5ea9a7af7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:39.644066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0876b71b-3432-48d6-b84b-748ebe0750bf req-ce17d188-7e5e-4f5d-a897-e3d5ea9a7af7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:39.657188 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0876b71b-3432-48d6-b84b-748ebe0750bf req-ce17d188-7e5e-4f5d-a897-e3d5ea9a7af7 service nova] Creating event network-changed:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:52:39.662750 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0876b71b-3432-48d6-b84b-748ebe0750bf req-ce17d188-7e5e-4f5d-a897-e3d5ea9a7af7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113965 Oct 02 01:52:39.665478 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3233/6647] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:52:39.671421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:39.672587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:39.680933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:39.681722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:39.682378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:39.683341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:39.684082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:39.684996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:39.797832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:39.806219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-15023c20-53b5-418b-9b61-1434e2457dca tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1391 microversion: 2.1 time: 0.139269 Oct 02 01:52:39.807095 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3234/6648] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:39 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1391 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:40.042783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:40.043859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:40.051992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:40.052985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:40.053695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:40.054969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:40.056698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:40.057696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:40.251384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:40.260175 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9fadfdd9-caca-41ae-beb8-5c60140253aa tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.225056 Oct 02 01:52:40.260924 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3235/6649] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:40 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:40.830314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:40.830956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:40.838085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:40.838682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:40.839097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:40.839823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:40.840302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:40.840746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:40.918843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:40.927023 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b6be2fc-3747-459d-8f8c-b90872b0b49a tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1226 microversion: 2.1 time: 0.100790 Oct 02 01:52:40.927820 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3236/6650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:40 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:41.282643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:41.283319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:41.290467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:41.291031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:41.291492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:41.292272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:41.292753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:41.293203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:41.439201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:41.447760 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fa96b5cc-5de1-4cdd-8e1c-52a5cbf1db69 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.169161 Oct 02 01:52:41.448345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3237/6651] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:41 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:41.679079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cf8f184a-d547-494f-8b46-5bfe285087c0 req-a33fd36d-2e1d-4986-ac4b-8e6162511268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59a22a7-0861-4392-b911-d932042720ae", "name": "network-vif-deleted", "tag": "42a8ab05-f07c-40f7-8e5b-41864c437cd3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:41.689695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cf8f184a-d547-494f-8b46-5bfe285087c0 req-a33fd36d-2e1d-4986-ac4b-8e6162511268 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:41.690122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cf8f184a-d547-494f-8b46-5bfe285087c0 req-a33fd36d-2e1d-4986-ac4b-8e6162511268 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:41.690568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cf8f184a-d547-494f-8b46-5bfe285087c0 req-a33fd36d-2e1d-4986-ac4b-8e6162511268 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:41.706710 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cf8f184a-d547-494f-8b46-5bfe285087c0 req-a33fd36d-2e1d-4986-ac4b-8e6162511268 service nova] Creating event network-vif-deleted:42a8ab05-f07c-40f7-8e5b-41864c437cd3 for instance f59a22a7-0861-4392-b911-d932042720ae on n-h1-master-1 Oct 02 01:52:41.711466 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cf8f184a-d547-494f-8b46-5bfe285087c0 req-a33fd36d-2e1d-4986-ac4b-8e6162511268 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036131 Oct 02 01:52:41.712357 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3238/6652] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:52:41.951539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:41.952156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:41.959312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:41.959812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:41.960264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:41.961087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:41.962059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:41.962695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:42.027675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:42.035563 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a19f68e1-73e5-408e-ac77-a120d5c7d041 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1226 microversion: 2.1 time: 0.088418 Oct 02 01:52:42.036137 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3239/6653] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:41 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:42.470969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:42.471601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:42.477884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:42.478207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:42.478685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:42.479398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:42.479870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:42.480312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:42.616762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:42.626279 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1dc7c34-2061-4550-bdf5-2abc4ee5ce6d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.159194 Oct 02 01:52:42.626945 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3240/6654] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:42 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:43.058525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:43.059239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:43.066890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:43.067405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:43.067863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:43.068587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:43.069062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:43.069512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:43.136449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:43.144401 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05c5c7e3-39b2-4aee-b854-d4e990527110 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1226 microversion: 2.1 time: 0.089861 Oct 02 01:52:43.144983 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3241/6655] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:43 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:43.649900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:43.650532 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:43.657510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:43.658007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:43.658458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:43.659191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:43.659666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:43.660096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:43.797683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:43.806691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-630b09d4-c219-471b-92a8-1bc0097606ca tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.161058 Oct 02 01:52:43.807262 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3242/6656] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:43 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:44.168412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:44.169291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:44.176388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:44.177020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:44.177477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:44.178891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:44.179372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:44.179885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:44.201402 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:44.247668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c3d05e92dd463e81ccc5a557e46fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff590c5b5cc499386a58d5b84c7462b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:44.255620 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-91d0f853-ba8e-4485-a12c-1bfbb3fd61e1 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 200 len: 1226 microversion: 2.1 time: 0.091430 Oct 02 01:52:44.256188 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3243/6657] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:44 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:44.829953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:44.830484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:44.837276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:44.837739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:44.838277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:44.839041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:44.839513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:44.839956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:44.982033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:44.991715 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b96a9b6f-370e-4b85-9661-c71e53c076c5 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.165693 Oct 02 01:52:44.992300 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3244/6658] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:44 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:45.280170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:45.280840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: f59a22a7-0861-4392-b911-d932042720ae] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:45.287979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:45.288654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:45.289259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:45.290089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:45.290576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:45.291053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:45.308204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance f59a22a7-0861-4392-b911-d932042720ae could not be found. Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae HTTP/1.1 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: exception: Instance f59a22a7-0861-4392-b911-d932042720ae could not be found. Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'f59a22a7-0861-4392-b911-d932042720ae'} Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59a22a7-0861-4392-b911-d932042720ae could not be found. Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59a22a7-0861-4392-b911-d932042720ae could not be found. Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:52:45.310227 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59a22a7-0861-4392-b911-d932042720ae could not be found. Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance f59a22a7-0861-4392-b911-d932042720ae could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77f1f032-a354-4a28-b769-55ac63f3a904 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae" status: 404 len: 111 microversion: 2.1 time: 0.035759 Oct 02 01:52:45.314534 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3245/6659] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:45 2022] GET /compute/v2.1/servers/f59a22a7-0861-4392-b911-d932042720ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:52:45.775870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:45.776382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:45.778245 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:45.785579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:45.786092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:45.786551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:45.787295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:45.787793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:45.788240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:45.802369 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a HTTP/1.1 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a'} Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:52:45.803981 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cae8337e-23d3-4a8a-9fa1-3eed1061912e tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 404 len: 111 microversion: 2.1 time: 0.034036 Oct 02 01:52:45.812168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3246/6660] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:52:45 2022] DELETE /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:52:45.814491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:45.815152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] [instance: d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:45.821095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:45.821606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:45.822058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:45.822818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:45.823299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:45.823744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:45.840281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] HTTP exception thrown: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Request method failure captured: Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a HTTP/1.1 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOOyTFuNvQbjPAqeCKzkgjCKiQdCJBziUu3w0pgNzB8P3iEUYBtytau-FWX38fNFIsYgwXnljecNJ0D45rY5vdGcFrVY6g4pc1R1_OscBBEy8jY4F9ogwcY7LYlXnblx4wRDLlZgGSSoqejpov41Cu-cMm1Er2xcMk6owwfZAqWHCiug Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1ff590c5b5cc499386a58d5b84c7462b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1ff590c5b5cc499386a58d5b84c7462b"}]}] Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1ff590c5b5cc499386a58d5b84c7462b Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362862820 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 30c3d05e92dd463e81ccc5a557e46fa3 Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBootPattern-1362862820-project Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a'} Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:52:45.841852 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 404 to user: Instance d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d39ab15f-da17-4fdd-a2d2-a4af6f02ae9f tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a" status: 404 len: 111 microversion: 2.1 time: 0.032394 Oct 02 01:52:45.846714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3247/6661] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:45 2022] GET /compute/v2.1/servers/d13a225c-d4b1-4f9b-8a9e-5ea2a98ee17a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:52:46.015808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:46.016567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:46.023053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:46.023777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:46.025127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:46.026307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:46.027219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:46.028025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:46.047395 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:46.176048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:46.186168 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96882a72-0e4c-424f-8cd7-2ff6fb0c53c0 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1281 microversion: 2.1 time: 0.174266 Oct 02 01:52:46.186793 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3248/6662] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:46 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:47.209547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:47.210124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:47.217085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:47.217582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:47.218030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:47.218761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:47.219229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:47.219669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:47.358487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:47.366257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec8ebbdb-002b-48ed-8334-17b2ff9c0e36 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.160773 Oct 02 01:52:47.367058 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3249/6663] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:47 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:48.390215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:48.390862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:48.397658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:48.398172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:48.398638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:48.399910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:48.400391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:48.400835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:48.537919 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:48.545814 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93c01eca-86f2-4870-8e96-e9b53cbd848d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.159622 Oct 02 01:52:48.546396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3250/6664] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:48 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:49.268625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de8f4f98-fc99-4939-ae05-b076e499e7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Calling method '.version_select at 0x7fb88021fee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:49.297733 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de8f4f98-fc99-4939-ae05-b076e499e7bc tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1102565841" status: 202 len: 0 microversion: 2.1 time: 0.033159 Oct 02 01:52:49.298340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3251/6665] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:52:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1102565841 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:52:49.569407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:49.570080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:49.579155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:49.579666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:49.580118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:49.581043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:49.581548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:49.582141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:49.726430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:49.736073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9a87866-d765-430d-9230-549d883ca886 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.170527 Oct 02 01:52:49.736804 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3252/6666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:49 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:50.760648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:50.761304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:50.768479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:50.769012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:50.769463 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:50.770185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:50.770680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:50.771121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:50.919611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:50.927643 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ea26c4f1-866e-446b-8979-2c3fedf40b6b tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.171799 Oct 02 01:52:50.928227 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3253/6667] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:50 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:51.953439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:51.954261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:51.972541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:51.972541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:51.972541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:51.972541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:51.972541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:51.972541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:52.190903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:52.199231 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bb1f1e1a-a0b4-4791-ba2d-daa1f387ed56 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.250678 Oct 02 01:52:52.199820 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3254/6668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:51 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:53.225291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:53.226807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:53.233587 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:53.235387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:53.236056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:53.236906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:53.238001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:53.238788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:53.239386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:53.481270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:53.489187 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f025e3e9-e469-4078-9439-933297cadf1c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.268268 Oct 02 01:52:53.489845 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3255/6669] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:53 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:54.513591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:54.514205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:54.521526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:54.522037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:54.522488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:54.523433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:54.523957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:54.524410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:54.689182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:54.698739 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d4d55686-1bd1-486b-bfa6-27892e5ba578 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.189044 Oct 02 01:52:54.699616 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3256/6670] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:54 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:55.325340 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4c408f53-37c0-4ac3-875a-1cc0ebe48d3d req-73ed174c-4af1-48eb-ae48-01b3c47bb943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:55.340140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4c408f53-37c0-4ac3-875a-1cc0ebe48d3d req-73ed174c-4af1-48eb-ae48-01b3c47bb943 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:55.340780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4c408f53-37c0-4ac3-875a-1cc0ebe48d3d req-73ed174c-4af1-48eb-ae48-01b3c47bb943 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:55.341340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4c408f53-37c0-4ac3-875a-1cc0ebe48d3d req-73ed174c-4af1-48eb-ae48-01b3c47bb943 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:55.366998 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4c408f53-37c0-4ac3-875a-1cc0ebe48d3d req-73ed174c-4af1-48eb-ae48-01b3c47bb943 service nova] Creating event network-vif-plugged:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:52:55.375791 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4c408f53-37c0-4ac3-875a-1cc0ebe48d3d req-73ed174c-4af1-48eb-ae48-01b3c47bb943 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053168 Oct 02 01:52:55.376758 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3257/6671] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:52:55.723534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:55.724235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:55.731442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:55.731950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:55.732400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:55.733111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:55.733583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:55.734024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:55.917189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:55.929281 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8423af4-0494-44bb-8356-3f6188018154 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1269 microversion: 2.1 time: 0.210495 Oct 02 01:52:55.942696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3258/6672] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:55 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:56.957504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:56.958234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:56.966253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:56.966960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:56.967509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:56.968324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:56.968869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:56.969388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:57.125505 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:57.134334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1efa8b29-7b7d-4c61-ad33-7766082bec13 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1459 microversion: 2.1 time: 0.180709 Oct 02 01:52:57.134882 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3259/6673] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:56 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1459 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:52:57.156288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:52:57.156921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:52:57.162856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:57.163354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:57.163805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:57.164555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:57.165164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:57.165608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:57.347195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:52:57.357383 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44745bb6-6341-446c-9ef9-8b74815fa08c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1459 microversion: 2.1 time: 0.204830 Oct 02 01:52:57.358216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3260/6674] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:52:57 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1459 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:52:59.286224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0c64c334-20ab-41ee-9bbd-fd53d27c93eb req-c7fa4a36-a8e6-4eb0-bf9f-7eab8d581b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:52:59.300172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0c64c334-20ab-41ee-9bbd-fd53d27c93eb req-c7fa4a36-a8e6-4eb0-bf9f-7eab8d581b39 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:52:59.301210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0c64c334-20ab-41ee-9bbd-fd53d27c93eb req-c7fa4a36-a8e6-4eb0-bf9f-7eab8d581b39 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:52:59.301683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0c64c334-20ab-41ee-9bbd-fd53d27c93eb req-c7fa4a36-a8e6-4eb0-bf9f-7eab8d581b39 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:52:59.315733 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0c64c334-20ab-41ee-9bbd-fd53d27c93eb req-c7fa4a36-a8e6-4eb0-bf9f-7eab8d581b39 service nova] Creating event network-changed:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:52:59.322278 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0c64c334-20ab-41ee-9bbd-fd53d27c93eb req-c7fa4a36-a8e6-4eb0-bf9f-7eab8d581b39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039555 Oct 02 01:52:59.323281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3261/6675] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:53:00.953713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d9ad77c8-226e-4f05-9407-4a81e402d238 req-90313edf-80d6-4ced-8ddd-89c1e3cd1e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:53:00.965240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9ad77c8-226e-4f05-9407-4a81e402d238 req-90313edf-80d6-4ced-8ddd-89c1e3cd1e94 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:00.965765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9ad77c8-226e-4f05-9407-4a81e402d238 req-90313edf-80d6-4ced-8ddd-89c1e3cd1e94 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:00.966203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d9ad77c8-226e-4f05-9407-4a81e402d238 req-90313edf-80d6-4ced-8ddd-89c1e3cd1e94 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:00.989337 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d9ad77c8-226e-4f05-9407-4a81e402d238 req-90313edf-80d6-4ced-8ddd-89c1e3cd1e94 service nova] Creating event network-changed:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:53:00.995479 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d9ad77c8-226e-4f05-9407-4a81e402d238 req-90313edf-80d6-4ced-8ddd-89c1e3cd1e94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047673 Oct 02 01:53:00.996070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3262/6676] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:53:03.011256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a197f4cc-7933-41d1-9652-7e0f36bc746a req-155f8225-b549-4688-a68e-48cd9b04b825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:53:03.021642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a197f4cc-7933-41d1-9652-7e0f36bc746a req-155f8225-b549-4688-a68e-48cd9b04b825 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:03.022134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a197f4cc-7933-41d1-9652-7e0f36bc746a req-155f8225-b549-4688-a68e-48cd9b04b825 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:03.022579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a197f4cc-7933-41d1-9652-7e0f36bc746a req-155f8225-b549-4688-a68e-48cd9b04b825 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:03.033734 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a197f4cc-7933-41d1-9652-7e0f36bc746a req-155f8225-b549-4688-a68e-48cd9b04b825 service nova] Creating event network-changed:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:53:03.039021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a197f4cc-7933-41d1-9652-7e0f36bc746a req-155f8225-b549-4688-a68e-48cd9b04b825 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031714 Oct 02 01:53:03.040263 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3263/6677] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:53:11.399281 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:53:11.399824 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:53:11.400471 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:53:11.400602 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:53:33.289690 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:53:33.290457 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=88 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:53:33.294684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:33.295255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:33.302411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:33.302953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:33.303414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:33.304328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:33.304806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:33.305252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:33.331573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:53:33.412670 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e78ff932-f3cd-467e-9979-b912f7b828dd tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 204 len: 0 microversion: 2.1 time: 0.124681 Oct 02 01:53:33.413364 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3264/6678] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:53:33 2022] DELETE /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:53:33.421327 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9ecc49ea-457b-4305-afd1-cd57b06e99d9 req-15dfd7a0-c732-48ed-966b-cccfabb07b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:53:33.431024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9ecc49ea-457b-4305-afd1-cd57b06e99d9 req-15dfd7a0-c732-48ed-966b-cccfabb07b38 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:33.431519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9ecc49ea-457b-4305-afd1-cd57b06e99d9 req-15dfd7a0-c732-48ed-966b-cccfabb07b38 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:33.431963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9ecc49ea-457b-4305-afd1-cd57b06e99d9 req-15dfd7a0-c732-48ed-966b-cccfabb07b38 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:33.443694 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9ecc49ea-457b-4305-afd1-cd57b06e99d9 req-15dfd7a0-c732-48ed-966b-cccfabb07b38 service nova] Creating event network-changed:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:53:33.448717 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9ecc49ea-457b-4305-afd1-cd57b06e99d9 req-15dfd7a0-c732-48ed-966b-cccfabb07b38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033754 Oct 02 01:53:33.449329 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3265/6679] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:53:33.455271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:33.455995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:33.462278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:33.462762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:33.463221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:33.463944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:33.464423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:33.464871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:33.615151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:53:33.624532 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2ed3303-6478-47c7-aec7-ca7c7e86dbf9 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1584 microversion: 2.1 time: 0.173528 Oct 02 01:53:33.625280 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3266/6680] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:33 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1584 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:53:34.650223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:34.650861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:34.658404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:34.658946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:34.659467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:34.660180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:34.660658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:34.661109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:34.857109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:53:34.865006 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0d632cf-bd92-4a2a-a76c-3c82919730c4 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1584 microversion: 2.1 time: 0.218673 Oct 02 01:53:34.865583 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3267/6681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:34 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1584 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:53:35.566679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c6a646d3-bec0-4d5d-9479-f85dc6947eea req-44df29ab-227d-4e75-b135-d354802e6319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ea8f5c-f706-4776-aa41-81fe212b8da4", "name": "network-vif-deleted", "tag": "7aa2aee4-69e7-42a4-8ecc-f0ec02692e71"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:53:35.576544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c6a646d3-bec0-4d5d-9479-f85dc6947eea req-44df29ab-227d-4e75-b135-d354802e6319 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:35.577072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c6a646d3-bec0-4d5d-9479-f85dc6947eea req-44df29ab-227d-4e75-b135-d354802e6319 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:35.577521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c6a646d3-bec0-4d5d-9479-f85dc6947eea req-44df29ab-227d-4e75-b135-d354802e6319 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:35.592384 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c6a646d3-bec0-4d5d-9479-f85dc6947eea req-44df29ab-227d-4e75-b135-d354802e6319 service nova] Creating event network-vif-deleted:7aa2aee4-69e7-42a4-8ecc-f0ec02692e71 for instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 on n-h2-master-1 Oct 02 01:53:35.597778 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c6a646d3-bec0-4d5d-9479-f85dc6947eea req-44df29ab-227d-4e75-b135-d354802e6319 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034727 Oct 02 01:53:35.601361 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3268/6682] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:53:35.891937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:35.892879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:35.899528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:35.900092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:35.900544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:35.901255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:35.901723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:35.902216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:35.971593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:53:35.980562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1ddfa43-254c-4ba1-9f60-a47b22d96005 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1229 microversion: 2.1 time: 0.094647 Oct 02 01:53:35.981381 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3269/6683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:35 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:53:37.005313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:37.005951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:37.013348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:37.013856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:37.014316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:37.015061 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:37.015539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:37.015987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:37.083425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:53:37.092300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6bfc9ab6-fe3a-4679-98ef-3745b97fa0f1 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1229 microversion: 2.1 time: 0.090869 Oct 02 01:53:37.092896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3270/6684] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:37 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:53:38.116205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:38.116874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:38.124226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:38.124724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:38.125203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:38.125908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:38.126380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:38.126852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:38.190375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:53:38.198428 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6107a736-ad59-43ab-a788-bc6fecc56fee tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1229 microversion: 2.1 time: 0.086398 Oct 02 01:53:38.199055 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3271/6685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:38 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:53:39.222742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:39.223375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:39.230326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:39.231360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:39.231813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:39.232522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:39.232989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:39.233427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:39.299216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5929ff3d530a49948e4485ad032924b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f53e04ccec74d66a5775d25aebc3689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:53:39.307183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c6433f8a-3999-42da-aec9-903e0ea8d028 tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 200 len: 1229 microversion: 2.1 time: 0.088457 Oct 02 01:53:39.307758 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3272/6686] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:39 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:53:40.330640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:40.331283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] [instance: d5ea8f5c-f706-4776-aa41-81fe212b8da4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:53:40.338136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:40.338655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:40.339109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:40.339812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:53:40.341148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:53:40.341271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:53:40.354400 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] HTTP exception thrown: Instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 could not be found. Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Request method failure captured: Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 HTTP/1.1 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO5tQeHq5gZ_nv4LGRMX8_TE2TQ7lcYJHbD-i8HjsHEVhmOUF2hAgEfhLTSIMjtr_ZXIjWDplPYRwZ6vkYFpAlk3itF0IotyX_Y9xLS-tYRLuPWs8e-b30lnVWjl1uFfY_Nv3lyJZHXFOay14JnGlXqeXjAzRqMjoS9p-NHnHqRuwfs Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0f53e04ccec74d66a5775d25aebc3689 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestVolumeBackupRestore-978877244 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f53e04ccec74d66a5775d25aebc3689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f53e04ccec74d66a5775d25aebc3689"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f53e04ccec74d66a5775d25aebc3689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f53e04ccec74d66a5775d25aebc3689"}]}] Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestVolumeBackupRestore-978877244 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0f53e04ccec74d66a5775d25aebc3689 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestVolumeBackupRestore-978877244 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestVolumeBackupRestore-978877244-project Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5929ff3d530a49948e4485ad032924b7 Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestVolumeBackupRestore-978877244-project Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 could not be found. Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd5ea8f5c-f706-4776-aa41-81fe212b8da4'} Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 could not be found. Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 could not be found. Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:53:40.356927 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 could not be found. Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Returning 404 to user: Instance d5ea8f5c-f706-4776-aa41-81fe212b8da4 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fa2a8996-928b-4ad3-a42e-338f5743b52c tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4" status: 404 len: 111 microversion: 2.1 time: 0.031810 Oct 02 01:53:40.361371 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3273/6687] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:53:40 2022] GET /compute/v2.1/servers/d5ea8f5c-f706-4776-aa41-81fe212b8da4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:53:40.516633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7755ca1-c7df-4917-a6d9-c70a3f57243d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] Calling method '.version_select at 0x7fb8800498b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:53:40.537225 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7755ca1-c7df-4917-a6d9-c70a3f57243d tempest-TestVolumeBackupRestore-978877244 tempest-TestVolumeBackupRestore-978877244-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-235884454" status: 202 len: 0 microversion: 2.1 time: 0.024557 Oct 02 01:53:40.537857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3274/6688] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-235884454 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:54:03.018202 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:03.019092 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:03.140022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-692457780", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:03.197608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] validate_networks() for None {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:54:03.800303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:54:03.800735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:54:03.801226 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:54:03.801644 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:54:03.802072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:54:03.811742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:03.812239 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:03.812690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:03.813468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:03.813939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:03.814372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:03.831058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Getting quotas for project 6e6f688001d740868acffef436ca890f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:54:03.836268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Getting quotas for user 9cc4261e4db8422ba1e4d2a8c970f47e and project 6e6f688001d740868acffef436ca890f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:54:03.853684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:54:03.853684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:54:03.897709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6606ff95-955a-4313-9494-520d058a71f8 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881421 Oct 02 01:54:03.898365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3275/6689] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:54:03.912084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5197bea2-dc9a-48fc-bc74-f33043505bac tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:03.912711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5197bea2-dc9a-48fc-bc74-f33043505bac tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:03.967755 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5197bea2-dc9a-48fc-bc74-f33043505bac tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:03.974888 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5197bea2-dc9a-48fc-bc74-f33043505bac tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1221 microversion: 2.1 time: 0.066584 Oct 02 01:54:03.975602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3276/6690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:03 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:04.999461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:05.000148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:05.008032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:05.008614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:05.009138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:05.009935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:05.010552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:05.011288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:05.083106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:05.093434 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bf51ce83-f8a3-488c-94c7-7985e35d42b7 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1281 microversion: 2.1 time: 0.097822 Oct 02 01:54:05.095133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3277/6691] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:04 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:06.120543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:06.121222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:06.128907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:06.129420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:06.129875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:06.130632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:06.131102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:06.131543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:06.266106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:06.274752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b72e1335-806a-4abc-80b7-1ac5f8216457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1321 microversion: 2.1 time: 0.157761 Oct 02 01:54:06.275562 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3278/6692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:06 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:06.909291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-518b7728-f755-43af-a11d-228263c4f3d6 req-2dca8c68-d6e4-4f3d-a2c8-a1f63e2a32a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0067d5a-281f-4286-a24c-0cc0416c5d29", "tag": "f7bfcd94-2e31-4b89-92f4-6c12089d6fe7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:06.921676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-518b7728-f755-43af-a11d-228263c4f3d6 req-2dca8c68-d6e4-4f3d-a2c8-a1f63e2a32a0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:06.922174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-518b7728-f755-43af-a11d-228263c4f3d6 req-2dca8c68-d6e4-4f3d-a2c8-a1f63e2a32a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:06.922767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-518b7728-f755-43af-a11d-228263c4f3d6 req-2dca8c68-d6e4-4f3d-a2c8-a1f63e2a32a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:06.938913 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-518b7728-f755-43af-a11d-228263c4f3d6 req-2dca8c68-d6e4-4f3d-a2c8-a1f63e2a32a0 service nova] Creating event network-changed:f7bfcd94-2e31-4b89-92f4-6c12089d6fe7 for instance c0067d5a-281f-4286-a24c-0cc0416c5d29 on n-h2-master-1 Oct 02 01:54:06.944877 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-518b7728-f755-43af-a11d-228263c4f3d6 req-2dca8c68-d6e4-4f3d-a2c8-a1f63e2a32a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039523 Oct 02 01:54:06.945685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3279/6693] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:54:07.299893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:07.300718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:07.307512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:07.308301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:07.308767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:07.309609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:07.310092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:07.311012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:07.443577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:07.451510 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f98e8a8-3a9a-40fd-8460-6169a5f65457 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1321 microversion: 2.1 time: 0.156370 Oct 02 01:54:07.452095 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3280/6694] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:07 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:08.474778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:08.475423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:08.482817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:08.483329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:08.483843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:08.484543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:08.485029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:08.485474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:08.615714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:08.623954 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed0688f5-d987-4e1a-94df-0e57681c27ef tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1321 microversion: 2.1 time: 0.153141 Oct 02 01:54:08.624787 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3281/6695] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:08 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:09.647576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:09.648212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:09.655888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:09.656391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:09.656849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:09.657562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:09.658039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:09.658484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:09.793445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:09.805578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f2d17b22-1deb-47be-b573-576d6d11432a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1321 microversion: 2.1 time: 0.161923 Oct 02 01:54:09.806558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3282/6696] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:09 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:10.829410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:10.830069 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:10.836965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:10.837466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:10.837923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:10.838661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:10.839141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:10.839585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:10.969127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:10.976963 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8e34922-4b50-4f9d-a872-174c8d0293aa tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1321 microversion: 2.1 time: 0.151522 Oct 02 01:54:10.977552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3283/6697] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:10 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:11.922246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-77c8953a-d59e-45a3-8921-bb657fff0faa req-3858d3d0-1c53-4a96-93b7-3820119938b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0067d5a-281f-4286-a24c-0cc0416c5d29", "name": "network-vif-plugged", "status": "completed", "tag": "f7bfcd94-2e31-4b89-92f4-6c12089d6fe7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:11.932006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-77c8953a-d59e-45a3-8921-bb657fff0faa req-3858d3d0-1c53-4a96-93b7-3820119938b0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:11.932508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-77c8953a-d59e-45a3-8921-bb657fff0faa req-3858d3d0-1c53-4a96-93b7-3820119938b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:11.932962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-77c8953a-d59e-45a3-8921-bb657fff0faa req-3858d3d0-1c53-4a96-93b7-3820119938b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:11.945292 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-77c8953a-d59e-45a3-8921-bb657fff0faa req-3858d3d0-1c53-4a96-93b7-3820119938b0 service nova] Creating event network-vif-plugged:f7bfcd94-2e31-4b89-92f4-6c12089d6fe7 for instance c0067d5a-281f-4286-a24c-0cc0416c5d29 on n-h2-master-1 Oct 02 01:54:11.950373 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-77c8953a-d59e-45a3-8921-bb657fff0faa req-3858d3d0-1c53-4a96-93b7-3820119938b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095837 Oct 02 01:54:11.951302 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3284/6698] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:54:12.002073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:12.002827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:12.009544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:12.010050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:12.010515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:12.011330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:12.011808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:12.012297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:12.147216 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:12.156185 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13816bcd-b0f0-4515-8709-f06bbb7dbcc4 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1321 microversion: 2.1 time: 0.159372 Oct 02 01:54:12.156767 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3285/6699] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:11 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:13.181514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:13.182153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:13.190060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.190570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.191050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.191770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.192246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.192705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.326514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:13.335003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aebdf72b-b81b-4348-8866-7818550f6189 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1470 microversion: 2.1 time: 0.157462 Oct 02 01:54:13.335757 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3286/6700] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:13 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:13.409196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ac27066-653f-4da5-8d54-06f04eb9dc5d tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Calling method '.version_select at 0x7fb8801a49d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:13.475359 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ac27066-653f-4da5-8d54-06f04eb9dc5d tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/8b63386b5e34448fab3193d7fa41bf81" status: 200 len: 371 microversion: 2.1 time: 0.118295 Oct 02 01:54:13.475979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3287/6701] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:54:13 2022] GET /compute/v2.1/os-quota-sets/8b63386b5e34448fab3193d7fa41bf81 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:54:13.488374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9112d903-82e8-49e0-8b31-4a2b56ea249b tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1556464969", "id": 427216609, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:13.507069 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9112d903-82e8-49e0-8b31-4a2b56ea249b tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022196 Oct 02 01:54:13.507638 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3288/6702] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:54:13 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:54:13.519386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "427216609"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:13.521616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:13.527444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.527950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.528410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.529125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.529603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.530050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.615891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b66cfb4f42f248f7918e182a959fa891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63386b5e34448fab3193d7fa41bf81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:13.621802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1556464969 {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:54:13.628522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.629022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.629477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.630220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.630848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.631327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.653535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Getting quotas for project 6e6f688001d740868acffef436ca890f. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:54:13.659316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Getting quotas for user 9cc4261e4db8422ba1e4d2a8c970f47e and project 6e6f688001d740868acffef436ca890f. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:54:13.677307 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] ram quota exceeded for 8b63386b5e34448fab3193d7fa41bf81, tried to resize instance. Oct 02 01:54:13.677876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Request method failure captured: Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29/action HTTP/1.1 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 38 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO86MOOW6gXXLibdlUrai7ZkEYOO-E_0NmP-CJKtWP8utdCP13KCF7za8OZwzOpkdxzKNSyGOueQU8M2rnMQgG65LIe9SF2N14w8O9wispuGBaKYheqrXPSOVf7o0TF9dxE3FMOYwcfP5Di0g02EEEmfJjpBxNckzCFaw_O9_MH-Bek Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8b63386b5e34448fab3193d7fa41bf81 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1515728217 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8b63386b5e34448fab3193d7fa41bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b63386b5e34448fab3193d7fa41bf81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b63386b5e34448fab3193d7fa41bf81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8b63386b5e34448fab3193d7fa41bf81"}]}] Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1515728217 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8b63386b5e34448fab3193d7fa41bf81 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1515728217 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-1515728217-project-admin Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: b66cfb4f42f248f7918e182a959fa891 Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1515728217-project-admin Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: {"resize": {"flavorRef": "427216609"}} Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c0067d5a-281f-4286-a24c-0cc0416c5d29', 'body': {'resize': {'flavorRef': '427216609'}}} Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:54:13.687169 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-575ae674-3332-42d9-b425-0f9ee906e4af tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29/action" status: 403 len: 118 microversion: 2.1 time: 0.172801 Oct 02 01:54:13.691811 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3289/6703] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:54:13 2022] POST /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29/action => generated 118 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:54:13.697213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c4c11cab-cee3-4199-9a24-8a6669a9cc1a tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:13.714802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c4c11cab-cee3-4199-9a24-8a6669a9cc1a tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/427216609" status: 202 len: 0 microversion: 2.1 time: 0.020987 Oct 02 01:54:13.715403 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3290/6704] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:54:13 2022] DELETE /compute/v2.1/flavors/427216609 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:54:13.724402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e01d5f6-8f2a-4a4f-9d46-e3b6dc3b6d0f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:13.745241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e01d5f6-8f2a-4a4f-9d46-e3b6dc3b6d0f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024183 Oct 02 01:54:13.745740 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3291/6705] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:54:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:13.766657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-568fd3e3-d561-485f-bf75-4689757a1fa6 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Calling method '.version_select at 0x7fb8809179d0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:13.833987 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-568fd3e3-d561-485f-bf75-4689757a1fa6 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/8b63386b5e34448fab3193d7fa41bf81" status: 200 len: 371 microversion: 2.1 time: 0.071203 Oct 02 01:54:13.834581 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3292/6706] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:54:13 2022] GET /compute/v2.1/os-quota-sets/8b63386b5e34448fab3193d7fa41bf81 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:54:13.846969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7b2ae82-c673-4425-9a7d-76233c23b405 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2101040081", "id": 1139307766, "os-flavor-access:is_public": "True"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:13.864904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7b2ae82-c673-4425-9a7d-76233c23b405 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022103 Oct 02 01:54:13.865496 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3293/6707] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:54:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:54:13.877207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1139307766"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:13.879453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:13.886063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.886557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.887031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.887731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.888197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.888635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.915698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b66cfb4f42f248f7918e182a959fa891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63386b5e34448fab3193d7fa41bf81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:13.921024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2101040081 {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:54:13.928378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.928869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.929316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.930046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:13.930513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:13.930972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:13.951138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Getting quotas for project 6e6f688001d740868acffef436ca890f. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:54:13.956311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Getting quotas for user 9cc4261e4db8422ba1e4d2a8c970f47e and project 6e6f688001d740868acffef436ca890f. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:54:13.969223 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] cores quota exceeded for 8b63386b5e34448fab3193d7fa41bf81, tried to resize instance. Oct 02 01:54:13.969772 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Request method failure captured: Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29/action HTTP/1.1 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 39 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO86MOOW6gXXLibdlUrai7ZkEYOO-E_0NmP-CJKtWP8utdCP13KCF7za8OZwzOpkdxzKNSyGOueQU8M2rnMQgG65LIe9SF2N14w8O9wispuGBaKYheqrXPSOVf7o0TF9dxE3FMOYwcfP5Di0g02EEEmfJjpBxNckzCFaw_O9_MH-Bek Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 8b63386b5e34448fab3193d7fa41bf81 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1515728217 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader,admin Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader,admin Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8b63386b5e34448fab3193d7fa41bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b63386b5e34448fab3193d7fa41bf81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b63386b5e34448fab3193d7fa41bf81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8b63386b5e34448fab3193d7fa41bf81"}]}] Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1515728217 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 8b63386b5e34448fab3193d7fa41bf81 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1515728217 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-1515728217-project-admin Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: b66cfb4f42f248f7918e182a959fa891 Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1515728217-project-admin Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: {"resize": {"flavorRef": "1139307766"}} Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c0067d5a-281f-4286-a24c-0cc0416c5d29', 'body': {'resize': {'flavorRef': '1139307766'}}} Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:54:13.971775 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed566b56-bf85-47c9-8c4c-c40b78184b54 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29/action" status: 403 len: 113 microversion: 2.1 time: 0.099534 Oct 02 01:54:13.975655 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3294/6708] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:54:13 2022] POST /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29/action => generated 113 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:54:13.981584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67f9316d-f3b7-489f-a566-dbe9dd3366b4 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:14.000680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67f9316d-f3b7-489f-a566-dbe9dd3366b4 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1139307766" status: 202 len: 0 microversion: 2.1 time: 0.022385 Oct 02 01:54:14.001179 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3295/6709] 10.222.0.23 () {58 vars in 1161 bytes} [Sun Oct 2 01:54:13 2022] DELETE /compute/v2.1/flavors/1139307766 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:54:14.008732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e79a316d-040a-43f3-ba4e-4feeac3c3323 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:14.028916 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e79a316d-040a-43f3-ba4e-4feeac3c3323 tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023619 Oct 02 01:54:14.029476 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3296/6710] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:54:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:14.050868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:14.051384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:14.054270 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:14.058567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:14.059092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:14.059548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:14.060260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:14.060973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:14.061432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:14.088115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:54:14.161351 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1114f836-a596-4948-b292-6e8eae9b1b2a tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 204 len: 0 microversion: 2.1 time: 0.114001 Oct 02 01:54:14.162090 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3297/6711] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:54:14 2022] DELETE /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:54:14.170972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:14.172704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:14.178630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:14.179152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:14.179620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:14.180365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:14.180842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:14.181284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:14.200855 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:14.322339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:14.330881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83f00751-0d42-4c91-8fed-244afd908fa0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1476 microversion: 2.1 time: 0.163946 Oct 02 01:54:14.331468 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3298/6712] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:14 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:15.357017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:15.357642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:15.365235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:15.365745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:15.366202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:15.366954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:15.367435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:15.367880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:15.505608 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:15.513580 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-16008dd9-a00e-46c7-90de-2be94e8d6c3f tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1476 microversion: 2.1 time: 0.160473 Oct 02 01:54:15.514162 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3299/6713] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:15 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:16.039873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f7ca656d-9951-49f6-a39e-0eb53894e5cd req-72390586-c78c-4a31-8ee4-69623ee32fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0067d5a-281f-4286-a24c-0cc0416c5d29", "name": "network-vif-deleted", "tag": "f7bfcd94-2e31-4b89-92f4-6c12089d6fe7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:16.054170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7ca656d-9951-49f6-a39e-0eb53894e5cd req-72390586-c78c-4a31-8ee4-69623ee32fb3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:16.054943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7ca656d-9951-49f6-a39e-0eb53894e5cd req-72390586-c78c-4a31-8ee4-69623ee32fb3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:16.055552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7ca656d-9951-49f6-a39e-0eb53894e5cd req-72390586-c78c-4a31-8ee4-69623ee32fb3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:16.074020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f7ca656d-9951-49f6-a39e-0eb53894e5cd req-72390586-c78c-4a31-8ee4-69623ee32fb3 service nova] Creating event network-vif-deleted:f7bfcd94-2e31-4b89-92f4-6c12089d6fe7 for instance c0067d5a-281f-4286-a24c-0cc0416c5d29 on n-h2-master-1 Oct 02 01:54:16.083598 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f7ca656d-9951-49f6-a39e-0eb53894e5cd req-72390586-c78c-4a31-8ee4-69623ee32fb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047385 Oct 02 01:54:16.084833 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3300/6714] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:54:16.540958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:16.541806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:16.551330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:16.553189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:16.553189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:16.553531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:16.554002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:16.554721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:16.587375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:16.588052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:16.588510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:16.588972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lazy-loading 'fault' on Instance uuid c0067d5a-281f-4286-a24c-0cc0416c5d29 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:54:16.631862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc4261e4db8422ba1e4d2a8c970f47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f688001d740868acffef436ca890f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:16.640240 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1bf3ab1-7d40-48d3-bfb6-73bfb3a78e6d tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 200 len: 1311 microversion: 2.1 time: 0.105723 Oct 02 01:54:16.640931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3301/6715] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:16 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:17.663700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:17.664383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] [instance: c0067d5a-281f-4286-a24c-0cc0416c5d29] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:17.671393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:17.671925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:17.672346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:17.673058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:17.673531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:17.673976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:17.688686 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] HTTP exception thrown: Instance c0067d5a-281f-4286-a24c-0cc0416c5d29 could not be found. Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Request method failure captured: Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 HTTP/1.1 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO86LE0jQh3nQ3lICkW2UcjEoeeHbaRpn5ykuMKE0DuXCjZnOVFWlJUHXEISOSfKWVz5TI2Um0O9Toy3f14QWg_LRTBRC8wfl8RNoNNtuC_QOtkqjSvGG8K0x24jmvwOhoE9eRuhkB3fVXKA262NndRaWSEnctN4WcVA96dbe27TqO4 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 6e6f688001d740868acffef436ca890f Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1904801568 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e6f688001d740868acffef436ca890f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e6f688001d740868acffef436ca890f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e6f688001d740868acffef436ca890f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e6f688001d740868acffef436ca890f"}]}] Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1904801568 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 6e6f688001d740868acffef436ca890f Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1904801568 Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersAdminNegativeTestJSON-1904801568-project Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 9cc4261e4db8422ba1e4d2a8c970f47e Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1904801568-project Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c0067d5a-281f-4286-a24c-0cc0416c5d29 could not be found. Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c0067d5a-281f-4286-a24c-0cc0416c5d29'} Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0067d5a-281f-4286-a24c-0cc0416c5d29 could not be found. Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0067d5a-281f-4286-a24c-0cc0416c5d29 could not be found. Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:17.689585 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0067d5a-281f-4286-a24c-0cc0416c5d29 could not be found. Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] Returning 404 to user: Instance c0067d5a-281f-4286-a24c-0cc0416c5d29 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-57af42fc-6223-4feb-bd7d-9fe4a4867fb0 tempest-ServersAdminNegativeTestJSON-1904801568 tempest-ServersAdminNegativeTestJSON-1904801568-project] 10.222.0.23 "GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29" status: 404 len: 111 microversion: 2.1 time: 0.031276 Oct 02 01:54:17.693158 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3302/6716] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:17 2022] GET /compute/v2.1/servers/c0067d5a-281f-4286-a24c-0cc0416c5d29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:54:23.932414 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:23.940427 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:24.056945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1009928090", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "53d9025e-f9ff-4b89-be11-d22a8b05e12f"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:24.112511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] validate_networks() for [('53d9025e-f9ff-4b89-be11-d22a8b05e12f', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:54:24.498021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:54:24.498459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:54:24.498975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:54:24.499477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:54:24.499908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:54:24.509071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:24.509568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:24.510016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:24.510823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:24.511295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:24.511736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:24.529319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Getting quotas for project 11b6f51d1d884a7d9e91bfb03a9c1e82. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:54:24.535598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Getting quotas for user e5f6f6deb50b4e64997c5941ca38eda9 and project 11b6f51d1d884a7d9e91bfb03a9c1e82. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:54:24.548531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:54:24.550848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:54:24.597347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6aef67f-c6ee-456c-86a8-b08463974a77 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670095 Oct 02 01:54:24.597860 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3303/6717] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:54:24.609281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26fb6091-6970-4ed2-be91-250561852994 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:24.610141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26fb6091-6970-4ed2-be91-250561852994 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:24.684899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26fb6091-6970-4ed2-be91-250561852994 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:24.692890 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26fb6091-6970-4ed2-be91-250561852994 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1215 microversion: 2.1 time: 0.087768 Oct 02 01:54:24.693468 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3304/6718] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:24 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:54:25.717099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:25.719079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:25.726468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:25.727080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:25.727616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:25.728355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:25.728837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:25.729375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:25.798396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:25.806745 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de6df1db-0f65-4f26-b9c0-ce1512f10ca0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1275 microversion: 2.1 time: 0.093492 Oct 02 01:54:25.807695 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3305/6719] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:25 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:26.831909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:26.832836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:26.842359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:26.843829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:26.844980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:26.845904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:26.846383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:26.847020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:26.990062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:26.998378 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23b7579e-7456-4cd5-8a5a-4d30facc7f0f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1315 microversion: 2.1 time: 0.170557 Oct 02 01:54:26.999009 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3306/6720] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:26 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:27.308757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bb871ee5-bf96-4e57-ac2c-254c944959fd req-af6369f7-d031-4ea3-b0b9-3ef3e95569d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b834b92e-358c-4d25-a23a-54b7ba6f38ed", "tag": "68c99126-2615-47b9-b983-0ffed0065b9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:27.321798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb871ee5-bf96-4e57-ac2c-254c944959fd req-af6369f7-d031-4ea3-b0b9-3ef3e95569d2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:27.322452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb871ee5-bf96-4e57-ac2c-254c944959fd req-af6369f7-d031-4ea3-b0b9-3ef3e95569d2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:27.322931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb871ee5-bf96-4e57-ac2c-254c944959fd req-af6369f7-d031-4ea3-b0b9-3ef3e95569d2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:27.336298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bb871ee5-bf96-4e57-ac2c-254c944959fd req-af6369f7-d031-4ea3-b0b9-3ef3e95569d2 service nova] Creating event network-changed:68c99126-2615-47b9-b983-0ffed0065b9c for instance b834b92e-358c-4d25-a23a-54b7ba6f38ed on n-h2-master-1 Oct 02 01:54:27.342219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bb871ee5-bf96-4e57-ac2c-254c944959fd req-af6369f7-d031-4ea3-b0b9-3ef3e95569d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038749 Oct 02 01:54:27.343837 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3307/6721] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:54:28.023403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:28.024030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:28.030212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:28.030777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:28.031287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:28.031995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:28.032461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:28.032924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:28.168700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:28.176856 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a28d2138-e1ff-48d6-a745-9ed102b986aa tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1315 microversion: 2.1 time: 0.158729 Oct 02 01:54:28.177458 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3308/6722] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:28 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:29.201467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:29.202096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:29.209162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:29.209663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:29.210118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:29.210867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:29.211345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:29.211790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:29.342786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:29.351436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f904a8e8-772c-4283-a073-9584bf9bc3c4 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1315 microversion: 2.1 time: 0.153924 Oct 02 01:54:29.352028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3309/6723] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:29 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:30.376108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:30.376752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:30.383584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:30.384085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:30.384543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:30.385258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:30.385741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:30.386192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:30.519970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:30.527710 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-55fea5a6-3870-46d1-8bca-a015ebb5a106 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1315 microversion: 2.1 time: 0.155813 Oct 02 01:54:30.528329 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3310/6724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:30 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:31.552091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:31.552732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:31.559870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:31.560377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:31.560829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:31.562349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:31.562848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:31.563287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:31.701419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:31.709409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ff3302bd-99c2-4d65-8d5f-8635f77b4f0c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1315 microversion: 2.1 time: 0.161373 Oct 02 01:54:31.709973 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3311/6725] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:31 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:32.124000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3766dd25-9537-44bb-b122-99e58260cb0d req-d53e9274-9113-4eb8-9b32-964dba9461b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834b92e-358c-4d25-a23a-54b7ba6f38ed", "name": "network-vif-plugged", "status": "completed", "tag": "68c99126-2615-47b9-b983-0ffed0065b9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:32.134993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3766dd25-9537-44bb-b122-99e58260cb0d req-d53e9274-9113-4eb8-9b32-964dba9461b0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:32.135541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3766dd25-9537-44bb-b122-99e58260cb0d req-d53e9274-9113-4eb8-9b32-964dba9461b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:32.136130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3766dd25-9537-44bb-b122-99e58260cb0d req-d53e9274-9113-4eb8-9b32-964dba9461b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:32.148573 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3766dd25-9537-44bb-b122-99e58260cb0d req-d53e9274-9113-4eb8-9b32-964dba9461b0 service nova] Creating event network-vif-plugged:68c99126-2615-47b9-b983-0ffed0065b9c for instance b834b92e-358c-4d25-a23a-54b7ba6f38ed on n-h2-master-1 Oct 02 01:54:32.153569 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3766dd25-9537-44bb-b122-99e58260cb0d req-d53e9274-9113-4eb8-9b32-964dba9461b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Oct 02 01:54:32.154480 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3312/6726] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:54:32.734797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:32.735520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:32.741721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:32.742223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:32.742782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:32.743492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:32.743965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:32.744409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:32.878965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:32.886680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d87a772-fb00-4bfd-bc7a-5e1393d50a4d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1315 microversion: 2.1 time: 0.157692 Oct 02 01:54:32.887265 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3313/6727] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:32 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:33.910773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:33.911408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:33.918267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:33.918800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:33.919247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:33.919952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:33.920424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:33.920875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:34.054360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:34.063875 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-482814d7-b425-4afb-aa9e-113ef3457034 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1501 microversion: 2.1 time: 0.157163 Oct 02 01:54:34.064596 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3314/6728] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:33 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:34.087177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:54:34.089407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:34.095567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:34.096071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:34.096525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:34.097273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:34.097744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:34.098189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:34.126937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:34.132280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:54:34.138751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:54:34.139193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:54:34.139731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:54:34.140411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:54:34.140849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:54:34.202411 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2206bd1-02ad-4f04-82b8-715fc932e43a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "POST /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed/action" status: 202 len: 0 microversion: 2.1 time: 0.119018 Oct 02 01:54:34.203266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3315/6729] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:54:34 2022] POST /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:54:34.210878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:34.211504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:34.217389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:34.218048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:34.218539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:34.219850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:34.219850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:34.220186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:34.356827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:34.365620 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-47cfc09b-de66-4f69-a188-37e417b167ba tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1510 microversion: 2.1 time: 0.158329 Oct 02 01:54:34.366224 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3316/6730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:34 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:35.389497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:35.390733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:35.392925 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:35.393653 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:35.400838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:35.401341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:35.401793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:35.402511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:35.403026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:35.403470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:35.541739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:35.545204 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:35.550458 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-70ca7e8a-b4ea-4c21-8fa0-319928d23793 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1510 microversion: 2.1 time: 0.165012 Oct 02 01:54:35.551071 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3317/6731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:35 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:36.574208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:36.574897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:36.583102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:36.583598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:36.584047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:36.584751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:36.585220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:36.585659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:36.724019 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:36.731727 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-577f4446-0e3a-4bd3-a6b1-37bf5a43aabf tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.161487 Oct 02 01:54:36.732300 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3318/6732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:36 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:37.756309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:37.757211 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:37.764039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:37.765037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:37.765469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:37.766171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:37.766656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:37.767095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:37.894691 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:37.902864 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f840098b-5539-4e66-8286-581c2d6a0cb2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.150538 Oct 02 01:54:37.903437 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3319/6733] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:37 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:38.930193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:38.930910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:38.940515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:38.941020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:38.941512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:38.942243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:38.942753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:38.943232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:39.078843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:39.086757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eb208a12-a96d-411e-b288-00de2200c531 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.162995 Oct 02 01:54:39.087342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3320/6734] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:38 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:40.110509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:40.111176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:40.117980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:40.118474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:40.118996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:40.119659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:40.120137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:40.120563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:40.254488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:40.262348 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40adfb3c-9a74-416e-b6cc-fbb5556d2a69 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.156316 Oct 02 01:54:40.262967 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3321/6735] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:40 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:41.285760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:41.287382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:41.295210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:41.295717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:41.296942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:41.297818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:41.298360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:41.298991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:41.429005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:41.437720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a12dd42b-7238-49c6-8267-c26e62751d32 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.155817 Oct 02 01:54:41.438313 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3322/6736] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:41 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:54:42.461354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:42.462025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:42.468952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:42.469462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:42.469914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:42.470647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:42.471126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:42.471571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:42.605522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:42.613504 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b3f2c3b-68f4-4c54-8067-3eb8cba8f26b tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.156097 Oct 02 01:54:42.617258 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3323/6737] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:42 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:43.637594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:43.638224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:43.645659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:43.646156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:43.646633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:43.647360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:43.647831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:43.648304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:43.777868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:43.786428 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8dbd27ab-d47d-46e6-b3d7-5623ba892546 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.152989 Oct 02 01:54:43.787029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3324/6738] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:43 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:44.809760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:44.810392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:44.813618 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:44.819246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:44.819753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:44.820205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:44.820923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:44.821396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:44.821839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:44.960221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:44.968835 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25794ab0-d297-4293-afe1-764209772d50 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.163079 Oct 02 01:54:44.969420 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3325/6739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:44 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:45.993212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:45.993898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:46.001738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:46.002243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:46.002741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:46.003461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:46.003939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:46.004395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:46.145990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:46.154184 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2df40633-6078-49cb-b324-9e03e4351df0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.164980 Oct 02 01:54:46.154814 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3326/6740] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:45 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:47.177530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:47.178172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:47.185234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:47.185732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:47.186209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:47.187598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:47.188068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:47.188508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:47.320681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:47.329131 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6226dd2-9e97-447d-a09e-e1ec3ccf2ec1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.155567 Oct 02 01:54:47.329713 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3327/6741] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:47 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:48.352378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:48.353006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:48.360366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:48.360869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:48.361323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:48.362036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:48.362531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:48.363007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:48.496167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:48.503914 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d024deb-aa66-435e-9cf0-a63f09cde1f1 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.155538 Oct 02 01:54:48.504518 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3328/6742] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:48 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:49.527662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:49.528287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:49.535227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:49.535720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:49.536173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:49.536873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:49.537339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:49.537776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:49.672149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:49.680034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-52127223-577b-4db2-a9c7-a5c783748d17 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.156389 Oct 02 01:54:49.680620 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3329/6743] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:49 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:50.704521 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:50.705203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:50.712215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:50.712743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:50.713189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:50.713891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:50.714360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:50.714849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:50.848707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:50.856436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fcc4521d-0e2b-459a-8cce-727783dcf02d tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.156394 Oct 02 01:54:50.857016 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3330/6744] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:50 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:51.418166 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:54:51.418767 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:54:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:54:51.881156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:51.881788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:51.888894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:51.889945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:51.890393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:51.891148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:51.891692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:51.892138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:52.025612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:52.034365 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b790160b-a363-4e1a-9f79-ae0149eeeab3 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.158258 Oct 02 01:54:52.035133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3331/6745] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:51 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:53.057980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:53.058735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:53.066305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:53.066846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:53.067299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:53.068041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:53.068506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:53.068958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:53.200217 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:53.208031 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-009019c9-f381-46b3-ba2f-cfe925e5728c tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.153992 Oct 02 01:54:53.208619 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3332/6746] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:53 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:54.232221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:54.232832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:54.239724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:54.240224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:54.240679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:54.241388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:54.241859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:54.242300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:54.379387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:54.387242 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1f61609-a609-47a6-8a35-0578b539e12e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.158996 Oct 02 01:54:54.387819 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3333/6747] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:54 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:55.411156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:55.411833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:55.418314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:55.418848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:55.419298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:55.420002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:55.420495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:55.420953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:55.439687 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:55.550111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:55.557825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eea254dd-0b40-4413-882e-70e6cbf7d51e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.150805 Oct 02 01:54:55.558412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3334/6748] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:55 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:56.592010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:56.592739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:56.599726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:56.600225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:56.600676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:56.601381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:56.601850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:56.602288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:56.735343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:56.743695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06492f05-8962-4f33-9858-f95bfc2831ad tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.155648 Oct 02 01:54:56.744266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3335/6749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:56 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:57.768617 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:57.769382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:57.776362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:57.776857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:57.777303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:57.778004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:57.778470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:57.778945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:57.914193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:57.923067 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04e76dba-9763-4521-be1b-7db240c69a4a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.158989 Oct 02 01:54:57.923674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3336/6750] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:57 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:54:58.947435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:54:58.948075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:54:58.955283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:58.955787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:58.956242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:58.956952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:54:58.957433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:54:58.957881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:54:59.087737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:54:59.095642 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6046d3e8-3703-4aff-b0b3-61b01e162984 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.152189 Oct 02 01:54:59.096231 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3337/6751] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:54:58 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:00.119229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:00.119862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:00.126936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:00.127436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:00.127893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:00.128602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:00.129075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:00.129518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:00.265063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:00.272836 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9970963b-44c1-475e-a220-4b3dea9947c7 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.157507 Oct 02 01:55:00.273416 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3338/6752] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:00 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:01.297429 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:01.298072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:01.305513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:01.306028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:01.306503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:01.307253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:01.307725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:01.308165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:01.443626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:01.451484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c4c309c-4795-4397-98a7-53468b573492 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.158514 Oct 02 01:55:01.452203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3339/6753] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:01 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:02.474956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:02.475630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:02.482521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:02.483558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:02.484009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:02.484711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:02.485184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:02.485623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:02.617735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:02.626073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f9d4cf5d-dc4f-408f-967b-ac81c29c3b6e tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1515 microversion: 2.1 time: 0.155081 Oct 02 01:55:02.626864 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3340/6754] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:02 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:03.655681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:03.657632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:03.664473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:03.664977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:03.665497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:03.666212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:03.666712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:03.667152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:03.875672 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:03.883521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6db0d0f8-1e66-49e1-93ea-31a9d4672d4f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1514 microversion: 2.1 time: 0.232231 Oct 02 01:55:03.898626 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3341/6755] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:03 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:03.929285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834b92e-358c-4d25-a23a-54b7ba6f38ed", "name": "network-vif-unplugged", "status": "completed", "tag": "68c99126-2615-47b9-b983-0ffed0065b9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:03.939887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:03.940421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:03.940816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:03.954205 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] Creating event network-vif-unplugged:68c99126-2615-47b9-b983-0ffed0065b9c for instance b834b92e-358c-4d25-a23a-54b7ba6f38ed on n-h1-master-1 Oct 02 01:55:03.960365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:55:03.972077 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1f80a44a-bf47-4aa4-b6b3-afdf4b01060d req-374a51e6-87e1-46e9-a26d-9cbb5b0fd700 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046397 Oct 02 01:55:03.972910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3342/6756] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:55:04.910252 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:04.910997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:04.917164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:04.917658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:04.918103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:04.918838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:04.919331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:04.919764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:05.052842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:05.060632 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-888c93a5-ff9f-48a6-95bf-0a23b8bf46d2 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1512 microversion: 2.1 time: 0.156379 Oct 02 01:55:05.061216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3343/6757] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:04 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:05.988901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b834b92e-358c-4d25-a23a-54b7ba6f38ed", "tag": "68c99126-2615-47b9-b983-0ffed0065b9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:05.998771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:05.999271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:05.999776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:06.013357 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] Creating event network-changed:68c99126-2615-47b9-b983-0ffed0065b9c for instance b834b92e-358c-4d25-a23a-54b7ba6f38ed on n-h1-master-1 Oct 02 01:55:06.018874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:55:06.029687 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-0f8e96fb-2b65-4924-949d-55af13a1d31d req-d2f21c3b-e8fd-4e99-adb3-4f41b94f118d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045331 Oct 02 01:55:06.030384 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3344/6758] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:55:06.085648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:06.086365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:06.092660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:06.093164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:06.094265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:06.095003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:06.095469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:06.095906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:06.230273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:06.238552 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3d292a2d-2ef8-4ab4-844d-b8b71e6b75de tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1512 microversion: 2.1 time: 0.157119 Oct 02 01:55:06.239378 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3345/6759] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:06 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:07.262190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:07.262863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:07.270894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:07.271399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:07.271856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:07.272573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:07.273056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:07.273503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:07.408832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:07.416697 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5b6954c-89fc-4792-9ff9-eeec9e72f324 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1512 microversion: 2.1 time: 0.158410 Oct 02 01:55:07.417282 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3346/6760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:07 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:08.441995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:08.442684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:08.449642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:08.450147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:08.450617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:08.451358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:08.451838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:08.452287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:08.583572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:08.591457 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebc8c99b-e80b-4504-a83a-3ffbf906251a tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1509 microversion: 2.1 time: 0.154380 Oct 02 01:55:08.592042 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3347/6761] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:08 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:08.614178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:08.614723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:08.620456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:08.620952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:08.621402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:08.622105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:08.622578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:08.623046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:08.649404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:55:08.698687 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Found an unconfirmed migration during delete, id: 16, status: finished Oct 02 01:55:10.217326 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-052f4b51-1011-4ed9-9f1b-97448d1b30d0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 204 len: 0 microversion: 2.1 time: 1.606480 Oct 02 01:55:10.218041 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3348/6762] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:55:08 2022] DELETE /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 0 bytes in 1609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:55:10.227538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:10.228260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:10.234099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:10.234876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:10.235079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:10.235791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:10.236271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:10.236711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:10.255802 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:10.374263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:10.382527 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3190a12b-6eb3-4405-a756-077572aea424 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1501 microversion: 2.1 time: 0.159112 Oct 02 01:55:10.383166 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3349/6763] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:10 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:11.407959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:11.408597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:11.415410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:11.415913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:11.416365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:11.417120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:11.417594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:11.418038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:11.557803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:11.566659 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6467dbd9-a679-49bd-88ad-13252815cf1f tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1501 microversion: 2.1 time: 0.163697 Oct 02 01:55:11.567242 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3350/6764] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:11 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:11.571657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ff7c9854-873a-45b6-9e26-776e0366ba67 req-123d14b4-69cc-4f62-8cf5-a8a3efc4520e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834b92e-358c-4d25-a23a-54b7ba6f38ed", "name": "network-vif-plugged", "status": "completed", "tag": "68c99126-2615-47b9-b983-0ffed0065b9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:11.581023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ff7c9854-873a-45b6-9e26-776e0366ba67 req-123d14b4-69cc-4f62-8cf5-a8a3efc4520e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:11.581507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ff7c9854-873a-45b6-9e26-776e0366ba67 req-123d14b4-69cc-4f62-8cf5-a8a3efc4520e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:11.581946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ff7c9854-873a-45b6-9e26-776e0366ba67 req-123d14b4-69cc-4f62-8cf5-a8a3efc4520e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:11.592752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ff7c9854-873a-45b6-9e26-776e0366ba67 req-123d14b4-69cc-4f62-8cf5-a8a3efc4520e service nova] Creating event network-vif-plugged:68c99126-2615-47b9-b983-0ffed0065b9c for instance b834b92e-358c-4d25-a23a-54b7ba6f38ed on n-h1-master-1 Oct 02 01:55:11.598627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ff7c9854-873a-45b6-9e26-776e0366ba67 req-123d14b4-69cc-4f62-8cf5-a8a3efc4520e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030211 Oct 02 01:55:11.599264 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3351/6765] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:55:12.199071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f8d18323-e840-4303-8279-cb0f8d1678a7 req-54536b4d-1737-416b-9e27-1d07bcaa2f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834b92e-358c-4d25-a23a-54b7ba6f38ed", "name": "network-vif-deleted", "tag": "68c99126-2615-47b9-b983-0ffed0065b9c"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:12.209712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f8d18323-e840-4303-8279-cb0f8d1678a7 req-54536b4d-1737-416b-9e27-1d07bcaa2f0c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:12.210211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f8d18323-e840-4303-8279-cb0f8d1678a7 req-54536b4d-1737-416b-9e27-1d07bcaa2f0c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:12.210685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f8d18323-e840-4303-8279-cb0f8d1678a7 req-54536b4d-1737-416b-9e27-1d07bcaa2f0c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:12.222061 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f8d18323-e840-4303-8279-cb0f8d1678a7 req-54536b4d-1737-416b-9e27-1d07bcaa2f0c service nova] Creating event network-vif-deleted:68c99126-2615-47b9-b983-0ffed0065b9c for instance b834b92e-358c-4d25-a23a-54b7ba6f38ed on n-h1-master-1 Oct 02 01:55:12.227678 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f8d18323-e840-4303-8279-cb0f8d1678a7 req-54536b4d-1737-416b-9e27-1d07bcaa2f0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Oct 02 01:55:12.228289 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3352/6766] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:55:12.592345 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:12.593080 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:12.600308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:12.600817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:12.601273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:12.602950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:12.603911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:12.604507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:12.642074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:12.642744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:12.643244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:12.643816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lazy-loading 'fault' on Instance uuid b834b92e-358c-4d25-a23a-54b7ba6f38ed {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:55:12.684906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5f6f6deb50b4e64997c5941ca38eda9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:12.693801 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e31c8b07-8579-4363-9dd4-acade0016949 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 200 len: 1305 microversion: 2.1 time: 0.107018 Oct 02 01:55:12.694485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3353/6767] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:12 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:13.717440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:13.718827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:13.725548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:13.726036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:13.726491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:13.727221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:13.727700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:13.728143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:13.741591 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] HTTP exception thrown: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Request method failure captured: Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed HTTP/1.1 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO9PLasBLCrDmDdSYDVI6jM03WauqjizTDRC5PlpKlWTENIxGyQRYI-hcQWiF6-4K0PiLHKWwuC7u2Rciu0KPlrK_eN-QvuiJST2WmxU_Adp5WZVMh89KoxEoa-vekKt5KT-TGdzWvrwHim10Y2L-0XrySjvgCHbjLpc3ty6mN6o8jk Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 11b6f51d1d884a7d9e91bfb03a9c1e82 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_11b6f51d1d884a7d9e91bfb03a9c1e82"}]}] Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 11b6f51d1d884a7d9e91bfb03a9c1e82 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-2017971550-project Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e5f6f6deb50b4e64997c5941ca38eda9 Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-2017971550-project Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: exception: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b834b92e-358c-4d25-a23a-54b7ba6f38ed'} Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:55:13.743262 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Returning 404 to user: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9aad4805-8ac6-4014-bbf0-f656276f9ef0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 404 len: 111 microversion: 2.1 time: 0.031324 Oct 02 01:55:13.747397 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3354/6768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:13 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:55:13.760682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:13.761188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:13.767777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:13.768272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:13.768718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:13.769414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:13.769878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:13.770313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:13.784176 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] HTTP exception thrown: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Request method failure captured: Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed HTTP/1.1 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO9PLasBLCrDmDdSYDVI6jM03WauqjizTDRC5PlpKlWTENIxGyQRYI-hcQWiF6-4K0PiLHKWwuC7u2Rciu0KPlrK_eN-QvuiJST2WmxU_Adp5WZVMh89KoxEoa-vekKt5KT-TGdzWvrwHim10Y2L-0XrySjvgCHbjLpc3ty6mN6o8jk Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 11b6f51d1d884a7d9e91bfb03a9c1e82 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_11b6f51d1d884a7d9e91bfb03a9c1e82"}]}] Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 11b6f51d1d884a7d9e91bfb03a9c1e82 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-2017971550-project Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e5f6f6deb50b4e64997c5941ca38eda9 Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-2017971550-project Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: exception: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b834b92e-358c-4d25-a23a-54b7ba6f38ed'} Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:55:13.785705 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Returning 404 to user: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-096b520d-2f6f-4fc3-b43a-06fa7aca7cc0 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 404 len: 111 microversion: 2.1 time: 0.030417 Oct 02 01:55:13.789687 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3355/6769] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:55:13 2022] DELETE /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:55:13.795638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:13.796253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] [instance: b834b92e-358c-4d25-a23a-54b7ba6f38ed] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:13.801893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:13.802382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:13.802867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:13.803562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:13.804057 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:13.804500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:13.819300 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] HTTP exception thrown: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Request method failure captured: Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed HTTP/1.1 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO9PLasBLCrDmDdSYDVI6jM03WauqjizTDRC5PlpKlWTENIxGyQRYI-hcQWiF6-4K0PiLHKWwuC7u2Rciu0KPlrK_eN-QvuiJST2WmxU_Adp5WZVMh89KoxEoa-vekKt5KT-TGdzWvrwHim10Y2L-0XrySjvgCHbjLpc3ty6mN6o8jk Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 11b6f51d1d884a7d9e91bfb03a9c1e82 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/11b6f51d1d884a7d9e91bfb03a9c1e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_11b6f51d1d884a7d9e91bfb03a9c1e82"}]}] Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 11b6f51d1d884a7d9e91bfb03a9c1e82 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-DeleteServersTestJSON-2017971550 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-DeleteServersTestJSON-2017971550-project Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: e5f6f6deb50b4e64997c5941ca38eda9 Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-DeleteServersTestJSON-2017971550-project Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: exception: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'b834b92e-358c-4d25-a23a-54b7ba6f38ed'} Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:55:13.820838 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] Returning 404 to user: Instance b834b92e-358c-4d25-a23a-54b7ba6f38ed could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65750eaa-0419-45af-9d6f-12817e188609 tempest-DeleteServersTestJSON-2017971550 tempest-DeleteServersTestJSON-2017971550-project] 10.222.0.23 "GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed" status: 404 len: 111 microversion: 2.1 time: 0.030496 Oct 02 01:55:13.826683 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3356/6770] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:13 2022] GET /compute/v2.1/servers/b834b92e-358c-4d25-a23a-54b7ba6f38ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:55:22.591321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1525213453", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "2a8c8dd6-4d80-4900-9a80-f8bf1d72fe8f"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:22.601361 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:22.650901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] validate_networks() for [('2a8c8dd6-4d80-4900-9a80-f8bf1d72fe8f', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:55:23.058845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:55:23.059395 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:55:23.060093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:55:23.060610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:55:23.061111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:55:23.077387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:23.079195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:23.079845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:23.080619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:23.081142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:23.081532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:23.103837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Getting quotas for project 25d936be31b84687b0f3179a6a06e869. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:55:23.109362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Getting quotas for user 63e6d9193514415799794e8bc1c8739d and project 25d936be31b84687b0f3179a6a06e869. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:55:23.122190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:55:23.125051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:55:23.174940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0dc85b0d-4847-4af5-b6ce-5f33ca04bd95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709955 Oct 02 01:55:23.175693 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3357/6771] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:55:23.187702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-269abcee-3a48-4807-9ba4-3822430754d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:23.188332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-269abcee-3a48-4807-9ba4-3822430754d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:23.245764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-269abcee-3a48-4807-9ba4-3822430754d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:23.256016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-269abcee-3a48-4807-9ba4-3822430754d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1218 microversion: 2.1 time: 0.072719 Oct 02 01:55:23.257255 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3358/6772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:23 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:24.279960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:24.280682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:24.288351 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:24.288885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:24.289345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:24.290068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:24.290544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:24.291058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:24.356643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:24.367050 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-216ff413-1797-4fec-b985-172a5b184575 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1270 microversion: 2.1 time: 0.090829 Oct 02 01:55:24.367663 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3359/6773] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:24 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:25.393179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:25.393841 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:25.411650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:25.411650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:25.411650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:25.411650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:25.411650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:25.417427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:25.615517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:25.623941 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfa24138-768d-4807-99a0-e23b57dc9b5a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1318 microversion: 2.1 time: 0.235564 Oct 02 01:55:25.625545 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3360/6774] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:25 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:26.110148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c84c78c8-ca18-4c91-81e5-e1ad5b8fc42e req-7aa79e7d-beac-4019-9687-72978e0f45c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0200a95-0f9e-437a-a337-f308b779a3f2", "tag": "70258078-6d29-4b4b-bd50-82ce58769ad7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:26.122194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c84c78c8-ca18-4c91-81e5-e1ad5b8fc42e req-7aa79e7d-beac-4019-9687-72978e0f45c4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:26.123232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c84c78c8-ca18-4c91-81e5-e1ad5b8fc42e req-7aa79e7d-beac-4019-9687-72978e0f45c4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:26.123763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c84c78c8-ca18-4c91-81e5-e1ad5b8fc42e req-7aa79e7d-beac-4019-9687-72978e0f45c4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:26.135956 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c84c78c8-ca18-4c91-81e5-e1ad5b8fc42e req-7aa79e7d-beac-4019-9687-72978e0f45c4 service nova] Creating event network-changed:70258078-6d29-4b4b-bd50-82ce58769ad7 for instance c0200a95-0f9e-437a-a337-f308b779a3f2 on n-h2-master-1 Oct 02 01:55:26.143006 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c84c78c8-ca18-4c91-81e5-e1ad5b8fc42e req-7aa79e7d-beac-4019-9687-72978e0f45c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038982 Oct 02 01:55:26.143732 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3361/6775] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:55:26.649915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:26.650714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:26.662389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:26.662984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:26.663454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:26.664205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:26.664681 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:26.665133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:26.794445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:26.802799 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67bf9683-529c-4be3-8bcd-8e44dd9850b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1318 microversion: 2.1 time: 0.157403 Oct 02 01:55:26.803403 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3362/6776] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:26 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:27.825740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:27.826534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:27.834349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:27.834881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:27.835329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:27.836068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:27.836541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:27.836976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:27.970638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:27.978436 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f4b898b-9b08-4b41-b389-0b22d57f82c1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1318 microversion: 2.1 time: 0.156720 Oct 02 01:55:27.979043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3363/6777] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:27 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:29.001724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:29.002355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:29.009438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:29.009938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:29.010390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:29.011205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:29.011677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:29.012123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:29.141084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:29.148825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0f96552d-4101-425d-9d90-4a92655d1a36 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1318 microversion: 2.1 time: 0.151335 Oct 02 01:55:29.149404 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3364/6778] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:28 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:30.173616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:30.174249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:30.181136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:30.181632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:30.182080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:30.182821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:30.183292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:30.183731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:30.321764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:30.335305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a8acf98-1797-4988-959c-05887c39b64f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1318 microversion: 2.1 time: 0.166096 Oct 02 01:55:30.335893 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3365/6779] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:30 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:30.340285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6af738aa-19bf-4a6e-a588-d65842089cb2 req-7d55923e-9648-4676-ae63-126f37feda1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0200a95-0f9e-437a-a337-f308b779a3f2", "name": "network-vif-plugged", "status": "completed", "tag": "70258078-6d29-4b4b-bd50-82ce58769ad7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:30.349542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6af738aa-19bf-4a6e-a588-d65842089cb2 req-7d55923e-9648-4676-ae63-126f37feda1e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:30.350029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6af738aa-19bf-4a6e-a588-d65842089cb2 req-7d55923e-9648-4676-ae63-126f37feda1e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:30.350477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6af738aa-19bf-4a6e-a588-d65842089cb2 req-7d55923e-9648-4676-ae63-126f37feda1e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:30.361587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6af738aa-19bf-4a6e-a588-d65842089cb2 req-7d55923e-9648-4676-ae63-126f37feda1e service nova] Creating event network-vif-plugged:70258078-6d29-4b4b-bd50-82ce58769ad7 for instance c0200a95-0f9e-437a-a337-f308b779a3f2 on n-h2-master-1 Oct 02 01:55:30.366502 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6af738aa-19bf-4a6e-a588-d65842089cb2 req-7d55923e-9648-4676-ae63-126f37feda1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029503 Oct 02 01:55:30.367121 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3366/6780] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:55:31.360426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:31.361171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:31.367427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:31.367921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:31.368366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:31.369063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:31.369523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:31.369957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:31.508266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:31.517423 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2de6993b-c952-43a2-bbbd-cded73de0f9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1318 microversion: 2.1 time: 0.162197 Oct 02 01:55:31.531317 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3367/6781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:31 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:32.541584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:32.542247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:32.549264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:32.549759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:32.550208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:32.550952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:32.551422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:32.551861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:32.684559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:32.693885 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c083419d-e05c-4cf0-9507-7feffd30ee43 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1509 microversion: 2.1 time: 0.156207 Oct 02 01:55:32.694676 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3368/6782] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:32 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:32.717282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:32.718760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:32.724853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:32.725359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:32.725810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:32.726525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:32.727031 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:32.727473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:32.867719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:32.876699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afe68722-aba2-4d23-9671-4558b5442634 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1509 microversion: 2.1 time: 0.163280 Oct 02 01:55:32.877314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3369/6783] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:32 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:32.899435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:32.901791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:32.908568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:32.909073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:32.909527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:32.910244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:32.912078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:32.913396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:32.993217 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0bdb2374-6e8d-43ce-af95-96d70275605e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "PUT /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1081 microversion: 2.1 time: 0.097650 Oct 02 01:55:32.993869 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3370/6784] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:55:32 2022] PUT /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1081 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:33.013177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:33.013799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:33.021420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.021914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.022357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.023100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.023566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.024002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.050457 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:33.091845 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:33.183677 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:33.192346 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6d11f8fb-adf5-4d42-862f-1962ed50abbe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1507 microversion: 2.1 time: 0.183246 Oct 02 01:55:33.192932 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3371/6785] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:33 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:33.215623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:33.216260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:33.223749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.224251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.224705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.225423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.225896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.226334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.259671 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:33.378102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:33.386973 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e30b13f0-7278-4fa0-a9ad-10f195c4a87c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1507 microversion: 2.1 time: 0.175340 Oct 02 01:55:33.387561 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3372/6786] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:33 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:33.416456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:55:33.419676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:33.429286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.430165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.430654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.431388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.431860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.432303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.465699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:33.473095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:55:33.479891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:55:33.480323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:55:33.480815 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:55:33.481242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:55:33.481703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:55:33.552442 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-718c4172-0d03-4132-a847-1f73eeb861e6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.140974 Oct 02 01:55:33.553314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3373/6787] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:55:33 2022] POST /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:55:33.563625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:33.564250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:33.571586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.572098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.572576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.573280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:33.573753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:33.574197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:33.727104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:33.736059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f6783869-7ea3-4517-8e6f-09628b50ce7d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1518 microversion: 2.1 time: 0.177408 Oct 02 01:55:33.736662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3374/6788] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:33 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:34.761238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:34.762218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:34.769990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:34.770497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:34.770988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:34.771747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:34.772221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:34.772666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:34.911642 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:34.919489 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81990a82-9db2-49ef-bda4-adb0df38c0cd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1518 microversion: 2.1 time: 0.162888 Oct 02 01:55:34.920075 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3375/6789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:34 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:35.944808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:35.945485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:35.952148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:35.952648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:35.953096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:35.954438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:35.955093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:35.955536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:36.094795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:36.102486 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9c46d24-6386-49e0-aa51-80d0d936a6a8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.162642 Oct 02 01:55:36.103199 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3376/6790] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:35 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:37.126414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:37.127734 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:37.135854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:37.136356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:37.136815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:37.137529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:37.138001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:37.138444 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:37.267119 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:37.275123 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ca42659-7fe8-4a86-a303-2305933cb455 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.152546 Oct 02 01:55:37.275747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3377/6791] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:37 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:38.299306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:38.299955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:38.306879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:38.307373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:38.307828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:38.308538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:38.309012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:38.309455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:38.445640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:38.453536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ce5a7900-4d38-4815-843f-4a377737f68a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.158942 Oct 02 01:55:38.454281 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3378/6792] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:38 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:39.476973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:39.477658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:39.485641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:39.486146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:39.486620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:39.487362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:39.487837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:39.488277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:39.621614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:39.629500 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-38cc187f-3a21-4a75-a55f-8350b0addbfd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.156481 Oct 02 01:55:39.630097 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3379/6793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:39 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:40.653320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:40.653984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:40.661592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:40.662094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:40.662558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:40.663294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:40.663802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:40.664244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:40.803002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:40.811142 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c7797682-0aae-4e29-b04d-4841c8991f4d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.161951 Oct 02 01:55:40.811717 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3380/6794] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:40 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:41.834688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:41.835355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:41.842221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:41.842751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:41.843207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:41.844418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:41.844960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:41.845403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:41.984396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:41.992850 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9107490f-3666-4843-a0e4-69188db3cccb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.162116 Oct 02 01:55:41.993426 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3381/6795] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:41 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:43.016486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:43.017130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:43.024109 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:43.024610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:43.025063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:43.025771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:43.026243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:43.026722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:43.156890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:43.164647 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63a7f21a-db8f-41f7-a21c-295843d13b9f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.152218 Oct 02 01:55:43.165233 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3382/6796] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:43 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:44.189191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:44.189934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:44.196896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:44.197388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:44.197843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:44.198542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:44.199104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:44.199541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:44.336915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:44.345336 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e863a0e-d3cc-4c89-9815-9a870872a3d7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.160518 Oct 02 01:55:44.345905 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3383/6797] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:44 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:45.368751 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:45.369402 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:45.376363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:45.376852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:45.377297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:45.377994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:45.378457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:45.378923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:45.515164 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:45.523907 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b2e7d72-2c36-4c08-a183-890b46bdc398 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.159098 Oct 02 01:55:45.524527 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3384/6798] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:45 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:46.547874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:46.548659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:46.555503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:46.556000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:46.556450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:46.557160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:46.557652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:46.558076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:46.697131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:46.705540 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fb26592c-c6bc-4733-91aa-2744d302219c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.162182 Oct 02 01:55:46.706147 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3385/6799] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:46 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:47.729262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:47.729950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:47.737771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:47.738272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:47.738766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:47.739495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:47.739964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:47.740404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:47.870262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:47.873899 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:47.879173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-09d3946e-bdaa-4d0e-adc2-e42be083f107 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.153820 Oct 02 01:55:47.879761 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3386/6800] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:47 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:48.901713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:48.902388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:48.911362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:48.911887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:48.912342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:48.913041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:48.913508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:48.913944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:49.046848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:49.054894 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8637a25-446a-4337-9a53-d59b7f7332d2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.157103 Oct 02 01:55:49.055467 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3387/6801] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:48 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:50.077676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:50.078989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:50.085961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:50.086452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:50.086934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:50.087637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:50.088107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:50.088542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:50.216399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:50.224463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-395fb834-9307-4363-8d9d-cdd3ad34c0fe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.150604 Oct 02 01:55:50.224982 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3388/6802] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:50 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:51.249979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:51.250639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:51.257726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:51.258222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:51.258699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:51.259409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:51.259883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:51.260324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:51.391927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:51.399642 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c35a40b-3c85-4139-b407-8e0e9b5fb721 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.153660 Oct 02 01:55:51.400212 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3389/6803] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:51 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:52.425027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:52.425678 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:52.432507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:52.433001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:52.433454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:52.434156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:52.434642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:52.435084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:52.570767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:52.579038 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-41d35175-753c-455d-ba09-573d0e75b156 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.158238 Oct 02 01:55:52.579723 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3390/6804] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:52 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:53.603405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:53.604067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:53.606752 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:53.613367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:53.613893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:53.614342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:53.615105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:53.615572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:53.616006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:53.746703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:53.754522 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-690b5424-3985-4fea-bfde-62abbf2bb826 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.155080 Oct 02 01:55:53.755120 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3391/6805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:53 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:54.778121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:54.778810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:54.787215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:54.787711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:54.788160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:54.788864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:54.789341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:54.789779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:54.929782 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:54.938369 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7149ce1d-8a6b-43f4-8460-6bf5568680bc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.163456 Oct 02 01:55:54.939000 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3392/6806] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:54 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:55.963924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:55.964681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:55.972163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:55.972667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:55.973147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:55.974358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:55.974358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:55.974885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:56.105570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:56.114481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e08a4c1-e550-4a72-9cbd-efa55e236aab tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.154569 Oct 02 01:55:56.115252 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3393/6807] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:55 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:57.143200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:57.143864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:57.150807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:57.151309 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:57.151760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:57.152476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:57.152938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:57.153372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:57.281981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:57.289955 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bef3cdfc-63da-45a4-a988-2d8a589b9fd6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.151366 Oct 02 01:55:57.290533 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3394/6808] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:57 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:58.317116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:58.317777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:58.324737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:58.325241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:58.325698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:58.326414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:58.326910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:58.327358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:58.462580 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:58.470689 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5fad617f-45d9-45d6-a36c-b868d23888ee tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.158460 Oct 02 01:55:58.471266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3395/6809] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:58 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:55:59.494122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:55:59.494774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:55:59.502259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:59.502784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:59.503231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:59.503934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:55:59.504400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:55:59.504840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:55:59.637740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:55:59.646189 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-66f8fb8e-f192-4259-a50e-2d19b7b1ecc0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.156045 Oct 02 01:55:59.646791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3396/6810] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:55:59 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:56:00.669801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:00.670535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:00.677627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:00.678123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:00.678574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:00.679301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:00.679771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:00.680210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:00.814761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:00.822593 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e3542e6-72ee-4a81-996b-d97c19b8cf6b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.156740 Oct 02 01:56:00.823197 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3397/6811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:00 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:01.847616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:01.848255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:01.855212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:01.855715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:01.856172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:01.856887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:01.857362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:01.857813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:01.992098 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:02.000340 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a251a24-6af7-494a-bf9d-42a3ece8abdd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.157214 Oct 02 01:56:02.000970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3398/6812] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:01 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:03.024967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:03.025601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:03.032697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:03.033189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:03.033916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:03.034643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:03.035115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:03.035582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:03.180001 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:03.188528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-371b9672-a7ac-4d20-ac55-22f40974cfa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.167430 Oct 02 01:56:03.189107 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3399/6813] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:03 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:04.212006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:04.212612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:04.219630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:04.220136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:04.220613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:04.221323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:04.221805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:04.222227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:04.357666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:04.366554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b6f4030-ef94-457f-a058-c002b0843468 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.158634 Oct 02 01:56:04.367175 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3400/6814] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:04 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:05.391541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:05.392215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:05.398724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:05.399217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:05.399668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:05.400361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:05.400826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:05.401263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:05.532738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:05.540465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5450bd6-32af-42e1-ab59-037cbde3aa0a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.153605 Oct 02 01:56:05.541043 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3401/6815] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:05 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:06.564951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:06.565640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:06.572601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:06.573100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:06.573555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:06.574268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:06.574785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:06.575241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:06.711372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:06.720113 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c83a46c9-8a7b-40da-81f8-ee67bdb2df5b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1523 microversion: 2.1 time: 0.159795 Oct 02 01:56:06.720694 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3402/6816] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:06 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:07.744586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:07.745260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:07.752829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:07.753393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:07.753775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:07.754498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:07.755011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:07.755460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:07.774202 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:07.969052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:07.977533 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7cc9f8e-a843-4761-8575-93bebb7f50c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1522 microversion: 2.1 time: 0.236835 Oct 02 01:56:07.978122 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3403/6817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:07 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:08.202238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0200a95-0f9e-437a-a337-f308b779a3f2", "name": "network-vif-unplugged", "status": "completed", "tag": "70258078-6d29-4b4b-bd50-82ce58769ad7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:08.212436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:08.212989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:08.213487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:08.225906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] Creating event network-vif-unplugged:70258078-6d29-4b4b-bd50-82ce58769ad7 for instance c0200a95-0f9e-437a-a337-f308b779a3f2 on n-h1-master-1 Oct 02 01:56:08.231413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] Instance c0200a95-0f9e-437a-a337-f308b779a3f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:56:08.244047 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c721bef1-dd53-4f81-931a-0f23e36ecd20 req-e7e4a6f1-af7b-4604-9bbc-90923cd5e93f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045528 Oct 02 01:56:08.244857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3404/6818] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:56:09.003937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:09.004662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:09.010838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:09.011335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:09.011787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:09.012488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:09.012955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:09.013392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:09.152693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:09.160752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1619c64a-fe3f-4e3d-bdbd-016c4c194a4a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1522 microversion: 2.1 time: 0.162019 Oct 02 01:56:09.161322 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3405/6819] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:08 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:10.184555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:10.185213 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:10.193111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:10.193614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:10.194069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:10.194809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:10.195282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:10.195729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:10.341317 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:10.349707 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4ce93989-3065-4edd-ac7c-788b143a4a32 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1520 microversion: 2.1 time: 0.169013 Oct 02 01:56:10.350296 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3406/6820] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:10 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:10.354724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0200a95-0f9e-437a-a337-f308b779a3f2", "tag": "70258078-6d29-4b4b-bd50-82ce58769ad7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:10.363675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:10.364169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:10.364615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:10.376830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] Creating event network-changed:70258078-6d29-4b4b-bd50-82ce58769ad7 for instance c0200a95-0f9e-437a-a337-f308b779a3f2 on n-h1-master-1 Oct 02 01:56:10.382425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] Instance c0200a95-0f9e-437a-a337-f308b779a3f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:56:10.393781 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1180125b-81ae-466a-b7bc-6fe379666b7b req-7991b85c-f8a5-4f19-8dce-c14d131d378d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042291 Oct 02 01:56:10.394469 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3407/6821] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:56:11.375975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:11.376685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:11.382893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:11.383380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:11.383825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:11.384517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:11.384981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:11.385420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:11.865214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:11.873749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2414004-afd5-4733-a67d-336de3d3a379 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1520 microversion: 2.1 time: 0.502897 Oct 02 01:56:11.878696 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3408/6822] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:11 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1520 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:12.898078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:12.898746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:12.905672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:12.906163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:12.906680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:12.908065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:12.908723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:12.909175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:13.043736 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:13.052137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-27fb4d8d-7142-4849-8baa-18acc79c1d50 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1517 microversion: 2.1 time: 0.158715 Oct 02 01:56:13.052712 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3409/6823] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:12 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:56:13.074724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:13.075264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:13.081847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:13.082388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:13.082880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:13.083595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:13.084116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:13.084601 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:13.146076 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ac2d1e0-b335-43ff-9cff-4b45e0ebdd11 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2/action" status: 204 len: 0 microversion: 2.1 time: 0.074672 Oct 02 01:56:13.146756 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3410/6824] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:56:13 2022] POST /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:56:13.154990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:13.156013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:13.163986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:13.164627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:13.165270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:13.166113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:13.166819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:13.167318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:13.312376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:13.320902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f4bcfed-a72e-4b6e-ba83-35d11fe0a9c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1517 microversion: 2.1 time: 0.169849 Oct 02 01:56:13.321910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3411/6825] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:13 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:14.346302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:14.346975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:14.353953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:14.354450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:14.354923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:14.355636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:14.356111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:14.356552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:14.503647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:14.511919 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e16c1d48-3005-46f1-ae6a-e5dbc3ca494e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1517 microversion: 2.1 time: 0.169997 Oct 02 01:56:14.513338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3412/6826] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:14 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:15.536623 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:15.537265 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:15.544181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:15.544675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:15.545124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:15.545826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:15.546292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:15.546779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:15.679822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:15.687778 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90363c6c-bd6f-410e-abf4-be66ac9d44d9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1509 microversion: 2.1 time: 0.154937 Oct 02 01:56:15.688608 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3413/6827] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:15 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:15.710837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:15.711462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:15.717840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:15.718342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:15.718817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:15.720019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:15.720493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:15.720935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:15.859256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:15.868804 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e6621bb-12b7-4ca6-bd8a-cde917b42ffe tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1509 microversion: 2.1 time: 0.161825 Oct 02 01:56:15.869386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3414/6828] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:15 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:15.873878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-55ec2941-9f4e-4b7e-8423-e67379fb3b57 req-14f576ea-ac85-4b09-8643-07a5c9cda4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0200a95-0f9e-437a-a337-f308b779a3f2", "name": "network-vif-plugged", "status": "completed", "tag": "70258078-6d29-4b4b-bd50-82ce58769ad7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:15.883163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-55ec2941-9f4e-4b7e-8423-e67379fb3b57 req-14f576ea-ac85-4b09-8643-07a5c9cda4aa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:15.883655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-55ec2941-9f4e-4b7e-8423-e67379fb3b57 req-14f576ea-ac85-4b09-8643-07a5c9cda4aa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:15.884095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-55ec2941-9f4e-4b7e-8423-e67379fb3b57 req-14f576ea-ac85-4b09-8643-07a5c9cda4aa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:15.896980 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-55ec2941-9f4e-4b7e-8423-e67379fb3b57 req-14f576ea-ac85-4b09-8643-07a5c9cda4aa service nova] Creating event network-vif-plugged:70258078-6d29-4b4b-bd50-82ce58769ad7 for instance c0200a95-0f9e-437a-a337-f308b779a3f2 on n-h1-master-1 Oct 02 01:56:15.902194 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-55ec2941-9f4e-4b7e-8423-e67379fb3b57 req-14f576ea-ac85-4b09-8643-07a5c9cda4aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031624 Oct 02 01:56:15.902857 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3415/6829] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:56:15.908600 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2634d6d-97ca-40f7-ad20-5d3624058d9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'create', calling method: .version_select at 0x7fb880bde3a0>, body: {"keypair": {"name": "tempest-keypair-1002776759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL48dKIrtVwsA9BInrpUA0cx1I5BgOorerMV0LUz1WyxfpXDFtyXmz6XuMVDET/xTqaCB2EjO0o9/880UVDP0ufwFAJiC8+2tFNdr+aHCKCmCpoQcMw7QwIyEbCIbd8/Q=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:15.924247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e2634d6d-97ca-40f7-ad20-5d3624058d9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Getting quotas for project 25d936be31b84687b0f3179a6a06e869. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:56:15.929405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e2634d6d-97ca-40f7-ad20-5d3624058d9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Getting quotas for user 63e6d9193514415799794e8bc1c8739d and project 25d936be31b84687b0f3179a6a06e869. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:56:15.955644 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2634d6d-97ca-40f7-ad20-5d3624058d9b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051595 Oct 02 01:56:15.956257 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3416/6830] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:56:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:56:17.143668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:17.144419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:17.153361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:17.153861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:17.154310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:17.155048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:17.155518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:17.155957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:17.287104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:17.294793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7eff187c-57eb-41c2-828a-3a9966ef04c0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 200 len: 1509 microversion: 2.1 time: 0.156084 Oct 02 01:56:17.295363 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3417/6831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:17 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:17.317312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:17.317867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:17.323848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:17.324347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:17.324796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:17.325500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:17.325968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:17.326403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:17.352447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:56:17.426622 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-388d9259-efb7-483b-99b1-9d1383318311 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 204 len: 0 microversion: 2.1 time: 0.113153 Oct 02 01:56:17.427230 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3418/6832] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:56:17 2022] DELETE /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:56:17.484650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-258519262", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "2a8c8dd6-4d80-4900-9a80-f8bf1d72fe8f"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:17.537926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] validate_networks() for [('2a8c8dd6-4d80-4900-9a80-f8bf1d72fe8f', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:56:17.926114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:56:17.926550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:56:17.927060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:56:17.927481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:56:17.927929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:56:17.937205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:17.939059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:17.939528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:17.940312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:17.940816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:17.941261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:17.960740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Getting quotas for project 25d936be31b84687b0f3179a6a06e869. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:56:17.966199 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Getting quotas for user 63e6d9193514415799794e8bc1c8739d and project 25d936be31b84687b0f3179a6a06e869. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:56:17.979624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:56:17.982030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:56:18.027666 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6994ee8b-ef16-4d78-bb60-dc79556ab53e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547264 Oct 02 01:56:18.028255 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3419/6833] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:56:18.039152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc54edc1-6f74-4557-a050-bd53909f7c14 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:18.039787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc54edc1-6f74-4557-a050-bd53909f7c14 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:18.098939 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc54edc1-6f74-4557-a050-bd53909f7c14 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:18.105956 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc54edc1-6f74-4557-a050-bd53909f7c14 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1217 microversion: 2.1 time: 0.070491 Oct 02 01:56:18.106543 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3420/6834] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:18 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:19.135501 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:19.136347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:19.144571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:19.145078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:19.145529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:19.146257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:19.146760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:19.147203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:19.164429 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:19.222572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:19.231265 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd419671-7bd7-41fe-96ed-c0342a43a022 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1269 microversion: 2.1 time: 0.103930 Oct 02 01:56:19.232490 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3421/6835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:19 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:19.373240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f12aed4c-5197-4387-9420-901ea3c84acb req-ebd03a13-ad27-42c7-9511-2d7178c4a052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0200a95-0f9e-437a-a337-f308b779a3f2", "name": "network-vif-deleted", "tag": "70258078-6d29-4b4b-bd50-82ce58769ad7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:19.396144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f12aed4c-5197-4387-9420-901ea3c84acb req-ebd03a13-ad27-42c7-9511-2d7178c4a052 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:19.396642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f12aed4c-5197-4387-9420-901ea3c84acb req-ebd03a13-ad27-42c7-9511-2d7178c4a052 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:19.397092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f12aed4c-5197-4387-9420-901ea3c84acb req-ebd03a13-ad27-42c7-9511-2d7178c4a052 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:19.411772 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f12aed4c-5197-4387-9420-901ea3c84acb req-ebd03a13-ad27-42c7-9511-2d7178c4a052 service nova] Creating event network-vif-deleted:70258078-6d29-4b4b-bd50-82ce58769ad7 for instance c0200a95-0f9e-437a-a337-f308b779a3f2 on n-h1-master-1 Oct 02 01:56:19.418562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f12aed4c-5197-4387-9420-901ea3c84acb req-ebd03a13-ad27-42c7-9511-2d7178c4a052 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049403 Oct 02 01:56:19.419644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3422/6836] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:56:20.256086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:20.256927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:20.264276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:20.264788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:20.265305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:20.266567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:20.267186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:20.267825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:20.482189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:20.490521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b4fb0df0-9ea5-4226-832f-c1ed8a0217cf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.238839 Oct 02 01:56:20.491138 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3423/6837] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:20 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:21.434292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1726f216-8573-4748-b0dc-372a88dd55c7 req-9a1dd02a-14df-46a5-abb9-e738c01fe678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362c7251-277a-4240-a6f4-8fef06d37fb3", "tag": "134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:21.444970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1726f216-8573-4748-b0dc-372a88dd55c7 req-9a1dd02a-14df-46a5-abb9-e738c01fe678 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:21.445461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1726f216-8573-4748-b0dc-372a88dd55c7 req-9a1dd02a-14df-46a5-abb9-e738c01fe678 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:21.445935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1726f216-8573-4748-b0dc-372a88dd55c7 req-9a1dd02a-14df-46a5-abb9-e738c01fe678 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:21.456886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1726f216-8573-4748-b0dc-372a88dd55c7 req-9a1dd02a-14df-46a5-abb9-e738c01fe678 service nova] Creating event network-changed:134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3 for instance 362c7251-277a-4240-a6f4-8fef06d37fb3 on n-h1-master-1 Oct 02 01:56:21.461581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1726f216-8573-4748-b0dc-372a88dd55c7 req-9a1dd02a-14df-46a5-abb9-e738c01fe678 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030989 Oct 02 01:56:21.462153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3424/6838] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:56:21.514656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:21.515376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:21.517433 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:21.522806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:21.523302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:21.523750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:21.524451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:21.524918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:21.525355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:21.662487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:21.670117 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1257d642-3d98-4c42-807e-0b060200bbc4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.159556 Oct 02 01:56:21.670704 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3425/6839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:21 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:22.693637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:22.694316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:22.701128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:22.701620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:22.702068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:22.702791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:22.703260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:22.703694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:22.833499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:22.841163 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-addeba2b-5d25-4b12-bb5d-9725fa2de6b6 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.151432 Oct 02 01:56:22.841730 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3426/6840] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:22 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:23.865139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:23.865774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:23.872787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:23.873282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:23.873735 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:23.874442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:23.874949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:23.875391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:24.008715 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:24.016389 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5753f101-cddf-4837-bf46-fd3e48fd28d0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.155797 Oct 02 01:56:24.017467 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3427/6841] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:23 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:25.039969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:25.040630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:25.047653 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:25.048208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:25.048658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:25.049366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:25.049838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:25.050281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:25.496671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:25.505159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ea3b9ee-8399-4a8f-9ed2-593767b958e9 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.469155 Oct 02 01:56:25.505745 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3428/6842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:25 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:26.529105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:26.529753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:26.537776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:26.538274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:26.538753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:26.539453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:26.539920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:26.540357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:26.670068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:26.678555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f4689d4-5d8e-48d5-80c4-2f48147b2075 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.153452 Oct 02 01:56:26.679161 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3429/6843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:26 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:27.701440 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:27.702089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:27.708962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:27.709455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:27.709902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:27.710620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:27.711100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:27.711535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:27.848974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:27.857027 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7ddf52f-f591-4204-b3fa-c36c9e949051 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.159437 Oct 02 01:56:27.857788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3430/6844] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:27 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:27.940760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9f82ae89-fe1e-487b-91fc-377d78a540cf req-b3971662-3b09-4bc4-b0c6-2c1544e4f50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362c7251-277a-4240-a6f4-8fef06d37fb3", "name": "network-vif-plugged", "status": "completed", "tag": "134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:27.949940 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:27.952954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9f82ae89-fe1e-487b-91fc-377d78a540cf req-b3971662-3b09-4bc4-b0c6-2c1544e4f50a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:27.953551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9f82ae89-fe1e-487b-91fc-377d78a540cf req-b3971662-3b09-4bc4-b0c6-2c1544e4f50a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:27.954021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9f82ae89-fe1e-487b-91fc-377d78a540cf req-b3971662-3b09-4bc4-b0c6-2c1544e4f50a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:27.966834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9f82ae89-fe1e-487b-91fc-377d78a540cf req-b3971662-3b09-4bc4-b0c6-2c1544e4f50a service nova] Creating event network-vif-plugged:134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3 for instance 362c7251-277a-4240-a6f4-8fef06d37fb3 on n-h1-master-1 Oct 02 01:56:27.973786 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9f82ae89-fe1e-487b-91fc-377d78a540cf req-b3971662-3b09-4bc4-b0c6-2c1544e4f50a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036524 Oct 02 01:56:27.975092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3431/6845] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:56:28.878055 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:28.883138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:28.883853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:28.890261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:28.890784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:28.891233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:28.891928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:28.892396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:28.892830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:29.026539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:29.034962 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21a0790e-6f4d-4449-aa0d-43a4e90aa761 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1317 microversion: 2.1 time: 0.158453 Oct 02 01:56:29.035535 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3432/6846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:28 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:30.058944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:30.059557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:30.067499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.067995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.068443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.069142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.069610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.070049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.197318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:30.205068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b90ade6a-e5ca-4b29-b78f-1e132cacb417 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1507 microversion: 2.1 time: 0.150116 Oct 02 01:56:30.205684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3433/6847] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:30 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:30.226901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:30.227524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:30.233179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.233669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.234115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.234851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.235318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.235782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.365053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:30.372834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0332d5b-a73b-410d-839c-7df759610cf2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1507 microversion: 2.1 time: 0.149401 Oct 02 01:56:30.373412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3434/6848] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:30 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:30.394817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:30.397108 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:30.402883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.403383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.403837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.404543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.405011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.405451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.434499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:30.440356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:56:30.447089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:56:30.447467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:56:30.447956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:56:30.448379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:56:30.448806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:56:30.511750 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4192821a-db56-4012-9a96-92c7c1b9c567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3/action" status: 202 len: 0 microversion: 2.1 time: 0.120795 Oct 02 01:56:30.512373 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3435/6849] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:56:30 2022] POST /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:56:30.520465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:30.521105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:30.527116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.527619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.528070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.528779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:30.529252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:30.529696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:30.666650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:30.675212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-65840a10-ac18-42e0-b115-1379ecd79524 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1514 microversion: 2.1 time: 0.158038 Oct 02 01:56:30.675963 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3436/6850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:30 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:31.409591 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:56:31.410186 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:56:31.411580 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:56:31.411699 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:56:31.698972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:31.699630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:31.706689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:31.707194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:31.707647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:31.708360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:31.708832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:31.709278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:31.840124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:31.850019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7238f685-c464-45cd-8ada-24b8f949eb28 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1514 microversion: 2.1 time: 0.154984 Oct 02 01:56:31.862651 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3437/6851] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:31 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:32.874131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:32.874788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:32.881697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:32.882189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:32.882668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:32.883375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:32.883840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:32.884275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:33.021792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:33.024037 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:33.030757 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dbc59686-d418-4b75-9e6a-22496042a9ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.160633 Oct 02 01:56:33.031345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3438/6852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:32 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:34.056100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:34.056742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:34.064392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:34.064899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:34.066218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:34.066910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:34.067383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:34.067822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:34.196000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:34.203657 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-04fd7c74-2b37-4d57-83d2-5386e1a536c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.152194 Oct 02 01:56:34.204228 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3439/6853] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:34 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:35.227189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:35.227847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:35.234948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:35.236058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:35.236058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:35.237511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:35.237990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:35.238437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:35.402288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:35.414937 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7259b533-88b5-48c3-8e2f-f635eb57ecbf tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.191975 Oct 02 01:56:35.415529 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3440/6854] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:35 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:36.442469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:36.443188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:36.450013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:36.450505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:36.450984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:36.451682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:36.452149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:36.452586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:36.581302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:36.589162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4379b6d-efe1-4bd9-99d1-b4b2e30ad93d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.151443 Oct 02 01:56:36.589738 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3441/6855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:36 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:37.612703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:37.613364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:37.620196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:37.620692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:37.621142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:37.621855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:37.622321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:37.622798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:37.755824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:37.763563 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6a1b0b9-e8bb-4b72-ae0b-dbf2002b7ae1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.155447 Oct 02 01:56:37.764140 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3442/6856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:37 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:38.787599 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:38.788303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:38.795244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:38.795747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:38.796200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:38.796911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:38.797384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:38.797824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:38.925101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:38.932802 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5abeb89c-5dbf-4ffc-b052-fc416c364691 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.149769 Oct 02 01:56:38.933375 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3443/6857] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:38 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:39.957150 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:39.957822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:39.964769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:39.965261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:39.965708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:39.966409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:39.966914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:39.967347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:40.100720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:40.108571 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e3e8478-4caf-47af-a1d0-ccdb63709d95 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.155847 Oct 02 01:56:40.109142 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3444/6858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:39 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:41.133503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:41.134130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:41.141226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:41.141723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:41.142170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:41.143442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:41.144220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:41.144951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:41.279092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:41.287628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c598779-7f8b-4cde-8c5d-063310fe887c tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.158483 Oct 02 01:56:41.288399 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3445/6859] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:41 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:42.311012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:42.311912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:42.319094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:42.319588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:42.320064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:42.320768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:42.321230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:42.321662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:42.469533 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:42.478020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4423c031-d5a8-423b-9968-a385eaf6ca7a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.171059 Oct 02 01:56:42.478607 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3446/6860] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:42 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:43.501439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:43.509027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:43.510372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:43.510900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:43.511354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:43.512071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:43.512544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:43.512988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:43.644207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:43.652011 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dffaa4ea-86dc-4df9-9e9a-e92e747bf0b2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.154610 Oct 02 01:56:43.652586 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3447/6861] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:43 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:44.677059 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:44.677854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:44.684713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:44.685207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:44.685655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:44.686356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:44.686857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:44.687295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:44.818406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:44.827086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49fffb89-1886-4fcc-88ee-b7d50ab5b023 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.154783 Oct 02 01:56:44.827703 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3448/6862] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:44 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:45.851823 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:45.852475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:45.859364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:45.859869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:45.860323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:45.861025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:45.861496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:45.862648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:45.990325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:45.998083 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-881a4bae-5cd9-4f22-b9f4-3b1970aaa204 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.150167 Oct 02 01:56:45.998682 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3449/6863] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:45 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:47.021974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:47.022648 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:47.029493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:47.029985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:47.030433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:47.031174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:47.031638 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:47.032075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:47.167592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:47.175366 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-881ae56b-2782-4672-b55c-6552ed6f4128 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.157911 Oct 02 01:56:47.175956 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3450/6864] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:47 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:48.199228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:48.199887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:48.207300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:48.207806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:48.208269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:48.208978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:48.209449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:48.209894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:48.340460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:48.348759 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05d59a6e-ad5c-49f9-bea5-fb43ea66e98b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.153446 Oct 02 01:56:48.349327 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3451/6865] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:48 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:49.373095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:49.373733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:49.381781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:49.382284 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:49.382772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:49.383488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:49.383965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:49.384433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:49.519152 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:49.526830 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83dc6d2e-979b-4852-80dd-c9c9b5ad3ea2 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.157677 Oct 02 01:56:49.527401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3452/6866] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:49 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:50.550932 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:50.551634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:50.558409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:50.558934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:50.559394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:50.560092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:50.560560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:50.561001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:50.690507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:50.698784 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1104cce6-7478-42a1-a3d7-cf44c3789cbb tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.151756 Oct 02 01:56:50.699358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3453/6867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:50 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:51.722204 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:51.722902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:51.725563 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=62 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:51.730909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:51.731408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:51.731862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:51.732569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:51.733039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:51.733478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:51.866228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:51.874007 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b4144e9-169a-4638-9682-67eacdca1c0e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.156536 Oct 02 01:56:51.874587 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3454/6868] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:51 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:52.898113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:52.898839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:52.905646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:52.906142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:52.906591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:52.907317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:52.907789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:52.908930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:52.923352 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:53.037956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:53.045809 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-410fb8eb-29f6-422b-95c8-a557ce599c30 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.151621 Oct 02 01:56:53.046388 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3455/6869] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:52 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:54.070229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:54.070887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:54.077798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:54.078299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:54.078790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:54.079497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:54.079969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:54.080625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:54.214344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:54.222743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e2b9978-80d9-47da-83eb-9b25d08adaa0 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.156445 Oct 02 01:56:54.223393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3456/6870] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:54 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:55.246980 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:55.247624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:55.254004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:55.254498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:55.254976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:55.255679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:55.256145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:55.256580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:55.389214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:55.397656 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d37a8d1-a65e-46c4-a1c9-fdcd0b739f48 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.154832 Oct 02 01:56:55.398226 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3457/6871] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:55 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:56.420994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:56.421964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:56.429364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:56.429864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:56.430317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:56.431068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:56.431540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:56.431984 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:56.559819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:56.568330 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3b038f17-54bc-4adf-b5a5-cd65f9d3a3c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.151371 Oct 02 01:56:56.568908 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3458/6872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:56 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:57.592506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:57.593148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:57.600582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:57.601078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:57.601524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:57.602230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:57.602725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:57.603164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:57.745536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:57.753729 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec0ddccd-6e70-4b59-b848-767b9e78cd2b tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.165212 Oct 02 01:56:57.754310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3459/6873] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:57 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:58.777951 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:58.778704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:58.785945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:58.786493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:58.786922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:58.787632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:58.788105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:58.788583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:58.917955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:56:58.926264 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e45718aa-2205-472f-ad2f-0ff4640c41c8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1519 microversion: 2.1 time: 0.152219 Oct 02 01:56:58.926871 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3460/6874] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:58 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:56:59.772335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362c7251-277a-4240-a6f4-8fef06d37fb3", "name": "network-vif-unplugged", "status": "completed", "tag": "134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:56:59.785094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:59.785667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:59.786049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:59.798137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] Creating event network-vif-unplugged:134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3 for instance 362c7251-277a-4240-a6f4-8fef06d37fb3 on n-h2-master-1 Oct 02 01:56:59.804831 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:56:59.817089 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6099a5f0-71a0-4fec-a6c7-fe38edb66d3b req-e1ff9d23-26c4-4324-bbe2-4aab65881fab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048719 Oct 02 01:56:59.817785 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3461/6875] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:56:59.950325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:56:59.950992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:56:59.957431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:59.957927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:59.958373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:56:59.959107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:56:59.959578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:56:59.960012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:00.102971 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:00.111255 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21d22a6a-71cf-44e6-9501-b204c1a05aa8 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1518 microversion: 2.1 time: 0.165178 Oct 02 01:57:00.122700 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3462/6876] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:56:59 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:01.137428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:01.138111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:01.146110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:01.146683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:01.147191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:01.147953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:01.148531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:01.149006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:01.298564 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:01.307430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7a5e8c1f-9dd0-4af5-8ea4-f4592ee479ac tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1516 microversion: 2.1 time: 0.174456 Oct 02 01:57:01.308039 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3463/6877] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:01 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:01.840366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362c7251-277a-4240-a6f4-8fef06d37fb3", "tag": "134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:01.850267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:01.850786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:01.851229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:01.865050 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] Creating event network-changed:134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3 for instance 362c7251-277a-4240-a6f4-8fef06d37fb3 on n-h2-master-1 Oct 02 01:57:01.870904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:57:01.881819 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a4191404-4c61-4fb9-940f-4d5ac093a8ca req-f0c790e2-9de5-4c91-ba16-d65878e3a272 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045178 Oct 02 01:57:01.882429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3464/6878] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:57:02.334554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:02.335319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:02.343200 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:02.343721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:02.344201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:02.344938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:02.345423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:02.345990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:02.500083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:02.508437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a149449b-2822-4b35-abe7-d8c3aff27567 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1513 microversion: 2.1 time: 0.179696 Oct 02 01:57:02.509092 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3465/6879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:02 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:02.531174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:02.531723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:02.538193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:02.538733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:02.539180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:02.539884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:02.540349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:02.540783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:02.598201 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5856abf-90ea-471f-b960-75a2205ddcbc tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "POST /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3/action" status: 204 len: 0 microversion: 2.1 time: 0.070575 Oct 02 01:57:02.599023 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3466/6880] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:57:02 2022] POST /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:57:02.607866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:02.608979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:02.618828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:02.619983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:02.620477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:02.621225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:02.621709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:02.622159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:02.843376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:02.852556 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6cf02bb-784a-44f3-93a2-2f15fc6aee74 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1513 microversion: 2.1 time: 0.249123 Oct 02 01:57:02.853139 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3467/6881] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:02 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:03.877695 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:03.878337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:03.886326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:03.886876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:03.887323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:03.888038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:03.888511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:03.888959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.044476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:04.052575 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a999dd4-0388-4b3b-ab75-1a4e9589df0d tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1505 microversion: 2.1 time: 0.179556 Oct 02 01:57:04.053221 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3468/6882] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:03 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:04.082178 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:04.082827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:04.088845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.089344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.089792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.090503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.091002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.091446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.225269 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:04.233070 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5d6bb129-a4ca-455e-9935-c2d6198a09c7 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1505 microversion: 2.1 time: 0.157371 Oct 02 01:57:04.233641 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3469/6883] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:04 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:57:04.256597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:04.257222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:04.262892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.263393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.263844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.264551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.265020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.265487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.401127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:04.408964 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5c44ae6-2361-445b-8103-4a489aee48ad tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1505 microversion: 2.1 time: 0.156029 Oct 02 01:57:04.409541 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3470/6884] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:04 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:04.431475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:04.431917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:04.437722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.438222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.438975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.440329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.440812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.441263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.460407 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:04.469552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:57:04.546392 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-19608778-b02f-4bcf-9b96-01150d674c8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "DELETE /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 204 len: 0 microversion: 2.1 time: 0.118427 Oct 02 01:57:04.547195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3471/6885] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:57:04 2022] DELETE /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:57:04.561408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:04.562005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:04.568658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.569154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.569602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.570297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.570793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.571230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.596727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:57:04.640821 n-d-master-1 devstack@n-api.service[122354]: INFO nova.compute.api [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Instance is already in deleting state, ignoring this request Oct 02 01:57:04.641659 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-654de06d-9837-4074-9be6-a608a0414a1f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "DELETE /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 204 len: 0 microversion: 2.1 time: 0.084543 Oct 02 01:57:04.642243 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3472/6886] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:57:04 2022] DELETE /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:57:04.650496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:04.651148 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:04.657112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.657608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.658084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.658827 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.659298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.659738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.799868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:04.808263 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e21429f7-6aa6-4ced-bf3b-be8302ea009e tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1511 microversion: 2.1 time: 0.161428 Oct 02 01:57:04.808851 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3473/6887] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:04 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:04.822818 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d6869d0c-5c45-40e8-9570-9fd44360dba3 req-66a39138-3978-45e3-9401-30cd1fb60f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362c7251-277a-4240-a6f4-8fef06d37fb3", "name": "network-vif-plugged", "status": "completed", "tag": "134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:04.824787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d6869d0c-5c45-40e8-9570-9fd44360dba3 req-66a39138-3978-45e3-9401-30cd1fb60f31 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:04.825276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d6869d0c-5c45-40e8-9570-9fd44360dba3 req-66a39138-3978-45e3-9401-30cd1fb60f31 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:04.825724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d6869d0c-5c45-40e8-9570-9fd44360dba3 req-66a39138-3978-45e3-9401-30cd1fb60f31 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:04.837825 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d6869d0c-5c45-40e8-9570-9fd44360dba3 req-66a39138-3978-45e3-9401-30cd1fb60f31 service nova] Creating event network-vif-plugged:134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3 for instance 362c7251-277a-4240-a6f4-8fef06d37fb3 on n-h2-master-1 Oct 02 01:57:04.843751 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d6869d0c-5c45-40e8-9570-9fd44360dba3 req-66a39138-3978-45e3-9401-30cd1fb60f31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033334 Oct 02 01:57:04.844371 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3474/6888] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:57:05.832975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:05.833690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:05.840384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:05.840878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:05.841323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:05.842017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:05.842483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:05.842957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:05.974987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:05.982734 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-191eaf19-c62d-48ba-8267-345f79ce1ff4 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1511 microversion: 2.1 time: 0.154574 Oct 02 01:57:05.983314 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3475/6889] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:05 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:06.922838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-feef0ff0-1dd8-457b-bd6e-45a61ac5fc4e req-cf1dfb69-a9b5-45e3-a0fb-35af324ab7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362c7251-277a-4240-a6f4-8fef06d37fb3", "name": "network-vif-deleted", "tag": "134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:06.935952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-feef0ff0-1dd8-457b-bd6e-45a61ac5fc4e req-cf1dfb69-a9b5-45e3-a0fb-35af324ab7ae service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:06.936455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-feef0ff0-1dd8-457b-bd6e-45a61ac5fc4e req-cf1dfb69-a9b5-45e3-a0fb-35af324ab7ae service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:06.936902 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-feef0ff0-1dd8-457b-bd6e-45a61ac5fc4e req-cf1dfb69-a9b5-45e3-a0fb-35af324ab7ae service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:06.950578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-feef0ff0-1dd8-457b-bd6e-45a61ac5fc4e req-cf1dfb69-a9b5-45e3-a0fb-35af324ab7ae service nova] Creating event network-vif-deleted:134c1ca9-bfc2-48d3-9dfa-524a7a9da1f3 for instance 362c7251-277a-4240-a6f4-8fef06d37fb3 on n-h2-master-1 Oct 02 01:57:06.956493 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-feef0ff0-1dd8-457b-bd6e-45a61ac5fc4e req-cf1dfb69-a9b5-45e3-a0fb-35af324ab7ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037730 Oct 02 01:57:06.957290 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3476/6890] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:57:07.007709 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:07.008974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:07.016085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:07.016626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:07.017087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:07.018243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:07.018744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:07.019162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:07.052966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:07.053432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:07.053887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:07.054422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lazy-loading 'fault' on Instance uuid 362c7251-277a-4240-a6f4-8fef06d37fb3 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:57:07.099794 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e6d9193514415799794e8bc1c8739d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d936be31b84687b0f3179a6a06e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:07.107594 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21321b77-b6de-4bdc-8c80-154a437e1a3a tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 200 len: 1305 microversion: 2.1 time: 0.105506 Oct 02 01:57:07.108127 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3477/6891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:07 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:08.130801 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:08.131433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: 362c7251-277a-4240-a6f4-8fef06d37fb3] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:08.138378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:08.138923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:08.139383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:08.140091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:08.140566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:08.141012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:08.155334 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] HTTP exception thrown: Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 could not be found. Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Request method failure captured: Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 HTTP/1.1 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO-Kew8dHb4t2IRc3DVxqDFcDcwyPpQhNGZg7zNO4tZA-7wDyk73Ta-NYTmxLCGIGOdh-kaRH04E3oAiX_bEue40XFlT5Cu7SCgg17XO5C9NOHVGkcAcGuZT3FNJRx8ALFq9GMxana0avhgM0O8WhLIFqWMMkz4m5YkSzHXE1T9xPK8 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 25d936be31b84687b0f3179a6a06e869 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25d936be31b84687b0f3179a6a06e869"}]}] Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 25d936be31b84687b0f3179a6a06e869 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerDiskConfigTestJSON-723409432-project Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e6d9193514415799794e8bc1c8739d Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerDiskConfigTestJSON-723409432-project Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 could not be found. Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '362c7251-277a-4240-a6f4-8fef06d37fb3'} Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 could not be found. Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 could not be found. Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:57:08.156999 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 could not be found. Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Returning 404 to user: Instance 362c7251-277a-4240-a6f4-8fef06d37fb3 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ca2ba9b-8e56-48d5-9be1-2ec9d4d93f8f tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3" status: 404 len: 111 microversion: 2.1 time: 0.032041 Oct 02 01:57:08.162157 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3478/6892] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:08 2022] GET /compute/v2.1/servers/362c7251-277a-4240-a6f4-8fef06d37fb3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:57:08.167746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-319b7681-174b-4b05-a72b-5a98a47bdebd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '.version_select at 0x7fb880b9f1f0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:08.188653 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-319b7681-174b-4b05-a72b-5a98a47bdebd tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002776759" status: 202 len: 0 microversion: 2.1 time: 0.024321 Oct 02 01:57:08.190074 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3479/6893] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002776759 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:57:08.779883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:08.780390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:08.787426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:08.787838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:08.788281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:08.788977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:08.789442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:08.789879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:08.804071 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] HTTP exception thrown: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Request method failure captured: Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 HTTP/1.1 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO-Kew8dHb4t2IRc3DVxqDFcDcwyPpQhNGZg7zNO4tZA-7wDyk73Ta-NYTmxLCGIGOdh-kaRH04E3oAiX_bEue40XFlT5Cu7SCgg17XO5C9NOHVGkcAcGuZT3FNJRx8ALFq9GMxana0avhgM0O8WhLIFqWMMkz4m5YkSzHXE1T9xPK8 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 25d936be31b84687b0f3179a6a06e869 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25d936be31b84687b0f3179a6a06e869"}]}] Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 25d936be31b84687b0f3179a6a06e869 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerDiskConfigTestJSON-723409432-project Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e6d9193514415799794e8bc1c8739d Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerDiskConfigTestJSON-723409432-project Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c0200a95-0f9e-437a-a337-f308b779a3f2'} Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:57:08.805933 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Returning 404 to user: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-37ee9c57-495b-4ded-8dff-d9a7f22ecea1 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 404 len: 111 microversion: 2.1 time: 0.031456 Oct 02 01:57:08.810425 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3480/6894] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:57:08 2022] DELETE /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:57:08.815782 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:08.816427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] [instance: c0200a95-0f9e-437a-a337-f308b779a3f2] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:08.821980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:08.822496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:08.822976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:08.823668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:08.824132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:08.824566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:08.838111 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] HTTP exception thrown: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Request method failure captured: Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 HTTP/1.1 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO-Kew8dHb4t2IRc3DVxqDFcDcwyPpQhNGZg7zNO4tZA-7wDyk73Ta-NYTmxLCGIGOdh-kaRH04E3oAiX_bEue40XFlT5Cu7SCgg17XO5C9NOHVGkcAcGuZT3FNJRx8ALFq9GMxana0avhgM0O8WhLIFqWMMkz4m5YkSzHXE1T9xPK8 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 25d936be31b84687b0f3179a6a06e869 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d936be31b84687b0f3179a6a06e869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25d936be31b84687b0f3179a6a06e869"}]}] Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 25d936be31b84687b0f3179a6a06e869 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723409432 Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerDiskConfigTestJSON-723409432-project Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 63e6d9193514415799794e8bc1c8739d Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerDiskConfigTestJSON-723409432-project Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: exception: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'c0200a95-0f9e-437a-a337-f308b779a3f2'} Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:57:08.840036 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] Returning 404 to user: Instance c0200a95-0f9e-437a-a337-f308b779a3f2 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-15a98274-40f2-4c2e-8e91-2893acb255c3 tempest-ServerDiskConfigTestJSON-723409432 tempest-ServerDiskConfigTestJSON-723409432-project] 10.222.0.23 "GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2" status: 404 len: 111 microversion: 2.1 time: 0.029506 Oct 02 01:57:08.844574 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3481/6895] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:08 2022] GET /compute/v2.1/servers/c0200a95-0f9e-437a-a337-f308b779a3f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:57:17.764923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93b67b3e-aa69-4373-8b69-d39fcdac498c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'create', calling method: .version_select at 0x7fb8801a4d30>, body: {"keypair": {"name": "tempest-keypair-1820247347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAznE/BNnBdvlYF+oGckZBGlQlMZ7sC7/RdtHqZd1cVX0nMeyzfBD6D/NXka0iWqHSkmXwgcCpgGn57Me6enbhLTs7cGal8lu2WJBb3UUWozo9MkJvSnNH/gqdQLK7IodQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:17.785530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-93b67b3e-aa69-4373-8b69-d39fcdac498c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:57:17.790868 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-93b67b3e-aa69-4373-8b69-d39fcdac498c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:57:17.822016 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93b67b3e-aa69-4373-8b69-d39fcdac498c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189790 Oct 02 01:57:17.822638 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3482/6896] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 01:57:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:57:19.102945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-70245804", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3200fe33-634c-4511-ad30-6b3869b87389"}], "security_groups": [{"name": "tempest-securitygroup--575292411"}], "key_name": "tempest-keypair-1820247347", "user_data": "}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:19.113423 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:19.224802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] validate_networks() for [('3200fe33-634c-4511-ad30-6b3869b87389', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:57:19.621527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:57:19.622031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:57:19.622530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:57:19.622986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:57:19.623418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:57:19.632956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:19.633492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:19.633943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:19.634721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:19.635196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:19.635639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:19.653347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:57:19.659866 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:57:19.673387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:57:19.676632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:57:19.732829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c1905d4-a88b-49b0-bc15-4f6241ccec59 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.634043 Oct 02 01:57:19.733412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3483/6897] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:57:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:57:19.744682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40d8143b-e3e4-40ba-bb32-45dcc4f37f0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:19.745314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40d8143b-e3e4-40ba-bb32-45dcc4f37f0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:19.806588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-40d8143b-e3e4-40ba-bb32-45dcc4f37f0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:19.815944 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40d8143b-e3e4-40ba-bb32-45dcc4f37f0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1237 microversion: 2.1 time: 0.074894 Oct 02 01:57:19.816788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3484/6898] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:19 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:57:20.839220 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:20.839900 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:20.843252 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:20.850014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:20.857311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:20.857801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:20.858591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:20.859094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:20.859749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:20.941929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:20.950296 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eaf3ec53-d8f0-4368-aefd-12f9b714f1f2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1297 microversion: 2.1 time: 0.114975 Oct 02 01:57:20.951203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3485/6899] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:20 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:21.980330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:21.980974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:21.988818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:21.989331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:21.989787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:21.990513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:21.991033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:21.991484 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:22.135423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:22.144364 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4d7b5f72-9522-4add-ac05-f0d65e7d59e5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1362 microversion: 2.1 time: 0.167995 Oct 02 01:57:22.145062 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3486/6900] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:21 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:22.341074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-80c5dde8-626a-4455-b738-e5945a3845e1 req-3c3c2b47-4325-4d28-974d-2d5bbbb12d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:22.351000 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80c5dde8-626a-4455-b738-e5945a3845e1 req-3c3c2b47-4325-4d28-974d-2d5bbbb12d0a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:22.351495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80c5dde8-626a-4455-b738-e5945a3845e1 req-3c3c2b47-4325-4d28-974d-2d5bbbb12d0a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:22.352156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80c5dde8-626a-4455-b738-e5945a3845e1 req-3c3c2b47-4325-4d28-974d-2d5bbbb12d0a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:22.364672 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-80c5dde8-626a-4455-b738-e5945a3845e1 req-3c3c2b47-4325-4d28-974d-2d5bbbb12d0a service nova] Creating event network-changed:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h2-master-1 Oct 02 01:57:22.369645 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-80c5dde8-626a-4455-b738-e5945a3845e1 req-3c3c2b47-4325-4d28-974d-2d5bbbb12d0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032376 Oct 02 01:57:22.370266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3487/6901] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:57:23.170528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:23.171258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:23.177623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:23.178114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:23.178563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:23.179287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:23.179756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:23.180194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:23.313379 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:23.321940 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5a38af29-1b93-468a-840c-ea9616d71b6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1362 microversion: 2.1 time: 0.156526 Oct 02 01:57:23.322506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3488/6902] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:23 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:24.345670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:24.346349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:24.353276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:24.353775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:24.354231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:24.354969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:24.355450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:24.355899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:24.487263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:24.494972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae77db1e-2f3c-41ca-a5be-e8aaaa9a264a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1362 microversion: 2.1 time: 0.153725 Oct 02 01:57:24.495554 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3489/6903] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:24 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:25.518229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:25.518918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:25.525429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:25.525926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:25.526378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:25.527124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:25.527595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:25.528038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:25.656908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:25.665323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a116d8c0-10e2-4d65-a708-23b9fb6b5935 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1362 microversion: 2.1 time: 0.151300 Oct 02 01:57:25.665896 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3490/6904] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:25 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:26.689758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:26.690539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:26.697457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:26.697956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:26.698452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:26.699190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:26.699668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:26.700110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:26.833329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:26.841151 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4e54d40e-4db6-42e2-b61c-cc2d17c8ba2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1362 microversion: 2.1 time: 0.155942 Oct 02 01:57:26.841921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3491/6905] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:26 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:26.888355 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3dd1375a-f84b-4c4f-96de-2893a5ba6348 req-100d4f50-8ea6-4473-9fe7-25dcd5237755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "name": "network-vif-plugged", "status": "completed", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:26.900248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3dd1375a-f84b-4c4f-96de-2893a5ba6348 req-100d4f50-8ea6-4473-9fe7-25dcd5237755 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:26.900983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3dd1375a-f84b-4c4f-96de-2893a5ba6348 req-100d4f50-8ea6-4473-9fe7-25dcd5237755 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:26.901430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3dd1375a-f84b-4c4f-96de-2893a5ba6348 req-100d4f50-8ea6-4473-9fe7-25dcd5237755 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:26.912640 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3dd1375a-f84b-4c4f-96de-2893a5ba6348 req-100d4f50-8ea6-4473-9fe7-25dcd5237755 service nova] Creating event network-vif-plugged:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h2-master-1 Oct 02 01:57:26.917892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3dd1375a-f84b-4c4f-96de-2893a5ba6348 req-100d4f50-8ea6-4473-9fe7-25dcd5237755 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Oct 02 01:57:26.918648 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3492/6906] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:57:27.865827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:27.866546 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:27.872807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:27.873305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:27.873756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:27.874461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:27.874968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:27.875439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:28.008460 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:28.016157 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f645c5d7-22f2-45af-94f2-32a30cce8ff5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1362 microversion: 2.1 time: 0.155540 Oct 02 01:57:28.016725 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3493/6907] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:27 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:57:29.041531 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:29.042198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:29.049629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:29.050126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:29.050575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:29.051313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:29.052090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:29.052539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:29.199809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:57:29.208640 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1cb3eac0-4edd-4e3d-b39b-04013810d91c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1549 microversion: 2.1 time: 0.171069 Oct 02 01:57:29.209226 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3494/6908] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:57:29 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:57:29.230759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:57:29.231197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:57:29.237491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:29.237981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:29.238431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:29.239161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:29.239630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:29.240069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:29.315858 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e497c828-0cf8-452a-a115-009e4e09ff45 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088659 Oct 02 01:57:29.316598 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3495/6909] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:57:29 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:57:30.549258 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:30.550110 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:30.555796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-29c67cf8-7252-431f-bcd9-7dbe2baf2ee1 req-b3e90d49-f676-41f3-aeb6-78e2a87b9103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:57:30.567055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-29c67cf8-7252-431f-bcd9-7dbe2baf2ee1 req-b3e90d49-f676-41f3-aeb6-78e2a87b9103 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:57:30.567551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-29c67cf8-7252-431f-bcd9-7dbe2baf2ee1 req-b3e90d49-f676-41f3-aeb6-78e2a87b9103 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:57:30.568001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-29c67cf8-7252-431f-bcd9-7dbe2baf2ee1 req-b3e90d49-f676-41f3-aeb6-78e2a87b9103 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:57:30.579911 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-29c67cf8-7252-431f-bcd9-7dbe2baf2ee1 req-b3e90d49-f676-41f3-aeb6-78e2a87b9103 service nova] Creating event network-changed:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h2-master-1 Oct 02 01:57:30.585310 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-29c67cf8-7252-431f-bcd9-7dbe2baf2ee1 req-b3e90d49-f676-41f3-aeb6-78e2a87b9103 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036808 Oct 02 01:57:30.586278 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3496/6910] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:58:04.638005 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=23 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:04.638885 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=60 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:04.643233 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:04.643952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:04.651156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:04.651652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:04.652103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:04.652803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:04.653271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:04.653710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:04.849804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:04.857793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2676733a-ef9f-4556-9d5b-2afdc6ff90ad tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1668 microversion: 2.1 time: 0.222544 Oct 02 01:58:04.858436 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3497/6911] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:04 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:04.879965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:04.880592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:04.886572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:04.887148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:04.887704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:04.888473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:04.888882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:04.889318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.022173 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:05.030095 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-190e425e-9673-4dbe-87bb-f511e89748b4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1668 microversion: 2.1 time: 0.153996 Oct 02 01:58:05.030688 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3498/6912] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:04 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:05.052016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:05.052665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:05.058363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:05.058896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:05.059392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.060091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:05.060564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:05.061010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.202885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:05.211398 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c51a245-8411-4bc5-91de-e30f0cd5b1a7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1668 microversion: 2.1 time: 0.163045 Oct 02 01:58:05.211976 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3499/6913] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:05 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:05.234115 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:05.236581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:05.242586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:05.243132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:05.243589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.244307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:05.244779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:05.245218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.276419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:05.281843 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:58:05.288593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:58:05.289033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:58:05.289530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:58:05.289952 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:58:05.290377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:58:05.355369 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17ab743c-6fd7-4acb-8bc1-ee1c6a7c6da9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4/action" status: 202 len: 0 microversion: 2.1 time: 0.124962 Oct 02 01:58:05.359150 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3500/6914] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:58:05 2022] POST /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:58:05.364423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:05.365057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:05.371071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:05.371576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:05.372029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.372747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:05.373220 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:05.373665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:05.514870 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:05.523918 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b2ab30e-91c6-4382-aed5-7e361523de0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1677 microversion: 2.1 time: 0.163747 Oct 02 01:58:05.524503 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3501/6915] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:05 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:06.548471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:06.549116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:06.556019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:06.556668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:06.557293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:06.558079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:06.558840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:06.559395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:06.696062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:06.704075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39806600-f34c-49dd-b66e-97baf72ad613 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1677 microversion: 2.1 time: 0.159538 Oct 02 01:58:06.704662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3502/6916] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:06 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:07.728412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:07.729090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:07.736039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:07.736578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:07.737032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:07.737741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:07.738215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:07.738686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:07.867209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:07.875038 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-191184f2-27d4-49fe-b48d-96003e8a4653 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.150454 Oct 02 01:58:07.875618 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3503/6917] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:07 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:08.899632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:08.900298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:08.907500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:08.908015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:08.909089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:08.909642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:08.910117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:08.910554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:09.051409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:09.059198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48b8fb88-321f-40dd-aa5f-a76c4eae3e12 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.163622 Oct 02 01:58:09.059785 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3504/6918] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:08 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:10.083260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:10.083915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:10.090794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:10.091287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:10.091733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:10.092428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:10.092899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:10.093343 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:10.221100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:10.228898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d511cc6-c53a-447e-9c40-ceabc77ab86e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.149809 Oct 02 01:58:10.229400 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3505/6919] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:10 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:11.252559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:11.253188 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:11.260168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:11.260777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:11.261226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:11.261953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:11.262422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:11.262891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:11.405156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:11.413742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a829bc82-c0b4-47d4-9362-25092818948a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.165223 Oct 02 01:58:11.414322 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3506/6920] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:11 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:11.427721 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:58:11.428224 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:58:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:58:12.437906 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:12.438561 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:12.445908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:12.446402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:12.446890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:12.447593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:12.448089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:12.448575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:12.575747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:12.583746 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-606b2806-2f62-493a-9020-7863c8a65107 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.149721 Oct 02 01:58:12.584317 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3507/6921] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:12 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:13.607559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:13.608212 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:13.616526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:13.617091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:13.617592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:13.618319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:13.618830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:13.619285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:13.759726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:13.767497 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-252afe2f-257a-4ceb-91f2-e7ff106ec01e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.164047 Oct 02 01:58:13.768073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3508/6922] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:13 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:14.791581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:14.792196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:14.799267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:14.800489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:14.800945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:14.801669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:14.802143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:14.802586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:14.947504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:14.955463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-66adfd27-2117-4d74-96db-057087ea2632 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.167867 Oct 02 01:58:14.956038 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3509/6923] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:14 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:15.978966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:15.979603 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:15.986537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:15.987709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:15.988227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:15.988935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:15.989411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:15.989855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:16.127197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:16.135627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c42a53f6-9e78-491c-81ba-38ce0d248f74 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.160590 Oct 02 01:58:16.136214 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3510/6924] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:15 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:17.160426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:17.161090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:17.167803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:17.168296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:17.168742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:17.169467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:17.169935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:17.170366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:17.305378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:17.313444 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bafbb752-623b-4c22-83aa-86a6e58148dc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.157523 Oct 02 01:58:17.314030 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3511/6925] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:17 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:18.337874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:18.338509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:18.345417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:18.345916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:18.347167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:18.348056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:18.348534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:18.348978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:18.352951 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:18.482992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:18.490930 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-35e8677e-4c0a-4924-9624-f1809ce1e4f8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1682 microversion: 2.1 time: 0.156984 Oct 02 01:58:18.491530 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3512/6926] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:18 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:19.514708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:19.515414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:19.522673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:19.523104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:19.523554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:19.524261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:19.524730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:19.525175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:19.744192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:19.751884 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4089faa-3f23-4301-906a-b6744e1bdf0a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1681 microversion: 2.1 time: 0.241071 Oct 02 01:58:19.752490 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3513/6927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:19 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:19.876113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "name": "network-vif-unplugged", "status": "completed", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:19.886885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:19.887377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:19.887822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:19.900105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] Creating event network-vif-unplugged:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h1-master-1 Oct 02 01:58:19.905663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:58:19.917257 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-75e2fc96-55ca-4d62-89aa-7bd3c8593a79 req-80b9fed8-74c7-4ebf-b8d5-459f8441212a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113112 Oct 02 01:58:19.917877 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3514/6928] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:58:20.776864 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:20.777583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:20.783833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:20.784333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:20.784786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:20.785494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:20.785963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:20.786400 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:20.930495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:20.938426 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-161c2150-32fc-458f-adf3-4fada9e950c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1681 microversion: 2.1 time: 0.166744 Oct 02 01:58:20.939027 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3515/6929] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:20 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:21.934419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:21.945143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:21.945632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:21.946076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:21.958322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] Creating event network-changed:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h1-master-1 Oct 02 01:58:21.963977 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:58:21.975719 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d1f90cf9-56f3-4e5b-a6a6-04ddb5e037e2 req-b8a68558-8f27-4d77-9dce-b8e9ff59e071 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044972 Oct 02 01:58:21.976333 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3516/6930] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:58:21.981360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:21.982063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:21.988377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:21.988865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:21.989315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:21.990009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:21.990477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:21.991017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:22.180258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:22.188109 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c66cc663-ca4a-4cdf-bd01-b0d8370a889b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1679 microversion: 2.1 time: 0.210597 Oct 02 01:58:22.188787 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3517/6931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:21 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:58:23.214628 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:23.215292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:23.222360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:23.222886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:23.223391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:23.224047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:23.224519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:23.224965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:23.353347 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:23.361028 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b152c6f-aa91-481f-bccf-7d86111d312f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1679 microversion: 2.1 time: 0.150302 Oct 02 01:58:23.361604 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3518/6932] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:23 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:24.385151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:24.386057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:24.393799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:24.394493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:24.394986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:24.395757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:24.396229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:24.396673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:24.539141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:24.547116 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5ef547b-0f61-4e9d-9d28-796c26e3db6f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1676 microversion: 2.1 time: 0.165757 Oct 02 01:58:24.547995 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3519/6933] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:24 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:24.571938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:24.572497 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:24.578506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:24.579036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:24.579495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:24.580301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:24.581624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:24.582084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:24.638918 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8d0ad59f-c8bb-484e-a562-ac379f7a4d31 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4/action" status: 204 len: 0 microversion: 2.1 time: 0.070541 Oct 02 01:58:24.639601 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3520/6934] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:58:24 2022] POST /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:58:24.648555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:24.649274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:24.655644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:24.656146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:24.656648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:24.657363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:24.657829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:24.658265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:24.790997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:24.798953 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c6e5fceb-180f-43dd-b881-554148639a38 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1676 microversion: 2.1 time: 0.154394 Oct 02 01:58:24.800120 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3521/6935] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:24 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:25.824287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:25.824985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:25.831669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:25.832170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:25.832625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:25.833336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:25.833807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:25.834249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:25.979586 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:25.988711 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e279bda-bb8e-4d33-b8c0-de8ba9ca284e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1676 microversion: 2.1 time: 0.168652 Oct 02 01:58:25.989305 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3522/6936] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:25 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:26.468055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-edca239b-60b1-4942-af39-f6dc1cb2655d req-60d7d182-e40f-4f79-9d29-02d65b7acc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "name": "network-vif-plugged", "status": "completed", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:26.480011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-edca239b-60b1-4942-af39-f6dc1cb2655d req-60d7d182-e40f-4f79-9d29-02d65b7acc74 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:26.480520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-edca239b-60b1-4942-af39-f6dc1cb2655d req-60d7d182-e40f-4f79-9d29-02d65b7acc74 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:26.481145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-edca239b-60b1-4942-af39-f6dc1cb2655d req-60d7d182-e40f-4f79-9d29-02d65b7acc74 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:26.493105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-edca239b-60b1-4942-af39-f6dc1cb2655d req-60d7d182-e40f-4f79-9d29-02d65b7acc74 service nova] Creating event network-vif-plugged:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h1-master-1 Oct 02 01:58:26.498297 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-edca239b-60b1-4942-af39-f6dc1cb2655d req-60d7d182-e40f-4f79-9d29-02d65b7acc74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033969 Oct 02 01:58:26.499076 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3523/6937] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:58:27.014673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:27.015390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:27.022661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.023160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.023611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.024315 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.024781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.025216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.154142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:27.162100 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-be859e40-d03f-4bfe-8d1d-b106ad5a5c22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1668 microversion: 2.1 time: 0.152489 Oct 02 01:58:27.162691 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3524/6938] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:27 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:27.185348 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:27.186006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:27.192777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.193277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.193730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.194434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.194966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.195414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.326995 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:27.335021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85f69153-3121-495a-8cbb-f4422698d092 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1668 microversion: 2.1 time: 0.153390 Oct 02 01:58:27.335603 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3525/6939] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:27 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:27.357504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:27.358193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:27.364943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.365447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.365901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.366751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.367110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.367554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.495721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:27.503793 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f14fff5a-499f-4b9b-8cdd-d6e2f8f90db7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1668 microversion: 2.1 time: 0.150434 Oct 02 01:58:27.504380 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3526/6940] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:27 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:27.525819 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:27.526266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:27.532048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.532545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.532998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.534256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.534756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.535197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.560844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:58:27.607951 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:27.640105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ab93d316-4bc8-4bcb-b229-7cc8f66224ce tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 204 len: 0 microversion: 2.1 time: 0.117720 Oct 02 01:58:27.640714 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3527/6941] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:58:27 2022] DELETE /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:58:27.649922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:27.650676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:27.656668 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.657171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.657625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.658329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:27.659382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:27.659822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:27.789492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:27.797256 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b086ba34-ee59-4e7d-8890-8db9a2fecdaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1674 microversion: 2.1 time: 0.151788 Oct 02 01:58:27.797830 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3528/6942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:27 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:28.821994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:28.822696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:28.829551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:28.830046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:28.830615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:28.831408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:28.831879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:28.832319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:29.085798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:29.093517 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bbbebd75-9c26-433e-8d2a-e3f7b9316e18 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1674 microversion: 2.1 time: 0.275439 Oct 02 01:58:29.094096 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3529/6943] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:28 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:30.118457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:30.119177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:30.126265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:30.126812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:30.127910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:30.128777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:30.129261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:30.129721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:30.218167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:30.226204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2993c2b3-3055-4a79-b8a6-f74b4cf562bd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 200 len: 1607 microversion: 2.1 time: 0.111588 Oct 02 01:58:30.226741 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3530/6944] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:30 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 1607 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:30.327630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9124b178-67f2-481a-b3b3-171d8bbcff13 req-e91d2cc6-2dc9-40b0-b7ba-a6577691e075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947ca187-d838-4a42-b7fd-bae3679b42d4", "name": "network-vif-deleted", "tag": "2aed06fe-8365-45f7-ab42-919436030e95"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:30.337618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9124b178-67f2-481a-b3b3-171d8bbcff13 req-e91d2cc6-2dc9-40b0-b7ba-a6577691e075 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:30.338112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9124b178-67f2-481a-b3b3-171d8bbcff13 req-e91d2cc6-2dc9-40b0-b7ba-a6577691e075 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:30.338557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9124b178-67f2-481a-b3b3-171d8bbcff13 req-e91d2cc6-2dc9-40b0-b7ba-a6577691e075 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:30.349941 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9124b178-67f2-481a-b3b3-171d8bbcff13 req-e91d2cc6-2dc9-40b0-b7ba-a6577691e075 service nova] Creating event network-vif-deleted:2aed06fe-8365-45f7-ab42-919436030e95 for instance 947ca187-d838-4a42-b7fd-bae3679b42d4 on n-h1-master-1 Oct 02 01:58:30.355455 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9124b178-67f2-481a-b3b3-171d8bbcff13 req-e91d2cc6-2dc9-40b0-b7ba-a6577691e075 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031548 Oct 02 01:58:30.356069 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3531/6945] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:58:31.251052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:31.251778 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:31.258941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:31.259443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:31.259892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:31.260600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:31.261072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:31.261513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:31.275617 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 HTTP/1.1 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '947ca187-d838-4a42-b7fd-bae3679b42d4'} Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:58:31.277278 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a54173cd-eedf-4529-adc3-15b5d8204a8c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 404 len: 111 microversion: 2.1 time: 0.032912 Oct 02 01:58:31.281587 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3532/6946] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:31 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:58:31.290004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:31.290660 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:31.296666 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:31.297166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:31.297619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:31.298328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:31.298840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:31.299707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:31.313629 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 HTTP/1.1 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '947ca187-d838-4a42-b7fd-bae3679b42d4'} Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:58:31.316250 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:58:31.320083 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a567a8d3-e1cc-46c5-979e-5007f2f4bd92 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 404 len: 111 microversion: 2.1 time: 0.033563 Oct 02 01:58:31.323950 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3533/6947] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:31 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:58:31.378142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1575607040", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "3200fe33-634c-4511-ad30-6b3869b87389"}], "security_groups": [{"name": "tempest-securitygroup--575292411"}], "key_name": "tempest-keypair-1820247347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:31.490964 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] validate_networks() for [('3200fe33-634c-4511-ad30-6b3869b87389', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:58:31.906365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:58:31.906876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:58:31.907374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:58:31.907799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:58:31.908228 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:58:31.917925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:31.918421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:31.918912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:31.919658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:31.920132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:31.920576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:31.937814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:58:31.943486 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:58:31.955690 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:58:31.957987 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:58:31.969662 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:32.005827 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f0815cb6-6ea0-4c4d-a2e4-d9d098a15d49 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.632974 Oct 02 01:58:32.006481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3534/6948] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:58:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:58:32.017415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e8611d0-41f4-4410-9cd1-a0238e6193e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:32.018170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e8611d0-41f4-4410-9cd1-a0238e6193e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:32.070960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e8611d0-41f4-4410-9cd1-a0238e6193e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:32.078461 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e8611d0-41f4-4410-9cd1-a0238e6193e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1239 microversion: 2.1 time: 0.064730 Oct 02 01:58:32.079087 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3535/6949] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:32 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:33.102141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:33.102885 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:33.110043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:33.110629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:33.111440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:33.111934 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:33.112470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:33.112977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:33.180045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:33.188571 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7382f52f-36d3-43c8-852c-b8bed230e45d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1299 microversion: 2.1 time: 0.090277 Oct 02 01:58:33.189450 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3536/6950] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:33 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:34.213437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:34.214078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:34.223316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:34.223830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:34.224286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:34.225011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:34.225649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:34.226088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:34.369507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:34.378117 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d19a7b2f-ead5-465d-aede-bd73a3ef0d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1364 microversion: 2.1 time: 0.168011 Oct 02 01:58:34.378742 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3537/6951] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:34 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:34.975954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c702adc4-a900-45fc-aa3e-242f7fc4b2a8 req-5e03ce8d-71bd-414f-be20-26be068f04db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:34.986331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c702adc4-a900-45fc-aa3e-242f7fc4b2a8 req-5e03ce8d-71bd-414f-be20-26be068f04db service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:34.986869 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c702adc4-a900-45fc-aa3e-242f7fc4b2a8 req-5e03ce8d-71bd-414f-be20-26be068f04db service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:34.987374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c702adc4-a900-45fc-aa3e-242f7fc4b2a8 req-5e03ce8d-71bd-414f-be20-26be068f04db service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:34.998806 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c702adc4-a900-45fc-aa3e-242f7fc4b2a8 req-5e03ce8d-71bd-414f-be20-26be068f04db service nova] Creating event network-changed:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h2-master-1 Oct 02 01:58:35.004478 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c702adc4-a900-45fc-aa3e-242f7fc4b2a8 req-5e03ce8d-71bd-414f-be20-26be068f04db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105014 Oct 02 01:58:35.005095 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3538/6952] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:58:35.404523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:35.406217 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:35.413440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:35.413952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:35.414412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:35.415156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:35.415633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:35.416096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:35.550803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:35.558729 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56581484-4042-4198-a57d-bd7f01a7c2fb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1364 microversion: 2.1 time: 0.159399 Oct 02 01:58:35.559309 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3539/6953] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:35 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:36.584905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:36.585558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:36.592495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:36.593001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:36.593454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:36.594165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:36.594651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:36.595094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:36.733752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:36.742324 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ea5f314-9e9e-4069-977c-bff5352a9afe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1364 microversion: 2.1 time: 0.162849 Oct 02 01:58:36.742940 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3540/6954] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:36 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:37.766401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:37.767190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:37.774232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:37.774771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:37.775228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:37.775974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:37.776448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:37.776893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:37.909133 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:37.917204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f6a5bc0-bc27-4706-b25e-3cc2fb3a1825 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1364 microversion: 2.1 time: 0.154848 Oct 02 01:58:37.917771 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3541/6955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:37 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:38.941936 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:38.942712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:38.949441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:38.949943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:38.950397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:38.951202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:38.951675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:38.952142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:39.087393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:39.096183 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-037f34a7-86fd-4dec-8d3f-6c69cd62232b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1364 microversion: 2.1 time: 0.158766 Oct 02 01:58:39.096850 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3542/6956] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:38 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:39.199769 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2cbf6f15-0f48-4889-b988-4278988acb49 req-65be87e5-ff7a-49a2-9b08-6efacf9d34b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "name": "network-vif-plugged", "status": "completed", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:39.211230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2cbf6f15-0f48-4889-b988-4278988acb49 req-65be87e5-ff7a-49a2-9b08-6efacf9d34b0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:39.211722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2cbf6f15-0f48-4889-b988-4278988acb49 req-65be87e5-ff7a-49a2-9b08-6efacf9d34b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:39.212165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2cbf6f15-0f48-4889-b988-4278988acb49 req-65be87e5-ff7a-49a2-9b08-6efacf9d34b0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:39.223891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2cbf6f15-0f48-4889-b988-4278988acb49 req-65be87e5-ff7a-49a2-9b08-6efacf9d34b0 service nova] Creating event network-vif-plugged:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h2-master-1 Oct 02 01:58:39.229406 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2cbf6f15-0f48-4889-b988-4278988acb49 req-65be87e5-ff7a-49a2-9b08-6efacf9d34b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Oct 02 01:58:39.230376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3543/6957] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:58:40.121346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:40.122058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:40.129584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:40.130072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:40.130519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:40.131243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:40.131708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:40.132144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:40.263403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:40.271660 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-599e223d-a0b6-4396-8158-c02e3f46535e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1364 microversion: 2.1 time: 0.154543 Oct 02 01:58:40.272239 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3544/6958] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:40 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:41.295219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:41.295862 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:41.302639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:41.303138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:41.303585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:41.304282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:41.304741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:41.305181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:41.439262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:58:41.447798 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0021489c-e1f2-4fcd-94f3-6b33d8a444d4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1551 microversion: 2.1 time: 0.156581 Oct 02 01:58:41.448379 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3545/6959] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:58:41 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:58:41.470609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:58:41.471140 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:58:41.476957 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:41.477454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:41.477906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:41.478623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:41.479103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:41.479547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:41.559103 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-94422fdc-c995-4589-95ef-768c2161e293 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091965 Oct 02 01:58:41.559743 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3546/6960] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:58:41 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:58:42.515268 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:42.516176 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:42.569191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-35f56f59-879a-42c4-b5af-810b4122f418 req-e5390ac8-195f-42dd-8c0f-b6d67e84cf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:58:42.578691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-35f56f59-879a-42c4-b5af-810b4122f418 req-e5390ac8-195f-42dd-8c0f-b6d67e84cf59 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:58:42.579193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-35f56f59-879a-42c4-b5af-810b4122f418 req-e5390ac8-195f-42dd-8c0f-b6d67e84cf59 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:58:42.579645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-35f56f59-879a-42c4-b5af-810b4122f418 req-e5390ac8-195f-42dd-8c0f-b6d67e84cf59 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:58:42.591228 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-35f56f59-879a-42c4-b5af-810b4122f418 req-e5390ac8-195f-42dd-8c0f-b6d67e84cf59 service nova] Creating event network-changed:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h2-master-1 Oct 02 01:58:42.596179 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-35f56f59-879a-42c4-b5af-810b4122f418 req-e5390ac8-195f-42dd-8c0f-b6d67e84cf59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081567 Oct 02 01:58:42.597579 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3547/6961] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:59:15.369315 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=28 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:15.369970 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:15.374464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eccf5c79-935f-4fe4-8fa5-a44af56dc6b2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:15.383261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccf5c79-935f-4fe4-8fa5-a44af56dc6b2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:15.383758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccf5c79-935f-4fe4-8fa5-a44af56dc6b2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:15.384204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eccf5c79-935f-4fe4-8fa5-a44af56dc6b2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:15.406704 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eccf5c79-935f-4fe4-8fa5-a44af56dc6b2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Going to try to stop instance {{(pid=122354) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 01:59:15.449550 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eccf5c79-935f-4fe4-8fa5-a44af56dc6b2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action" status: 202 len: 0 microversion: 2.1 time: 0.082272 Oct 02 01:59:15.450378 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3548/6962] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:59:15 2022] POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:59:15.459728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:15.460472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:15.476770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:15.477280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:15.477765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:15.478492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:15.478994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:15.479437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:15.620177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:15.626305 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d85713bd-af20-4c7f-9d37-0c758a2ba70f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.171489 Oct 02 01:59:15.626921 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3549/6963] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:15 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:16.651874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:16.652550 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:16.659716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:16.660224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:16.660651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:16.661975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:16.662624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:16.663059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:16.794965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:16.803646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfa299c7-6b65-4b7e-ac2b-20404412e0ea tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.155647 Oct 02 01:59:16.804235 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3550/6964] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:16 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:59:17.828571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:17.829225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:17.836660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:17.837168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:17.837622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:17.838338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:17.838843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:17.839285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:17.968839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:17.977491 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-55eb451e-ebb4-49c1-81b3-943c32ada82a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.152846 Oct 02 01:59:17.978136 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3551/6965] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:17 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:19.001234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:19.001904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:19.009301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:19.009797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:19.010256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:19.010990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:19.011481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:19.011912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:19.143028 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:19.154892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c2f2a75f-2103-48be-a16f-8d1be81440d2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.157202 Oct 02 01:59:19.155685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3552/6966] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:18 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:20.180966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:20.181636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:20.188395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:20.188891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:20.189340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:20.190041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:20.190507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:20.190973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:20.318567 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:20.326806 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cd3ad923-97ba-4d74-8c01-87c1d871f78f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.150425 Oct 02 01:59:20.327366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3553/6967] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:20 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:21.352257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:21.352923 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:21.360088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:21.360590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:21.361044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:21.361762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:21.362235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:21.362705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:21.501141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:21.509048 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-64504a45-7e61-4ea6-b7ca-57060a4fc9c8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.162112 Oct 02 01:59:21.509654 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3554/6968] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:21 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:22.533552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:22.534167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:22.541911 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:22.542413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:22.542886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:22.543599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:22.544069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:22.544509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:22.671705 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:22.680067 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82a530cd-ceb8-4508-ba83-d38353d47fbc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.150588 Oct 02 01:59:22.680642 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3555/6969] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:22 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:23.704991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:23.705683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:23.712452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:23.712946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:23.713393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:23.714095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:23.714562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:23.715046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:23.851240 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:23.859146 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-33d18976-1b5f-4834-8b2e-2843ce6adc2b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.158061 Oct 02 01:59:23.859740 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3556/6970] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:23 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:24.883263 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:24.883957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:24.890799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:24.891290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:24.891733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:24.892433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:24.892898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:24.893342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:25.023711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:25.032190 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b38dd6c-e47b-4130-b0f7-dabf00177b9f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.153031 Oct 02 01:59:25.032794 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3557/6971] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:24 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:26.056837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:26.057490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:26.064097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:26.064593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:26.065042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:26.065737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:26.066202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:26.066929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:26.197227 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:26.204935 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f1c3ef6-0b6e-4cf3-b595-9193fdb5356d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.152383 Oct 02 01:59:26.205513 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3558/6972] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:26 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:27.229426 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:27.230073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:27.236907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:27.237398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:27.237846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:27.238543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:27.239107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:27.239542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:27.374234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:27.383361 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfbbb39f-7a7d-4b80-99e9-9141791d0ba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.158540 Oct 02 01:59:27.383949 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3559/6973] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:27 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:28.407068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:28.407741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:28.414731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:28.415263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:28.415715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:28.416420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:28.416892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:28.417335 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:28.544618 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:28.553123 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8cf7cc3-89bf-4936-9741-097d84ba438d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.149470 Oct 02 01:59:28.553716 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3560/6974] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:28 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:29.578839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:29.579496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:29.587055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:29.587551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:29.588001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:29.588736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:29.589206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:29.589649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:29.720981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:29.728766 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53d30b17-a109-4c44-b5a7-7d75653a074f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.153874 Oct 02 01:59:29.729350 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3561/6975] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:29 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:30.752293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:30.753014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:30.760534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:30.761060 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:30.761506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:30.762203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:30.762699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:30.763142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:30.918529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:30.926385 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b5902557-853b-4a55-9bd5-1f6cbe8a3b55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.178015 Oct 02 01:59:30.926985 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3562/6976] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:30 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:31.950735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:31.951441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:31.958318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:31.958882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:31.959955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:31.960678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:31.961161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:31.961610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:31.980506 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:32.097954 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:32.106244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d3623930-2df9-4f9f-93ca-0991bfdafc15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1657 microversion: 2.1 time: 0.159439 Oct 02 01:59:32.106872 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3563/6977] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:31 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:32.129018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:32.132147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:32.138033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:32.138532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:32.139022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:32.139729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:32.140203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:32.140644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:32.168803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:32.174169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 01:59:32.181193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:59:32.181630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:59:32.182123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:59:32.182547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:59:32.183003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:59:32.245559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7c48e0fa-83ef-4f7c-ad12-2e103a443685 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action" status: 202 len: 0 microversion: 2.1 time: 0.120126 Oct 02 01:59:32.246272 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3564/6978] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:59:32 2022] POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:59:32.254106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:32.254811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:32.261214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:32.262047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:32.262198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:32.262926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:32.263397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:32.263942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:32.404424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:32.414159 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c33220a5-30dc-4068-a614-9b8d4da7367a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.163433 Oct 02 01:59:32.415045 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3565/6979] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:32 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:33.442859 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:33.444428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:33.451447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:33.451938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:33.452386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:33.453084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:33.453550 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:33.453986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:33.591020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:33.598904 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2995116-c379-4d69-a27e-01db1c76929c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1680 microversion: 2.1 time: 0.161720 Oct 02 01:59:33.599609 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3566/6980] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:33 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:59:34.622287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:34.622984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:34.630002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:34.630504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:34.631033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:34.631745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:34.632217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:34.632659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:34.763945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:34.772169 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-916a7bc2-cf0a-4c7d-b55e-17638acee396 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1685 microversion: 2.1 time: 0.153368 Oct 02 01:59:34.772897 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3567/6981] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:34 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:35.797130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:35.797818 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:35.805053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:35.805854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:35.806330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:35.807075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:35.807542 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:35.807978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:35.935687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:35.943879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-73c2501f-fcce-41fb-8ca4-517f719a138d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1685 microversion: 2.1 time: 0.150525 Oct 02 01:59:35.944457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3568/6982] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:35 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:36.931223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "name": "network-vif-unplugged", "status": "completed", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:36.942956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:36.943450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:36.944006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:36.960020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] Creating event network-vif-unplugged:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h1-master-1 Oct 02 01:59:36.969810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] Instance 974389aa-2f4d-4171-9496-7c68b7912937 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:59:36.987193 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d98fac1c-1fd1-4866-a537-960315ec757d req-3dd70d0e-043a-4881-a322-17180cf93520 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059778 Oct 02 01:59:36.987816 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3569/6983] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:59:36.993576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:36.995026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:37.004759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:37.005532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:37.006003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:37.007363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:37.007852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:37.008293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:37.258652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:37.267235 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bbbe9d65-3311-48a9-9327-1807c6b7449f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1684 microversion: 2.1 time: 0.277505 Oct 02 01:59:37.267929 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3570/6984] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:36 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1684 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:59:38.293511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:38.294187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:38.300959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:38.301453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:38.301899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:38.302607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:38.303642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:38.304127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:38.436733 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:38.445654 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d12d60c6-3b80-41d4-bf04-772ef71badb9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1682 microversion: 2.1 time: 0.156066 Oct 02 01:59:38.446232 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3571/6985] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:38 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:39.014273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:39.024471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:39.025079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:39.025585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:39.038064 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] Creating event network-changed:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h1-master-1 Oct 02 01:59:39.044569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] Instance 974389aa-2f4d-4171-9496-7c68b7912937 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 01:59:39.055691 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-78d19e4e-fe2c-4ecf-a03c-3aa8195b5e96 req-c0d6b3d4-3b9b-4cdd-b3a6-3969228bd09e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045136 Oct 02 01:59:39.056305 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3572/6986] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:59:39.470821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:39.471640 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:39.478408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:39.479014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:39.479469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:39.480184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:39.480652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:39.481096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:39.613805 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:39.624509 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-99a9ba6b-922e-4209-8d26-b245b2083d2f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1682 microversion: 2.1 time: 0.158736 Oct 02 01:59:39.625104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3573/6987] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:39 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:40.649003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:40.649708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:40.658704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:40.659208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:40.659700 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:40.660415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:40.660882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:40.661323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:40.892810 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:40.902002 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5d93af2d-f93d-4341-960d-de5f203e85e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1678 microversion: 2.1 time: 0.257407 Oct 02 01:59:40.902588 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3574/6988] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:40 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:40.925771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:40.926342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:40.934122 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:40.934268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:40.934838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:40.936305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:40.936781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:40.937223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:41.011521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-12470bfa-758b-4c83-96c8-415bcf96ca46 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action" status: 204 len: 0 microversion: 2.1 time: 0.089826 Oct 02 01:59:41.012609 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3575/6989] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:59:40 2022] POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:59:41.022253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:41.023329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:41.030506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:41.031050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:41.031509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:41.032225 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:41.032762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:41.033265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:41.505323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:41.514075 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-881cb134-f882-42d8-a35d-c4e5b65ef130 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1678 microversion: 2.1 time: 0.496992 Oct 02 01:59:41.514685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3576/6990] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:41 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1678 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:42.538424 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:42.539120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:42.546091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:42.546592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:42.547079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:42.547787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:42.548260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:42.548711 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:42.676033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:42.684424 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c706d152-ede0-474e-a462-671b9bb89833 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1657 microversion: 2.1 time: 0.150160 Oct 02 01:59:42.684998 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3577/6991] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:42 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:42.707374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:42.707996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:42.713757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:42.714252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:42.714736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:42.715436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:42.715903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:42.716340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:42.731653 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:42.854209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:42.863344 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-59d611eb-1573-4660-8d47-fa19c189f097 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1657 microversion: 2.1 time: 0.159476 Oct 02 01:59:42.863961 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3578/6992] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:42 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:42.886458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9fe298ea-9b29-45f9-9ec0-34a24796f59e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:42.892920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fe298ea-9b29-45f9-9ec0-34a24796f59e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:42.893421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fe298ea-9b29-45f9-9ec0-34a24796f59e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:42.893900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9fe298ea-9b29-45f9-9ec0-34a24796f59e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:42.919653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9fe298ea-9b29-45f9-9ec0-34a24796f59e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Going to try to start instance {{(pid=122354) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 01:59:42.968340 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9fe298ea-9b29-45f9-9ec0-34a24796f59e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action" status: 202 len: 0 microversion: 2.1 time: 0.085160 Oct 02 01:59:42.969355 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3579/6993] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 01:59:42 2022] POST /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:59:43.031706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-773acf79-2575-417e-9b42-36e1782fba79 req-d941de7c-4e0f-443a-a8ac-23da9c6ef799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "name": "network-vif-plugged", "status": "completed", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:43.041654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-773acf79-2575-417e-9b42-36e1782fba79 req-d941de7c-4e0f-443a-a8ac-23da9c6ef799 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:43.042146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-773acf79-2575-417e-9b42-36e1782fba79 req-d941de7c-4e0f-443a-a8ac-23da9c6ef799 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:43.042589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-773acf79-2575-417e-9b42-36e1782fba79 req-d941de7c-4e0f-443a-a8ac-23da9c6ef799 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:43.055342 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-773acf79-2575-417e-9b42-36e1782fba79 req-d941de7c-4e0f-443a-a8ac-23da9c6ef799 service nova] Creating event network-vif-plugged:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h1-master-1 Oct 02 01:59:43.060714 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-773acf79-2575-417e-9b42-36e1782fba79 req-d941de7c-4e0f-443a-a8ac-23da9c6ef799 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089911 Oct 02 01:59:43.061386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3580/6994] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:59:43.066412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:43.067439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:43.074023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:43.074554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:43.075042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:43.075752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:43.076230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:43.076676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:43.291761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:43.299506 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44ba741d-c126-4925-9da5-2d329690052c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1666 microversion: 2.1 time: 0.236992 Oct 02 01:59:43.300354 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3581/6995] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:43 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1666 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:59:44.323671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:44.324447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:44.331578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:44.332089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:44.332544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:44.333252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:44.333723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:44.334364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:44.470137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:44.478041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dcf20bca-065c-476f-bc4e-01400a479268 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1670 microversion: 2.1 time: 0.158301 Oct 02 01:59:44.478630 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3582/6996] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:44 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:44.501248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:44.501738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:44.508025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:44.508532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:44.508958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:44.509650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:44.510114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:44.510545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:44.535318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:59:44.613359 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8923271f-fabc-4096-858d-09cedd0e3016 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 204 len: 0 microversion: 2.1 time: 0.115033 Oct 02 01:59:44.614070 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3583/6997] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:59:44 2022] DELETE /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:59:44.623344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:44.624060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:44.629865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:44.630348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:44.630850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:44.632212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:44.632693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:44.633141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:44.649279 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:59:44.649462 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 01:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 (ip 10.222.0.23) !!! Oct 02 01:59:44.772711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:44.780579 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-179a2ce3-06ed-4c0c-ab30-ca9564cc10b5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1676 microversion: 2.1 time: 0.161324 Oct 02 01:59:44.781153 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3584/6998] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:44 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:45.805616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:45.806502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:45.809423 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:45.815056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:45.815614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:45.816069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:45.816841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:45.817733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:45.818180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:45.964176 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:45.972182 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7478a744-c9c9-4f7e-bef8-74b337b6adb5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1676 microversion: 2.1 time: 0.171353 Oct 02 01:59:45.972776 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3585/6999] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:45 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:46.997746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:46.998558 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:47.005605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:47.006244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:47.006718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:47.007431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:47.007895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:47.008334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:47.093410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:47.104331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-713abd02-b3c8-4081-8b2a-f9eecb370742 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 200 len: 1609 microversion: 2.1 time: 0.110314 Oct 02 01:59:47.105495 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3586/7000] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:46 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 1609 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:47.110922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b311f947-d765-4c48-8dd9-5c45077c878f req-848e2893-0537-4ee4-a1b3-e92fab9a7a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974389aa-2f4d-4171-9496-7c68b7912937", "name": "network-vif-deleted", "tag": "145cb98e-75e2-4513-b1f4-9c8a3b70ea56"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:47.122299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b311f947-d765-4c48-8dd9-5c45077c878f req-848e2893-0537-4ee4-a1b3-e92fab9a7a06 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:47.122849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b311f947-d765-4c48-8dd9-5c45077c878f req-848e2893-0537-4ee4-a1b3-e92fab9a7a06 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:47.123293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b311f947-d765-4c48-8dd9-5c45077c878f req-848e2893-0537-4ee4-a1b3-e92fab9a7a06 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:47.135485 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b311f947-d765-4c48-8dd9-5c45077c878f req-848e2893-0537-4ee4-a1b3-e92fab9a7a06 service nova] Creating event network-vif-deleted:145cb98e-75e2-4513-b1f4-9c8a3b70ea56 for instance 974389aa-2f4d-4171-9496-7c68b7912937 on n-h1-master-1 Oct 02 01:59:47.140483 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b311f947-d765-4c48-8dd9-5c45077c878f req-848e2893-0537-4ee4-a1b3-e92fab9a7a06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Oct 02 01:59:47.143327 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3587/7001] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:59:48.132273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:48.132986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:48.139321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:48.140323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:48.140863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:48.141883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:48.142465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:48.142932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:48.161355 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 HTTP/1.1 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '974389aa-2f4d-4171-9496-7c68b7912937'} Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:59:48.163738 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b44f14e8-6625-4e0e-b292-c1108855be6c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 404 len: 111 microversion: 2.1 time: 0.038776 Oct 02 01:59:48.168100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3588/7002] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:48 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:59:48.187471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:48.188091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:48.196067 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:48.196577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:48.197026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:48.197740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:48.198265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:48.198657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:48.213851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 HTTP/1.1 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '974389aa-2f4d-4171-9496-7c68b7912937'} Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:59:48.215444 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0413b8f6-0b80-4b62-b0cc-e45cfcae0132 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 404 len: 111 microversion: 2.1 time: 0.033597 Oct 02 01:59:48.220054 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3589/7003] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:48 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:59:48.265811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1266188489", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "3200fe33-634c-4511-ad30-6b3869b87389"}], "security_groups": [{"name": "tempest-securitygroup--575292411"}], "key_name": "tempest-keypair-1820247347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:48.377384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] validate_networks() for [('3200fe33-634c-4511-ad30-6b3869b87389', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:59:48.818075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:59:48.818707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:59:48.819230 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:59:48.819663 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:59:48.820095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:59:48.831595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:48.832092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:48.832544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:48.833286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:48.833751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:48.834993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:48.854905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:59:48.860130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:59:48.872525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:59:48.874860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:59:48.923024 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b23073eb-d4b1-40b7-af0e-a90790b76bdf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660936 Oct 02 01:59:48.923672 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3590/7004] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:59:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:59:48.935221 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-64857859-e513-4eaa-aff1-2da7507484d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:48.935875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-64857859-e513-4eaa-aff1-2da7507484d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:48.991943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-64857859-e513-4eaa-aff1-2da7507484d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:48.999954 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-64857859-e513-4eaa-aff1-2da7507484d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1239 microversion: 2.1 time: 0.068415 Oct 02 01:59:49.000616 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3591/7005] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:48 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:50.024484 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:50.025149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:50.033071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:50.033581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:50.034030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:50.035296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:50.035296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:50.035996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:50.106362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:50.114696 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4b1ec028-2dab-4083-9e02-1c9970ab040e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1299 microversion: 2.1 time: 0.094208 Oct 02 01:59:50.115553 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3592/7006] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:50 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:51.139052 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:51.139666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:51.146502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:51.147049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:51.147506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:51.148261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:51.148982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:51.149163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:51.288383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:51.296294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ee0ea7a-198e-4b1f-84c9-9db1988ecfbe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1364 microversion: 2.1 time: 0.161383 Oct 02 01:59:51.296875 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3593/7007] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:51 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:51.421095 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:59:51.421599 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:59:51.423334 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:59:51.423453 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 01:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 01:59:51.565496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7997acd1-c89f-4072-9f03-d5fcf2af5791 req-37e255f8-5e21-43d0-9ff6-2288726046eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:51.575885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7997acd1-c89f-4072-9f03-d5fcf2af5791 req-37e255f8-5e21-43d0-9ff6-2288726046eb service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:51.576389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7997acd1-c89f-4072-9f03-d5fcf2af5791 req-37e255f8-5e21-43d0-9ff6-2288726046eb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:51.576830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7997acd1-c89f-4072-9f03-d5fcf2af5791 req-37e255f8-5e21-43d0-9ff6-2288726046eb service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:51.588254 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7997acd1-c89f-4072-9f03-d5fcf2af5791 req-37e255f8-5e21-43d0-9ff6-2288726046eb service nova] Creating event network-changed:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 01:59:51.593328 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7997acd1-c89f-4072-9f03-d5fcf2af5791 req-37e255f8-5e21-43d0-9ff6-2288726046eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082959 Oct 02 01:59:51.593944 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3594/7008] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:59:52.322525 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:52.323169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:52.330680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:52.331190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:52.333527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:52.333527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:52.333527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:52.333527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:52.464338 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:52.472120 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6910cf2d-4776-4a52-a024-b412c421eb61 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1364 microversion: 2.1 time: 0.155558 Oct 02 01:59:52.472699 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3595/7009] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:52 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:53.496508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:53.497198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:53.504753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:53.505297 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:53.505748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:53.507547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:53.508257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:53.508764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:53.648511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:53.657463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e8dc01c-af69-4f88-9da1-62518f16eb97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1364 microversion: 2.1 time: 0.164757 Oct 02 01:59:53.658152 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3596/7010] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:53 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:54.683803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:54.684507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:54.691455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:54.691949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:54.692708 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:54.693416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:54.694165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:54.694637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:54.710124 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:54.829399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:54.837780 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4085251f-2a72-4d96-aea7-c3be9da19be7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1364 microversion: 2.1 time: 0.157920 Oct 02 01:59:54.838363 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3597/7011] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:54 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:55.556521 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-794145d1-4773-4023-805e-4cc8aca93d3e req-d3baada3-ac9c-4864-ad10-5033181cc45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "name": "network-vif-plugged", "status": "completed", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:55.567821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-794145d1-4773-4023-805e-4cc8aca93d3e req-d3baada3-ac9c-4864-ad10-5033181cc45b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:55.568670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-794145d1-4773-4023-805e-4cc8aca93d3e req-d3baada3-ac9c-4864-ad10-5033181cc45b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:55.569136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-794145d1-4773-4023-805e-4cc8aca93d3e req-d3baada3-ac9c-4864-ad10-5033181cc45b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:55.580771 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-794145d1-4773-4023-805e-4cc8aca93d3e req-d3baada3-ac9c-4864-ad10-5033181cc45b service nova] Creating event network-vif-plugged:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 01:59:55.586458 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-794145d1-4773-4023-805e-4cc8aca93d3e req-d3baada3-ac9c-4864-ad10-5033181cc45b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033935 Oct 02 01:59:55.587094 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3598/7012] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:59:55.862336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:55.863100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:55.871005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:55.871512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:55.871975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:55.872683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:55.873160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:55.873608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:56.006351 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:56.014178 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccbd5b73-1cc9-42db-a6dc-83b93721480e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1364 microversion: 2.1 time: 0.156235 Oct 02 01:59:56.014789 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3599/7013] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:55 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:57.038209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:57.038882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:57.045759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:57.046262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:57.046780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:57.047488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:57.047963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:57.048405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:57.181285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:59:57.189050 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ef8059b-e7f7-46f5-9c2f-4776a8a75c9d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1551 microversion: 2.1 time: 0.155124 Oct 02 01:59:57.189620 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3600/7014] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:59:57 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:59:57.212464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:59:57.212973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:59:57.218850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:57.219377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:57.219832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:57.220534 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:57.221048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:57.221495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:57.298593 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23d54fec-ea9c-4853-8a5f-d80dcfcd97dd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089753 Oct 02 01:59:57.299639 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3601/7015] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:59:57 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:59:58.262978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-40a0d497-70e7-4388-9390-d6dc80b2bd6e req-ffb46444-fdf5-4b6e-8edc-0affc4992f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:59:58.272742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-40a0d497-70e7-4388-9390-d6dc80b2bd6e req-ffb46444-fdf5-4b6e-8edc-0affc4992f8c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:59:58.273339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-40a0d497-70e7-4388-9390-d6dc80b2bd6e req-ffb46444-fdf5-4b6e-8edc-0affc4992f8c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:59:58.273802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-40a0d497-70e7-4388-9390-d6dc80b2bd6e req-ffb46444-fdf5-4b6e-8edc-0affc4992f8c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:59:58.286255 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-40a0d497-70e7-4388-9390-d6dc80b2bd6e req-ffb46444-fdf5-4b6e-8edc-0affc4992f8c service nova] Creating event network-changed:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 01:59:58.292380 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-40a0d497-70e7-4388-9390-d6dc80b2bd6e req-ffb46444-fdf5-4b6e-8edc-0affc4992f8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034067 Oct 02 01:59:58.293335 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3602/7016] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 01:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:00:28.638848 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:28.639676 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:28.641620 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:28.642304 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=23 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:28.647165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:28.649603 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:28.660420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:28.660917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:28.661372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:28.662080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:28.662554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:28.663022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:28.691493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:28.698582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 02:00:28.705025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:00:28.705463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:00:28.705994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:00:28.706420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:00:28.706873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:00:28.772795 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-568f2ad6-0102-4027-a7c5-1c0ee604018b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1/action" status: 202 len: 0 microversion: 2.1 time: 0.134918 Oct 02 02:00:28.773619 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3603/7017] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:00:28 2022] POST /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:00:28.781545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:28.782162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:28.791206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:28.791710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:28.792162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:28.792880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:28.793425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:28.794019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:28.930791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:28.938857 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffca9060-f98d-49dc-b7f3-3f412f440740 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1679 microversion: 2.1 time: 0.161043 Oct 02 02:00:28.939448 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3604/7018] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:28 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:29.963489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:29.964127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:29.971191 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:29.971691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:29.972515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:29.974035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:29.974324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:29.974793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:30.109735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:30.117971 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6271c438-245b-4e7a-8c25-7ee1322682cb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1679 microversion: 2.1 time: 0.158707 Oct 02 02:00:30.118544 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3605/7019] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:29 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:31.141795 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:31.142495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:31.149731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:31.150228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:31.150706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:31.151408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:31.151875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:31.152310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:31.281610 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:31.289987 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef7a1050-4853-494e-b3e9-30ceb6e262f6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.152764 Oct 02 02:00:31.290576 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3606/7020] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:31 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:32.313687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:32.314326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:32.322366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:32.322894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:32.323353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:32.324058 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:32.324529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:32.324969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:32.457537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:32.465294 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-716ac7e1-2b8f-4f42-a5d5-a5df713c2e3e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.155685 Oct 02 02:00:32.465874 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3607/7021] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:32 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:33.488555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:33.489203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:33.496830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:33.497329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:33.497783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:33.498488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:33.498988 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:33.499431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:33.632343 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:33.642111 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-513813bb-91a7-4daa-8206-a1eb97badaaa tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.157421 Oct 02 02:00:33.642747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3608/7022] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:33 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:34.668250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:34.668968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:34.675679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:34.676175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:34.676618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:34.677319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:34.677783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:34.678222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:34.809688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:34.817525 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-067ce57a-e3a6-4b85-83e7-c3f6d953abb7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.154414 Oct 02 02:00:34.818359 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3609/7023] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:34 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:35.842051 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:35.842710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:35.849140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:35.849647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:35.850102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:35.850850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:35.851966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:35.852416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:35.985185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:35.993191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1ae161e-a662-41a9-af7c-3740741e228d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.155279 Oct 02 02:00:35.993765 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3610/7024] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:35 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:37.017037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:37.017679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:37.024752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:37.025253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:37.025707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:37.026414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:37.026918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:37.027363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:37.155067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:37.162906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29261d8e-3f33-434c-852b-6d3b87f24367 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.149853 Oct 02 02:00:37.163490 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3611/7025] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:37 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:38.187124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:38.187822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:38.194968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:38.195479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:38.196025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:38.196744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:38.197217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:38.197660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:38.359508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:38.369306 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e7fe0acf-6cb7-4cce-b8d9-49892a5d5317 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.186156 Oct 02 02:00:38.369887 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3612/7026] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:38 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:39.393420 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:39.394084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:39.401713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:39.402206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:39.402676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:39.403383 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:39.403954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:39.404396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:39.536668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:39.544498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dbae8530-3cfe-48c2-a156-e3530b4b1247 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.155009 Oct 02 02:00:39.545071 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3613/7027] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:39 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:40.568470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:40.569156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:40.576527 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:40.577026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:40.577479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:40.578190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:40.578687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:40.579136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:40.708720 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:40.717388 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56f419d0-3c28-4de4-aee8-ca3a8246bae1 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.153109 Oct 02 02:00:40.717979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3614/7028] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:40 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:41.742012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:41.742770 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:41.749473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:41.749959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:41.750402 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:41.751119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:41.751590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:41.752027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:41.889367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:41.897067 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-33961e8c-f0c3-45fc-8b83-b79b10e772ff tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1684 microversion: 2.1 time: 0.159016 Oct 02 02:00:41.897646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3615/7029] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:41 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:42.922306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:42.923082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:42.930841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:42.931622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:42.932073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:42.932791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:42.933457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:42.933997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:43.129328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:43.137809 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-af1b64f8-d505-4d60-8a56-06482d571576 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1683 microversion: 2.1 time: 0.219938 Oct 02 02:00:43.138396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3616/7030] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:42 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:43.419562 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "name": "network-vif-unplugged", "status": "completed", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:43.431978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:43.432860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:43.433713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:43.449863 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] Creating event network-vif-unplugged:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h1-master-1 Oct 02 02:00:43.455689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:00:43.467423 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ac8e7518-7720-4267-a872-ef82d37a4468 req-472d35e2-ed6a-48ec-89e0-f34ee74babad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051821 Oct 02 02:00:43.468406 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3617/7031] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:00:44.164335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:44.165206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:44.172586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:44.173218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:44.173671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:44.174397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:44.174895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:44.175337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:44.196185 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:44.518560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:44.526623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca1a2d99-2ab1-4a60-a3c2-00859ef7bd03 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1683 microversion: 2.1 time: 0.367324 Oct 02 02:00:44.527215 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3618/7032] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:44 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1683 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:45.501908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:45.512845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:45.513342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:45.513785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:45.526331 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] Creating event network-changed:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h1-master-1 Oct 02 02:00:45.531652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:00:45.542191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-4d9632ef-eca8-41b9-b789-a8d1996eaf10 req-8d518120-1398-4579-a521-a8743c4cb5ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044132 Oct 02 02:00:45.542812 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3619/7033] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:00:45.550784 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:45.551492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:45.557707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:45.558203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:45.558677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:45.559407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:45.559874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:45.560418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:45.708960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:45.717854 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c913678d-0364-4593-8b5f-1526da548eda tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1681 microversion: 2.1 time: 0.171013 Oct 02 02:00:45.718455 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3620/7034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:45 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:46.742742 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:46.743443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:46.750169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:46.750698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:46.751152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:46.751854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:46.752327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:46.752796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:46.880989 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:46.889428 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c66a754b-26ba-44c1-9fcd-f72f63374d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1681 microversion: 2.1 time: 0.150857 Oct 02 02:00:46.890003 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3621/7035] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:46 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:47.919404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:47.920090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:47.927802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:47.928283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:47.928728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:47.929460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:47.930018 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:47.930503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.071875 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:48.079599 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-34245064-d196-4cf4-b9c6-fae2568d0506 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1678 microversion: 2.1 time: 0.164129 Oct 02 02:00:48.080176 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3622/7036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:47 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:48.104000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:48.104541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:48.110280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:48.110750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:48.111199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.111896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:48.112359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:48.112794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.148633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:48.149124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:48.149570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.150300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:48.150803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:48.151241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.171601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:00:48.176808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:00:48.292360 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29b57f90-4bcd-4557-a20e-875da9e409d9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1/action" status: 202 len: 0 microversion: 2.1 time: 0.190295 Oct 02 02:00:48.293000 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3623/7037] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:00:48 2022] POST /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:00:48.309082 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:48.309884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:48.317461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:48.317963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:48.318715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.319425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:48.320908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:48.320908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:48.511333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:48.519092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0dee9f32-2d4a-46c8-b739-ab7aa96d8778 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1677 microversion: 2.1 time: 0.221764 Oct 02 02:00:48.519676 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3624/7038] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:48 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:49.547172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:49.547960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:49.555939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:49.556434 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:49.556889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:49.557605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:49.558076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:49.558516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:49.690316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:49.698991 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a086e346-b2d3-4f4e-b2d3-3900722ce522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1677 microversion: 2.1 time: 0.159452 Oct 02 02:00:49.699584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3625/7039] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:49 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:00:50.724298 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:50.724912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:50.731924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:50.732428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:50.732906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:50.733774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:50.734247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:50.734715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:50.865023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:50.873453 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-73266c09-4e02-4fb0-926d-a31769eae0fe tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1677 microversion: 2.1 time: 0.152968 Oct 02 02:00:50.874035 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3626/7040] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:50 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:51.357371 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "name": "network-vif-plugged", "status": "completed", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:51.373393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:51.374312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:51.375077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:51.390591 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] Creating event network-vif-plugged:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 02:00:51.398074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:00:51.414510 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a95bd5c8-e206-4e86-829a-26a96072bfea req-8b45ff66-aa00-420e-996a-bfad1dd97776 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068633 Oct 02 02:00:51.416232 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3627/7041] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:00:51.706517 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "name": "network-vif-unplugged", "status": "completed", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:51.718776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:51.719280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:51.719721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:51.734024 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] Creating event network-vif-unplugged:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 02:00:51.739578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:00:51.750542 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f1203a4e-1d36-47f8-b672-179bf7c9ece2 req-e97b4dda-cb7c-4e04-bb82-e7fb9a6b6633 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048197 Oct 02 02:00:51.751383 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3628/7042] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:00:51.898549 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:51.899570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:51.905750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:51.906253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:51.906726 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:51.907436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:51.907904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:51.908344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:52.078448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:52.086519 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c405c104-6036-456f-8fb3-fc76efca469a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1677 microversion: 2.1 time: 0.192456 Oct 02 02:00:52.087321 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3629/7043] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:51 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:53.111737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:53.112405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:53.119787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:53.120280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:53.120722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:53.121418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:53.121882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:53.122316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:53.250915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:53.259448 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f84ba7b2-a1d8-4154-9b4d-140b5abc5552 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1677 microversion: 2.1 time: 0.151531 Oct 02 02:00:53.260021 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3630/7044] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:53 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:53.782399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:53.793467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:53.793963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:53.794414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:53.806852 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] Creating event network-changed:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 02:00:53.812224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:00:53.823088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7550208e-220a-4b8a-b08c-e8b768179319 req-bb16d719-940e-4c97-a24f-8bc22dab72b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045098 Oct 02 02:00:53.823760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3631/7045] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:00:54.286047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:54.286854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:54.295037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.295842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.296510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.297491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.298252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.298956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.489261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:54.497683 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-100e6f58-048f-4740-931f-374327a68522 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1670 microversion: 2.1 time: 0.217961 Oct 02 02:00:54.498271 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3632/7046] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:54 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:54.521079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:54.521711 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:54.528551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.529052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.529494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.530196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.530686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.531129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.549608 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:54.663111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:54.671463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-64bfdd3e-0e28-4d12-8c52-ede0a989c812 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1670 microversion: 2.1 time: 0.154254 Oct 02 02:00:54.672049 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3633/7047] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:54 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:54.693556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:54.694177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:54.699873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.700369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.700818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.701520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.701987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.702435 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.834457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:54.842787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fc9f815a-6a35-4bff-af20-dd927e3a11e0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1670 microversion: 2.1 time: 0.152990 Oct 02 02:00:54.843365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3634/7048] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:54 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:54.865324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:54.865836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:54.871747 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.872249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.872702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.873407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.873876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.874314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.899854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:00:54.977998 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f416949-3f00-47b8-812d-f7d072de460f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 204 len: 0 microversion: 2.1 time: 0.114986 Oct 02 02:00:54.977998 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3635/7049] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:00:54 2022] DELETE /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:00:54.988405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:54.989368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:54.996279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.996781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.997235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:54.997948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:54.998419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:54.998897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:55.133388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:55.141068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e61abb8a-030b-45ec-8d7c-1496eec6ae10 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1676 microversion: 2.1 time: 0.158586 Oct 02 02:00:55.141643 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3636/7050] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:54 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:56.164955 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:56.165595 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:56.172205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:56.172712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:56.173158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:56.173864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:56.174337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:56.174818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:56.304749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:56.312700 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-798d66dc-2109-4a5c-bc3f-8461979b3f68 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1676 microversion: 2.1 time: 0.151789 Oct 02 02:00:56.313271 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3637/7051] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:56 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:00:57.196592 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d6d55401-3008-4411-ab59-39198a7e3515 req-9be989c7-f7b9-478a-817c-6409c07723fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15e010-b6d0-4ad8-8509-cf0c5f5109f1", "name": "network-vif-deleted", "tag": "aa31a691-625c-48ca-88aa-c843c98801d9"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:57.207056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d6d55401-3008-4411-ab59-39198a7e3515 req-9be989c7-f7b9-478a-817c-6409c07723fe service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:57.207543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d6d55401-3008-4411-ab59-39198a7e3515 req-9be989c7-f7b9-478a-817c-6409c07723fe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:57.207979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d6d55401-3008-4411-ab59-39198a7e3515 req-9be989c7-f7b9-478a-817c-6409c07723fe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:57.219776 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d6d55401-3008-4411-ab59-39198a7e3515 req-9be989c7-f7b9-478a-817c-6409c07723fe service nova] Creating event network-vif-deleted:aa31a691-625c-48ca-88aa-c843c98801d9 for instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 on n-h2-master-1 Oct 02 02:00:57.225197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d6d55401-3008-4411-ab59-39198a7e3515 req-9be989c7-f7b9-478a-817c-6409c07723fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033189 Oct 02 02:00:57.229521 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3638/7052] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:00:57.341895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:57.342748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:57.349139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:57.349872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:57.350487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:57.351522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:57.352253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:57.352882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:57.385908 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:57.391336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:57.392032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:57.392636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:57.393239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lazy-loading 'fault' on Instance uuid 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:00:57.454344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:57.463684 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-73c02146-3e10-42bf-84a2-7e76dd9e4614 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 200 len: 1329 microversion: 2.1 time: 0.126796 Oct 02 02:00:57.464351 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3639/7053] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:57 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:00:58.489118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:58.489723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:58.491649 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:58.498099 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:58.498591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:58.499054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:58.499766 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:58.500213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:58.500647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:58.513957 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 HTTP/1.1 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5b15e010-b6d0-4ad8-8509-cf0c5f5109f1'} Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:00:58.515607 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6eb275f4-dde4-4c2d-8734-1897420f554c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 404 len: 111 microversion: 2.1 time: 0.032039 Oct 02 02:00:58.520459 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3640/7054] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:58 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:00:58.531851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:58.532468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:58.538152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:58.539455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:58.539908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:58.540622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:58.541087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:58.541523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:58.556387 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 HTTP/1.1 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5b15e010-b6d0-4ad8-8509-cf0c5f5109f1'} Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:00:58.557935 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e3f83a9-c38e-4a2a-9543-d64459e21878 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 404 len: 111 microversion: 2.1 time: 0.031203 Oct 02 02:00:58.562551 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3641/7055] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:58 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:00:58.614918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1756132895", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "3200fe33-634c-4511-ad30-6b3869b87389"}], "security_groups": [{"name": "tempest-securitygroup--575292411"}], "key_name": "tempest-keypair-1820247347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:00:58.719366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] validate_networks() for [('3200fe33-634c-4511-ad30-6b3869b87389', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:00:59.089858 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:00:59.090306 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:00:59.090838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:00:59.091299 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:00:59.091731 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:00:59.101371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:59.102372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:59.102873 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:59.103625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:00:59.104103 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:00:59.104547 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:00:59.122005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:00:59.127409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:00:59.140086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:00:59.142365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:00:59.189277 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85e99474-821f-4a23-9b27-c965d7b2094b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.579003 Oct 02 02:00:59.190118 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3642/7056] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:00:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:00:59.201425 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2c191af9-18e0-410e-bdd5-9e5bb908fba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:00:59.202278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2c191af9-18e0-410e-bdd5-9e5bb908fba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:00:59.256073 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2c191af9-18e0-410e-bdd5-9e5bb908fba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:00:59.263913 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2c191af9-18e0-410e-bdd5-9e5bb908fba9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1239 microversion: 2.1 time: 0.066241 Oct 02 02:00:59.264500 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3643/7057] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:00:59 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:00.288385 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:00.289075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:00.297022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:00.297535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:00.298002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:00.298753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:00.299235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:00.299679 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:00.380341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:00.389276 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-077faa79-2a6a-4e6c-a426-65a2c8c6e37c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1299 microversion: 2.1 time: 0.104667 Oct 02 02:01:00.390031 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3644/7058] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:00 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:01.413377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:01.414015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:01.421570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:01.422083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:01.422539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:01.423296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:01.423771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:01.424254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:01.657473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:01.667478 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-026f3f8d-7a80-4218-b453-4caa376d5e63 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.257910 Oct 02 02:01:01.668204 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3645/7059] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:01 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:01.807670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8b134145-c0c8-4efb-97df-acbffedb972b req-0ad3bf25-e7e7-4755-bbd3-549ec110dc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:01:01.819737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8b134145-c0c8-4efb-97df-acbffedb972b req-0ad3bf25-e7e7-4755-bbd3-549ec110dc84 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:01.820242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8b134145-c0c8-4efb-97df-acbffedb972b req-0ad3bf25-e7e7-4755-bbd3-549ec110dc84 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:01.820693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8b134145-c0c8-4efb-97df-acbffedb972b req-0ad3bf25-e7e7-4755-bbd3-549ec110dc84 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:01.833150 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8b134145-c0c8-4efb-97df-acbffedb972b req-0ad3bf25-e7e7-4755-bbd3-549ec110dc84 service nova] Creating event network-changed:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:01:01.839398 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8b134145-c0c8-4efb-97df-acbffedb972b req-0ad3bf25-e7e7-4755-bbd3-549ec110dc84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037675 Oct 02 02:01:01.840014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3646/7060] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:01:02.693316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:02.694288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:02.701381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:02.701883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:02.702337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:02.703077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:02.703551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:02.703989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:02.842128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:02.849829 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ca755d57-914c-4dcd-9e40-47a4fc9d7dd5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.161592 Oct 02 02:01:02.850393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3647/7061] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:02 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:03.873776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:03.874414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:03.881303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:03.881796 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:03.882248 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:03.883001 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:03.883580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:03.884025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:04.025214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:04.032857 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c2e7dbea-084c-4531-ad44-fd9f49c59875 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.163320 Oct 02 02:01:04.033429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3648/7062] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:03 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:05.056450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:05.057075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:05.066186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:05.066718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:05.067176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:05.067881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:05.068352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:05.069045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:05.195920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:05.203725 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e9ef404c-cee6-48f3-adff-b3fec33d205e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.151816 Oct 02 02:01:05.204307 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3649/7063] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:05 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:06.229076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:06.229802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:06.236275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:06.236771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:06.237219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:06.237922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:06.238389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:06.238860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:06.372450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:06.380094 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25b47ed1-95b8-4bc0-a419-29fe97e1bac3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.155095 Oct 02 02:01:06.380663 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3650/7064] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:06 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:07.389957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-32236825-4917-401a-b28e-b76ba7864061 req-91d8b9df-63ff-4f0e-8542-532e54da5baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "name": "network-vif-plugged", "status": "completed", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:01:07.401520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-32236825-4917-401a-b28e-b76ba7864061 req-91d8b9df-63ff-4f0e-8542-532e54da5baf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:07.402074 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-32236825-4917-401a-b28e-b76ba7864061 req-91d8b9df-63ff-4f0e-8542-532e54da5baf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:07.402528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-32236825-4917-401a-b28e-b76ba7864061 req-91d8b9df-63ff-4f0e-8542-532e54da5baf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:07.414034 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-32236825-4917-401a-b28e-b76ba7864061 req-91d8b9df-63ff-4f0e-8542-532e54da5baf service nova] Creating event network-vif-plugged:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:01:07.419826 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-32236825-4917-401a-b28e-b76ba7864061 req-91d8b9df-63ff-4f0e-8542-532e54da5baf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Oct 02 02:01:07.420502 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3651/7065] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:01:07.425488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:07.426201 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:07.434769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:07.435273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:07.435728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:07.436438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:07.436909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:07.437348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:07.629170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:07.636876 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-efcf9c3c-1b5f-4a1d-83c0-c6f6f79757f0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.215240 Oct 02 02:01:07.637441 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3652/7066] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:07 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:01:08.660898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:08.661577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:08.669243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:08.669753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:08.670211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:08.670954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:08.671457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:08.671916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:08.676033 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:01:08.804134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:08.812921 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0761217d-7a58-4250-b536-03b9c9e5d1bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1364 microversion: 2.1 time: 0.155867 Oct 02 02:01:08.813787 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3653/7067] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:08 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:09.837433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:09.838171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:09.840171 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:01:09.840879 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:01:09.847979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:09.848417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:09.848868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:09.849576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:09.850049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:09.850489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:09.980791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:01:09.988552 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-013e57d6-8003-48cf-9a84-79f50e0165c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1552 microversion: 2.1 time: 0.155087 Oct 02 02:01:09.989125 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3654/7068] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:01:09 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:01:10.012408 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:01:10.012917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:01:10.018733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:10.019235 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:10.019686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:10.020389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:10.020858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:10.021296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:10.101706 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e759af69-4aee-487f-b2c0-574615b591bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093107 Oct 02 02:01:10.102313 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3655/7069] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 02:01:10 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:01:11.036530 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-80000285-d295-4d14-af3a-15552c3d7bed req-95e7e3a1-dda4-48bb-bb6c-a10dd2c4ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:01:11.046467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80000285-d295-4d14-af3a-15552c3d7bed req-95e7e3a1-dda4-48bb-bb6c-a10dd2c4ade6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:01:11.047071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80000285-d295-4d14-af3a-15552c3d7bed req-95e7e3a1-dda4-48bb-bb6c-a10dd2c4ade6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:01:11.047587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-80000285-d295-4d14-af3a-15552c3d7bed req-95e7e3a1-dda4-48bb-bb6c-a10dd2c4ade6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:01:11.059318 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-80000285-d295-4d14-af3a-15552c3d7bed req-95e7e3a1-dda4-48bb-bb6c-a10dd2c4ade6 service nova] Creating event network-changed:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:01:11.064268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-80000285-d295-4d14-af3a-15552c3d7bed req-95e7e3a1-dda4-48bb-bb6c-a10dd2c4ade6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032661 Oct 02 02:01:11.065029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3656/7070] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:01:31.438240 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:01:31.438869 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:01:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:02:25.109291 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:25.110061 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:25.115412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:25.116141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:25.124108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:25.124614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:25.125071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:25.125782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:25.126259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:25.126778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:25.257107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:25.265373 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-74b2a9ef-f745-4c16-9523-11616c453893 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1671 microversion: 2.1 time: 0.158486 Oct 02 02:02:25.265939 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3657/7071] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:25 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:25.287393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7009131d-924d-477e-9703-3266a58eb0e3"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:02:25.289707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:25.295461 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:25.295953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:25.296395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:25.297120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:25.297585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:25.298020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:25.551853 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a2205224-fac5-4236-8bef-4a6f34fa8393 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267889 Oct 02 02:02:25.552471 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3658/7072] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 02:02:25 2022] POST /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:02:36.300258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:02:36.302701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:36.305170 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:02:36.306040 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:36.306745 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:36.313021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:36.313518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:36.313965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:36.314704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:36.315176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:36.315607 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:36.348281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:36.353636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 02:02:36.360631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:02:36.361067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:02:36.361556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:02:36.361990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:02:36.362688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:02:36.424951 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-794ffca1-c76b-4c4f-ae7a-d51fb9476799 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.128891 Oct 02 02:02:36.425749 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3659/7073] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:02:36 2022] POST /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:02:36.433579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:36.434126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:36.441320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:36.441817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:36.442270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:36.443013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:36.443481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:36.443930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:36.596031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:36.604553 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2af77de1-5cbf-403c-ab9f-0aac00fd24d5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1726 microversion: 2.1 time: 0.174646 Oct 02 02:02:36.605362 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3660/7074] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:36 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:37.628719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:37.629466 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:37.637500 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:37.637999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:37.639078 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:37.639963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:37.640436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:37.640878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:37.646267 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 57372. Oct 02 02:02:37.771899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:37.781559 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3741b7e-4484-4693-b7c1-cb249818b02f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1726 microversion: 2.1 time: 0.156695 Oct 02 02:02:37.782138 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3661/7075] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:37 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:38.805555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:38.806235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:38.813449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:38.814055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:38.814512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:38.815252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:38.815720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:38.816159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:38.947431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:38.955840 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-77d2cd38-8459-4b11-a46c-fd59eb1a8ebb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.154137 Oct 02 02:02:38.956428 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3662/7076] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:38 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:39.979654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:39.980284 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:39.987475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:39.987975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:39.988423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:39.989131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:39.989600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:39.990040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:40.117643 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:40.126252 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1d782fbc-8ae0-4865-9834-7171e77de7d6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.150509 Oct 02 02:02:40.126863 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3663/7077] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:39 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:41.150780 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:41.151462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:41.160076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:41.160580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:41.161030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:41.161750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:41.163266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:41.163722 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:41.328195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:41.336565 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c36c7016-c031-4e69-a97d-b78c0992c43d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.189773 Oct 02 02:02:41.337173 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3664/7078] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:41 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:42.361790 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:42.362450 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:42.369150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:42.369639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:42.370084 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:42.370805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:42.371277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:42.371712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:42.502511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:42.510881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfae13f1-c3f3-4a94-b2a9-5bc857a0fa15 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.153169 Oct 02 02:02:42.511463 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3665/7079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:42 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:43.534362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:43.535066 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:43.541864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:43.542362 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:43.542847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:43.543556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:43.544044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:43.545007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:43.671587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:43.679789 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01bb1ff7-8f82-4161-b9cf-9f8554fd5a0f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.149357 Oct 02 02:02:43.680376 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3666/7080] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:43 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:02:44.704768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:44.705509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:44.712208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:44.712707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:44.713161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:44.713864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:44.714337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:44.714810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:44.851037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:44.860057 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2a0e3d65-50ab-462d-ae04-0cfece01cde0 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.159910 Oct 02 02:02:44.860653 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3667/7081] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:44 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:45.889005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:45.889669 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:45.896549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:45.897048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:45.897497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:45.898215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:45.898825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:45.899267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:46.030057 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:46.038669 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2f828e33-8e63-4734-adf4-c897598be3c5 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.153670 Oct 02 02:02:46.039246 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3668/7082] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:45 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:47.066850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:47.067514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:47.074769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:47.075269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:47.075799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:47.076604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:47.077079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:47.077522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:47.210781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:47.220299 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5944bdd9-6644-4620-88e5-730863e5451a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.156887 Oct 02 02:02:47.220875 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3669/7083] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:47 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:48.244506 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:48.245155 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:48.252475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:48.252970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:48.253418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:48.254116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:48.254580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:48.255039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:48.391147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:48.399733 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ba07fbfd-8637-46d0-abe0-b4870f4d905e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.159095 Oct 02 02:02:48.400308 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3670/7084] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:48 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:49.423473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:49.424126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:49.430931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:49.431429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:49.431883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:49.432589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:49.433062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:49.433505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:49.560236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:49.568564 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e20cd6c7-d41e-4e67-94f4-c373d8bb688d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.149166 Oct 02 02:02:49.569148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3671/7085] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:49 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:50.595887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:50.596581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:50.603312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:50.603805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:50.604252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:50.604949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:50.605416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:50.605851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:50.740682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:50.748961 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36fbe71a-7f9c-4f7f-ad5b-20ab5924daf3 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.157001 Oct 02 02:02:50.749536 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3672/7086] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:50 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:51.772786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:51.773421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:51.785951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:51.786459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:51.786937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:51.789123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:51.789606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:51.790051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:51.928395 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:51.937386 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c364eba4-a79f-4f91-bfde-03b1df57396d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.168521 Oct 02 02:02:51.937962 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3673/7087] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:51 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:52.961074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:52.961752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:52.969294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:52.969801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:52.970263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:52.971008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:52.971492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:52.971939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:52.976088 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:53.415965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:53.424487 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-de0cad5c-91a9-481d-b7e4-55de00096250 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.467302 Oct 02 02:02:53.425075 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3674/7088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:52 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:54.448145 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:54.448800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:54.455883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:54.456379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:54.456826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:54.457522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:54.457990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:54.458426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:54.585883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:54.594692 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a87f054-5136-4f6c-bad1-e6407480ca56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.150742 Oct 02 02:02:54.595270 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3675/7089] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:54 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:55.617277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:55.618081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:55.625396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:55.625884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:55.626326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:55.627064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:55.627530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:55.627966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:55.765662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:55.774194 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2687b0e6-bf17-457a-a7ed-f6dc35b43dec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.160804 Oct 02 02:02:55.774798 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3676/7090] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:55 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:56.800238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:56.800894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:56.807611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:56.808117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:56.808579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:56.809290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:56.809775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:56.810223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:56.944024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:56.952972 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-28171b42-0973-4971-abfa-f6900d29822b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1731 microversion: 2.1 time: 0.157573 Oct 02 02:02:56.953566 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3677/7091] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:56 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:02:57.930112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:02:57.958491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:57.959154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:57.959865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:57.974980 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] Creating event network-vif-unplugged:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h2-master-1 Oct 02 02:02:57.981337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:02:57.992988 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-ae52fa67-e495-4bee-b3f0-214cbc5e3eb2 req-84c980bf-f87c-440f-a94b-e34c2acc4189 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067893 Oct 02 02:02:57.993923 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3678/7092] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:02:57.999972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:58.000809 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:58.007312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:58.008305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:58.009048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:58.009924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:58.010554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:58.011170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:58.164950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:58.175219 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8381094-3ace-45ba-b2b9-9b7fe49c0bc6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1730 microversion: 2.1 time: 0.179665 Oct 02 02:02:58.175823 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3679/7093] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:57 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:02:59.199382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:02:59.200037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:02:59.207460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:59.207961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:59.208420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:59.209131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:02:59.209605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:02:59.210048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:02:59.344232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:02:59.353008 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfd25f92-fba3-4b75-9b49-855ea421e47d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1730 microversion: 2.1 time: 0.157727 Oct 02 02:02:59.353593 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3680/7094] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:02:59 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:00.020645 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:00.039843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:00.040341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:00.040788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:00.053881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] Creating event network-changed:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h2-master-1 Oct 02 02:03:00.059662 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:03:00.071596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b17a5f4d-5352-4a03-bde7-ac3ec75dd2a1 req-1f487466-16f3-4f9d-bc94-6f4ece115a38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054451 Oct 02 02:03:00.072247 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3681/7095] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:03:00.378706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:00.380261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:00.387920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:00.388563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:00.389397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:00.391073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:00.391775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:00.392437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:00.631914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:00.641578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1517ebe-ebd1-46f1-b2d3-d53062c6c806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.268259 Oct 02 02:03:00.642759 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3682/7096] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:00 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:03:01.667443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:01.668096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:01.676575 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:01.677092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:01.677551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:01.678288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:01.678859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:01.679368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:01.829225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:01.837851 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dce29ffd-8e5f-4a0d-8e86-794422cd8d39 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.174480 Oct 02 02:03:01.838442 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3683/7097] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:01 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:03:02.862071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:02.862757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:02.869521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:02.870016 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:02.870472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:02.871206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:02.871683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:02.872124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:03.009341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:03.018701 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-00c53f83-ba5b-47c2-94d6-0b866f1f7314 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.161171 Oct 02 02:03:03.019289 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3684/7098] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:02 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:04.043472 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:04.044412 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:04.052331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:04.052970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:04.053439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:04.054198 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:04.054826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:04.055376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:04.190324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:04.200920 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-22520b5d-2d3f-4ba0-bbb4-2ca2ca90cc5e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.161556 Oct 02 02:03:04.201512 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3685/7099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:04 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:05.226722 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:05.227994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:05.236776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:05.237378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:05.237859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:05.238578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:05.239073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:05.239515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:05.368289 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:05.376786 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cedf2179-3a4b-4c8c-a3eb-9d08edf91714 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.154566 Oct 02 02:03:05.377372 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3686/7100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:05 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:06.401405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:06.402043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:06.404838 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=61 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:06.410573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:06.411100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:06.411555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:06.412270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:06.412744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:06.413194 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:06.561857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:06.570104 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5817e10-9495-45af-973d-27767cbcc14e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.172677 Oct 02 02:03:06.570697 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3687/7101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:06 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:07.594296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:07.595023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:07.601824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:07.602321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:07.602804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:07.603511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:07.603981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:07.604419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:07.732896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:07.741761 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6e39d554-8ad0-49c7-b6d2-91e0dfb9dcec tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.151381 Oct 02 02:03:07.742338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3688/7102] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:07 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:08.767881 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:08.768559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:08.775377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:08.775865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:08.776310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:08.777005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:08.777471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:08.777906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:09.169834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:09.178323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4bec4aa9-cdc2-44b5-8f00-91d749ca5788 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.415644 Oct 02 02:03:09.178941 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3689/7103] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:08 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:10.203072 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:10.203741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:10.210373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:10.210906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:10.211363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:10.212059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:10.212524 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:10.212962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:10.341887 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:10.351376 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3f3c944-f1cb-451f-9ab8-23ae3ed185e6 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1728 microversion: 2.1 time: 0.152419 Oct 02 02:03:10.351947 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3690/7104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:10 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:11.376576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:11.377236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:11.383951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.384448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.384907 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.385647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.386119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.386556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.404777 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:11.435472 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:03:11.436088 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:03:11.441154 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:03:11.441298 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:03:11.522513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:11.531173 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ec67692b-cf31-43ea-b8f0-2fe95a79d6bb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1725 microversion: 2.1 time: 0.159055 Oct 02 02:03:11.531747 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3691/7105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:11 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:03:11.554076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:11.554652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:11.560438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.560930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.561415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.562767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.563245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.563686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.600356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.600850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.601295 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.602032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.602496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.602958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.623260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:03:11.628903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Getting quotas for user 2429d94874654da69f134916b5659877 and project 0ea3f726ac484294b995890cfa5b0533. Resources: {'ram', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:03:11.727882 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f7cc6b66-b233-4b2b-b937-e5cd0c04966f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "POST /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.177207 Oct 02 02:03:11.728520 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3692/7106] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:03:11 2022] POST /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:03:11.737245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:11.737959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:11.744155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.744648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.745136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.745900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:11.746385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:11.746831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:11.893447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:11.901934 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf4e787b-b0ed-4e13-bb4d-a8a10da1c6bc tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.169162 Oct 02 02:03:11.902509 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3693/7107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:11 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:12.927231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:12.927959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:12.934842 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:12.935340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:12.935790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:12.937253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:12.937761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:12.938207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:13.070439 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:13.080076 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83f7d93b-0aee-4a7c-9d8e-56d5304c2596 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.156720 Oct 02 02:03:13.080677 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3694/7108] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:12 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:14.105074 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:14.105740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:14.113100 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:14.113518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:14.113970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:14.114713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:14.115183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:14.115619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:14.289264 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:14.299376 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a8a04991-1270-4354-8448-56aecde82769 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.198458 Oct 02 02:03:14.305565 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3695/7109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:14 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:14.541492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "name": "network-vif-plugged", "status": "completed", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:14.552319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:14.552991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:14.553536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:14.565910 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] Creating event network-vif-plugged:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h2-master-1 Oct 02 02:03:14.572058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:03:14.584086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2458e399-d0f9-404d-8a17-4d47e01ed090 req-4f442933-ea89-4fd8-8387-11ad72018786 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047111 Oct 02 02:03:14.584849 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3696/7110] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:03:15.326017 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:15.326765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:15.333661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:15.334162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:15.334622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:15.335336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:15.335801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:15.336237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:15.475353 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:15.485591 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58409fbd-b99c-46a9-8466-d8338650453d tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.164811 Oct 02 02:03:15.486180 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3697/7111] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:15 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:16.514515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:16.516235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:16.524982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:16.525483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:16.525959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:16.526749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:16.527464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:16.527912 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:16.667198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:16.676942 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-34b2f80b-1e24-4ef0-8447-904965602eac tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.170612 Oct 02 02:03:16.678633 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3698/7112] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:16 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:03:17.092249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:17.103181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:17.103676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:17.104314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:17.117527 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] Creating event network-vif-unplugged:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:03:17.123291 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:03:17.134248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9c579a7e-602d-4e69-8dd1-2164f084e3cf req-540da957-87c4-40c1-bc90-eb41409b8966 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046561 Oct 02 02:03:17.134911 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3699/7113] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:03:17.705568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:17.706294 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:17.712525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:17.713030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:17.713481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:17.714193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:17.714696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:17.715142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:17.925962 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:17.934455 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9566fa4b-6f0f-49e6-bc94-19ad0ef7dc22 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.234817 Oct 02 02:03:17.935341 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3700/7114] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:17 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:18.965876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:18.967748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:18.977790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:18.978561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:18.979132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:18.979966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:18.980633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:18.981344 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:19.192490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:19.201268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-75a69076-5bfa-4e4c-80f9-04d5f8b83ee7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.244776 Oct 02 02:03:19.201964 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3701/7115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:18 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:03:19.208060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:19.218905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:19.219540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:19.220055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:19.235396 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] Creating event network-changed:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:03:19.240574 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:03:19.252329 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f27f625f-e80e-4f00-be27-05b0dd514737 req-e724f95e-73e6-465e-89a8-c8d96d9e5c2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049185 Oct 02 02:03:19.253701 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3702/7116] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:03:20.227042 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:20.227771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:20.235656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:20.236157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:20.236608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:20.237321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:20.237799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:20.238245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:20.382579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:20.391994 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cac1cef3-d094-44a9-bace-95c5e3bf06e7 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.169162 Oct 02 02:03:20.392596 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3703/7117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:20 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:21.417179 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:21.417851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:21.425543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:21.426043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:21.426506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:21.427249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:21.427725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:21.428171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:21.565777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:21.574469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4cfa083b-534a-4879-a854-f7c7581759e2 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.161323 Oct 02 02:03:21.575089 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3704/7118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:21 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:22.598647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:22.600075 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:22.602051 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:22.608438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:22.608931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:22.609860 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:22.610569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:22.611059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:22.611517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:22.754027 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:22.763309 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5e82e02-3f38-4169-a911-124fc73dbb7c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.168642 Oct 02 02:03:22.764029 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3705/7119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:22 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:23.787925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:23.788626 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:23.795163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:23.795659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:23.796106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:23.796807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:23.797305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:23.797788 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:23.802089 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:23.932229 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:23.941189 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cb0c6831-6953-4e46-875c-93869f050b41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.157193 Oct 02 02:03:23.941768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3706/7120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:23 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:24.965773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:24.966448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:24.974740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:24.974852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:24.975276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:24.975987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:24.976462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:24.976903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:25.105139 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:25.113432 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39cbb455-30b8-40c6-85b8-d5c5681a2deb tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.151779 Oct 02 02:03:25.114010 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3707/7121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:24 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:26.136847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:26.137529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:26.144270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:26.144816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:26.145247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:26.145953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:26.146429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:26.146905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:26.286557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:26.294894 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b9882c93-edf1-4f76-b153-97ad6e7dbdcf tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.162070 Oct 02 02:03:26.295471 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3708/7122] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:26 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:27.319262 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:27.319899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:27.327162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:27.327667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:27.329177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:27.329900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:27.330381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:27.330858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:27.461520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:27.471025 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48b386b2-cd7b-423d-bb84-4236a223227f tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.155791 Oct 02 02:03:27.471619 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3709/7123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:27 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:28.494266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:28.495035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:28.502195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:28.503002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:28.503456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:28.504161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:28.504630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:28.505071 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:28.686071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:28.694419 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4dcba1ee-2c80-46fb-84d0-032e61627140 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.204125 Oct 02 02:03:28.695032 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3710/7124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:28 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:29.720358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:29.720996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:29.727994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:29.728496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:29.728951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:29.729662 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:29.730141 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:29.730589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:29.862802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:29.871162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5c6159bb-db00-4a9d-9ae8-bf60f9242b8e tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.155576 Oct 02 02:03:29.871775 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3711/7125] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:29 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:30.895475 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:30.896131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:30.903091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:30.903595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:30.904079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:30.904792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:30.905266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:30.905712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:31.036463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:31.045003 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1448c240-646e-458d-a1a0-6c366fcaec35 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1724 microversion: 2.1 time: 0.153157 Oct 02 02:03:31.045584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3712/7126] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:30 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:32.071844 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:32.072493 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:32.079981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.080491 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.080949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.081667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.082148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.082624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.218323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:32.227824 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f707b912-3fca-44c1-8f49-2840dcc97329 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1717 microversion: 2.1 time: 0.160008 Oct 02 02:03:32.228366 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3713/7127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:32 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:32.252573 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:32.253278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:32.259472 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.260065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.260584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.261356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.261832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.262272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.400547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:32.409612 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1cdba2b6-fd80-49c4-9bd7-5353aa93f8ae tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1717 microversion: 2.1 time: 0.161232 Oct 02 02:03:32.410192 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3714/7128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:32 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:32.431560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:32.432181 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:32.438151 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.438692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.439147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.439856 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.440330 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.440773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.574444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:32.583218 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-51aafba2-7473-4eda-a8d2-1f031ae65d56 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1717 microversion: 2.1 time: 0.155285 Oct 02 02:03:32.583793 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3715/7129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:32 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:32.606067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:32.606572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:32.612393 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.612896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.613342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.614040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.614507 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.615041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.640123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:03:32.719528 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-40b8708b-21ea-4e9b-b06e-e446662015cd tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 204 len: 0 microversion: 2.1 time: 0.116766 Oct 02 02:03:32.720723 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3716/7130] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:03:32 2022] DELETE /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:03:32.731904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:32.732656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:32.738866 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.739372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.739828 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.740541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:32.741014 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:32.741497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:32.878175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:32.886567 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8320ab45-fedc-4581-bea8-9779a39a3fb4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1723 microversion: 2.1 time: 0.158880 Oct 02 02:03:32.887167 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3717/7131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:32 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:33.909631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:33.910274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:33.917105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:33.917599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:33.918052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:33.918806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:33.919301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:33.919739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:34.050373 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:34.058730 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-783fc8fe-f2b9-4a37-b4af-3e9475455f41 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1723 microversion: 2.1 time: 0.153140 Oct 02 02:03:34.059302 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3718/7132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:33 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:34.252118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-d324989f-5e87-40b8-8edf-b0bca5cbeff0 req-b304a66c-9f12-476a-97f5-a0c14b322e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "name": "network-vif-plugged", "status": "completed", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:34.262253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d324989f-5e87-40b8-8edf-b0bca5cbeff0 req-b304a66c-9f12-476a-97f5-a0c14b322e97 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:34.262780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d324989f-5e87-40b8-8edf-b0bca5cbeff0 req-b304a66c-9f12-476a-97f5-a0c14b322e97 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:34.263227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-d324989f-5e87-40b8-8edf-b0bca5cbeff0 req-b304a66c-9f12-476a-97f5-a0c14b322e97 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:34.274465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-d324989f-5e87-40b8-8edf-b0bca5cbeff0 req-b304a66c-9f12-476a-97f5-a0c14b322e97 service nova] Creating event network-vif-plugged:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:03:34.279427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-d324989f-5e87-40b8-8edf-b0bca5cbeff0 req-b304a66c-9f12-476a-97f5-a0c14b322e97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Oct 02 02:03:34.280030 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3719/7133] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:03:35.085707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:35.086431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:35.092562 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:35.093065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:35.093546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:35.094291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:35.094797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:35.095241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:35.325195 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:35.333881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b3a6888-fc14-4d00-87cf-7a84c9b36d0b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1723 microversion: 2.1 time: 0.253325 Oct 02 02:03:35.334483 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3720/7134] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:35 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:35.783121 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-19dc1e9a-11c8-46aa-bd1f-a8904d2533d0 req-f3a8d442-c07c-41f1-9412-754af158ef1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9", "name": "network-vif-deleted", "tag": "b6ee460a-55d3-4f93-a3fe-fc952ff47319"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:35.794561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-19dc1e9a-11c8-46aa-bd1f-a8904d2533d0 req-f3a8d442-c07c-41f1-9412-754af158ef1c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:35.795644 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-19dc1e9a-11c8-46aa-bd1f-a8904d2533d0 req-f3a8d442-c07c-41f1-9412-754af158ef1c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:35.796831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-19dc1e9a-11c8-46aa-bd1f-a8904d2533d0 req-f3a8d442-c07c-41f1-9412-754af158ef1c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:35.817381 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-19dc1e9a-11c8-46aa-bd1f-a8904d2533d0 req-f3a8d442-c07c-41f1-9412-754af158ef1c service nova] Creating event network-vif-deleted:b6ee460a-55d3-4f93-a3fe-fc952ff47319 for instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 on n-h1-master-1 Oct 02 02:03:35.823442 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-19dc1e9a-11c8-46aa-bd1f-a8904d2533d0 req-f3a8d442-c07c-41f1-9412-754af158ef1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045346 Oct 02 02:03:35.824768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3721/7135] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:03:36.358105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:36.360258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:36.367805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:36.368321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:36.368778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:36.369499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:36.369974 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:36.370593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:36.393877 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:36.449386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:36.458553 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ed2d8076-723c-49c7-9000-28169fdafa55 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1370 microversion: 2.1 time: 0.104782 Oct 02 02:03:36.459298 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3722/7136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:36 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:37.483496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:37.484215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:37.487214 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:37.494614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:37.495142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:37.495595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:37.496327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:37.496837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:37.497271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:37.566860 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:37.575596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-878bf5d6-4804-4f46-ac56-359fff3a7d4b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1370 microversion: 2.1 time: 0.096177 Oct 02 02:03:37.576175 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3723/7137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:37 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:38.657210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:38.657842 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:38.664680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:38.665246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:38.665705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:38.666421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:38.666927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:38.667377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:38.729500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:38.738620 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3905c9f8-8ba4-47de-9a47-156d7fb0adf4 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1370 microversion: 2.1 time: 0.086486 Oct 02 02:03:38.739214 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3724/7138] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:38 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:39.761674 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:39.762341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:39.770370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:39.770885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:39.771457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:39.772179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:39.772652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:39.773092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:39.842330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2429d94874654da69f134916b5659877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea3f726ac484294b995890cfa5b0533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:39.851341 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bc286dfe-2f4a-4d05-ad3e-f105c9b4533a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 200 len: 1370 microversion: 2.1 time: 0.093658 Oct 02 02:03:39.852293 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3725/7139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:39 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:40.884004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:40.884694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:40.891812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:40.892333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:40.892801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:40.893540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:40.894024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:40.894479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:40.909105 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 HTTP/1.1 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9'} Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:40.910835 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6b71fd62-7796-41b1-8cfb-b9865e846806 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 404 len: 111 microversion: 2.1 time: 0.032345 Oct 02 02:03:40.915605 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3726/7140] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:40 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:40.975974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:40.978205 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:40.985149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:40.985778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:40.986244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:40.986997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:40.987488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:40.987941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:41.000859 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-volume_attachments HTTP/1.1 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9'} Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:41.002455 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20d4fa08-ee92-43c5-a38a-5c93251937d8 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032121 Oct 02 02:03:41.006447 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3727/7141] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:03:40 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.329909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.330503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.337496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.338245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.338737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.339459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.339944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.340394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.354699 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 HTTP/1.1 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9'} Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.356277 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3ab942ff-0087-4a4a-a567-850b6e2b53e9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 404 len: 111 microversion: 2.1 time: 0.031894 Oct 02 02:03:44.361039 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3728/7142] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:03:44 2022] DELETE /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.366328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.366991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.372761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.373291 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.373749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.374558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.375779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.376237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.389557 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 HTTP/1.1 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9'} Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.391456 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b81b2389-371c-421d-b053-107566141c97 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9" status: 404 len: 111 microversion: 2.1 time: 0.030107 Oct 02 02:03:44.396754 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3729/7143] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:44 2022] GET /compute/v2.1/servers/7a366cd4-6fa5-4e93-87e8-7d1bbcfbf5d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.401214 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.401739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.408384 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.408924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.409413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.410160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.410687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.411146 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.429049 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 HTTP/1.1 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5b15e010-b6d0-4ad8-8509-cf0c5f5109f1'} Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.430762 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8f5bc27-8db2-401d-a8a5-1b936621b08a tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 404 len: 111 microversion: 2.1 time: 0.034804 Oct 02 02:03:44.434561 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3730/7144] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:03:44 2022] DELETE /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:03:44.441609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.442255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.448721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.449241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.449744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.450486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.451004 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.451457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.466522 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 HTTP/1.1 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5b15e010-b6d0-4ad8-8509-cf0c5f5109f1'} Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.468146 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.472959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-504d74c2-ef75-4b4d-88be-fd2b4b83d532 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1" status: 404 len: 111 microversion: 2.1 time: 0.033104 Oct 02 02:03:44.473999 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3731/7145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:44 2022] GET /compute/v2.1/servers/5b15e010-b6d0-4ad8-8509-cf0c5f5109f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.478975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.479503 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.486104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.486721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.487214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.487970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.488448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.488897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.503092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 HTTP/1.1 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '974389aa-2f4d-4171-9496-7c68b7912937'} Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.504683 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0eab5a3-377b-4191-8db5-ce844f3b6d6b tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 404 len: 111 microversion: 2.1 time: 0.030957 Oct 02 02:03:44.509235 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3732/7146] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:03:44 2022] DELETE /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.514100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.514757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 974389aa-2f4d-4171-9496-7c68b7912937] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.521119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.521622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.522073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.522826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.523304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.523751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.537743 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 HTTP/1.1 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '974389aa-2f4d-4171-9496-7c68b7912937'} Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.539313 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 974389aa-2f4d-4171-9496-7c68b7912937 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bba45f59-cbbc-466b-9d80-8f097ba2e1c9 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937" status: 404 len: 111 microversion: 2.1 time: 0.030175 Oct 02 02:03:44.544463 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3733/7147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:44 2022] GET /compute/v2.1/servers/974389aa-2f4d-4171-9496-7c68b7912937 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.549043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.549557 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.555581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.556024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.556482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.557189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.557664 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.558106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.571749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 HTTP/1.1 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '947ca187-d838-4a42-b7fd-bae3679b42d4'} Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.573616 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9ea3812e-81f5-44a2-b64f-b091ab8e2957 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 404 len: 111 microversion: 2.1 time: 0.029764 Oct 02 02:03:44.581797 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3734/7148] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:03:44 2022] DELETE /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:03:44.584814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.585452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [instance: 947ca187-d838-4a42-b7fd-bae3679b42d4] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:44.591537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.592049 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.592515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.593316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:44.593808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:44.594262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:44.607893 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] HTTP exception thrown: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Request method failure captured: Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 HTTP/1.1 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOO_9iRoNvFWMQzTXHQaFBXNSfMjZ73ihQh9NOKRJ5A7VKmiDtOyzPI3-4Nz4j0ydfyjyrFtDp1qj04YQvpAEvMKXykSOWXY4cE_mSNMa8vAcU5lTwZhpEjrCMam_4fVGMjc3bsFvC_rAxc8qlZAAiMl2UtYi_xaF9IhTxgbtX0ACQho Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ea3f726ac484294b995890cfa5b0533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ea3f726ac484294b995890cfa5b0533"}]}] Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 0ea3f726ac484294b995890cfa5b0533 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServerActionsTestJSON-1816228411 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 2429d94874654da69f134916b5659877 Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServerActionsTestJSON-1816228411-project Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '947ca187-d838-4a42-b7fd-bae3679b42d4'} Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:03:44.609973 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Returning 404 to user: Instance 947ca187-d838-4a42-b7fd-bae3679b42d4 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e2d2ec1b-01bf-4b21-9741-23b15c07205c tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4" status: 404 len: 111 microversion: 2.1 time: 0.030633 Oct 02 02:03:44.617902 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3735/7149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:44 2022] GET /compute/v2.1/servers/947ca187-d838-4a42-b7fd-bae3679b42d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:03:44.619824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-08d2c86d-aeb2-43bb-b20c-dace095c4884 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] Calling method '.version_select at 0x7fb88002db80>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:44.624205 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08d2c86d-aeb2-43bb-b20c-dace095c4884 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [47c40a63-51e3-45d3-af8f-916b003895e8] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:03:45.631819 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [None req-08d2c86d-aeb2-43bb-b20c-dace095c4884 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] [47c40a63-51e3-45d3-af8f-916b003895e8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 57546. Oct 02 02:03:45.653530 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-08d2c86d-aeb2-43bb-b20c-dace095c4884 tempest-ServerActionsTestJSON-1816228411 tempest-ServerActionsTestJSON-1816228411-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820247347" status: 202 len: 0 microversion: 2.1 time: 1.037164 Oct 02 02:03:45.654396 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3736/7150] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 02:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820247347 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:03:55.007147 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=40 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:55.131654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1065187619", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "f08e124f-58d7-45b0-8e5a-c969f4d4dddc"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:55.194798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] validate_networks() for [('f08e124f-58d7-45b0-8e5a-c969f4d4dddc', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:03:55.601572 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:03:55.602016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:03:55.602542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:03:55.602997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:03:55.603431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:03:55.614487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:55.614971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:55.615493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:55.616416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:55.616953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:55.617576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:55.635465 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Getting quotas for project 9123a284aa514e8481ea676fd61ab9f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:03:55.641851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Getting quotas for user a45f3f8301994a87aac47bcd366c6605 and project 9123a284aa514e8481ea676fd61ab9f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:03:55.655455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:03:55.658565 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:03:55.715747 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aef9e9ca-2f82-4c2e-87e2-6c5004b39190 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710420 Oct 02 02:03:55.716628 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3737/7151] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:03:55.728180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e7441d3-b571-4c02-aa57-97e8dcaa03e4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:55.728820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e7441d3-b571-4c02-aa57-97e8dcaa03e4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:55.785003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7e7441d3-b571-4c02-aa57-97e8dcaa03e4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:55.795764 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e7441d3-b571-4c02-aa57-97e8dcaa03e4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1217 microversion: 2.1 time: 0.071441 Oct 02 02:03:55.798662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3738/7152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:55 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:56.821477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:56.822401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:56.829864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:56.830414 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:56.830896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:56.831629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:56.832107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:56.832730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:56.899893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:56.909795 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a247234-6370-462b-ba96-795e517bb7f5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1269 microversion: 2.1 time: 0.092063 Oct 02 02:03:56.922622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3739/7153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:56 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:03:57.933346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:57.934791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:57.944511 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:57.945551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:57.947149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:57.948388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:57.949066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:57.949717 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:58.153513 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:58.163663 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f333cb1e-d2ac-4dd3-845f-60eebc19d98e tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1317 microversion: 2.1 time: 0.234176 Oct 02 02:03:58.164872 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3740/7154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:57 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:03:58.803030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-65b4c03b-a410-4795-be02-832eb3626b75 req-8c4d79a9-2e0b-456f-af0d-d90410ee3f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e75319-1b52-4e8d-84f9-941a1e50ef30", "tag": "4ac2610b-efd6-41f6-bd36-7a313681ebb6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:03:58.814184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-65b4c03b-a410-4795-be02-832eb3626b75 req-8c4d79a9-2e0b-456f-af0d-d90410ee3f84 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:58.815518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-65b4c03b-a410-4795-be02-832eb3626b75 req-8c4d79a9-2e0b-456f-af0d-d90410ee3f84 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:58.815970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-65b4c03b-a410-4795-be02-832eb3626b75 req-8c4d79a9-2e0b-456f-af0d-d90410ee3f84 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:58.829335 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-65b4c03b-a410-4795-be02-832eb3626b75 req-8c4d79a9-2e0b-456f-af0d-d90410ee3f84 service nova] Creating event network-changed:4ac2610b-efd6-41f6-bd36-7a313681ebb6 for instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 on n-h2-master-1 Oct 02 02:03:58.834447 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-65b4c03b-a410-4795-be02-832eb3626b75 req-8c4d79a9-2e0b-456f-af0d-d90410ee3f84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035260 Oct 02 02:03:58.836186 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3741/7155] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:03:59.188326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:03:59.189106 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:03:59.196269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:59.196773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:59.197486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:59.198193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:03:59.198695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:03:59.199156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:03:59.339880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:03:59.348978 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6b67bd3-d288-4d79-81a4-607316bdc0ba tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1317 microversion: 2.1 time: 0.165046 Oct 02 02:03:59.349589 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3742/7156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:03:59 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:00.375716 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:00.376364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:00.383485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:00.383929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:00.384420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:00.385147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:00.385622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:00.386065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:00.517799 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:00.525515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7006113c-4394-4d6b-b201-f216466e187a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1317 microversion: 2.1 time: 0.154504 Oct 02 02:04:00.526179 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3743/7157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:00 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:01.548035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:01.548697 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:01.555521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:01.556019 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:01.556467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:01.557180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:01.557646 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:01.558085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:01.699547 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:01.708991 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20f5046d-1ebe-48a4-bcb4-e317ce3d8466 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1317 microversion: 2.1 time: 0.164809 Oct 02 02:04:01.709687 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3744/7158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:01 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:02.732713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:02.733341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:02.740976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:02.741483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:02.741940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:02.743011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:02.743392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:02.743837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:02.878241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:02.886450 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1c2ce25-792b-4406-bb7e-7924721deb4b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1317 microversion: 2.1 time: 0.157574 Oct 02 02:04:02.887486 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3745/7159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:02 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:02.893511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3f0858ed-9661-4ff0-8848-5a9593a3a06b req-a7261bf8-69a3-4a1d-8114-77130751aca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e75319-1b52-4e8d-84f9-941a1e50ef30", "name": "network-vif-plugged", "status": "completed", "tag": "4ac2610b-efd6-41f6-bd36-7a313681ebb6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:02.903385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f0858ed-9661-4ff0-8848-5a9593a3a06b req-a7261bf8-69a3-4a1d-8114-77130751aca6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:02.904076 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f0858ed-9661-4ff0-8848-5a9593a3a06b req-a7261bf8-69a3-4a1d-8114-77130751aca6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:02.904521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f0858ed-9661-4ff0-8848-5a9593a3a06b req-a7261bf8-69a3-4a1d-8114-77130751aca6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:02.916162 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3f0858ed-9661-4ff0-8848-5a9593a3a06b req-a7261bf8-69a3-4a1d-8114-77130751aca6 service nova] Creating event network-vif-plugged:4ac2610b-efd6-41f6-bd36-7a313681ebb6 for instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 on n-h2-master-1 Oct 02 02:04:02.921749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3f0858ed-9661-4ff0-8848-5a9593a3a06b req-a7261bf8-69a3-4a1d-8114-77130751aca6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032276 Oct 02 02:04:02.922470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3746/7160] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:04:03.910798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:03.911464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:03.918440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:03.918975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:03.919426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:03.920131 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:03.920598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:03.921044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:04.059067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:04.067322 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85319489-e09d-4a42-b2e0-525ff5e2dc61 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1317 microversion: 2.1 time: 0.161427 Oct 02 02:04:04.068073 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3747/7161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:03 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:05.091934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:05.092575 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:05.099477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:05.099970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:05.100418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:05.101117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:05.101582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:05.102020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:05.232698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:05.241068 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0b2acdad-f2fe-4218-8a79-b91ca2562e63 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.153101 Oct 02 02:04:05.241649 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3748/7162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:05 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:05.303030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-785348451", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "f08e124f-58d7-45b0-8e5a-c969f4d4dddc"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:05.359099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] validate_networks() for [('f08e124f-58d7-45b0-8e5a-c969f4d4dddc', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:04:05.625330 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:05.730116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:04:05.730636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:04:05.731142 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:04:05.731569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:04:05.731996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:04:05.741702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:05.742136 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:05.742590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:05.743366 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:05.743844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:05.744289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:05.761120 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Getting quotas for project 9123a284aa514e8481ea676fd61ab9f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:04:05.766689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Getting quotas for user a45f3f8301994a87aac47bcd366c6605 and project 9123a284aa514e8481ea676fd61ab9f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:04:05.779034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:04:05.782026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:04:05.826959 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fb074241-befe-4ba1-a126-964b0d35e21a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527844 Oct 02 02:04:05.828548 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3749/7163] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:04:05.839624 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c69b7ad0-5146-4395-93a3-86644b66ab28 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:05.840285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c69b7ad0-5146-4395-93a3-86644b66ab28 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:05.894774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c69b7ad0-5146-4395-93a3-86644b66ab28 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:05.904433 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c69b7ad0-5146-4395-93a3-86644b66ab28 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1216 microversion: 2.1 time: 0.068599 Oct 02 02:04:05.905019 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3750/7164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:05 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:06.928024 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:06.928696 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:06.935880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:06.936387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:06.936917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:06.937643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:06.938119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:06.938571 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:07.055407 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:07.064311 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1a81e312-4b29-4ec6-92f2-6a9414f6d43c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1286 microversion: 2.1 time: 0.140169 Oct 02 02:04:07.065039 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3751/7165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:06 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:08.093600 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:08.094210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:08.100972 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:08.108745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:08.109378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:08.109891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:08.110744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:08.111283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:08.111832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:08.313732 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:08.322198 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c3ef306-9731-485b-92f7-c7791e1dc1c4 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.232702 Oct 02 02:04:08.323197 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3752/7166] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:08 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:08.429491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-661cf1a4-6347-4dcd-9196-4e49f9017946 req-847197b2-7f61-4441-9777-5f1fa18c9ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a08231-c045-4a89-b794-4a07e4273830", "tag": "7123d8c2-76ae-4ac3-83df-7937a6c55935"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:08.440312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-661cf1a4-6347-4dcd-9196-4e49f9017946 req-847197b2-7f61-4441-9777-5f1fa18c9ede service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:08.440804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-661cf1a4-6347-4dcd-9196-4e49f9017946 req-847197b2-7f61-4441-9777-5f1fa18c9ede service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:08.441299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-661cf1a4-6347-4dcd-9196-4e49f9017946 req-847197b2-7f61-4441-9777-5f1fa18c9ede service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:08.452815 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-661cf1a4-6347-4dcd-9196-4e49f9017946 req-847197b2-7f61-4441-9777-5f1fa18c9ede service nova] Creating event network-changed:7123d8c2-76ae-4ac3-83df-7937a6c55935 for instance a5a08231-c045-4a89-b794-4a07e4273830 on n-h1-master-1 Oct 02 02:04:08.457983 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-661cf1a4-6347-4dcd-9196-4e49f9017946 req-847197b2-7f61-4441-9777-5f1fa18c9ede service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094227 Oct 02 02:04:08.458608 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3753/7167] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:04:09.347471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:09.348219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:09.355489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:09.355982 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:09.356427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:09.357129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:09.357594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:09.358030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:09.489804 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:09.497555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ddea6b48-407f-4c0f-8549-60a2f329b66b tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.155029 Oct 02 02:04:09.498128 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3754/7168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:09 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:10.520673 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:10.521313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:10.528153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:10.528648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:10.529094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:10.529795 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:10.530264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:10.530751 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:10.660744 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:10.668546 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0ade1968-3ac5-4432-bffe-0a2cc24d2dc7 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.151852 Oct 02 02:04:10.669123 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3755/7169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:10 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:11.692973 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:11.693630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:11.700712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:11.701201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:11.701647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:11.703149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:11.703633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:11.704075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:11.834509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:11.842235 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-67ad77d1-3ae3-4661-a4fc-7653606a84bc tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.153249 Oct 02 02:04:11.843355 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3756/7170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:11 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:12.865826 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:12.866514 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:12.873620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:12.874915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:12.875723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:12.876086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:12.876554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:12.876991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:13.007330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:13.015430 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d5a28fb-b7ed-4ab2-8d70-18c521e9f6c1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.153311 Oct 02 02:04:13.015740 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3757/7171] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:12 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:14.037526 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:14.038192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:14.045094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:14.045591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:14.046892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:14.047635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:14.048108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:14.048551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:14.181197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:14.184865 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=100 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:14.190161 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf7cb351-05c4-482d-999d-7de916151d26 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.156596 Oct 02 02:04:14.190765 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3758/7172] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:14 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:14.459692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-05f94ff6-29ec-4ffa-a59e-9def07f72367 req-29fb24d7-cac3-4170-a22b-d8116ba1cbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a08231-c045-4a89-b794-4a07e4273830", "name": "network-vif-plugged", "status": "completed", "tag": "7123d8c2-76ae-4ac3-83df-7937a6c55935"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:14.471433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-05f94ff6-29ec-4ffa-a59e-9def07f72367 req-29fb24d7-cac3-4170-a22b-d8116ba1cbd9 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:14.471949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-05f94ff6-29ec-4ffa-a59e-9def07f72367 req-29fb24d7-cac3-4170-a22b-d8116ba1cbd9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:14.472387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-05f94ff6-29ec-4ffa-a59e-9def07f72367 req-29fb24d7-cac3-4170-a22b-d8116ba1cbd9 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:14.483831 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-05f94ff6-29ec-4ffa-a59e-9def07f72367 req-29fb24d7-cac3-4170-a22b-d8116ba1cbd9 service nova] Creating event network-vif-plugged:7123d8c2-76ae-4ac3-83df-7937a6c55935 for instance a5a08231-c045-4a89-b794-4a07e4273830 on n-h1-master-1 Oct 02 02:04:14.488968 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-05f94ff6-29ec-4ffa-a59e-9def07f72367 req-29fb24d7-cac3-4170-a22b-d8116ba1cbd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032993 Oct 02 02:04:14.489564 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3759/7173] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:04:15.215084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:15.215802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:15.222756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:15.223263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:15.223729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:15.224417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:15.224888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:15.225333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:15.358436 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:15.366824 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fd36db8a-dbc7-45d7-9676-478bbd8641f0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1316 microversion: 2.1 time: 0.156917 Oct 02 02:04:15.367403 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3760/7174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:15 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:16.389397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:16.390739 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:16.392691 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:16.393437 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:16.400622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:16.401132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:16.401590 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:16.402307 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:16.402815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:16.403273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:16.537290 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:16.545072 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d262a849-3fa2-43a6-8e1d-baddfab5e016 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1504 microversion: 2.1 time: 0.159660 Oct 02 02:04:16.545646 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3761/7175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:16 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:16.567898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:16.568406 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:16.574319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:16.574857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:16.575304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:16.575998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:16.576462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:16.576896 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:16.601321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:04:16.675206 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8c1343d7-d535-4b4e-830c-19ae82d05f5c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 204 len: 0 microversion: 2.1 time: 0.110589 Oct 02 02:04:16.676124 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3762/7176] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:04:16 2022] DELETE /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:04:16.684421 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:16.685137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:16.691716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:16.692207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:16.692649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:16.693377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:16.693850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:16.694287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:16.830053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:16.838323 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f42144ff-b4c3-4545-8b50-d2ce78bf6bf5 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1510 microversion: 2.1 time: 0.158135 Oct 02 02:04:16.838958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3763/7177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:16 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:17.862076 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:17.862785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:17.869794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:17.870298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:17.870781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:17.871495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:17.871961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:17.872403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:18.007314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:18.015702 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2aedc4c-5eec-4210-9f4e-a78569d67392 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1510 microversion: 2.1 time: 0.158163 Oct 02 02:04:18.016205 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3764/7178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:17 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:18.661324 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-412c16e8-8563-45d4-bfe9-9bb8701ab3eb req-2e3631c1-f415-485a-aa79-a360d8100cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a08231-c045-4a89-b794-4a07e4273830", "name": "network-vif-deleted", "tag": "7123d8c2-76ae-4ac3-83df-7937a6c55935"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:18.675346 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-412c16e8-8563-45d4-bfe9-9bb8701ab3eb req-2e3631c1-f415-485a-aa79-a360d8100cdc service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:18.675864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-412c16e8-8563-45d4-bfe9-9bb8701ab3eb req-2e3631c1-f415-485a-aa79-a360d8100cdc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:18.676320 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-412c16e8-8563-45d4-bfe9-9bb8701ab3eb req-2e3631c1-f415-485a-aa79-a360d8100cdc service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:18.694140 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-412c16e8-8563-45d4-bfe9-9bb8701ab3eb req-2e3631c1-f415-485a-aa79-a360d8100cdc service nova] Creating event network-vif-deleted:7123d8c2-76ae-4ac3-83df-7937a6c55935 for instance a5a08231-c045-4a89-b794-4a07e4273830 on n-h1-master-1 Oct 02 02:04:18.699862 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-412c16e8-8563-45d4-bfe9-9bb8701ab3eb req-2e3631c1-f415-485a-aa79-a360d8100cdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042268 Oct 02 02:04:18.705401 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3765/7179] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:04:19.040735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:19.041494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:19.048453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:19.048959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:19.049417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:19.050128 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:19.050621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:19.051080 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:19.083209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:19.083714 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:19.084182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:19.084655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lazy-loading 'fault' on Instance uuid a5a08231-c045-4a89-b794-4a07e4273830 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:04:19.130203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:19.138428 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c459c8f4-2ca5-4e6c-b4be-d1ec1219c176 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 200 len: 1306 microversion: 2.1 time: 0.102859 Oct 02 02:04:19.139398 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3766/7180] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:19 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:20.162090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:20.162779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.169549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.170048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.170502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.171979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.172464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.172910 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.186378 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] HTTP exception thrown: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 HTTP/1.1 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a5a08231-c045-4a89-b794-4a07e4273830'} Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:20.188125 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 404 to user: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0f7cc98-f061-4b54-b4f1-1f382fde622a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 404 len: 111 microversion: 2.1 time: 0.031507 Oct 02 02:04:20.192756 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3767/7181] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:20 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:04:20.198748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:20.199384 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.205416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.205919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.206371 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.207129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.207597 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.208047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.339166 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:20.348980 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ad9e2596-aee9-489d-a197-f59d9dbc854d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.153919 Oct 02 02:04:20.349803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3768/7182] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:20 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:04:20.371912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2561b2ea-7fe6-4711-bc1c-48aeba817433 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:20.374323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2561b2ea-7fe6-4711-bc1c-48aeba817433 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.379787 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-2561b2ea-7fe6-4711-bc1c-48aeba817433 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] HTTP exception thrown: Instance 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc could not be found. Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2561b2ea-7fe6-4711-bc1c-48aeba817433 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc/action HTTP/1.1 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 32 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: {"resize": {"flavorRef": "452"}} Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc could not be found. Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc', 'body': {'resize': {'flavorRef': '452'}}} Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc could not be found. Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:04:20.381535 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc could not be found. Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc could not be found. Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2561b2ea-7fe6-4711-bc1c-48aeba817433 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 404 to user: Instance 041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2561b2ea-7fe6-4711-bc1c-48aeba817433 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "POST /compute/v2.1/servers/041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc/action" status: 404 len: 111 microversion: 2.1 time: 0.014787 Oct 02 02:04:20.385924 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3769/7183] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:04:20 2022] POST /compute/v2.1/servers/041e2cd9-31c7-49c0-8a3b-02fdff5c9ecc/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:04:20.391768 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:20.392388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.398730 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.399222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.399676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.400375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.400841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.401275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.527496 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:20.536834 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-309f51cc-a1cc-42f4-888b-900733ffc990 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.149286 Oct 02 02:04:20.537412 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3770/7184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:20 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:20.561918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:20.562449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.568494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.569021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.569474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.570177 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.570678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.571123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.702630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:20.710484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9beb87fe-3195-4cb2-b8f7-fafe2c7d7bc9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.154043 Oct 02 02:04:20.711100 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3771/7185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:20 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:20.734786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "5d89c3b2-e10c-40f4-b818-66c55e81039a"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:20.737055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.742950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.743453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.743905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.744618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.745089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.745531 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.784950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:20.790109 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] HTTP exception thrown: Flavor 5d89c3b2-e10c-40f4-b818-66c55e81039a could not be found. Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30/action HTTP/1.1 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 65 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: {"resize": {"flavorRef": "5d89c3b2-e10c-40f4-b818-66c55e81039a"}} Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: exception: Flavor 5d89c3b2-e10c-40f4-b818-66c55e81039a could not be found. Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '05e75319-1b52-4e8d-84f9-941a1e50ef30', 'body': {'resize': {'flavorRef': '5d89c3b2-e10c-40f4-b818-66c55e81039a'}}} Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:20.792014 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5d89c3b2-e10c-40f4-b818-66c55e81039a could not be found. Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 5d89c3b2-e10c-40f4-b818-66c55e81039a could not be found. Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5d89c3b2-e10c-40f4-b818-66c55e81039a could not be found. Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 400 to user: Flavor 5d89c3b2-e10c-40f4-b818-66c55e81039a could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4c28c77c-d89d-49d6-bdf1-29abc127fee9 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "POST /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30/action" status: 400 len: 107 microversion: 2.1 time: 0.063299 Oct 02 02:04:20.797364 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3772/7186] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:04:20 2022] POST /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30/action => generated 107 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 02:04:20.802431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:20.803113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.808853 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.809350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.809802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.810505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.811005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.811831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.940993 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:20.949106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f012c5ba-d783-404c-af89-5e4e08a77e46 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.150213 Oct 02 02:04:20.949684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3773/7187] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:20 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:04:20.972639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:20.973270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:20.979205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.979704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.980153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:20.980861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:20.981331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:20.981771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.114814 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:21.122592 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1b87ac6e-de92-479f-b962-b970cdbc6b7d tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.153764 Oct 02 02:04:21.123187 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3774/7188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:20 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:21.145477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e878f418-1295-46c7-b899-db928c7f82d1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e878f418-1295-46c7-b899-db928c7f82d1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: request: POST /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30/action HTTP/1.1 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 29 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: {"resize": {"flavorRef": ""}} Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '05e75319-1b52-4e8d-84f9-941a1e50ef30', 'body': {'resize': {'flavorRef': ''}}} Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise error Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi '' Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.156895 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e878f418-1295-46c7-b899-db928c7f82d1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e878f418-1295-46c7-b899-db928c7f82d1 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "POST /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30/action" status: 400 len: 113 microversion: 2.1 time: 0.016709 Oct 02 02:04:21.161792 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3775/7189] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:04:21 2022] POST /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30/action => generated 113 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 02 02:04:21.166368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:21.167020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:21.174801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.175301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.175755 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.176473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.176945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.177390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.306699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:21.314795 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e59e2af-501e-4307-a44c-1c6905eb9acf tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1505 microversion: 2.1 time: 0.151782 Oct 02 02:04:21.315352 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3776/7190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:21 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:21.341380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:21.341892 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:21.348814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.349322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.349778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.350495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.351002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.351459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.367817 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] HTTP exception thrown: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 HTTP/1.1 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a5a08231-c045-4a89-b794-4a07e4273830'} Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:04:21.369571 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 404 to user: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5926349a-ce78-4764-bd19-f38dce33951a tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 404 len: 111 microversion: 2.1 time: 0.033270 Oct 02 02:04:21.373947 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3777/7191] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:04:21 2022] DELETE /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:04:21.379541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:21.380197 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: a5a08231-c045-4a89-b794-4a07e4273830] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:21.386589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.387121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.387570 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.388269 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.388736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.389176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.402997 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] HTTP exception thrown: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 HTTP/1.1 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: exception: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'a5a08231-c045-4a89-b794-4a07e4273830'} Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:21.404452 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 404 to user: Instance a5a08231-c045-4a89-b794-4a07e4273830 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f4feb53-eb7b-4aa7-9f70-5d68d78a51ac tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830" status: 404 len: 111 microversion: 2.1 time: 0.030598 Oct 02 02:04:21.410030 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3778/7192] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:21 2022] GET /compute/v2.1/servers/a5a08231-c045-4a89-b794-4a07e4273830 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:04:21.414703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:21.415390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:21.421193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.421784 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.422245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.422980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.423455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.423900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.428030 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:21.452451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:04:21.526020 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-94ee1edc-2607-44b2-8cb5-81fba45bc7da tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 204 len: 0 microversion: 2.1 time: 0.114628 Oct 02 02:04:21.526668 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3779/7193] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:04:21 2022] DELETE /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:04:21.535741 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:21.536461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:21.542540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.543075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.543532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.544276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:21.544782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:21.545224 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:21.681323 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:21.689468 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac278269-e1aa-4d7f-8cf8-ce598c3ec7c0 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1511 microversion: 2.1 time: 0.157742 Oct 02 02:04:21.690054 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3780/7194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:21 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:22.713996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:22.715206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:22.723918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:22.724816 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:22.725404 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:22.726258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:22.726776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:22.727228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:22.859528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:22.867312 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68443d94-9b36-4e1d-8f44-7b744065cf14 tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1511 microversion: 2.1 time: 0.157943 Oct 02 02:04:22.867894 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3781/7195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:22 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:23.508333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-6007e13b-3d09-4fcc-a653-5a0424983f83 req-78ce4c48-8f84-4d13-9318-ae5813074ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e75319-1b52-4e8d-84f9-941a1e50ef30", "name": "network-vif-deleted", "tag": "4ac2610b-efd6-41f6-bd36-7a313681ebb6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:23.519977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6007e13b-3d09-4fcc-a653-5a0424983f83 req-78ce4c48-8f84-4d13-9318-ae5813074ecf service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:23.520577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6007e13b-3d09-4fcc-a653-5a0424983f83 req-78ce4c48-8f84-4d13-9318-ae5813074ecf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:23.521095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-6007e13b-3d09-4fcc-a653-5a0424983f83 req-78ce4c48-8f84-4d13-9318-ae5813074ecf service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:23.533744 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-6007e13b-3d09-4fcc-a653-5a0424983f83 req-78ce4c48-8f84-4d13-9318-ae5813074ecf service nova] Creating event network-vif-deleted:4ac2610b-efd6-41f6-bd36-7a313681ebb6 for instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 on n-h2-master-1 Oct 02 02:04:23.539285 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-6007e13b-3d09-4fcc-a653-5a0424983f83 req-78ce4c48-8f84-4d13-9318-ae5813074ecf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035039 Oct 02 02:04:23.540268 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3782/7196] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:04:23.893316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:23.893991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:23.900226 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:23.900728 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:23.901183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:23.901886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:23.902358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:23.902830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:23.933605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:23.934098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:23.934541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:23.935031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lazy-loading 'fault' on Instance uuid 05e75319-1b52-4e8d-84f9-941a1e50ef30 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:04:23.978849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45f3f8301994a87aac47bcd366c6605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9123a284aa514e8481ea676fd61ab9f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:04:23.986924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a7bb3ef-224b-47f7-83eb-0afa0ba4e9cd tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 200 len: 1307 microversion: 2.1 time: 0.099271 Oct 02 02:04:23.987510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3783/7197] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:23 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:04:25.012006 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:04:25.012692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] [instance: 05e75319-1b52-4e8d-84f9-941a1e50ef30] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:04:25.019715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:25.020217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:25.020676 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:25.021385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:04:25.021859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:04:25.022305 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:04:25.038458 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] HTTP exception thrown: Instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 could not be found. Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Request method failure captured: Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 HTTP/1.1 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPGK3Y4p9GNvINBLYvLNBJ0l1FD9kwwCe-Bj03L9HNaGqZHcqsjrkV-rfVsbeqQeAG0meoTA2ZHmSN4G4mZUWBapklJaJSlbOXrVn6z603TxM07rfcYxMKP8UbWfnrI1wcq-60jI0z8S1T7SgHqhhISK7MCze3JWsxZorWlRLoxFUmQ Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9123a284aa514e8481ea676fd61ab9f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9123a284aa514e8481ea676fd61ab9f7"}]}] Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 9123a284aa514e8481ea676fd61ab9f7 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1186280672 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: a45f3f8301994a87aac47bcd366c6605 Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-ServersNegativeTestJSON-1186280672-project Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 could not be found. Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '05e75319-1b52-4e8d-84f9-941a1e50ef30'} Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 could not be found. Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 could not be found. Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:04:25.040128 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 could not be found. Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] Returning 404 to user: Instance 05e75319-1b52-4e8d-84f9-941a1e50ef30 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f541d32a-5122-4d43-a468-8c5dc53e6b3c tempest-ServersNegativeTestJSON-1186280672 tempest-ServersNegativeTestJSON-1186280672-project] 10.222.0.23 "GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30" status: 404 len: 111 microversion: 2.1 time: 0.033568 Oct 02 02:04:25.044438 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3784/7198] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:04:25 2022] GET /compute/v2.1/servers/05e75319-1b52-4e8d-84f9-941a1e50ef30 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:04:51.449563 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:04:51.450043 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:04:59.596877 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:59.597792 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:59.832849 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7c7647d7-1bc0-4a5a-81ed-994ef52da9a1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: .version_select at 0x7fb881ce78b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-123824955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGds+t9kBTMG8/hKfa/qsIi64OHgkNQpWLnLsKSg9NK10/cUAvFXKF0rVJhGiFVlZXuxmbsmA4xVekfroemiPGN7f2rjdQ14vOhM9zifnzx8Xbfg9bY/dItPA1PaQQvOFQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:04:59.849670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7c7647d7-1bc0-4a5a-81ed-994ef52da9a1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:04:59.856046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-7c7647d7-1bc0-4a5a-81ed-994ef52da9a1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for user 66aadeddc0524f2ab7c167aae9a30468 and project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:04:59.885767 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7c7647d7-1bc0-4a5a-81ed-994ef52da9a1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.290623 Oct 02 02:04:59.886685 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3785/7199] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:04:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:04:59.949418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-921122776", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-123824955", "networks": [{"uuid": "4d1d6dfe-9a48-4b27-b236-cfab19eddbb8"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:00.014413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] validate_networks() for [('4d1d6dfe-9a48-4b27-b236-cfab19eddbb8', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:05:00.525117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:05:00.525584 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:05:00.526071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:05:00.526492 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:05:00.526953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:05:00.535946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:00.536436 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:00.536880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:00.537610 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:00.538077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:00.538514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:00.555302 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:05:00.560504 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for user 66aadeddc0524f2ab7c167aae9a30468 and project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:05:00.573287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:05:00.575889 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:05:00.624336 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b18dfd04-3e79-499d-9eee-2e27d7c07bc0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679135 Oct 02 02:05:00.633779 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3786/7200] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:05:00.640296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-22911ff3-0ba5-4b92-ba59-6b27593a807d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:00.641441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-22911ff3-0ba5-4b92-ba59-6b27593a807d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:00.699208 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-22911ff3-0ba5-4b92-ba59-6b27593a807d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:00.707154 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-22911ff3-0ba5-4b92-ba59-6b27593a807d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1261 microversion: 2.1 time: 0.071001 Oct 02 02:05:00.707767 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3787/7201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:00 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:01.731396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:01.732068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:01.745533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:01.747119 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:01.747775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:01.748686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:01.749314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:01.751645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:01.834491 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:01.848451 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1e28b48f-036e-4478-8f71-ad8a255efc6b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1321 microversion: 2.1 time: 0.121168 Oct 02 02:05:01.862711 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3788/7202] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:01 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1321 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:02.876701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:02.877499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:02.884844 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:02.885643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:02.886278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:02.887216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:02.887808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:02.888480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:03.108280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:03.117465 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7364e927-4455-471c-9345-a1b9433aa286 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.246349 Oct 02 02:05:03.118056 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3789/7203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:02 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:03.396606 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-df7bedf5-5257-49d8-8abd-c3905281fe32 req-eeb89ec5-09e0-44c1-9f6b-effeed440d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8022cf-8b9a-449b-a745-a3a22998a7b7", "tag": "1f4e737e-b917-4e4e-a3c4-ee166f89cca5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:03.408367 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df7bedf5-5257-49d8-8abd-c3905281fe32 req-eeb89ec5-09e0-44c1-9f6b-effeed440d90 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:03.408871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df7bedf5-5257-49d8-8abd-c3905281fe32 req-eeb89ec5-09e0-44c1-9f6b-effeed440d90 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:03.409328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-df7bedf5-5257-49d8-8abd-c3905281fe32 req-eeb89ec5-09e0-44c1-9f6b-effeed440d90 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:03.421295 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-df7bedf5-5257-49d8-8abd-c3905281fe32 req-eeb89ec5-09e0-44c1-9f6b-effeed440d90 service nova] Creating event network-changed:1f4e737e-b917-4e4e-a3c4-ee166f89cca5 for instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 on n-h1-master-1 Oct 02 02:05:03.426927 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-df7bedf5-5257-49d8-8abd-c3905281fe32 req-eeb89ec5-09e0-44c1-9f6b-effeed440d90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034773 Oct 02 02:05:03.427880 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3790/7204] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:04.145654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:04.146387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:04.153805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:04.154322 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:04.154822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:04.155544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:04.156697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:04.157333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:04.294270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:04.302366 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d97340fe-dba5-44e2-af44-60e647ca08e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.161602 Oct 02 02:05:04.302988 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3791/7205] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:04 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:05.326554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:05.327218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:05.334290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:05.334871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:05.335321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:05.336025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:05.336493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:05.336933 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:05.465929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:05.474163 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a9f2168-c2f7-4500-823d-cffad2919c33 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.152051 Oct 02 02:05:05.474820 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3792/7206] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:05 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:06.497449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:06.498118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:06.505247 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:06.505748 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:06.506205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:06.506954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:06.507431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:06.507878 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:06.646912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:06.655150 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48dc8660-b6b0-439a-b2ff-14d370463ac3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.161624 Oct 02 02:05:06.655757 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3793/7207] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:06 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:07.679236 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:07.679911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:07.686705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:07.687204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:07.687670 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:07.688374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:07.688872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:07.689317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:07.817582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:07.825711 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ebb057dd-5820-4c7f-8cae-148f2c35ebee tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.150493 Oct 02 02:05:07.826298 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3794/7208] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:07 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:08.811712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bb9a85b3-3afe-468f-8d61-384e86a3faff req-3dfe0bb8-cef5-4488-bcba-34652f52a887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8022cf-8b9a-449b-a745-a3a22998a7b7", "name": "network-vif-plugged", "status": "completed", "tag": "1f4e737e-b917-4e4e-a3c4-ee166f89cca5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:08.821622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb9a85b3-3afe-468f-8d61-384e86a3faff req-3dfe0bb8-cef5-4488-bcba-34652f52a887 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:08.822139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb9a85b3-3afe-468f-8d61-384e86a3faff req-3dfe0bb8-cef5-4488-bcba-34652f52a887 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:08.822593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bb9a85b3-3afe-468f-8d61-384e86a3faff req-3dfe0bb8-cef5-4488-bcba-34652f52a887 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:08.834339 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bb9a85b3-3afe-468f-8d61-384e86a3faff req-3dfe0bb8-cef5-4488-bcba-34652f52a887 service nova] Creating event network-vif-plugged:1f4e737e-b917-4e4e-a3c4-ee166f89cca5 for instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 on n-h1-master-1 Oct 02 02:05:08.839522 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bb9a85b3-3afe-468f-8d61-384e86a3faff req-3dfe0bb8-cef5-4488-bcba-34652f52a887 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092211 Oct 02 02:05:08.840342 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3795/7209] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:08.848708 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:08.849467 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:08.855687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:08.856184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:08.856636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:08.857338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:08.857808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:08.858251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:09.058387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:09.066263 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0397cdad-8109-4d0d-9473-083cf8ef2254 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.221614 Oct 02 02:05:09.066873 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3796/7210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:08 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:05:10.089342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:10.089960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:10.097208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:10.097710 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:10.098168 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:10.098914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:10.099392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:10.099837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:10.244136 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:10.252505 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90646087-aa92-4b50-acf6-4457c465d69c tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1361 microversion: 2.1 time: 0.167095 Oct 02 02:05:10.253078 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3797/7211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:10 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:11.276190 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:11.276883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:11.278929 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:11.279650 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:11.287467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:11.287962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:11.288421 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:11.289132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:11.289609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:11.290053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:11.430806 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:11.438994 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8dd62889-da84-4cd5-9d3d-1a2a0113a655 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1553 microversion: 2.1 time: 0.166843 Oct 02 02:05:11.439567 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3798/7212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:11 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:11.461589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:11.462218 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:11.468114 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:11.469106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:11.469699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:11.470416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:11.470922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:11.471373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:11.603463 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:11.611662 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-39d59e21-efa5-4ab0-beff-d6a7ead5b2b9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1553 microversion: 2.1 time: 0.153705 Oct 02 02:05:11.612250 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3799/7213] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:11 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:13.218275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9d50cb-8f99-47d9-affd-322f3d3528cd"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:13.220970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:13.227875 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:13.228376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:13.228832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:13.229539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:13.230055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:13.230505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:13.489752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e683885-1304-470c-bf17-992081a35c34 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275261 Oct 02 02:05:13.490417 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3800/7214] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 02:05:13 2022] POST /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:24.210793 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:24.211592 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:24.215997 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:24.216630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:24.224903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:24.225403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:24.225859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:24.226578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:24.232943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:24.233418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:24.323738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lazy-loading 'services' on Instance uuid 5a8022cf-8b9a-449b-a745-a3a22998a7b7 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:05:24.397760 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0e6e899e-6df5-4801-81c0-54cd4e980d66 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments/0d9d50cb-8f99-47d9-affd-322f3d3528cd" status: 202 len: 0 microversion: 2.1 time: 0.188545 Oct 02 02:05:24.398450 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3801/7215] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:05:24 2022] DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments/0d9d50cb-8f99-47d9-affd-322f3d3528cd => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:05:24.407576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:24.410086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:24.417394 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:24.418412 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:24.419093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:24.419981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:24.420493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:24.420953 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:24.455360 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-208bd0b0-8b52-40e2-9bef-e3afa748e2fd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051902 Oct 02 02:05:24.455939 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3802/7216] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:05:24 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:25.468231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:25.471141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:25.478043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:25.478541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:25.479026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:25.480332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:25.480813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:25.481258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:25.512516 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-92d2db4a-6c2c-4628-b1a4-1a9207dd5ef5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Oct 02 02:05:25.513011 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3803/7217] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:05:25 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:26.525582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:26.527932 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:26.535365 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:26.535981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:26.536439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:26.537174 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:26.537645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:26.538087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:26.572752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b293536d-dc04-4d4a-bced-911c8e9ae4d5 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051212 Oct 02 02:05:26.573365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3804/7218] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:05:26 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:27.586280 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:27.588489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:27.596201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:27.596697 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:27.597153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:27.597871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:27.598340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:27.598808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:27.629439 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-183e3174-8854-48ad-81c8-6e2b0a455719 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047121 Oct 02 02:05:27.630203 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3805/7219] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:05:27 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:28.642239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:28.644483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:28.651423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:28.651917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:28.652368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:28.653077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:28.653548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:28.653986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:28.687685 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ece53eb6-3736-498a-8b28-28fbb08d8139 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049603 Oct 02 02:05:28.688569 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3806/7220] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:05:28 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:29.699712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:29.701894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:29.709054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:29.709548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:29.709995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:29.710715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:29.711186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:29.711624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:29.741012 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85c22497-aca7-43d3-ba1b-da422f44ab27 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045626 Oct 02 02:05:29.741676 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3807/7221] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:05:29 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 02:05:29.752994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:29.753500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:29.759228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:29.759729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:29.760179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:29.760885 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:29.761355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:29.761799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:29.836543 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] HTTP exception thrown: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 is not attached to volume 0d9d50cb-8f99-47d9-affd-322f3d3528cd Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Request method failure captured: Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments/0d9d50cb-8f99-47d9-affd-322f3d3528cd HTTP/1.1 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPHFfsZ_fzFtgK7kQ3518q0KqRz7M0gvt9u4R4prYpCzaxmJn6OSJdVBhfr4xYZXfFgEiDWB8bGqPDrhs8LwaTj6rOai_Gs1ZAo74oeZL1ODbm0uhJNFEKQYXJKWKICheNYZHTxh3rpNFcAJVxC_-JAmZMN1eOr_p_0iFvbVxEne4Nk Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b7a97088bd433ebe3a0a70f027de2f"}]}] Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66aadeddc0524f2ab7c167aae9a30468 Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 is not attached to volume 0d9d50cb-8f99-47d9-affd-322f3d3528cd Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '5a8022cf-8b9a-449b-a745-a3a22998a7b7', 'id': '0d9d50cb-8f99-47d9-affd-322f3d3528cd'} Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0d9d50cb-8f99-47d9-affd-322f3d3528cd. Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 is not attached to volume 0d9d50cb-8f99-47d9-affd-322f3d3528cd Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:05:29.849717 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 is not attached to volume 0d9d50cb-8f99-47d9-affd-322f3d3528cd Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Returning 404 to user: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 is not attached to volume 0d9d50cb-8f99-47d9-affd-322f3d3528cd {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1934be8-f1d9-4730-ac79-e426d29fb729 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments/0d9d50cb-8f99-47d9-affd-322f3d3528cd" status: 404 len: 154 microversion: 2.1 time: 0.102613 Oct 02 02:05:29.854552 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3808/7222] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:05:29 2022] DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7/os-volume_attachments/0d9d50cb-8f99-47d9-affd-322f3d3528cd => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:05:33.201137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:33.201839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:33.211499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:33.212020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:33.212488 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:33.213459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:33.214368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:33.215266 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:33.249836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:05:33.329217 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8f53a4e6-12e1-4396-a61a-7629b343c209 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 204 len: 0 microversion: 2.1 time: 0.131987 Oct 02 02:05:33.330632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3809/7223] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:05:33 2022] DELETE /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:05:33.339458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:33.340180 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:33.346949 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:33.347516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:33.347964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:33.348671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:33.349180 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:33.349603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:33.486909 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:33.494947 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-525be4bd-e3e3-4fbb-ae87-f26c107b1043 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1559 microversion: 2.1 time: 0.159952 Oct 02 02:05:33.495616 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3810/7224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:33 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:34.519063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:34.519721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:34.526733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:34.527230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:34.527680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:34.528382 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:34.528846 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:34.529285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:34.658876 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:34.666568 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-962dea83-b0b2-4ec3-acec-41fd7abdb2e3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1559 microversion: 2.1 time: 0.151577 Oct 02 02:05:34.667162 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3811/7225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:34 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:35.543443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a8230995-cd8d-4780-afe7-801f01816446 req-d2c5a17d-c325-4e40-a463-d8b4da716957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8022cf-8b9a-449b-a745-a3a22998a7b7", "name": "network-vif-deleted", "tag": "1f4e737e-b917-4e4e-a3c4-ee166f89cca5"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:35.556840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a8230995-cd8d-4780-afe7-801f01816446 req-d2c5a17d-c325-4e40-a463-d8b4da716957 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:35.557234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a8230995-cd8d-4780-afe7-801f01816446 req-d2c5a17d-c325-4e40-a463-d8b4da716957 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:35.557680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a8230995-cd8d-4780-afe7-801f01816446 req-d2c5a17d-c325-4e40-a463-d8b4da716957 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:35.582380 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a8230995-cd8d-4780-afe7-801f01816446 req-d2c5a17d-c325-4e40-a463-d8b4da716957 service nova] Creating event network-vif-deleted:1f4e737e-b917-4e4e-a3c4-ee166f89cca5 for instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 on n-h1-master-1 Oct 02 02:05:35.587466 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a8230995-cd8d-4780-afe7-801f01816446 req-d2c5a17d-c325-4e40-a463-d8b4da716957 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047710 Oct 02 02:05:35.588267 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3812/7226] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:35.695582 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:35.697187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:35.704449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:35.705048 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:35.705516 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:35.706698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:35.706917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:35.707375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:35.740306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:35.740872 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:35.741280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:35.741737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lazy-loading 'fault' on Instance uuid 5a8022cf-8b9a-449b-a745-a3a22998a7b7 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:05:35.783053 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:35.791712 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-73ef0e29-ca07-4408-9ff5-582a6636e739 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 200 len: 1351 microversion: 2.1 time: 0.102782 Oct 02 02:05:35.792297 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3813/7227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:35 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:05:36.815607 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:36.816297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 5a8022cf-8b9a-449b-a745-a3a22998a7b7] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:36.823043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:36.823532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:36.823980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:36.824930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:36.825396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:36.825859 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:36.839535 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] HTTP exception thrown: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 could not be found. Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Request method failure captured: Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 HTTP/1.1 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPHFfsZ_fzFtgK7kQ3518q0KqRz7M0gvt9u4R4prYpCzaxmJn6OSJdVBhfr4xYZXfFgEiDWB8bGqPDrhs8LwaTj6rOai_Gs1ZAo74oeZL1ODbm0uhJNFEKQYXJKWKICheNYZHTxh3rpNFcAJVxC_-JAmZMN1eOr_p_0iFvbVxEne4Nk Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b7a97088bd433ebe3a0a70f027de2f"}]}] Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66aadeddc0524f2ab7c167aae9a30468 Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 could not be found. Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '5a8022cf-8b9a-449b-a745-a3a22998a7b7'} Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 could not be found. Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 could not be found. Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:36.841177 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 could not be found. Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Returning 404 to user: Instance 5a8022cf-8b9a-449b-a745-a3a22998a7b7 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-36edb5f9-03cd-4a7c-a9a8-fd4ed1e5b434 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7" status: 404 len: 111 microversion: 2.1 time: 0.031078 Oct 02 02:05:36.846387 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3814/7228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:36 2022] GET /compute/v2.1/servers/5a8022cf-8b9a-449b-a745-a3a22998a7b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:05:36.851803 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a532e7ea-fffe-48e6-909c-4d44c51a0e43 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '.version_select at 0x7fb8818d6670>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:36.872527 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a532e7ea-fffe-48e6-909c-4d44c51a0e43 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-123824955" status: 202 len: 0 microversion: 2.1 time: 0.024553 Oct 02 02:05:36.873117 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3815/7229] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 02:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-123824955 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:05:36.890471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b52499d6-db5c-4949-9e31-bd2a1fae1335 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: .version_select at 0x7fb880bde8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-574239898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA10rIrvshqB0cKYyEKJ0OmBpMvqaIyoVvdXexpuNmKT2fJ1HWQ1QQM+DRsJA2/LZVFAe4cWc2O4I0Zv/nDPgSM4Kx4G3MtwogoikpQt6lD/Di222u8QA0tZSSExujkoA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:36.906511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b52499d6-db5c-4949-9e31-bd2a1fae1335 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:05:36.912441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b52499d6-db5c-4949-9e31-bd2a1fae1335 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for user 66aadeddc0524f2ab7c167aae9a30468 and project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:05:36.937623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b52499d6-db5c-4949-9e31-bd2a1fae1335 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050814 Oct 02 02:05:36.938271 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3816/7230] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:05:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:36.989365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2053839548", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-574239898", "networks": [{"uuid": "4d1d6dfe-9a48-4b27-b236-cfab19eddbb8"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:37.042487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] validate_networks() for [('4d1d6dfe-9a48-4b27-b236-cfab19eddbb8', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:05:37.410534 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:05:37.411002 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:05:37.411488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:05:37.411907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:05:37.412330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:05:37.420985 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:37.421476 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:37.421924 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:37.422687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:37.423159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:37.424184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:37.441064 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:05:37.446336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for user 66aadeddc0524f2ab7c167aae9a30468 and project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:05:37.458712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:05:37.461012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:05:37.508776 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9fb1562-ddca-4dd9-9141-cee1f08c02d1 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524039 Oct 02 02:05:37.509660 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3817/7231] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:05:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:05:37.521283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef2ffb70-c12e-48bb-bcbf-6bbd44901fb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:37.521916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef2ffb70-c12e-48bb-bcbf-6bbd44901fb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:37.587657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ef2ffb70-c12e-48bb-bcbf-6bbd44901fb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:37.596001 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef2ffb70-c12e-48bb-bcbf-6bbd44901fb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1262 microversion: 2.1 time: 0.078596 Oct 02 02:05:37.596766 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3818/7232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:37 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:05:38.620056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:38.620698 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:38.628150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:38.628654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:38.629126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:38.629820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:38.630286 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:38.630752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:38.696918 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:38.701271 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:38.707148 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e63f093-2842-4ae3-993a-c2fc342b4d2e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1322 microversion: 2.1 time: 0.091570 Oct 02 02:05:38.707978 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3819/7233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:38 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:05:39.732687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:39.733321 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:39.742345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:39.742882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:39.743336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:39.744055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:39.744526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:39.744967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:39.879200 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:39.894721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-023c3e8d-20ed-4cd3-8249-05244ef5d51e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.165923 Oct 02 02:05:39.895337 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3820/7234] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:39 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:40.126512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9eccafa2-1091-42c5-86ed-9fa802f8d375 req-3ca2b05a-b283-4c8b-a2a5-746e05068dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a4730f-c84b-4372-8e06-9ba78c467451", "tag": "fcc82096-c8dd-4140-a2dc-17717bc74ae2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:40.138089 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9eccafa2-1091-42c5-86ed-9fa802f8d375 req-3ca2b05a-b283-4c8b-a2a5-746e05068dd6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:40.138841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9eccafa2-1091-42c5-86ed-9fa802f8d375 req-3ca2b05a-b283-4c8b-a2a5-746e05068dd6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:40.139288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9eccafa2-1091-42c5-86ed-9fa802f8d375 req-3ca2b05a-b283-4c8b-a2a5-746e05068dd6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:40.150855 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9eccafa2-1091-42c5-86ed-9fa802f8d375 req-3ca2b05a-b283-4c8b-a2a5-746e05068dd6 service nova] Creating event network-changed:fcc82096-c8dd-4140-a2dc-17717bc74ae2 for instance d7a4730f-c84b-4372-8e06-9ba78c467451 on n-h2-master-1 Oct 02 02:05:40.155788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9eccafa2-1091-42c5-86ed-9fa802f8d375 req-3ca2b05a-b283-4c8b-a2a5-746e05068dd6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089438 Oct 02 02:05:40.156554 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3821/7235] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:40.919210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:40.919922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:40.927469 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:40.927969 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:40.928415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:40.929116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:40.929583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:40.930021 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:41.063854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:41.071812 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85da4520-c908-49b5-be14-fc6a1d4bf676 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.157061 Oct 02 02:05:41.072391 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3822/7236] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:40 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:42.096612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:42.097354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:42.104433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:42.104925 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:42.105372 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:42.106107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:42.106553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:42.107012 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:42.258822 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:42.268665 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-801a0c73-37a6-4a73-bf11-be45b874ae32 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.176640 Oct 02 02:05:42.269256 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3823/7237] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:42 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:43.298013 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:43.299234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:43.306214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:43.306746 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:43.307206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:43.307918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:43.308392 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:43.308835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:43.443332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:43.451429 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8c9d984-3cc0-4637-8d1d-0d3436a5f111 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.157374 Oct 02 02:05:43.452010 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3824/7238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:43 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:44.475372 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:44.476047 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:44.482961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:44.483464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:44.483916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:44.484616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:44.485081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:44.485519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:44.614012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:44.621766 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3575656c-424c-4f3e-9478-eaf6036e23db tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.150365 Oct 02 02:05:44.622343 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3825/7239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:44 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:45.645386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:45.646068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:45.653391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:45.653884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:45.654338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:45.655072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:45.655556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:45.655997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:45.787026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:45.795087 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4bcc2cc-bae5-48f0-9e11-2d7a33f5a26e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.154162 Oct 02 02:05:45.795662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3826/7240] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:45 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:46.817455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:46.818124 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:46.825222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:46.825713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:46.826161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:46.826882 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:46.827354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:46.827790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:46.964171 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:46.971455 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c178c0c-89cf-4c4a-9d89-d7406f65b979 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.157117 Oct 02 02:05:46.972187 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3827/7241] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:46 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:47.203934 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-a4ca8582-bea7-4138-962c-6215201a69f6 req-3c10dff3-a756-4588-bf29-ae54e36c7786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a4730f-c84b-4372-8e06-9ba78c467451", "name": "network-vif-plugged", "status": "completed", "tag": "fcc82096-c8dd-4140-a2dc-17717bc74ae2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:47.216062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a4ca8582-bea7-4138-962c-6215201a69f6 req-3c10dff3-a756-4588-bf29-ae54e36c7786 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:47.216838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a4ca8582-bea7-4138-962c-6215201a69f6 req-3c10dff3-a756-4588-bf29-ae54e36c7786 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:47.217498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-a4ca8582-bea7-4138-962c-6215201a69f6 req-3c10dff3-a756-4588-bf29-ae54e36c7786 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:47.229284 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-a4ca8582-bea7-4138-962c-6215201a69f6 req-3c10dff3-a756-4588-bf29-ae54e36c7786 service nova] Creating event network-vif-plugged:fcc82096-c8dd-4140-a2dc-17717bc74ae2 for instance d7a4730f-c84b-4372-8e06-9ba78c467451 on n-h2-master-1 Oct 02 02:05:47.234197 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-a4ca8582-bea7-4138-962c-6215201a69f6 req-3c10dff3-a756-4588-bf29-ae54e36c7786 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034816 Oct 02 02:05:47.235047 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3828/7242] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:05:47.996308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:47.997100 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:47.999146 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:47.999855 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:48.006926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:48.007426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:48.007930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:48.008634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:48.009203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:48.009543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:48.142832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:48.150475 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e0e8cdc0-ea0a-431b-a799-c8c55f7c1142 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1362 microversion: 2.1 time: 0.158529 Oct 02 02:05:48.151106 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3829/7243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:47 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:49.175292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:49.175996 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:49.182716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:49.183210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:49.183660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:49.184395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:49.184867 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:49.185312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:49.317239 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:49.325313 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b190c914-a46c-40b6-bbc9-c30ef8014e90 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1554 microversion: 2.1 time: 0.154385 Oct 02 02:05:49.325882 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3830/7244] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:49 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:49.347241 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:05:49.347897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:49.350620 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:49.354992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:49.355566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:49.356023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:49.356732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:49.357202 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:49.357642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:49.489507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:05:49.497250 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc7ffd49-939a-4241-819a-e96579fd6255 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1554 microversion: 2.1 time: 0.153680 Oct 02 02:05:49.497843 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3831/7245] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:05:49 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:05:50.991542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2983cd7-f35d-4af6-9ba4-4c7a14874d29"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:05:50.993896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:05:51.000758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:51.001256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:51.002328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:51.003066 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:05:51.003538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:05:51.003976 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:05:51.263157 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-90ea68a8-32f0-4449-811b-03570cb45aa2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275293 Oct 02 02:05:51.263809 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3832/7246] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 02:05:50 2022] POST /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:01.981643 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:01.982446 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:01.988281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:01.988898 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:01.996483 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:01.997097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:01.997553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:01.998262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:01.998763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:01.999205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:02.081303 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lazy-loading 'services' on Instance uuid d7a4730f-c84b-4372-8e06-9ba78c467451 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:06:02.151165 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-97ddec90-42dc-421f-a530-eff8a26c5edb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments/d2983cd7-f35d-4af6-9ba4-4c7a14874d29" status: 202 len: 0 microversion: 2.1 time: 0.171585 Oct 02 02:06:02.151764 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3833/7247] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:06:01 2022] DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments/d2983cd7-f35d-4af6-9ba4-4c7a14874d29 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:06:02.162724 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:02.166861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:02.177205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:02.178095 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:02.178829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:02.179876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:02.180415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:02.180920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:02.214141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e0c0345-2803-4515-898c-3733d3b4c194 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057524 Oct 02 02:06:02.214941 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3834/7248] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:02 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:03.227721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:03.230433 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:03.238349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:03.238879 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:03.239333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:03.240046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:03.240519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:03.240967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:03.271900 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-56f11ff0-be8d-44dd-a45b-8fc48a89aef7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Oct 02 02:06:03.272485 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3835/7249] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:03 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:04.286117 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:04.288376 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:04.295675 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:04.296190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:04.296651 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:04.297391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:04.297857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:04.298555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:04.333207 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-628350f8-1976-4edf-b5c6-407bff678220 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052558 Oct 02 02:06:04.333803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3836/7250] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:04 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:05.346807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:05.348999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:05.356147 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:05.356744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:05.357233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:05.357954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:05.358420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:05.358899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:05.390191 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b2126639-d3c4-4a30-93bb-114c27e838d9 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048273 Oct 02 02:06:05.390791 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3837/7251] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:05 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:06.402187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:06.404325 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:06.412300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:06.412798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:06.413246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:06.413992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:06.414464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:06.414935 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:06.445409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-23ca366d-d3d6-4aa4-85ff-9d0d4d89f911 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Oct 02 02:06:06.445979 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3838/7252] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:06 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:07.459068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:07.461326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:07.468152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:07.468642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:07.469088 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:07.469826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:07.470306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:07.470764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:07.499966 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a43bd021-64fc-44e4-8fcb-211cae707bb3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045647 Oct 02 02:06:07.507018 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3839/7253] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:07 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 02 02:06:07.513390 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:07.513899 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:07.520791 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:07.521302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:07.521762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:07.522506 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:07.523026 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:07.523474 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:07.598152 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] HTTP exception thrown: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 is not attached to volume d2983cd7-f35d-4af6-9ba4-4c7a14874d29 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Request method failure captured: Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments/d2983cd7-f35d-4af6-9ba4-4c7a14874d29 HTTP/1.1 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPHFfsZ_fzFtgK7kQ3518q0KqRz7M0gvt9u4R4prYpCzaxmJn6OSJdVBhfr4xYZXfFgEiDWB8bGqPDrhs8LwaTj6rOai_Gs1ZAo74oeZL1ODbm0uhJNFEKQYXJKWKICheNYZHTxh3rpNFcAJVxC_-JAmZMN1eOr_p_0iFvbVxEne4Nk Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b7a97088bd433ebe3a0a70f027de2f"}]}] Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66aadeddc0524f2ab7c167aae9a30468 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 is not attached to volume d2983cd7-f35d-4af6-9ba4-4c7a14874d29 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': 'd7a4730f-c84b-4372-8e06-9ba78c467451', 'id': 'd2983cd7-f35d-4af6-9ba4-4c7a14874d29'} Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d2983cd7-f35d-4af6-9ba4-4c7a14874d29. Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 is not attached to volume d2983cd7-f35d-4af6-9ba4-4c7a14874d29 Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:07.599830 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 is not attached to volume d2983cd7-f35d-4af6-9ba4-4c7a14874d29 Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Returning 404 to user: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 is not attached to volume d2983cd7-f35d-4af6-9ba4-4c7a14874d29 {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e6d7381f-8a67-4782-a6e3-694ac441008a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments/d2983cd7-f35d-4af6-9ba4-4c7a14874d29" status: 404 len: 154 microversion: 2.1 time: 0.091970 Oct 02 02:06:07.604432 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3840/7254] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:06:07 2022] DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451/os-volume_attachments/d2983cd7-f35d-4af6-9ba4-4c7a14874d29 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:06:10.957745 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:10.958434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:10.965841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:10.966767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:10.967306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:10.968134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:10.968689 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:10.969212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:11.000656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:06:11.093009 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccf7d408-d0a7-434a-98ef-372384fd27c0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 204 len: 0 microversion: 2.1 time: 0.138803 Oct 02 02:06:11.093553 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3841/7255] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:06:10 2022] DELETE /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:06:11.102725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:11.103447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:11.109381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:11.109880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:11.110334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:11.111814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:11.112055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:11.112502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:11.247277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:11.255929 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3e4c7fc6-02fc-45f5-96fe-f765926dff74 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1560 microversion: 2.1 time: 0.157512 Oct 02 02:06:11.256510 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3842/7256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:11 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:06:12.281447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:12.282641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:12.290486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:12.291028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:12.291489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:12.292207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:12.292685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:12.293132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:12.427902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:12.435703 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-05bf40f2-0a35-4af9-9066-3790b58a0e4f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1560 microversion: 2.1 time: 0.159351 Oct 02 02:06:12.436282 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3843/7257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:12 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:13.461048 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:13.461718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:13.468496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:13.468994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:13.469446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:13.470830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:13.471460 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:13.471903 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:13.625405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:13.634139 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d2353b2b-486c-4b6d-9e9a-6be5929243b7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 200 len: 1560 microversion: 2.1 time: 0.177058 Oct 02 02:06:13.634764 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3844/7258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:13 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:13.639196 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3f4ad982-9e89-489d-b4c9-fe394ce219e3 req-8bfd3f3d-06d5-4a4d-b876-faa091a6d10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a4730f-c84b-4372-8e06-9ba78c467451", "name": "network-vif-deleted", "tag": "fcc82096-c8dd-4140-a2dc-17717bc74ae2"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:13.649042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f4ad982-9e89-489d-b4c9-fe394ce219e3 req-8bfd3f3d-06d5-4a4d-b876-faa091a6d10e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:13.649545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f4ad982-9e89-489d-b4c9-fe394ce219e3 req-8bfd3f3d-06d5-4a4d-b876-faa091a6d10e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:13.650007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3f4ad982-9e89-489d-b4c9-fe394ce219e3 req-8bfd3f3d-06d5-4a4d-b876-faa091a6d10e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:13.662260 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3f4ad982-9e89-489d-b4c9-fe394ce219e3 req-8bfd3f3d-06d5-4a4d-b876-faa091a6d10e service nova] Creating event network-vif-deleted:fcc82096-c8dd-4140-a2dc-17717bc74ae2 for instance d7a4730f-c84b-4372-8e06-9ba78c467451 on n-h2-master-1 Oct 02 02:06:13.667226 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3f4ad982-9e89-489d-b4c9-fe394ce219e3 req-8bfd3f3d-06d5-4a4d-b876-faa091a6d10e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031277 Oct 02 02:06:13.667834 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3845/7259] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:14.662031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:14.662786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: d7a4730f-c84b-4372-8e06-9ba78c467451] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:14.669143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:14.669640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:14.670093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:14.670837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:14.671311 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:14.671752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:14.685603 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] HTTP exception thrown: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 could not be found. Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Request method failure captured: Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 HTTP/1.1 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPHFfsZ_fzFtgK7kQ3518q0KqRz7M0gvt9u4R4prYpCzaxmJn6OSJdVBhfr4xYZXfFgEiDWB8bGqPDrhs8LwaTj6rOai_Gs1ZAo74oeZL1ODbm0uhJNFEKQYXJKWKICheNYZHTxh3rpNFcAJVxC_-JAmZMN1eOr_p_0iFvbVxEne4Nk Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b7a97088bd433ebe3a0a70f027de2f"}]}] Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 66aadeddc0524f2ab7c167aae9a30468 Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: exception: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 could not be found. Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': 'd7a4730f-c84b-4372-8e06-9ba78c467451'} Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 could not be found. Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 could not be found. Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:14.687311 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 could not be found. Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Returning 404 to user: Instance d7a4730f-c84b-4372-8e06-9ba78c467451 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3183e2c9-9485-4464-a058-8922fc1705c3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451" status: 404 len: 111 microversion: 2.1 time: 0.032083 Oct 02 02:06:14.692735 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3846/7260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:14 2022] GET /compute/v2.1/servers/d7a4730f-c84b-4372-8e06-9ba78c467451 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 02:06:14.697933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-caf39f87-9f50-46f5-81c2-7e0e4a9d8828 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '.version_select at 0x7fb88088ba60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:14.717557 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-caf39f87-9f50-46f5-81c2-7e0e4a9d8828 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-574239898" status: 202 len: 0 microversion: 2.1 time: 0.023142 Oct 02 02:06:14.718146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3847/7261] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 02:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-574239898 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:06:14.737818 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cdc0b814-f682-4b73-840a-b9b9722474a7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: .version_select at 0x7fb8811fd5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1682902686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmSVvsuJA8KJh+4F23dp+fnJADkd1b832TueBoioG04erO2x7Neeib3sr06N1DmAeypXqIhTQOWC83FWtKGCoGoLv+60N4+euaAZ5/CRWuVKvxM2oafRvPiZX3aRu5jkA=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:14.755418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-cdc0b814-f682-4b73-840a-b9b9722474a7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:06:14.760710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-cdc0b814-f682-4b73-840a-b9b9722474a7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for user 66aadeddc0524f2ab7c167aae9a30468 and project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:06:14.783204 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cdc0b814-f682-4b73-840a-b9b9722474a7 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049884 Oct 02 02:06:14.783800 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3848/7262] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:06:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:14.835405 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1956930432", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1682902686", "networks": [{"uuid": "4d1d6dfe-9a48-4b27-b236-cfab19eddbb8"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:14.894630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] validate_networks() for [('4d1d6dfe-9a48-4b27-b236-cfab19eddbb8', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:06:15.269132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:06:15.269568 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:06:15.270056 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:06:15.270476 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:06:15.270927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:06:15.279781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:15.280274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:15.280720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:15.281451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:15.281915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:15.282954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:15.300242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:06:15.305653 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Getting quotas for user 66aadeddc0524f2ab7c167aae9a30468 and project 99b7a97088bd433ebe3a0a70f027de2f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:06:15.318383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:06:15.320776 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:06:15.371995 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df1c49ef-0ca5-4269-92c3-da69e3c0be2d tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540458 Oct 02 02:06:15.372837 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3849/7263] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:06:15.384093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-21906c34-fb27-4724-b256-43b523de7b42 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:15.384700 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-21906c34-fb27-4724-b256-43b523de7b42 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:15.442415 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-21906c34-fb27-4724-b256-43b523de7b42 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:15.450542 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-21906c34-fb27-4724-b256-43b523de7b42 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1263 microversion: 2.1 time: 0.070088 Oct 02 02:06:15.451148 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3850/7264] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:15 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:16.474944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:16.475877 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:16.483696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:16.484195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:16.484658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:16.485379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:16.486572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:16.487456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:16.562282 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:16.571832 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-93206662-7c38-4b24-96d1-854565a401af tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1323 microversion: 2.1 time: 0.100698 Oct 02 02:06:16.572425 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3851/7265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:16 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1323 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:17.596658 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:17.597359 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:17.604599 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:17.605121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:17.605582 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:17.606314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:17.606829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:17.607280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:17.613220 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:17.749657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:17.759353 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-610470fa-0d90-4be0-89d2-720c1741a1cb tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.166975 Oct 02 02:06:17.759968 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3852/7266] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:17 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:18.297398 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-63698a60-4afe-49e4-9c8a-d028fb33d0c7 req-19568cc3-2b6f-4ce3-b465-0a7c6527fb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97aaa1e6-3d17-4560-8b33-4457dc21503f", "tag": "00036976-58ac-4aed-beee-20d5b0183e40"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:18.309905 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-63698a60-4afe-49e4-9c8a-d028fb33d0c7 req-19568cc3-2b6f-4ce3-b465-0a7c6527fb01 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:18.310443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-63698a60-4afe-49e4-9c8a-d028fb33d0c7 req-19568cc3-2b6f-4ce3-b465-0a7c6527fb01 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:18.311906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-63698a60-4afe-49e4-9c8a-d028fb33d0c7 req-19568cc3-2b6f-4ce3-b465-0a7c6527fb01 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:18.325666 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-63698a60-4afe-49e4-9c8a-d028fb33d0c7 req-19568cc3-2b6f-4ce3-b465-0a7c6527fb01 service nova] Creating event network-changed:00036976-58ac-4aed-beee-20d5b0183e40 for instance 97aaa1e6-3d17-4560-8b33-4457dc21503f on n-h2-master-1 Oct 02 02:06:18.331948 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-63698a60-4afe-49e4-9c8a-d028fb33d0c7 req-19568cc3-2b6f-4ce3-b465-0a7c6527fb01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038437 Oct 02 02:06:18.332580 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3853/7267] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:18.784339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:18.785054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:18.791310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:18.791810 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:18.792263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:18.792975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:18.793446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:18.793891 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:18.928026 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:18.935811 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4079e482-4c02-4e99-9c1e-a074aebf5722 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.156795 Oct 02 02:06:18.936393 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3854/7268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:18 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:19.959969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:19.960676 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:19.967858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:19.968355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:19.968805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:19.969522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:19.970013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:19.970453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:20.102374 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:20.110096 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd395bc5-af3c-442e-86f0-5dd8d0d5289e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.154459 Oct 02 02:06:20.111345 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3855/7269] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:19 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:21.134681 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:21.135307 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:21.142818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:21.143323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:21.143775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:21.144487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:21.144961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:21.145413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:21.272226 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:21.280248 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2258be14-9200-4fdf-b5a3-4ddaf972201e tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.149634 Oct 02 02:06:21.280833 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3856/7270] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:21 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:22.309087 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:22.309761 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:22.316639 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:22.317138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:22.317593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:22.318302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:22.318808 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:22.319304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:22.459817 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:22.467562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cfa8a337-5921-4e47-b7d3-1b0f54a45c39 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.162621 Oct 02 02:06:22.468143 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3857/7271] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:22 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:23.490847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:23.491427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:23.498313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:23.498855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:23.499314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:23.500030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:23.500509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:23.500959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:23.632367 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:23.640085 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e4e48283-b170-4062-82cb-10f6b3500dff tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.153684 Oct 02 02:06:23.640658 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3858/7272] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:23 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:24.663764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:24.664494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:24.671302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:24.671797 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:24.672245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:24.672944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:24.673427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:24.673852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:24.806829 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:24.816827 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6b9fd08b-a806-470e-b62a-589a063262cf tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.156910 Oct 02 02:06:24.817410 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3859/7273] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:24 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:25.421884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-1356e3fd-2d8a-489a-9d02-3151edfde25a req-ebe7d810-9576-4c65-9106-4919f718d062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aaa1e6-3d17-4560-8b33-4457dc21503f", "name": "network-vif-plugged", "status": "completed", "tag": "00036976-58ac-4aed-beee-20d5b0183e40"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:25.427166 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:25.434121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1356e3fd-2d8a-489a-9d02-3151edfde25a req-ebe7d810-9576-4c65-9106-4919f718d062 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:25.434672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1356e3fd-2d8a-489a-9d02-3151edfde25a req-ebe7d810-9576-4c65-9106-4919f718d062 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:25.435264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-1356e3fd-2d8a-489a-9d02-3151edfde25a req-ebe7d810-9576-4c65-9106-4919f718d062 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:25.446203 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:25.448974 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-1356e3fd-2d8a-489a-9d02-3151edfde25a req-ebe7d810-9576-4c65-9106-4919f718d062 service nova] Creating event network-vif-plugged:00036976-58ac-4aed-beee-20d5b0183e40 for instance 97aaa1e6-3d17-4560-8b33-4457dc21503f on n-h2-master-1 Oct 02 02:06:25.454471 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-1356e3fd-2d8a-489a-9d02-3151edfde25a req-ebe7d810-9576-4c65-9106-4919f718d062 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036621 Oct 02 02:06:25.455942 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3860/7274] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:25.843141 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:25.843941 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:25.851244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:25.851749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:25.852205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:25.852915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:25.853386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:25.853829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:25.990247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:25.997987 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6f91e84-5dc1-48e6-8947-13c2c9d0051a tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1363 microversion: 2.1 time: 0.160399 Oct 02 02:06:25.998762 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3861/7275] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:25 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:27.022058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:27.022746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:27.029744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:27.030246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:27.030848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:27.031578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:27.032043 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:27.032486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:27.165315 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:27.173567 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afdabdbb-0e11-4df5-8adf-aa148dff070b tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1554 microversion: 2.1 time: 0.156147 Oct 02 02:06:27.174195 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3862/7276] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:27 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:27.196162 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:27.196777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:27.202656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:27.203150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:27.203596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:27.204302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:27.204776 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:27.205321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:27.336737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:27.344879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4546a32e-73c8-471e-a87a-4a9d7c38aece tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1554 microversion: 2.1 time: 0.152159 Oct 02 02:06:27.345484 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3863/7277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:27 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:28.856633 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "309e7eda-4649-49a9-b25c-955217e96338"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:28.859101 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:28.863028 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:28.867041 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:28.867535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:28.868023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:28.868729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:28.869195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:28.869631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:29.129484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-84a6874a-0633-4267-8c56-62b5e8f00fdc tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "POST /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276686 Oct 02 02:06:29.130310 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3864/7278] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 02:06:28 2022] POST /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:06:31.446727 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:06:31.447352 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:06:31.451418 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:06:31.451528 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:06:32.171004 n-d-master-1 devstack@n-api.service[122355]: DEBUG neutronclient.v2_0.client [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=122355) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 02 02:06:32.171819 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.795500 Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack Traceback (most recent call last): Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-b89241dc-7a1d-45c7-bf6c-31e79b803dfa'] Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack Traceback (most recent call last): Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return req.get_response(self.application) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack self.force_reraise() Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack raise self.value Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return resp(environ, start_response) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return request.get_response(self.application) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 02 02:06:32.233601 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return resp(environ, start_response) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return resp(environ, start_response) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return resp(environ, start_response) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self._create_instance( Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2641, in validate_networks Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ports = neutron.list_ports(**params)['ports'] Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 815, in list_ports Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.list('ports', self.ports_path, retrieve_all, Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 02 02:06:32.238952 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] http://10.222.0.23/compute/v2.1/servers returned with HTTP 401 Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:06:32 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.23) Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: CRITICAL nova [None req-1c533a6d-bb1b-42aa-b79c-df710132f4d5 tempest-TestVolumeBootPattern-1362862820 tempest-TestVolumeBootPattern-1362862820-project] Unhandled error: OSError: write error Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova OSError: write error Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: ERROR nova Oct 02 02:06:32.243428 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3415/7279] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:51:31 2022] POST /compute/v2.1/servers => generated 0 bytes in 900861 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Oct 02 02:06:40.033076 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:40.038871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:40.039482 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:40.046922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:40.047433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:40.047894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:40.048609 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:40.050169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:40.050652 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:40.132537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lazy-loading 'services' on Instance uuid 97aaa1e6-3d17-4560-8b33-4457dc21503f {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:06:40.202974 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26a2d36a-199d-4092-9a7b-0eab3f1f9460 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments/309e7eda-4649-49a9-b25c-955217e96338" status: 202 len: 0 microversion: 2.1 time: 0.171849 Oct 02 02:06:40.203596 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3865/7280] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:06:40 2022] DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments/309e7eda-4649-49a9-b25c-955217e96338 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:06:40.213851 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:40.216158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:40.222505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:40.223036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:40.223511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:40.224210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:40.224666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:40.225089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:40.259883 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-245926c3-4adf-4819-a5e6-2744659c8369 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051465 Oct 02 02:06:40.260391 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3416/7281] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:40 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:41.274650 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:41.277011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:41.283628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:41.284203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:41.284660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:41.285376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:41.289009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:41.289009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:41.318794 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3322a547-b0d5-44cc-bbb3-9411894f0219 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049613 Oct 02 02:06:41.319811 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3866/7282] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:41 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:42.331663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:42.333986 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:42.343479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:42.343851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:42.344329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:42.345036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:42.345490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:42.345975 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:42.380575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-811e7be2-86e6-4be2-b4fa-8d3713cfabc2 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053286 Oct 02 02:06:42.381157 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3417/7283] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:42 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:43.399198 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:43.401570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:43.410036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:43.410536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:43.411022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:43.412572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:43.412572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:43.412819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:43.451938 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a1329c7-a6f1-4122-ae47-2a7d98210958 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062456 Oct 02 02:06:43.452439 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3867/7284] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:43 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:44.465300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:44.467554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:44.477187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:44.477673 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:44.478109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:44.478836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:44.479292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:44.479715 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:44.510326 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9cce660c-388c-4d1a-a959-949195fa20f0 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049035 Oct 02 02:06:44.510931 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3418/7285] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:44 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:45.523621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:45.525840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:45.532625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:45.533117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:45.534229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:45.535040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:45.535539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:45.535979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:45.564671 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cbb266cb-1637-4047-8402-aa71ae3ea121 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045077 Oct 02 02:06:45.565543 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3868/7286] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:06:45 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 02:06:45.576822 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:45.577325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:45.584607 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:45.585123 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:45.585562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:45.586252 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:45.586763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:45.587188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:45.661564 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] HTTP exception thrown: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f is not attached to volume 309e7eda-4649-49a9-b25c-955217e96338 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Request method failure captured: Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments/309e7eda-4649-49a9-b25c-955217e96338 HTTP/1.1 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPHFfsZ_fzFtgK7kQ3518q0KqRz7M0gvt9u4R4prYpCzaxmJn6OSJdVBhfr4xYZXfFgEiDWB8bGqPDrhs8LwaTj6rOai_Gs1ZAo74oeZL1ODbm0uhJNFEKQYXJKWKICheNYZHTxh3rpNFcAJVxC_-JAmZMN1eOr_p_0iFvbVxEne4Nk Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b7a97088bd433ebe3a0a70f027de2f"}]}] Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 66aadeddc0524f2ab7c167aae9a30468 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f is not attached to volume 309e7eda-4649-49a9-b25c-955217e96338 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '97aaa1e6-3d17-4560-8b33-4457dc21503f', 'id': '309e7eda-4649-49a9-b25c-955217e96338'} Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 309e7eda-4649-49a9-b25c-955217e96338. Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f is not attached to volume 309e7eda-4649-49a9-b25c-955217e96338 Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:45.663478 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f is not attached to volume 309e7eda-4649-49a9-b25c-955217e96338 Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Returning 404 to user: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f is not attached to volume 309e7eda-4649-49a9-b25c-955217e96338 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e3661354-f357-4b2b-a344-4c8dff3c9411 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments/309e7eda-4649-49a9-b25c-955217e96338" status: 404 len: 154 microversion: 2.1 time: 0.092385 Oct 02 02:06:45.667973 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3419/7287] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:06:45 2022] DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f/os-volume_attachments/309e7eda-4649-49a9-b25c-955217e96338 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:06:49.019489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:49.020165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:49.027378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:49.027898 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:49.028349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:49.029085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:49.029554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:49.029999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:49.061296 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:06:49.141167 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ef18862e-07ad-4c6e-870d-2d80a9ae7fbe tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 204 len: 0 microversion: 2.1 time: 0.126119 Oct 02 02:06:49.147703 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3869/7288] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:06:49 2022] DELETE /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 02:06:49.153447 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:49.154078 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:49.165212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:49.165801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:49.166316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:49.167131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:49.167670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:49.168191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:49.298565 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:49.306430 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-643e7fba-49b8-43b5-912d-ff2bbdc06cfd tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1560 microversion: 2.1 time: 0.157214 Oct 02 02:06:49.307046 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3420/7289] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:49 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:06:50.331818 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:50.332538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:50.339613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:50.340111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:50.340564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:50.341267 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:50.341741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:50.342213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:50.478730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:50.486724 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-88fc9929-8872-4b0e-93d0-69005c7daf36 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1560 microversion: 2.1 time: 0.160259 Oct 02 02:06:50.487580 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3870/7290] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:50 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:06:51.327541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-19266245-91e9-4e74-9b99-419c55eb1bf4 req-b2ce2e3b-d3bb-4263-bd59-52b2c88d5d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aaa1e6-3d17-4560-8b33-4457dc21503f", "name": "network-vif-deleted", "tag": "00036976-58ac-4aed-beee-20d5b0183e40"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:06:51.340929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-19266245-91e9-4e74-9b99-419c55eb1bf4 req-b2ce2e3b-d3bb-4263-bd59-52b2c88d5d92 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:51.341411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-19266245-91e9-4e74-9b99-419c55eb1bf4 req-b2ce2e3b-d3bb-4263-bd59-52b2c88d5d92 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:51.341871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-19266245-91e9-4e74-9b99-419c55eb1bf4 req-b2ce2e3b-d3bb-4263-bd59-52b2c88d5d92 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:51.354788 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-19266245-91e9-4e74-9b99-419c55eb1bf4 req-b2ce2e3b-d3bb-4263-bd59-52b2c88d5d92 service nova] Creating event network-vif-deleted:00036976-58ac-4aed-beee-20d5b0183e40 for instance 97aaa1e6-3d17-4560-8b33-4457dc21503f on n-h2-master-1 Oct 02 02:06:51.361008 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-19266245-91e9-4e74-9b99-419c55eb1bf4 req-b2ce2e3b-d3bb-4263-bd59-52b2c88d5d92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037489 Oct 02 02:06:51.362351 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3421/7291] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:06:51.510255 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:51.511132 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:51.519015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:51.519517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:51.519978 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:51.520692 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:51.521166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:51.521611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:51.553917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:51.554418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:51.554900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:51.555361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lazy-loading 'fault' on Instance uuid 97aaa1e6-3d17-4560-8b33-4457dc21503f {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:06:51.596657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66aadeddc0524f2ab7c167aae9a30468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b7a97088bd433ebe3a0a70f027de2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:06:51.605670 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-68aa162e-78c7-407a-ba1a-400b131af914 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 200 len: 1353 microversion: 2.1 time: 0.099194 Oct 02 02:06:51.606273 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3871/7292] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:51 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:06:52.631865 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:52.632572 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] [instance: 97aaa1e6-3d17-4560-8b33-4457dc21503f] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:06:52.638952 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:52.639443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:52.639877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:52.640596 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:06:52.641052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:06:52.641477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:06:52.655639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] HTTP exception thrown: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f could not be found. Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Request method failure captured: Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f HTTP/1.1 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPHFfsZ_fzFtgK7kQ3518q0KqRz7M0gvt9u4R4prYpCzaxmJn6OSJdVBhfr4xYZXfFgEiDWB8bGqPDrhs8LwaTj6rOai_Gs1ZAo74oeZL1ODbm0uhJNFEKQYXJKWKICheNYZHTxh3rpNFcAJVxC_-JAmZMN1eOr_p_0iFvbVxEne4Nk Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b7a97088bd433ebe3a0a70f027de2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b7a97088bd433ebe3a0a70f027de2f"}]}] Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 99b7a97088bd433ebe3a0a70f027de2f Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1437998982 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 66aadeddc0524f2ab7c167aae9a30468 Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestEncryptedCinderVolumes-1437998982-project Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f could not be found. Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '97aaa1e6-3d17-4560-8b33-4457dc21503f'} Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f could not be found. Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f could not be found. Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:52.657221 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f could not be found. Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Returning 404 to user: Instance 97aaa1e6-3d17-4560-8b33-4457dc21503f could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-612bb64c-9a15-46e8-af3e-f4c8d9764c1f tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f" status: 404 len: 111 microversion: 2.1 time: 0.032521 Oct 02 02:06:52.662259 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3422/7293] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:06:52 2022] GET /compute/v2.1/servers/97aaa1e6-3d17-4560-8b33-4457dc21503f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:06:52.667588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ac502f51-81db-4536-bcce-ebdc09e52dc3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] Calling method '.version_select at 0x7fb8816783a0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:06:52.687389 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ac502f51-81db-4536-bcce-ebdc09e52dc3 tempest-TestEncryptedCinderVolumes-1437998982 tempest-TestEncryptedCinderVolumes-1437998982-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1682902686" status: 202 len: 0 microversion: 2.1 time: 0.023580 Oct 02 02:06:52.687960 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3872/7294] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 02:06:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1682902686 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:07:19.933682 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1393abd9-ccdf-4fd9-9abc-c559ee36a600 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'create', calling method: .version_select at 0x7fb87bfb5280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1440780059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVQ0SbJdRNyYvZZSDJlef1DyWA1CkfKK7JxrTYv2TZB3Gfqguy7EMpwG6TDYLcY+lHX24YChoab/EiBXIKu1P7X1ZwGFtHnk/NRiU0GVAdmE3nCSqFJe0Zn3roaasWKNw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:19.939307 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=14 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:19.939947 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=34 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:19.955127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1393abd9-ccdf-4fd9-9abc-c559ee36a600 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:07:19.961056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-1393abd9-ccdf-4fd9-9abc-c559ee36a600 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for user 95d2890faf84462493c012c0619b663f and project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:07:19.988064 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1393abd9-ccdf-4fd9-9abc-c559ee36a600 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058469 Oct 02 02:07:19.989362 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3423/7295] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:07:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:20.036807 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:20.037523 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:20.041756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1089400062", "imageRef": "496292fe-97b8-4e7d-badc-4e61eb12c2b2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1440780059", "networks": [{"uuid": "ee61806a-fd7f-4e3d-8eb2-a92ffcbc3dc8"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:20.097022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] validate_networks() for [('ee61806a-fd7f-4e3d-8eb2-a92ffcbc3dc8', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:07:20.479786 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:07:20.480231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:07:20.480757 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:07:20.481187 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:07:20.481616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:07:20.490629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:20.491134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:20.491589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:20.492336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:20.492851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:20.493299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:20.510104 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:07:20.515409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for user 95d2890faf84462493c012c0619b663f and project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:07:20.528203 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:07:20.530458 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='496292fe-97b8-4e7d-badc-4e61eb12c2b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:07:20.576372 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-012e11e7-ebda-4014-9b81-5811d023084b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541555 Oct 02 02:07:20.577216 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3873/7296] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:07:20.589004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ddb20c9-d463-4e5b-8909-66232446ce23 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:20.589757 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6ddb20c9-d463-4e5b-8909-66232446ce23 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:20.654530 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6ddb20c9-d463-4e5b-8909-66232446ce23 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:20.663309 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ddb20c9-d463-4e5b-8909-66232446ce23 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1259 microversion: 2.1 time: 0.078989 Oct 02 02:07:20.663883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3424/7297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:20 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:21.688451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:21.690093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:21.697241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:21.697759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:21.698215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:21.699112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:21.699623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:21.700073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:21.767397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:21.776832 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-86e5064f-37f9-4dbd-a9db-996da498173d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1319 microversion: 2.1 time: 0.093506 Oct 02 02:07:21.777434 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3874/7298] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:21 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:22.800267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:22.801055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:22.807925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:22.808413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:22.808858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:22.809556 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:22.810024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:22.810534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:22.974378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:22.984487 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d658dc6b-d213-4cf3-9299-d20fa28719ea tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.187877 Oct 02 02:07:22.985673 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3425/7299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:22 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:24.010773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:24.012111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:24.019455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:24.020039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:24.020494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:24.021212 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:24.021685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:24.022150 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:24.159925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:24.170267 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4afe5b26-3635-488f-893e-da46b2c398da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.164715 Oct 02 02:07:24.172306 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3875/7300] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:24 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:25.196715 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:25.198657 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:25.207648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:25.208621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:25.209295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:25.210334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:25.211853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:25.212538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:25.350008 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:25.360599 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8c290cab-2a5f-4504-9a12-f45f49a422c5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.170099 Oct 02 02:07:25.366438 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3426/7301] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:25 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:26.386953 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:26.387597 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:26.394927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:26.395423 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:26.395871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:26.396574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:26.397044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:26.397477 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:26.547593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:26.555891 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-29e3e8e5-fca8-4a6a-8367-2ae934ff94b5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.172608 Oct 02 02:07:26.556674 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3876/7302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:26 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:27.579778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:27.580503 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:27.588229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:27.588716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:27.589155 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:27.589844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:27.590308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:27.590788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:27.738991 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:27.746945 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a735dd59-2ecd-4055-b076-73ef60c85002 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.171288 Oct 02 02:07:27.747524 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3427/7303] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:27 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:28.770802 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:28.772109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:28.780399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:28.780908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:28.781360 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:28.783079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:28.783920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:28.784727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:28.928637 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:28.941069 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-95040f59-2bb0-4ed3-9db4-d8bb4e5dd078 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.174004 Oct 02 02:07:28.941971 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3877/7304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:28 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:29.966516 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:29.967504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:29.974930 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:29.975983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:29.976961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:29.978291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:29.979036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:29.979582 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:30.137003 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:30.145070 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7cc14027-3b14-483d-81a1-5afabed310be tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.183639 Oct 02 02:07:30.145670 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3428/7305] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:29 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:31.169257 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:31.169914 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:31.172929 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:31.173787 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:31.180948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:31.181458 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:31.181914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:31.182657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:31.183446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:31.183564 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:31.317693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:31.326650 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a9ed8517-406b-4c23-87ae-57ea904be277 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.161375 Oct 02 02:07:31.327541 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3878/7306] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:31 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:31.408781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e1fc312b-469f-44b2-a575-8588b4cbdeb8 req-ca138382-0835-49d7-906d-143178cf36e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:31.415653 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:31.423996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e1fc312b-469f-44b2-a575-8588b4cbdeb8 req-ca138382-0835-49d7-906d-143178cf36e0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:31.424483 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e1fc312b-469f-44b2-a575-8588b4cbdeb8 req-ca138382-0835-49d7-906d-143178cf36e0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:31.425033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e1fc312b-469f-44b2-a575-8588b4cbdeb8 req-ca138382-0835-49d7-906d-143178cf36e0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:31.436813 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e1fc312b-469f-44b2-a575-8588b4cbdeb8 req-ca138382-0835-49d7-906d-143178cf36e0 service nova] Creating event network-changed:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:07:31.442420 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e1fc312b-469f-44b2-a575-8588b4cbdeb8 req-ca138382-0835-49d7-906d-143178cf36e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037897 Oct 02 02:07:31.443471 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3429/7307] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:32.351288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:32.351916 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:32.359672 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:32.360101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:32.360545 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:32.361244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:32.361743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:32.362209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:32.501039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:32.508840 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7699b5c8-cab0-4f49-9d44-2221dcdf20b3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.161411 Oct 02 02:07:32.509413 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3879/7308] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:32 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:33.534060 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:33.534784 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:33.541064 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:33.541545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:33.541982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:33.542692 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:33.543148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:33.543570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:33.672126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:33.679740 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-503b0806-2818-451f-8c3c-2aba4b2feef4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.150813 Oct 02 02:07:33.680333 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3430/7309] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:33 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:34.703297 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:34.703908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:34.710843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:34.711893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:34.712415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:34.713120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:34.713593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:34.714036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:34.842055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:34.849720 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8bbd1b74-436f-4bef-a671-ba34fb8c4a78 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.150619 Oct 02 02:07:34.850297 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3880/7310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:34 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:35.874588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:35.875153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:35.881921 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:35.882402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:35.882877 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:35.883589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:35.884039 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:35.884462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:36.020643 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:36.028569 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bdc44be9-4f61-4f09-9c7e-9bb549cc4d69 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.158204 Oct 02 02:07:36.029371 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3431/7311] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:35 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:37.052093 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:37.052719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:37.060163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:37.060661 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:37.061112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:37.061812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:37.062278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:37.062745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:37.193435 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:37.201761 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-81433121-88d1-4691-baa1-f8ce50e7c632 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.153543 Oct 02 02:07:37.202632 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3881/7312] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:37 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:37.660870 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1be598ba-2b5f-428e-8f12-3b832c086937 req-78eef5b0-9a57-4ef1-8c69-9e455c4edf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "name": "network-vif-plugged", "status": "completed", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:37.672734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1be598ba-2b5f-428e-8f12-3b832c086937 req-78eef5b0-9a57-4ef1-8c69-9e455c4edf23 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:37.673231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1be598ba-2b5f-428e-8f12-3b832c086937 req-78eef5b0-9a57-4ef1-8c69-9e455c4edf23 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:37.673671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1be598ba-2b5f-428e-8f12-3b832c086937 req-78eef5b0-9a57-4ef1-8c69-9e455c4edf23 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:37.685352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1be598ba-2b5f-428e-8f12-3b832c086937 req-78eef5b0-9a57-4ef1-8c69-9e455c4edf23 service nova] Creating event network-vif-plugged:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:07:37.690483 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1be598ba-2b5f-428e-8f12-3b832c086937 req-78eef5b0-9a57-4ef1-8c69-9e455c4edf23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Oct 02 02:07:37.691158 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3432/7313] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:38.225035 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:38.225670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:38.232671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:38.233170 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:38.233626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:38.234339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:38.234850 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:38.235352 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:38.369507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:38.377360 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-48ea383e-451a-4897-93f8-325af63fb9da tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1359 microversion: 2.1 time: 0.156330 Oct 02 02:07:38.377935 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3882/7314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:38 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:39.401384 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:39.402243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:39.408964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.409449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.409887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.410577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.411065 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.411489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.543600 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:39.551367 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c2c97b3b-518c-4961-b648-cdfe51dc5b1d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1549 microversion: 2.1 time: 0.155174 Oct 02 02:07:39.551944 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3433/7315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:39 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:07:39.575031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:39.575665 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:39.582481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.583015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.583470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.584216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.584694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.585142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.713689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:39.721390 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-684f6659-d283-4049-9672-544803395bc7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1549 microversion: 2.1 time: 0.150736 Oct 02 02:07:39.721965 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3883/7316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:39 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:39.749192 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:39.753973 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:39.754780 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Searching by: {'deleted': False, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa'} {{(pid=122355) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 02:07:39.760640 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.761163 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.761606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.762333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.762824 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.763257 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.790862 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.multi_cell_list [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 02:07:39.818191 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e6258d89-23ca-4a5e-816b-93363deede40 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072912 Oct 02 02:07:39.818816 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3434/7317] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 02:07:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:39.831012 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:39.831647 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:39.837783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.838280 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.838779 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.839489 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:39.839965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:39.840410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:39.970668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:39.979286 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e796ecbc-cd5d-4f30-8333-17cdd12d95f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1549 microversion: 2.1 time: 0.152480 Oct 02 02:07:39.979900 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3884/7318] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:39 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:41.530847 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6d8450f-b557-4035-ad7c-8ba865cd815e"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:41.533152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:41.540605 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:41.541100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:41.541538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:41.542237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:41.542716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:41.543145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:41.809290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fadc0cbf-731c-4796-ad93-72c8a7267856 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282176 Oct 02 02:07:41.813073 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3435/7319] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 02:07:41 2022] POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:54.873938 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:54.874569 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:54.877483 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:54.878307 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=68 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:54.884729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:54.885234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:54.885688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:54.886395 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:54.886908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:54.887349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:55.019693 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:55.028908 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ccdd9023-6019-4ec8-997f-c2af4bb663f7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1595 microversion: 2.1 time: 0.158809 Oct 02 02:07:55.029496 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3885/7320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:54 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:07:57.043373 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:57.044226 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:57.045094 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:57.051168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-1d8e968f-a9ae-47dd-9a52-0f5e9f2394ed req-725013b8-5b9f-4b28-b3df-74b7981cf3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:57.066232 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1d8e968f-a9ae-47dd-9a52-0f5e9f2394ed req-725013b8-5b9f-4b28-b3df-74b7981cf3e0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:57.067202 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1d8e968f-a9ae-47dd-9a52-0f5e9f2394ed req-725013b8-5b9f-4b28-b3df-74b7981cf3e0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:57.067774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-1d8e968f-a9ae-47dd-9a52-0f5e9f2394ed req-725013b8-5b9f-4b28-b3df-74b7981cf3e0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:57.083490 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-1d8e968f-a9ae-47dd-9a52-0f5e9f2394ed req-725013b8-5b9f-4b28-b3df-74b7981cf3e0 service nova] Creating event network-changed:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:07:57.089482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-1d8e968f-a9ae-47dd-9a52-0f5e9f2394ed req-725013b8-5b9f-4b28-b3df-74b7981cf3e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048135 Oct 02 02:07:57.090941 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3436/7321] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:58.217847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1693249508"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:58.218622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:58.239417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:58.240118 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:58.240580 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:58.241345 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:58.241823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:58.242363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:58.379628 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Adding security group 69cb27ac-9189-4320-9fa3-bb42b132ff5c to port aa846784-942d-414b-bbb8-cd01e163608b Oct 02 02:07:58.711549 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9b14c3e5-8f04-42ba-9044-2871c3084209 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action" status: 202 len: 0 microversion: 2.1 time: 0.497696 Oct 02 02:07:58.712695 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3886/7322] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:07:58 2022] POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:07:58.721700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c5d4915b-7b5f-435e-b38b-e6c2958d8381 req-a3b2facb-def3-4ffc-bab6-f893e6e8421d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:07:58.724590 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:07:58.725207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:07:58.733164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c5d4915b-7b5f-435e-b38b-e6c2958d8381 req-a3b2facb-def3-4ffc-bab6-f893e6e8421d service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:58.733648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c5d4915b-7b5f-435e-b38b-e6c2958d8381 req-a3b2facb-def3-4ffc-bab6-f893e6e8421d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:58.734081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c5d4915b-7b5f-435e-b38b-e6c2958d8381 req-a3b2facb-def3-4ffc-bab6-f893e6e8421d service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:58.734877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:58.735561 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:58.736182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:58.737154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:07:58.737625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:07:58.738211 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:07:58.747286 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c5d4915b-7b5f-435e-b38b-e6c2958d8381 req-a3b2facb-def3-4ffc-bab6-f893e6e8421d service nova] Creating event network-changed:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:07:58.753019 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c5d4915b-7b5f-435e-b38b-e6c2958d8381 req-a3b2facb-def3-4ffc-bab6-f893e6e8421d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034868 Oct 02 02:07:58.753883 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3437/7323] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:07:58.906863 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:07:58.918106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0100c864-155f-4f4b-af79-8de2a2af77a7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1761 microversion: 2.1 time: 0.197830 Oct 02 02:07:58.918768 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3887/7324] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:07:58 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1761 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:09:36.327127 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 02 02:09:36.327757 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:09:36.328744 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:09:36.330015 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 02:09:36.330170 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action (ip 10.222.0.23) !!! Oct 02 02:09:36.336672 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:09:36.339742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:09:36.347658 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:09:36.348147 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:09:36.348586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:09:36.349279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:09:36.349736 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:09:36.350166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:09:36.424070 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-806a35aa-ca31-4cd5-8ba8-207243d22790 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action" status: 202 len: 0 microversion: 2.1 time: 0.099298 Oct 02 02:09:36.424844 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3438/7325] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:09:36 2022] POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:09:36.432967 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:09:36.433725 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=16 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:09:36.434722 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:09:36.435026 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d (ip 10.222.0.23) !!! Oct 02 02:09:36.437087 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:09:36.437350 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d (ip 10.222.0.23) !!! Oct 02 02:09:36.439133 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 02 02:09:36.458718 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:09:36.459380 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:09:36.465690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:09:36.466188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:09:36.467430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:09:36.468159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:09:36.468972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:09:36.469422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:09:36.784581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:09:36.793366 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d8abde4c-9097-4ab8-b0d5-7ed39889ec88 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1763 microversion: 2.1 time: 0.363103 Oct 02 02:09:36.793988 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3888/7326] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:09:36 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1763 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:09:37.819606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:09:37.820570 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:09:37.829100 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:09:37.829590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:09:37.830031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:09:37.830760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:09:37.831220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:09:37.831648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:09:37.838450 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58888. Oct 02 02:09:37.975910 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:09:37.984336 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4aedfa6c-79eb-4a82-a445-d43880a59f5d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1761 microversion: 2.1 time: 0.171041 Oct 02 02:09:37.984906 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3439/7327] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:09:37 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1761 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:10:51.947274 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:10:51.948339 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:10:51.948841 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:10:51.949622 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:10:51.954576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1693249508"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:10:51.955154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:51.963033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:51.963539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:51.963994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:51.964706 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:51.965179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:51.965619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:52.103724 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Removing security group 69cb27ac-9189-4320-9fa3-bb42b132ff5c from port aa846784-942d-414b-bbb8-cd01e163608b Oct 02 02:10:52.404479 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d4a65b9d-9219-47c8-9fad-0c60f453f19f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action" status: 202 len: 0 microversion: 2.1 time: 0.458852 Oct 02 02:10:52.405104 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3889/7328] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:10:51 2022] POST /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:10:52.411479 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:10:52.412426 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:10:52.530889 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-3817fd8b-bea6-43d9-865b-e4ea69c05b4c req-0df7a5e3-9576-47dc-a030-6be253518369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:10:52.540879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3817fd8b-bea6-43d9-865b-e4ea69c05b4c req-0df7a5e3-9576-47dc-a030-6be253518369 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:52.541362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3817fd8b-bea6-43d9-865b-e4ea69c05b4c req-0df7a5e3-9576-47dc-a030-6be253518369 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:52.542006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-3817fd8b-bea6-43d9-865b-e4ea69c05b4c req-0df7a5e3-9576-47dc-a030-6be253518369 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:52.553876 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-3817fd8b-bea6-43d9-865b-e4ea69c05b4c req-0df7a5e3-9576-47dc-a030-6be253518369 service nova] Creating event network-changed:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:10:52.559469 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-3817fd8b-bea6-43d9-865b-e4ea69c05b4c req-0df7a5e3-9576-47dc-a030-6be253518369 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149851 Oct 02 02:10:52.560099 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3440/7329] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:10:53.839999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:53.840527 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:53.848990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:53.850281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:53.850876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:53.851647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:53.852134 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:53.852584 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:53.858636 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58934. Oct 02 02:10:53.872468 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58936. Oct 02 02:10:53.944552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lazy-loading 'services' on Instance uuid 3012ba33-d6b8-4869-bde8-42298c23da6d {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:10:54.023578 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d76d5c0f-fd87-41ee-9246-af5cacc1262c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments/f6d8450f-b557-4035-ad7c-8ba865cd815e" status: 202 len: 0 microversion: 2.1 time: 0.188713 Oct 02 02:10:54.024340 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3890/7330] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:10:53 2022] DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments/f6d8450f-b557-4035-ad7c-8ba865cd815e => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:10:54.034836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:54.037998 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:54.045451 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:54.045949 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:54.046431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:54.047165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:54.047626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:54.048090 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:54.079664 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26177157-9b86-41a7-ba55-c2f5ab9452e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050473 Oct 02 02:10:54.080256 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3441/7331] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:10:54 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:10:54.575362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2b60376b-6e53-4100-8dc2-934918b305e7 req-e1f20b70-e4a8-4898-960f-24109b7a6bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:10:54.585427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2b60376b-6e53-4100-8dc2-934918b305e7 req-e1f20b70-e4a8-4898-960f-24109b7a6bec service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:54.585926 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2b60376b-6e53-4100-8dc2-934918b305e7 req-e1f20b70-e4a8-4898-960f-24109b7a6bec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:54.586373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2b60376b-6e53-4100-8dc2-934918b305e7 req-e1f20b70-e4a8-4898-960f-24109b7a6bec service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:54.597459 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2b60376b-6e53-4100-8dc2-934918b305e7 req-e1f20b70-e4a8-4898-960f-24109b7a6bec service nova] Creating event network-changed:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:10:54.602995 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2b60376b-6e53-4100-8dc2-934918b305e7 req-e1f20b70-e4a8-4898-960f-24109b7a6bec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 Oct 02 02:10:54.603687 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3891/7332] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:10:55.094217 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:55.096325 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:55.103412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:55.104166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:55.104853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:55.106094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:55.106789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:55.107288 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:55.141575 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f35d2e97-b182-4ff4-95e3-85e7bb4ee9a5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052300 Oct 02 02:10:55.142167 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3442/7333] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:10:55 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:10:56.156010 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:56.158448 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:56.165497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:56.166010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:56.166783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:56.167606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:56.167743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:56.168091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:56.199610 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5e26a61e-00fe-4d55-bb6e-6b73aac5d276 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Oct 02 02:10:56.200441 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3892/7334] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:10:56 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:10:57.212956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:57.215126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:57.221898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:57.222386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:57.222972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:57.223662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:57.224933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:57.225571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:57.255557 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d7e75e64-23a4-4760-be1d-3d44a8fc4640 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Oct 02 02:10:57.256133 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3443/7335] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:10:57 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:10:58.268787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:58.272389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:58.279450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:58.279954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:58.280495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:58.281135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:58.281623 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:58.282185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:58.312709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a470b13-d307-4594-9907-4016abc96860 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048111 Oct 02 02:10:58.317519 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3893/7336] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:10:58 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:10:59.325806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:59.327923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:59.334895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:59.335380 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:59.335813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:59.336517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:59.336962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:59.337379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:59.365840 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b9cb9b54-8466-4cfc-8941-1f23f1a4ed95 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044260 Oct 02 02:10:59.366395 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3444/7337] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:10:59 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 02:10:59.377191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:10:59.377824 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:10:59.385424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:59.385927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:59.386427 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:59.387164 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:10:59.387636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:10:59.388081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:10:59.466314 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] HTTP exception thrown: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d is not attached to volume f6d8450f-b557-4035-ad7c-8ba865cd815e Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Request method failure captured: Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: request: DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments/f6d8450f-b557-4035-ad7c-8ba865cd815e HTTP/1.1 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPJIXiHLSVjhWP7e64W92A5QiG2URbiZ5jExCvWrUxlb0GsR2WS6M_MZVFHzH0agv4vGrmNtrCp3pg4AIkWjOmMPFgSgYjuLd9riu5bYI3W_9QhqnNhrzv9NaC8zntfUrVk-UkuE4ch5eFJE_de28t69b3keC1Bh906_q030Q3DjvKc Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e94ca75d802e46e3aa9cc7bb492107fa"}]}] Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 95d2890faf84462493c012c0619b663f Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d is not attached to volume f6d8450f-b557-4035-ad7c-8ba865cd815e Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: action_args: {'server_id': '3012ba33-d6b8-4869-bde8-42298c23da6d', 'id': 'f6d8450f-b557-4035-ad7c-8ba865cd815e'} Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6d8450f-b557-4035-ad7c-8ba865cd815e. Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d is not attached to volume f6d8450f-b557-4035-ad7c-8ba865cd815e Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:10:59.467965 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d is not attached to volume f6d8450f-b557-4035-ad7c-8ba865cd815e Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Returning 404 to user: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d is not attached to volume f6d8450f-b557-4035-ad7c-8ba865cd815e {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ceb5f015-2fb6-4083-842c-ffdccdc338b7 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments/f6d8450f-b557-4035-ad7c-8ba865cd815e" status: 404 len: 154 microversion: 2.1 time: 0.096387 Oct 02 02:10:59.473086 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3894/7338] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:10:59 2022] DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d/os-volume_attachments/f6d8450f-b557-4035-ad7c-8ba865cd815e => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:11:02.726747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:02.727383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:02.734258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:02.734779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:02.735219 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:02.735912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:02.736370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:02.736797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:02.762415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:11:02.843304 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-585292cd-3c74-4515-ac5d-6f12f5a490a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 204 len: 0 microversion: 2.1 time: 0.120151 Oct 02 02:11:02.844060 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3445/7339] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:11:02 2022] DELETE /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:11:02.853451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:02.854091 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:02.863369 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:02.863888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:02.864341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:02.865068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:02.865572 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:02.866015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:02.999422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:03.007735 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1a7c2b37-c678-40ba-8eff-b4cafc02c6cb tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1555 microversion: 2.1 time: 0.158925 Oct 02 02:11:03.008312 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3895/7340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:02 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:04.033702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:04.034409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:04.042701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:04.043186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:04.043630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:04.044320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:04.044778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:04.045207 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:04.181412 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:04.189259 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-be9c62d7-b8d4-448c-894f-9638ab73db12 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1555 microversion: 2.1 time: 0.159845 Oct 02 02:11:04.189832 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3446/7341] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:04 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:05.110483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-61ce7b8d-68aa-437f-bc5a-7b3429beed1c req-9efdd50f-3341-4ab6-9f93-a80f05e6385f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3012ba33-d6b8-4869-bde8-42298c23da6d", "name": "network-vif-deleted", "tag": "aa846784-942d-414b-bbb8-cd01e163608b"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:05.120438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-61ce7b8d-68aa-437f-bc5a-7b3429beed1c req-9efdd50f-3341-4ab6-9f93-a80f05e6385f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:05.120923 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-61ce7b8d-68aa-437f-bc5a-7b3429beed1c req-9efdd50f-3341-4ab6-9f93-a80f05e6385f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:05.121379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-61ce7b8d-68aa-437f-bc5a-7b3429beed1c req-9efdd50f-3341-4ab6-9f93-a80f05e6385f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:05.133130 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-61ce7b8d-68aa-437f-bc5a-7b3429beed1c req-9efdd50f-3341-4ab6-9f93-a80f05e6385f service nova] Creating event network-vif-deleted:aa846784-942d-414b-bbb8-cd01e163608b for instance 3012ba33-d6b8-4869-bde8-42298c23da6d on n-h2-master-1 Oct 02 02:11:05.138145 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-61ce7b8d-68aa-437f-bc5a-7b3429beed1c req-9efdd50f-3341-4ab6-9f93-a80f05e6385f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114312 Oct 02 02:11:05.138839 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3896/7342] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:11:05.215792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:05.216402 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:05.223348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:05.223832 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:05.224332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:05.225211 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:05.225662 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:05.226085 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:05.257779 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:05.258173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:05.258623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:05.259089 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lazy-loading 'fault' on Instance uuid 3012ba33-d6b8-4869-bde8-42298c23da6d {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:11:05.299568 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:05.307958 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4fcaeb91-5d62-4ce5-9f17-ec6aeb3ad67d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 200 len: 1349 microversion: 2.1 time: 0.096027 Oct 02 02:11:05.308524 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3447/7343] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:05 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:06.334018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:06.334760 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 3012ba33-d6b8-4869-bde8-42298c23da6d] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:06.340936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:06.341429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:06.341877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:06.342579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:06.343173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:06.343615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:06.357526 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] HTTP exception thrown: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d could not be found. Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Request method failure captured: Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d HTTP/1.1 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPJIXiHLSVjhWP7e64W92A5QiG2URbiZ5jExCvWrUxlb0GsR2WS6M_MZVFHzH0agv4vGrmNtrCp3pg4AIkWjOmMPFgSgYjuLd9riu5bYI3W_9QhqnNhrzv9NaC8zntfUrVk-UkuE4ch5eFJE_de28t69b3keC1Bh906_q030Q3DjvKc Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e94ca75d802e46e3aa9cc7bb492107fa"}]}] Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 95d2890faf84462493c012c0619b663f Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d could not be found. Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '3012ba33-d6b8-4869-bde8-42298c23da6d'} Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d could not be found. Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d could not be found. Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:11:06.359192 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d could not be found. Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Returning 404 to user: Instance 3012ba33-d6b8-4869-bde8-42298c23da6d could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a475075-19d9-41de-9582-0026ae9890c4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d" status: 404 len: 111 microversion: 2.1 time: 0.031905 Oct 02 02:11:06.364481 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3897/7344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:06 2022] GET /compute/v2.1/servers/3012ba33-d6b8-4869-bde8-42298c23da6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:11:06.370045 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-05e41dad-9934-4a9c-bea8-5b2699a31bc5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '.version_select at 0x7fb8804e21f0>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:06.374544 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05e41dad-9934-4a9c-bea8-5b2699a31bc5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [1ca9303e-bd9b-44eb-af41-44da04a3265d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:11:07.383770 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [None req-05e41dad-9934-4a9c-bea8-5b2699a31bc5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [1ca9303e-bd9b-44eb-af41-44da04a3265d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58988. Oct 02 02:11:07.404566 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-05e41dad-9934-4a9c-bea8-5b2699a31bc5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1440780059" status: 202 len: 0 microversion: 2.1 time: 1.039011 Oct 02 02:11:07.405174 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3448/7345] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 02:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1440780059 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:11:16.684313 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d9d9fe7-3be6-4051-82e0-ed320b576c37 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'create', calling method: .version_select at 0x7fb880ae1af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1388643267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ4xXAlTJxlxCXJJQfEe6qrEu7hetm99SQUwMRjNmFhj0IcaDWVM4vjkfe9H8NgwTNwaKKNiRV+RSKTlruSRkbvgueGFwXh+5ZrnqfJsdxAXtI/YZ96bNUrxtB8wf1tjw=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:16.690566 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=18 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:16.692014 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:16.706157 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2d9d9fe7-3be6-4051-82e0-ed320b576c37 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:11:16.711657 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-2d9d9fe7-3be6-4051-82e0-ed320b576c37 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for user 95d2890faf84462493c012c0619b663f and project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:11:16.739155 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d9d9fe7-3be6-4051-82e0-ed320b576c37 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058755 Oct 02 02:11:16.740474 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3898/7346] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:11:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:11:16.788281 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:16.792914 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2085315490", "imageRef": "bb2e9dd4-84c0-4463-8a35-1ed6f4bd1064", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1388643267", "networks": [{"uuid": "ee61806a-fd7f-4e3d-8eb2-a92ffcbc3dc8"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:16.846482 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] validate_networks() for [('ee61806a-fd7f-4e3d-8eb2-a92ffcbc3dc8', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:11:17.331247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:11:17.331680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:11:17.332163 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:11:17.332581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:11:17.333000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:11:17.343185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:17.343609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:17.344079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:17.344810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:17.345268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:17.345723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:17.364146 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:11:17.370824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Getting quotas for user 95d2890faf84462493c012c0619b663f and project e94ca75d802e46e3aa9cc7bb492107fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:11:17.384742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:11:17.387043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb2e9dd4-84c0-4463-8a35-1ed6f4bd1064',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:11:17.433843 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a25a3177-ce2d-4935-8eee-4fec428fbd73 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648025 Oct 02 02:11:17.434825 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3449/7347] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:11:17.446553 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7b3593df-bcf9-4557-a35c-e66f4669e177 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:17.447219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7b3593df-bcf9-4557-a35c-e66f4669e177 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:17.503365 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7b3593df-bcf9-4557-a35c-e66f4669e177 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:17.510933 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7b3593df-bcf9-4557-a35c-e66f4669e177 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1259 microversion: 2.1 time: 0.068944 Oct 02 02:11:17.511513 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3899/7348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:17 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:18.542429 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:18.543338 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:18.557876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:18.558724 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:18.559351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:18.560527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:18.561188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:18.561790 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:18.921113 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:18.933454 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-468b6638-57cf-4813-a414-88ce15221d44 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1319 microversion: 2.1 time: 0.396872 Oct 02 02:11:18.935239 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3450/7349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:18 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:11:19.961545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:19.962184 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:19.980167 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:19.980785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:19.981246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:19.981979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:19.982453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:19.982989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:20.128377 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:20.136644 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-272cfaa8-8722-4c14-8a90-34bf23cdc5f1 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.179118 Oct 02 02:11:20.137240 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3900/7350] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:19 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:21.160693 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:21.162056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:21.170419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:21.171143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:21.171591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:21.172297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:21.172993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:21.173584 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:21.318487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:21.326924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1a038688-5f51-4afa-98df-2b1c6fa68063 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.170104 Oct 02 02:11:21.327505 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3451/7351] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:21 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:22.351153 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:22.351828 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:22.358986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:22.359492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:22.359951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:22.360673 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:22.361152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:22.361596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:22.497273 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:22.508387 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6739d87-2e3f-49cc-9a3d-d1a0b2da377c tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.161266 Oct 02 02:11:22.509729 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3901/7352] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:22 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:23.532392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:23.533072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:23.537209 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:23.542657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:23.543203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:23.543679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:23.544468 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:23.544929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:23.545358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:23.698627 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:23.706738 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-913806e6-001f-467f-afe0-33c0f14ace48 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.178387 Oct 02 02:11:23.707306 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3452/7353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:23 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:24.731927 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:24.732908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:24.739886 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:24.740397 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:24.740855 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:24.741583 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:24.742055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:24.742499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:24.897933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:24.905745 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f24f3ab-f8ee-46df-80d5-17ff3f9ce951 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.177882 Oct 02 02:11:24.912499 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3902/7354] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:24 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:11:25.929371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:25.930018 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:25.936809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:25.937315 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:25.937753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:25.938453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:25.938947 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:25.939378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:26.084838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:26.093543 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-11d3273e-d450-45dd-be83-7ff233224f7f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.167976 Oct 02 02:11:26.094411 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3453/7355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:25 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:27.118490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:27.119177 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:27.126098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:27.126591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:27.127075 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:27.127775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:27.128251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:27.128790 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:27.262835 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:27.270986 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f3b1496c-bff4-43fa-994a-116e1c37b125 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.156625 Oct 02 02:11:27.271558 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3903/7356] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:27 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:28.294732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:28.295356 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:28.298231 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:28.299015 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:28.307857 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:28.308350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:28.308786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:28.309489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:28.309950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:28.310383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:28.439202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:28.446941 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-69321bcd-458d-4211-a13a-7f8304f4159b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.156139 Oct 02 02:11:28.447518 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3454/7357] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:28 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:29.470884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:29.471515 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:29.473987 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:29.480328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:29.480824 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:29.481272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:29.481971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:29.482441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:29.482908 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:29.619277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:29.627021 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f12e84f-f39d-4d90-8c3e-59ff499c0298 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.160079 Oct 02 02:11:29.627621 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3904/7358] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:29 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:30.419823 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-7e02fa6c-0d90-40f8-8dfd-37a89e7e4691 req-64b4e132-7ad1-4b74-a694-ff779a81a3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:30.434136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7e02fa6c-0d90-40f8-8dfd-37a89e7e4691 req-64b4e132-7ad1-4b74-a694-ff779a81a3e5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:30.435081 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7e02fa6c-0d90-40f8-8dfd-37a89e7e4691 req-64b4e132-7ad1-4b74-a694-ff779a81a3e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:30.435547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-7e02fa6c-0d90-40f8-8dfd-37a89e7e4691 req-64b4e132-7ad1-4b74-a694-ff779a81a3e5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:30.448289 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-7e02fa6c-0d90-40f8-8dfd-37a89e7e4691 req-64b4e132-7ad1-4b74-a694-ff779a81a3e5 service nova] Creating event network-changed:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:11:30.453670 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-7e02fa6c-0d90-40f8-8dfd-37a89e7e4691 req-64b4e132-7ad1-4b74-a694-ff779a81a3e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037513 Oct 02 02:11:30.454304 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3455/7359] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:11:30.651292 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:30.651956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:30.658888 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:30.659388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:30.659843 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:30.660555 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:30.661029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:30.661478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:30.870743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:30.878515 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9e6a0107-48f5-4196-b191-37d30b8d76f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.231207 Oct 02 02:11:30.879141 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3905/7360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:30 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:31.902477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:31.903219 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:31.910142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:31.910643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:31.911086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:31.912314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:31.912789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:31.913229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:32.100269 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:32.108034 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5c9301d9-c91b-4e31-b47e-a79c37634fc0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.209779 Oct 02 02:11:32.108604 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3456/7361] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:31 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:33.131848 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:33.132480 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:33.139276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:33.140010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:33.140207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:33.140940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:33.141408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:33.141845 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:33.359986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:33.368338 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-46fea38f-d128-4b2f-af49-966f9fae4ab6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.240598 Oct 02 02:11:33.368926 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3906/7362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:33 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:34.391929 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:34.392549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:34.399879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:34.400368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:34.400813 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:34.401509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:34.401972 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:34.402404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:34.531898 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:34.540802 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f748932-f02c-46cc-8182-c7d99a086b0d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.152673 Oct 02 02:11:34.541384 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3457/7363] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:34 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:35.565570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:35.566223 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:35.573337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:35.574105 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:35.574557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:35.575283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:35.575749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:35.576185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:35.708102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:35.716098 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6bb0582-8f5e-42e0-aa4a-059db4a0ce01 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.154484 Oct 02 02:11:35.716691 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3907/7364] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:35 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:36.720040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-258140e5-4b06-4bd8-ae26-3b937bfb23c5 req-01cb6017-ba35-415f-a805-7f42f01e326a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "name": "network-vif-plugged", "status": "completed", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:36.730022 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-258140e5-4b06-4bd8-ae26-3b937bfb23c5 req-01cb6017-ba35-415f-a805-7f42f01e326a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:36.730586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-258140e5-4b06-4bd8-ae26-3b937bfb23c5 req-01cb6017-ba35-415f-a805-7f42f01e326a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:36.731122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-258140e5-4b06-4bd8-ae26-3b937bfb23c5 req-01cb6017-ba35-415f-a805-7f42f01e326a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:36.740403 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:36.741598 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:36.743187 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-258140e5-4b06-4bd8-ae26-3b937bfb23c5 req-01cb6017-ba35-415f-a805-7f42f01e326a service nova] Creating event network-vif-plugged:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:11:36.748439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:36.748609 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-258140e5-4b06-4bd8-ae26-3b937bfb23c5 req-01cb6017-ba35-415f-a805-7f42f01e326a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089600 Oct 02 02:11:36.748941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:36.749399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:36.749809 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3458/7365] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:11:36.750123 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:36.750618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:36.751064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:36.929154 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:36.936913 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d9dae3c7-38e2-48c3-87b9-33eb4cfbb8a0 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.200966 Oct 02 02:11:36.937822 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3908/7366] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:36 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:11:37.961098 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:37.961876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:37.968753 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:37.969239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:37.969676 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:37.970377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:37.970868 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:37.971294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:38.100129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:38.107861 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da05b1f3-477a-4ce0-bbbe-6a327dcf5246 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1359 microversion: 2.1 time: 0.151037 Oct 02 02:11:38.108726 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3459/7367] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:37 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:39.132378 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:39.133000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:39.139962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.140457 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.140916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.141620 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.142091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.142535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.274511 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:39.282290 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bd552c48-bfe7-4d6d-a456-1f9fffb6563d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1549 microversion: 2.1 time: 0.154547 Oct 02 02:11:39.282895 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3909/7368] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:39 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:39.306072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:39.306723 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:39.313493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.313980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.314419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.315141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.315601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.316027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.442296 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:39.450906 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fe42a1b7-6f4d-4f73-aeff-6c60b89840f9 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1549 microversion: 2.1 time: 0.149176 Oct 02 02:11:39.451509 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3460/7369] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:39 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:39.472747 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:39.478071 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:39.478882 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Searching by: {'deleted': False, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa'} {{(pid=122354) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 02:11:39.484219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.484712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.485158 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.485887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.486357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.486831 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.510721 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.multi_cell_list [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 02:11:39.536730 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-13b3f850-3de0-44da-a4e8-e14eafd7b706 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067729 Oct 02 02:11:39.537247 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3910/7370] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 02:11:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:11:39.549395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:39.550016 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:39.556634 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.557122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.557567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.558248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:39.558735 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:39.559162 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:39.688620 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:39.696332 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4fccd9eb-a4a5-4c67-aed9-0d1e85bacdec tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1549 microversion: 2.1 time: 0.150814 Oct 02 02:11:39.696902 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3461/7371] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:39 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:41.211231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91b2c1e0-3a97-4aab-8ed2-0531526d5554"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:41.213625 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:41.220528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:41.221035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:41.221494 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:41.222210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:41.222752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:41.223192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:41.483051 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-00b3821a-d15f-43c9-9840-9b95bc19e2c8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276178 Oct 02 02:11:41.483669 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3911/7372] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 2 02:11:41 2022] POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:11:52.271903 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:52.272528 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:52.275564 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=19 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:52.276417 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=66 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:52.282385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:52.282902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:52.283344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:52.284043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:52.284504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:52.284928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:52.416946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:52.425125 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-edb5205a-290b-4a6e-ad13-9b2d20adcc47 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1595 microversion: 2.1 time: 0.157836 Oct 02 02:11:52.425697 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3462/7373] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:52 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:54.338276 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:54.339432 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:54.340221 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:54.352160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-3d0ebaa7-765f-4708-a7cc-1d9e215a3961 req-e753f229-0978-465d-8c09-463209f6a3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:54.365178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3d0ebaa7-765f-4708-a7cc-1d9e215a3961 req-e753f229-0978-465d-8c09-463209f6a3a3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:54.365775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3d0ebaa7-765f-4708-a7cc-1d9e215a3961 req-e753f229-0978-465d-8c09-463209f6a3a3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:54.366719 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-3d0ebaa7-765f-4708-a7cc-1d9e215a3961 req-e753f229-0978-465d-8c09-463209f6a3a3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:54.381104 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-3d0ebaa7-765f-4708-a7cc-1d9e215a3961 req-e753f229-0978-465d-8c09-463209f6a3a3 service nova] Creating event network-changed:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:11:54.387291 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-3d0ebaa7-765f-4708-a7cc-1d9e215a3961 req-e753f229-0978-465d-8c09-463209f6a3a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054095 Oct 02 02:11:54.388446 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3912/7374] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:11:55.351970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1255106242"}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:55.352537 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:55.359475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:55.359994 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:55.360448 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:55.361140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:55.361598 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:55.362029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:55.499217 n-d-master-1 devstack@n-api.service[122355]: INFO nova.network.security_group_api [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Adding security group bf1f2adb-8cae-491f-89d3-be05b799a7b1 to port 62bc1745-4360-48d6-8209-927bf974faec Oct 02 02:11:55.820651 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e45b28fe-392d-4a43-8bea-f7ddd7b5a048 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action" status: 202 len: 0 microversion: 2.1 time: 0.473011 Oct 02 02:11:55.821285 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3463/7375] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:11:55 2022] POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:11:55.831588 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:11:55.832851 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:11:55.840036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:55.840539 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:55.841222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:55.842181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:55.843156 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:55.843826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:56.001349 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:11:56.010730 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3a5cc21-6fcd-4f6d-b43c-3e073a323072 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1760 microversion: 2.1 time: 0.184685 Oct 02 02:11:56.011329 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3913/7376] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:11:55 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1760 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:11:56.404381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ad0622c0-fd2d-4e66-bc75-dbb6d496de54 req-cb6d2ddf-b2be-47ff-b459-03f8ad1114a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:11:56.414893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ad0622c0-fd2d-4e66-bc75-dbb6d496de54 req-cb6d2ddf-b2be-47ff-b459-03f8ad1114a0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:11:56.415476 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ad0622c0-fd2d-4e66-bc75-dbb6d496de54 req-cb6d2ddf-b2be-47ff-b459-03f8ad1114a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:11:56.416036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ad0622c0-fd2d-4e66-bc75-dbb6d496de54 req-cb6d2ddf-b2be-47ff-b459-03f8ad1114a0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:11:56.428383 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ad0622c0-fd2d-4e66-bc75-dbb6d496de54 req-cb6d2ddf-b2be-47ff-b459-03f8ad1114a0 service nova] Creating event network-changed:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:11:56.433414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ad0622c0-fd2d-4e66-bc75-dbb6d496de54 req-cb6d2ddf-b2be-47ff-b459-03f8ad1114a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033954 Oct 02 02:11:56.434014 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3464/7377] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:12:44.130863 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=4 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:44.131544 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:44.177149 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:12:44.179508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:44.185560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:44.186062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:44.186503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:44.187232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:44.187694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:44.188129 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:44.264283 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c1706fd3-aeaf-4443-89ce-896e682d47fa tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action" status: 202 len: 0 microversion: 2.1 time: 0.138384 Oct 02 02:12:44.264904 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3914/7378] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:12:44 2022] POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:12:44.271564 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:44.272308 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:44.276445 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:44.277157 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:44.284133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:44.284621 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:44.285171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:44.285874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:44.286332 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:44.286795 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:44.519841 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:44.528973 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b615778c-455e-498a-bf5f-468f8a8caa63 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1752 microversion: 2.1 time: 0.259598 Oct 02 02:12:44.529568 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3465/7379] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:44 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:45.554847 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:45.556118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:45.562179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:45.562705 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:45.563152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:45.563849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:45.564314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:45.564749 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:45.722891 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:45.732244 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bcd4abb5-51a1-4566-b08d-87d576535720 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.182449 Oct 02 02:12:45.733014 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3915/7380] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:45 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:46.756931 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:46.757549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:46.765007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:46.765492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:46.765933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:46.766679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:46.767140 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:46.767569 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:46.917152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:46.925440 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b1589767-1ae2-451c-af29-8c14190036e3 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.172456 Oct 02 02:12:46.926026 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3466/7381] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:46 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:47.950232 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:47.950903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:47.957915 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:47.958420 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:47.958916 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:47.959640 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:47.960125 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:47.960578 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:48.106271 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:48.114562 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-85da673e-ddf9-4b10-bb4d-963a4e4f1f2b tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.169167 Oct 02 02:12:48.115166 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3916/7382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:47 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:49.139714 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:49.140344 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:49.147136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:49.147632 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:49.148053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:49.148833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:49.149352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:49.149819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:49.291970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:49.302573 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4434e4e1-7cfb-4420-ae02-8c7a7fdd8e3d tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.166667 Oct 02 02:12:49.303206 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3467/7383] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:49 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:50.332244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:50.332867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:50.341028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:50.341526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:50.341973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:50.342715 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:50.343185 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:50.343622 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:50.499277 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:50.507481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f28ec49-516a-4ad5-9ad0-0fbdcd0261f5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.179289 Oct 02 02:12:50.508789 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3917/7384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:50 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:51.532340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:51.532962 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:51.540292 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:51.540783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:51.541220 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:51.541912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:51.542368 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:51.542835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:51.700886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:51.709147 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-92965720-f326-4261-9bf5-6e27bd110a54 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.180778 Oct 02 02:12:51.709718 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3468/7385] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:51 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:52.733182 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:52.733812 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:52.740619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:52.741116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:52.741563 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:52.742989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:52.743605 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:52.744047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:52.886837 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:52.895061 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4cf0cec6-fddb-49aa-9380-8387bbbd4245 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.165843 Oct 02 02:12:52.895633 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3918/7386] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:52 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:53.918976 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:53.919592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:53.926390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:53.926929 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:53.927410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:53.928321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:53.928760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:53.929191 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:54.071124 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:54.079683 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ffb2eaa-28bc-4c55-9fc1-f3816c17eecf tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.165470 Oct 02 02:12:54.080261 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3469/7387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:53 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:55.105058 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:55.105683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:55.111858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:55.112356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:55.112802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:55.113503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:55.113967 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:55.114403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:55.263728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:55.272104 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-151e4911-53d1-42bd-be0e-c7f7fc7a8066 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1757 microversion: 2.1 time: 0.172078 Oct 02 02:12:55.272684 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3919/7388] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:55 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:12:56.296518 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:12:56.297137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:12:56.303908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:56.304888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:56.305335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:56.306036 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:12:56.306484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:12:56.306938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:12:56.452855 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:12:56.461480 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1df9230-d3ae-40af-891f-d6c6868dc22a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1760 microversion: 2.1 time: 0.169002 Oct 02 02:12:56.462104 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3470/7389] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:12:56 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:13:51.648904 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1255106242"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:13:51.649520 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:51.652220 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 02:13:51.652375 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:13:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action (ip 10.222.0.23) !!! Oct 02 02:13:51.653604 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:13:51.653754 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:13:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action (ip 10.222.0.23) !!! Oct 02 02:13:51.654707 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:13:51.655395 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:13:51.665471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:51.665972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:51.666426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:51.667182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:51.667657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:51.668102 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:51.809071 n-d-master-1 devstack@n-api.service[122354]: INFO nova.network.security_group_api [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Removing security group bf1f2adb-8cae-491f-89d3-be05b799a7b1 from port 62bc1745-4360-48d6-8209-927bf974faec Oct 02 02:13:52.105124 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-58682e0b-07ea-48d3-9fec-91422355f28f tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action" status: 202 len: 0 microversion: 2.1 time: 0.461327 Oct 02 02:13:52.105783 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3920/7390] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:13:51 2022] POST /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:13:52.118667 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-acb0200f-0964-4d42-a83f-acf655b8312b req-f801ed31-4108-4811-9bb9-15a5947e6f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:13:52.129625 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 02 02:13:52.131158 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 02:13:52.131504 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 02 02:13:52.132847 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:13:52.133763 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=36 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:13:52.136118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-acb0200f-0964-4d42-a83f-acf655b8312b req-f801ed31-4108-4811-9bb9-15a5947e6f94 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:52.136953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-acb0200f-0964-4d42-a83f-acf655b8312b req-f801ed31-4108-4811-9bb9-15a5947e6f94 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:52.137680 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-acb0200f-0964-4d42-a83f-acf655b8312b req-f801ed31-4108-4811-9bb9-15a5947e6f94 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:52.155146 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-acb0200f-0964-4d42-a83f-acf655b8312b req-f801ed31-4108-4811-9bb9-15a5947e6f94 service nova] Creating event network-changed:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:13:52.160841 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-acb0200f-0964-4d42-a83f-acf655b8312b req-f801ed31-4108-4811-9bb9-15a5947e6f94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046909 Oct 02 02:13:52.162639 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3471/7391] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:53.515958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:53.516469 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:53.521114 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e11da0f2-fb60-4f7a-a4fa-74e09a3c8c42 req-8ed28ab7-fb6b-4e9e-99a4-3dfd648d17a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:13:53.523030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:53.523537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:53.523991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:53.524707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:53.525190 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:53.525626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:53.531731 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e11da0f2-fb60-4f7a-a4fa-74e09a3c8c42 req-8ed28ab7-fb6b-4e9e-99a4-3dfd648d17a6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:53.532423 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e11da0f2-fb60-4f7a-a4fa-74e09a3c8c42 req-8ed28ab7-fb6b-4e9e-99a4-3dfd648d17a6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:53.532924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e11da0f2-fb60-4f7a-a4fa-74e09a3c8c42 req-8ed28ab7-fb6b-4e9e-99a4-3dfd648d17a6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:53.545311 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e11da0f2-fb60-4f7a-a4fa-74e09a3c8c42 req-8ed28ab7-fb6b-4e9e-99a4-3dfd648d17a6 service nova] Creating event network-changed:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:13:53.550965 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e11da0f2-fb60-4f7a-a4fa-74e09a3c8c42 req-8ed28ab7-fb6b-4e9e-99a4-3dfd648d17a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Oct 02 02:13:53.551854 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3472/7392] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:53.615714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lazy-loading 'services' on Instance uuid 23ad618e-47ff-4354-ae23-3dc429ac6554 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:13:53.694862 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-06064b51-9d21-4de9-83e9-21e0fedeeed6 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments/91b2c1e0-3a97-4aab-8ed2-0531526d5554" status: 202 len: 0 microversion: 2.1 time: 0.183757 Oct 02 02:13:53.697363 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3921/7393] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:13:53 2022] DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments/91b2c1e0-3a97-4aab-8ed2-0531526d5554 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:13:53.706343 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:53.709195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:53.718660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:53.719589 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:53.720337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:53.721646 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:53.722293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:53.722760 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:53.804447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1451db9b-c002-420a-8135-663a28cac8dd tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102155 Oct 02 02:13:53.807134 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3473/7394] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:13:53 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:54.822021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:54.824346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:54.830655 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:54.831153 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:54.831602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:54.832306 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:54.832771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:54.833209 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:54.864180 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-98ac6d6d-c91b-4ce8-9b20-f930867b5267 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048236 Oct 02 02:13:54.864904 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3922/7395] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:13:54 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:55.877205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:55.879489 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:55.886548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:55.887071 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:55.887518 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:55.888230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:55.888684 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:55.889110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:55.921499 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9e3e9f1f-7bb5-4b7b-8311-f8f08f3a0ab8 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048337 Oct 02 02:13:55.922089 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3474/7396] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:13:55 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:56.935109 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:56.937260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:56.945035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:56.945815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:56.946276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:56.947022 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:56.947505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:56.947951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:56.979439 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-513d1013-f9a8-48cd-8434-fd8515146bad tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Oct 02 02:13:56.980028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3923/7397] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:13:56 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:57.992172 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:57.994532 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:58.001648 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:58.002213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:58.002746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:58.003613 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:58.004186 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:58.004645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:58.035617 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1e0cfd13-2a25-45a6-a964-5bc2777df1a4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 Oct 02 02:13:58.036293 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3475/7398] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:13:57 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:13:59.047808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:59.051005 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:59.057663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:59.058160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:59.058625 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:59.059349 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:59.059822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:59.060261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:59.090481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-92358f43-22e2-4e31-aaa1-f2d4ecb34538 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046701 Oct 02 02:13:59.091082 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3924/7399] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 02:13:59 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 02:13:59.101664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:13:59.102215 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:13:59.108879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:59.109358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:59.109793 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:59.110478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:13:59.111034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:13:59.111460 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:13:59.185969 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] HTTP exception thrown: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 is not attached to volume 91b2c1e0-3a97-4aab-8ed2-0531526d5554 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Request method failure captured: Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: request: DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments/91b2c1e0-3a97-4aab-8ed2-0531526d5554 HTTP/1.1 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPJIXiHLSVjhWP7e64W92A5QiG2URbiZ5jExCvWrUxlb0GsR2WS6M_MZVFHzH0agv4vGrmNtrCp3pg4AIkWjOmMPFgSgYjuLd9riu5bYI3W_9QhqnNhrzv9NaC8zntfUrVk-UkuE4ch5eFJE_de28t69b3keC1Bh906_q030Q3DjvKc Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e94ca75d802e46e3aa9cc7bb492107fa"}]}] Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 95d2890faf84462493c012c0619b663f Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 is not attached to volume 91b2c1e0-3a97-4aab-8ed2-0531526d5554 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: action_args: {'server_id': '23ad618e-47ff-4354-ae23-3dc429ac6554', 'id': '91b2c1e0-3a97-4aab-8ed2-0531526d5554'} Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 91b2c1e0-3a97-4aab-8ed2-0531526d5554. Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 is not attached to volume 91b2c1e0-3a97-4aab-8ed2-0531526d5554 Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:13:59.187676 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 is not attached to volume 91b2c1e0-3a97-4aab-8ed2-0531526d5554 Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Returning 404 to user: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 is not attached to volume 91b2c1e0-3a97-4aab-8ed2-0531526d5554 {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3b39431-a17e-4183-8f68-368e4dfbd76a tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments/91b2c1e0-3a97-4aab-8ed2-0531526d5554" status: 404 len: 154 microversion: 2.1 time: 0.091445 Oct 02 02:13:59.192223 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3476/7400] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 2 02:13:59 2022] DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554/os-volume_attachments/91b2c1e0-3a97-4aab-8ed2-0531526d5554 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:14:02.443499 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:02.444063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:02.452468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:02.452980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:02.453437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:02.454160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:02.454659 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:02.455440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:02.483272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:14:02.574484 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-37ccf846-adfb-4946-a528-9d467c8b5d94 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 204 len: 0 microversion: 2.1 time: 0.134846 Oct 02 02:14:02.574893 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3925/7401] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:14:02 2022] DELETE /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:14:02.583071 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:02.584374 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:02.592091 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:02.592583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:02.593028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:02.593732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:02.594192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:02.594637 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:02.729423 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:02.743308 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9b21b5c5-3da2-43dc-92da-64ea0542e4f4 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1555 microversion: 2.1 time: 0.163125 Oct 02 02:14:02.744364 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3477/7402] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:02 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:03.771275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:03.771945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:03.781009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:03.782685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:03.782685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:03.783138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:03.783801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:03.784257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:03.913783 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:03.921555 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-63ec357e-6740-4b7d-92b5-27fdef275470 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1555 microversion: 2.1 time: 0.154815 Oct 02 02:14:03.922133 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3926/7403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:03 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:04.890177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-134c3362-5776-4bf0-82d7-e72c8d768a7e req-709ba200-08d4-4cd9-8ff2-890b545eb0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ad618e-47ff-4354-ae23-3dc429ac6554", "name": "network-vif-deleted", "tag": "62bc1745-4360-48d6-8209-927bf974faec"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:04.901426 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-134c3362-5776-4bf0-82d7-e72c8d768a7e req-709ba200-08d4-4cd9-8ff2-890b545eb0f1 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:04.901918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-134c3362-5776-4bf0-82d7-e72c8d768a7e req-709ba200-08d4-4cd9-8ff2-890b545eb0f1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:04.902352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-134c3362-5776-4bf0-82d7-e72c8d768a7e req-709ba200-08d4-4cd9-8ff2-890b545eb0f1 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:04.914215 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-134c3362-5776-4bf0-82d7-e72c8d768a7e req-709ba200-08d4-4cd9-8ff2-890b545eb0f1 service nova] Creating event network-vif-deleted:62bc1745-4360-48d6-8209-927bf974faec for instance 23ad618e-47ff-4354-ae23-3dc429ac6554 on n-h1-master-1 Oct 02 02:14:04.919131 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-134c3362-5776-4bf0-82d7-e72c8d768a7e req-709ba200-08d4-4cd9-8ff2-890b545eb0f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032620 Oct 02 02:14:04.919731 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3478/7404] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:14:04.946329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:04.946991 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:04.954046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:04.954558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:04.955037 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:04.956029 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:04.956671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:04.957116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:05.024423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d2890faf84462493c012c0619b663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ca75d802e46e3aa9cc7bb492107fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:05.033709 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa7ebd9c-8b6a-480f-aac6-6c5e273693e5 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 200 len: 1344 microversion: 2.1 time: 0.092212 Oct 02 02:14:05.034326 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3927/7405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:04 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 1344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:06.058820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:06.059529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] [instance: 23ad618e-47ff-4354-ae23-3dc429ac6554] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:06.065655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:06.066141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:06.066579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:06.067785 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:06.068247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:06.068678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:06.082174 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] HTTP exception thrown: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 could not be found. Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Request method failure captured: Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 HTTP/1.1 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPJIXiHLSVjhWP7e64W92A5QiG2URbiZ5jExCvWrUxlb0GsR2WS6M_MZVFHzH0agv4vGrmNtrCp3pg4AIkWjOmMPFgSgYjuLd9riu5bYI3W_9QhqnNhrzv9NaC8zntfUrVk-UkuE4ch5eFJE_de28t69b3keC1Bh906_q030Q3DjvKc Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e94ca75d802e46e3aa9cc7bb492107fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e94ca75d802e46e3aa9cc7bb492107fa"}]}] Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: e94ca75d802e46e3aa9cc7bb492107fa Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1806020972 Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 95d2890faf84462493c012c0619b663f Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestMinimumBasicScenario-1806020972-project Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 could not be found. Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '23ad618e-47ff-4354-ae23-3dc429ac6554'} Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 could not be found. Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 could not be found. Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:14:06.084487 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 could not be found. Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Returning 404 to user: Instance 23ad618e-47ff-4354-ae23-3dc429ac6554 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78bd25ea-87ae-4595-b60d-48bc5d612943 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554" status: 404 len: 111 microversion: 2.1 time: 0.032294 Oct 02 02:14:06.089755 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3479/7406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:06 2022] GET /compute/v2.1/servers/23ad618e-47ff-4354-ae23-3dc429ac6554 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:14:06.094712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-18473662-fa9e-4c08-bdaa-f0180c6a4093 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] Calling method '.version_select at 0x7fb8807ba8b0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:06.127024 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-18473662-fa9e-4c08-bdaa-f0180c6a4093 tempest-TestMinimumBasicScenario-1806020972 tempest-TestMinimumBasicScenario-1806020972-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1388643267" status: 202 len: 0 microversion: 2.1 time: 0.036148 Oct 02 02:14:06.127618 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3928/7407] 10.222.0.23 () {58 vars in 1272 bytes} [Sun Oct 2 02:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1388643267 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:14:14.903399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-689abaa8-c2ff-4b3a-9c9d-8b876e00dacf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: .version_select at 0x7fb87be35ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-796815330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuRxrkTCxvXSrTzLLXbm078S1ofnAyyXiiJjh0JVjAiXgPJGGGizgxRygDgTuNdxOVG4RSRxptrkGmIzjk6CrxYE4JXNntuE7rXn0/ckjF2ulg1S0tpQ3bhv1BAYnAI8w=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:14.922382 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-689abaa8-c2ff-4b3a-9c9d-8b876e00dacf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:14:14.927690 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-689abaa8-c2ff-4b3a-9c9d-8b876e00dacf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:14:14.956114 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-689abaa8-c2ff-4b3a-9c9d-8b876e00dacf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.228762 Oct 02 02:14:14.956734 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3480/7408] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:14:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:14:20.698664 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:20.700909 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:20.706581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1158843551", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "cf1fc4a3-e7de-4f8f-96c2-2a89844e188d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-796815330", "security_groups": [{"name": "tempest-secgroup-smoke-982134869"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:20.833495 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] validate_networks() for [('cf1fc4a3-e7de-4f8f-96c2-2a89844e188d', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:14:21.353189 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:14:21.353701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:14:21.354401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:14:21.354852 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:14:21.355278 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:14:21.364840 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:21.365567 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:21.366044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:21.366979 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:21.367619 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:21.368242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:21.388022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:14:21.394225 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:14:21.408105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:14:21.411419 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:14:21.473547 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e024bf41-5cdb-4a4d-98e6-2370cb150562 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.776140 Oct 02 02:14:21.474303 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3929/7409] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:14:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:14:21.484392 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=38 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:21.491309 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a3c4b8a-6583-434d-a5d0-c6f0db55e7aa tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:21.492664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a3c4b8a-6583-434d-a5d0-c6f0db55e7aa tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:21.570277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a3c4b8a-6583-434d-a5d0-c6f0db55e7aa tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:21.578166 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a3c4b8a-6583-434d-a5d0-c6f0db55e7aa tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1266 microversion: 2.1 time: 0.095951 Oct 02 02:14:21.580501 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3481/7410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:21 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:22.603193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:22.604147 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:22.611271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:22.611775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:22.612230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:22.612942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:22.614039 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:22.614771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:22.678219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:22.686040 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f01e6548-3b40-4e66-97b1-ec0f58d213df tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1318 microversion: 2.1 time: 0.088296 Oct 02 02:14:22.686647 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3930/7411] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:22 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:23.709813 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:23.710441 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:23.714136 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:23.719995 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:23.720773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:23.721524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:23.722428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:23.723116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:23.723713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:23.919085 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:23.929516 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1ffca87d-3cd6-45ac-b014-9d610c06894f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1391 microversion: 2.1 time: 0.223886 Oct 02 02:14:23.930128 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3482/7412] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:23 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:24.749295 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-28918464-c581-49f6-a252-d72365b0f0dc req-353c43d2-7a58-4238-8184-c2f0050152e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f54f2c7-b614-45b8-be22-f58e1b1da7e8", "tag": "59e88ca3-36a6-413d-ae1b-ba183490a770"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:24.760936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-28918464-c581-49f6-a252-d72365b0f0dc req-353c43d2-7a58-4238-8184-c2f0050152e6 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:24.761451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-28918464-c581-49f6-a252-d72365b0f0dc req-353c43d2-7a58-4238-8184-c2f0050152e6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:24.762121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-28918464-c581-49f6-a252-d72365b0f0dc req-353c43d2-7a58-4238-8184-c2f0050152e6 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:24.774069 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-28918464-c581-49f6-a252-d72365b0f0dc req-353c43d2-7a58-4238-8184-c2f0050152e6 service nova] Creating event network-changed:59e88ca3-36a6-413d-ae1b-ba183490a770 for instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 on n-h2-master-1 Oct 02 02:14:24.779411 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-28918464-c581-49f6-a252-d72365b0f0dc req-353c43d2-7a58-4238-8184-c2f0050152e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034291 Oct 02 02:14:24.780323 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3931/7413] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:14:24.955247 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:24.955875 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:24.963968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:24.964714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:24.965156 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:24.965871 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:24.966327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:24.966782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:25.105732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:25.114079 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44d8f79d-c2dc-4908-849d-b4b16cc45a5c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1391 microversion: 2.1 time: 0.162594 Oct 02 02:14:25.114785 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3483/7414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:24 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:26.138694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:26.139570 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:26.147449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:26.148090 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:26.148611 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:26.149454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:26.150002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:26.150510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:26.299915 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:26.308923 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-291f51c7-effd-46a9-9303-6ce0d6526ce7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1391 microversion: 2.1 time: 0.175391 Oct 02 02:14:26.309519 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3932/7415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:26 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:27.332904 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:27.333552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:27.340384 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:27.340881 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:27.341322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:27.342024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:27.342484 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:27.342939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:27.487860 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:27.496606 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-622fd311-8ce6-4a2f-9987-6d022b94ed1c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1391 microversion: 2.1 time: 0.167632 Oct 02 02:14:27.497195 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3484/7416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:27 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:28.521897 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:28.522522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:28.529587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:28.530085 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:28.530533 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:28.531256 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:28.531721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:28.532157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:28.667867 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:28.675847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-96f4f82e-e5f6-40bd-85ff-ee1928fb0c2c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1391 microversion: 2.1 time: 0.159088 Oct 02 02:14:28.676423 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3933/7417] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:28 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:29.484668 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b5586fb2-ec0c-424e-afa0-dd9f134f363e req-277efed8-6399-4e36-a630-709882475149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f54f2c7-b614-45b8-be22-f58e1b1da7e8", "name": "network-vif-plugged", "status": "completed", "tag": "59e88ca3-36a6-413d-ae1b-ba183490a770"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:29.496933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b5586fb2-ec0c-424e-afa0-dd9f134f363e req-277efed8-6399-4e36-a630-709882475149 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:29.497425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b5586fb2-ec0c-424e-afa0-dd9f134f363e req-277efed8-6399-4e36-a630-709882475149 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:29.497858 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b5586fb2-ec0c-424e-afa0-dd9f134f363e req-277efed8-6399-4e36-a630-709882475149 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:29.510065 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b5586fb2-ec0c-424e-afa0-dd9f134f363e req-277efed8-6399-4e36-a630-709882475149 service nova] Creating event network-vif-plugged:59e88ca3-36a6-413d-ae1b-ba183490a770 for instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 on n-h2-master-1 Oct 02 02:14:29.515418 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b5586fb2-ec0c-424e-afa0-dd9f134f363e req-277efed8-6399-4e36-a630-709882475149 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034568 Oct 02 02:14:29.516363 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3485/7418] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:14:29.699540 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:29.700172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:29.707036 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:29.707557 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:29.708097 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:29.708814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:29.709303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:29.709738 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:29.845750 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:29.854872 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-277117ad-b396-4aed-8bd3-5e6008e419d2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1391 microversion: 2.1 time: 0.159020 Oct 02 02:14:29.855551 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3934/7419] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:29 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:30.887040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:30.887750 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:30.895119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:30.895606 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:30.896044 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:30.896774 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:30.897230 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:30.897659 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:31.030587 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:31.039072 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f2ff4c14-dd34-4238-a730-b6fa6e937c2e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1564 microversion: 2.1 time: 0.156435 Oct 02 02:14:31.039657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3486/7420] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:30 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:31.061944 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:31.062566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:31.070296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:31.070825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:31.071279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:31.071987 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:31.072455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:31.072893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:31.207063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:31.214785 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b7e54327-f039-4ee4-ae37-03d870803154 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1564 microversion: 2.1 time: 0.156590 Oct 02 02:14:31.215363 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3935/7421] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:31 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:33.103729 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:14:33.104425 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:33.106492 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:33.107366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-5fdf298d-02d3-4fc5-9980-7f35cd610507 req-7bff6121-4383-468f-80e5-954905e46d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f54f2c7-b614-45b8-be22-f58e1b1da7e8", "tag": "59e88ca3-36a6-413d-ae1b-ba183490a770"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:33.113269 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:33.114037 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:33.115809 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:33.116691 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:33.117352 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:33.118554 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:33.119248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:33.119847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:33.121331 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5fdf298d-02d3-4fc5-9980-7f35cd610507 req-7bff6121-4383-468f-80e5-954905e46d47 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:33.122056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5fdf298d-02d3-4fc5-9980-7f35cd610507 req-7bff6121-4383-468f-80e5-954905e46d47 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:33.122504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-5fdf298d-02d3-4fc5-9980-7f35cd610507 req-7bff6121-4383-468f-80e5-954905e46d47 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:33.134695 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-5fdf298d-02d3-4fc5-9980-7f35cd610507 req-7bff6121-4383-468f-80e5-954905e46d47 service nova] Creating event network-changed:59e88ca3-36a6-413d-ae1b-ba183490a770 for instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 on n-h2-master-1 Oct 02 02:14:33.140165 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-5fdf298d-02d3-4fc5-9980-7f35cd610507 req-7bff6121-4383-468f-80e5-954905e46d47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036950 Oct 02 02:14:33.140954 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3936/7422] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:14:33.265833 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:14:33.278649 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d43e3705-cda7-4118-8235-04839df58bd4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1564 microversion: 2.1 time: 0.179097 Oct 02 02:14:33.279876 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3487/7423] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:14:33 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:14:56.529420 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:56.530250 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=36 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:56.535281 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:14:56.537612 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:14:56.545389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:56.545826 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:56.546296 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:56.547024 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:14:56.547495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:14:56.547943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:14:56.616521 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eaf01e6b-df2c-4e7b-b98d-5583ac2a8365 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action" status: 200 len: 24569 microversion: 2.1 time: 0.089047 Oct 02 02:14:56.617163 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3937/7424] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:14:56 2022] POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action => generated 24569 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:15:03.027011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:03.027555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:03.029666 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=11 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:03.030379 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=32 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:03.037493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:03.037985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:03.038425 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:03.039166 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:03.039628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:03.040061 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:03.108535 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f3e93f8e-09eb-458b-a0fa-555b5e4b48f3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action" status: 202 len: 0 microversion: 2.1 time: 0.085542 Oct 02 02:15:03.111832 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3488/7425] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:15:03 2022] POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:15:03.118772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:03.119510 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:03.127205 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:03.127737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:03.128207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:03.129007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:03.129490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:03.129940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:03.315387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:03.323765 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-83c800f5-1430-46c8-8acf-0444f7cb2ba4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1688 microversion: 2.1 time: 0.209252 Oct 02 02:15:03.324439 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3938/7426] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:03 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1688 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:04.349968 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:04.350613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:04.356743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:04.357233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:04.357674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:04.358366 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:04.358870 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:04.359301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:04.493877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:04.501637 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6158102c-7d70-4c13-9f95-e91f128643e8 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1668 microversion: 2.1 time: 0.157337 Oct 02 02:15:04.502208 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3489/7427] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:04 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:05.602839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:05.606772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:05.617519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:05.618062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:05.618512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:05.619249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:05.619723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:05.620169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:05.703199 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1821bfb9-b43e-4b1b-9c5f-33360c45ef6d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action" status: 200 len: 32646 microversion: 2.1 time: 0.107356 Oct 02 02:15:05.703894 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3939/7428] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:15:05 2022] POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action => generated 32646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:15:05.716348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:05.716891 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:05.724027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:05.724515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:05.724961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:05.725660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:05.726120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:05.726550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:05.800439 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9d48185-935b-44ac-bfa8-d93b92c5878b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action" status: 202 len: 0 microversion: 2.1 time: 0.087310 Oct 02 02:15:05.801112 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3490/7429] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:15:05 2022] POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:15:05.810020 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:05.810978 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:05.819576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:05.820178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:05.820709 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:05.821521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:05.822096 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:05.822657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:05.968921 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:05.978049 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c898370f-083e-4de0-97a2-b54795ed3877 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1675 microversion: 2.1 time: 0.172301 Oct 02 02:15:05.978656 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3940/7430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:05 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:07.005245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:07.005949 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:07.012492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:07.012980 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:07.013470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:07.014215 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:07.014696 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:07.015152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:07.154792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:07.163597 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1cfb6182-61c9-494d-b449-ec02a31df5e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1683 microversion: 2.1 time: 0.164585 Oct 02 02:15:07.164168 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3491/7431] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:06 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:07.268054 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:07.270924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:07.278997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:07.279499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:07.279952 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:07.280669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:07.281145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:07.281589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:07.344339 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e72c0b4d-5789-491f-9ff4-0fdebca50a28 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action" status: 200 len: 36054 microversion: 2.1 time: 0.080303 Oct 02 02:15:07.345015 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3941/7432] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:15:07 2022] POST /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8/action => generated 36054 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:15:08.380248 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:08.380786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:08.381985 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-97249a1a-e8c2-4ef7-922e-d68853158528 req-ee9eafed-a459-49c5-921c-01c1dd747d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f54f2c7-b614-45b8-be22-f58e1b1da7e8", "tag": "59e88ca3-36a6-413d-ae1b-ba183490a770"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:08.387295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:08.387796 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:08.388245 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:08.389320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:08.389462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:08.389842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:08.393914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-97249a1a-e8c2-4ef7-922e-d68853158528 req-ee9eafed-a459-49c5-921c-01c1dd747d1b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:08.394520 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-97249a1a-e8c2-4ef7-922e-d68853158528 req-ee9eafed-a459-49c5-921c-01c1dd747d1b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:08.394998 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-97249a1a-e8c2-4ef7-922e-d68853158528 req-ee9eafed-a459-49c5-921c-01c1dd747d1b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:08.407092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-97249a1a-e8c2-4ef7-922e-d68853158528 req-ee9eafed-a459-49c5-921c-01c1dd747d1b service nova] Creating event network-changed:59e88ca3-36a6-413d-ae1b-ba183490a770 for instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 on n-h2-master-1 Oct 02 02:15:08.412886 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-97249a1a-e8c2-4ef7-922e-d68853158528 req-ee9eafed-a459-49c5-921c-01c1dd747d1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035294 Oct 02 02:15:08.413584 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3942/7433] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:15:08.423397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:15:08.528444 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4b9deab3-3832-4dde-9672-c81c6ee8e030 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 204 len: 0 microversion: 2.1 time: 0.153149 Oct 02 02:15:08.532452 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3492/7434] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:15:08 2022] DELETE /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:15:08.542774 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:08.543884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:08.551624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:08.552148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:08.552742 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:08.553595 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:08.554072 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:08.554510 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:08.696752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:08.704596 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bdf09fba-fa1f-4f8b-9629-7dbea5550102 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1689 microversion: 2.1 time: 0.166416 Oct 02 02:15:08.705182 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3943/7435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:08 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:09.730659 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:09.731370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:09.738882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:09.739381 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:09.739827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:09.740559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:09.741017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:09.741450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:09.887142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:09.895036 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0919af93-5f2d-4b9f-b5ca-8b8f0fd56ee4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1689 microversion: 2.1 time: 0.168589 Oct 02 02:15:09.895612 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3493/7436] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:09 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:10.748583 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c7cf3013-3159-4581-866c-a495f3ec5395 req-a39364ca-712a-4e68-b4b6-db90ee490bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f54f2c7-b614-45b8-be22-f58e1b1da7e8", "name": "network-vif-deleted", "tag": "59e88ca3-36a6-413d-ae1b-ba183490a770"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:10.760761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c7cf3013-3159-4581-866c-a495f3ec5395 req-a39364ca-712a-4e68-b4b6-db90ee490bb2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:10.761254 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c7cf3013-3159-4581-866c-a495f3ec5395 req-a39364ca-712a-4e68-b4b6-db90ee490bb2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:10.761702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c7cf3013-3159-4581-866c-a495f3ec5395 req-a39364ca-712a-4e68-b4b6-db90ee490bb2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:10.773985 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c7cf3013-3159-4581-866c-a495f3ec5395 req-a39364ca-712a-4e68-b4b6-db90ee490bb2 service nova] Creating event network-vif-deleted:59e88ca3-36a6-413d-ae1b-ba183490a770 for instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 on n-h2-master-1 Oct 02 02:15:10.779924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c7cf3013-3159-4581-866c-a495f3ec5395 req-a39364ca-712a-4e68-b4b6-db90ee490bb2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034969 Oct 02 02:15:10.780544 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3944/7437] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:15:10.919746 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:10.920370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:10.928231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:10.928729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:10.929240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:10.929937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:10.930396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:10.930884 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:10.965295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:10.965784 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:10.966238 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:10.966735 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lazy-loading 'fault' on Instance uuid 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:15:11.011451 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:11.020330 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6f25c68f-00ca-4b3f-bfd7-0f74c24cb744 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 200 len: 1356 microversion: 2.1 time: 0.104519 Oct 02 02:15:11.020930 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3494/7438] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:10 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:12.046725 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:12.047451 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 7f54f2c7-b614-45b8-be22-f58e1b1da7e8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:12.053895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:12.054408 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:12.054883 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:12.055587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:12.056063 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:12.056503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:12.070379 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] HTTP exception thrown: Instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 could not be found. Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Request method failure captured: Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 HTTP/1.1 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPP2zTcvQHzOjJn5pf8cTPe4LaJi20bSbAigbb8-B_bE9sq3Q3LnmuTMJ5SlOczD4xHnassqviUnn86sYp2agw3mQDtBs1croMn27NDgi7bXbgCyhfgss0tTxbCPmYiSDQ9m_DupvN8TtHrc1FJDJAOGZIkaoYaQBKdLu_HZUs-mLc0 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bbed5972f66e4bbd8d012c06ef5f384d"}]}] Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5c1075fd1070483db992c1b46001a8e0 Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 could not be found. Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '7f54f2c7-b614-45b8-be22-f58e1b1da7e8'} Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 could not be found. Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 could not be found. Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:15:12.072032 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 could not be found. Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Returning 404 to user: Instance 7f54f2c7-b614-45b8-be22-f58e1b1da7e8 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8eed8d40-25b1-4a64-98dc-e76c945e959d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8" status: 404 len: 111 microversion: 2.1 time: 0.031852 Oct 02 02:15:12.077335 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3945/7439] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:12 2022] GET /compute/v2.1/servers/7f54f2c7-b614-45b8-be22-f58e1b1da7e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:15:15.112427 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b887f7c0-4f7b-43b5-8091-cc8176d1de06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '.version_select at 0x7fb87be35b80>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:15.134551 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b887f7c0-4f7b-43b5-8091-cc8176d1de06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-796815330" status: 202 len: 0 microversion: 2.1 time: 0.026522 Oct 02 02:15:15.135174 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3495/7440] 10.222.0.23 () {58 vars in 1281 bytes} [Sun Oct 2 02:15:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-796815330 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:15:15.163928 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-10a0c3be-823c-40a5-a5b8-9c17deac092b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: .version_select at 0x7fb880b0a8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1040590581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbW5xtHvwfHNUGEK8xWAQYo/l4Pel+yk+p/KSqIqouItQeOUYvB6XGIUpIhi/FM2wxn2I6teQnPu5yW9Heu4bW77UXq0L84WeH7OZMd5ypkbedbJAnYyKDHM9uGqTJX+Q=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:15.182764 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-10a0c3be-823c-40a5-a5b8-9c17deac092b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:15:15.187988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-10a0c3be-823c-40a5-a5b8-9c17deac092b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:15:15.211167 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-10a0c3be-823c-40a5-a5b8-9c17deac092b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052491 Oct 02 02:15:15.211789 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3946/7441] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:15:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:15:21.024053 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2010077487", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "c74a7267-b60e-4602-9b8f-fd0b09c665a9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1040590581", "security_groups": [{"name": "tempest-secgroup-smoke-822369087"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:21.035008 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:21.137076 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] validate_networks() for [('c74a7267-b60e-4602-9b8f-fd0b09c665a9', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:15:21.581437 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:15:21.581943 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:15:21.582498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:15:21.583209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:15:21.583701 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:15:21.592946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:21.593690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:21.594189 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:21.594981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:21.595444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:21.596021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:21.618686 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:15:21.625389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:15:21.639443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:15:21.646278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:15:21.706009 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e698fb9c-f5a0-47b8-a9ae-6ce956b6873e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.685312 Oct 02 02:15:21.714121 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3496/7442] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:15:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:15:21.726131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ae9c10ea-d090-4257-8496-bf4679ac9e26 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:21.739165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ae9c10ea-d090-4257-8496-bf4679ac9e26 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:21.874933 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ae9c10ea-d090-4257-8496-bf4679ac9e26 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:21.883398 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ae9c10ea-d090-4257-8496-bf4679ac9e26 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1267 microversion: 2.1 time: 0.166621 Oct 02 02:15:21.885056 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3947/7443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:21 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:22.909299 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:22.910088 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:22.916833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:22.917604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:22.918043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:22.918962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:22.919591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:22.920026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:22.988214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:22.996338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-66eb4c2c-cafc-4810-820e-4d6d665576f5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1319 microversion: 2.1 time: 0.093111 Oct 02 02:15:22.997051 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3497/7444] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:22 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:24.020797 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:24.022779 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:24.030162 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=36 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:24.033499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:24.034688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:24.035403 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:24.036541 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:24.037121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:24.037660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:24.123999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:24.138654 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5275b722-ed5c-40dd-92f3-ed95810bdc06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1325 microversion: 2.1 time: 0.121592 Oct 02 02:15:24.157912 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3948/7445] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:24 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1325 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:25.003246 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-b7441d3e-74b1-4e46-9fcd-66933acfa704 req-4d7272b6-fb29-40a4-9385-c770f0609f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b", "tag": "752e2807-dd66-4cc5-84fe-5c86f3abb681"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:25.014103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7441d3e-74b1-4e46-9fcd-66933acfa704 req-4d7272b6-fb29-40a4-9385-c770f0609f72 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:25.014585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7441d3e-74b1-4e46-9fcd-66933acfa704 req-4d7272b6-fb29-40a4-9385-c770f0609f72 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:25.015297 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-b7441d3e-74b1-4e46-9fcd-66933acfa704 req-4d7272b6-fb29-40a4-9385-c770f0609f72 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:25.028557 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-b7441d3e-74b1-4e46-9fcd-66933acfa704 req-4d7272b6-fb29-40a4-9385-c770f0609f72 service nova] Creating event network-changed:752e2807-dd66-4cc5-84fe-5c86f3abb681 for instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b on n-h2-master-1 Oct 02 02:15:25.033742 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-b7441d3e-74b1-4e46-9fcd-66933acfa704 req-4d7272b6-fb29-40a4-9385-c770f0609f72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035132 Oct 02 02:15:25.034356 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3498/7446] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:15:25.165259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:25.165893 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:25.172829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:25.173326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:25.174192 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:25.175117 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:25.175920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:25.176376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:25.421287 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:25.429106 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-55cdddba-cbac-49b6-8c81-852883ea2805 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1392 microversion: 2.1 time: 0.267783 Oct 02 02:15:25.429692 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3949/7447] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:25 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:26.453921 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:26.454658 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:26.460899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:26.461391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:26.461833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:26.462535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:26.463026 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:26.463469 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:26.684961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:26.693385 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e5f0538b-bedb-4f5a-828c-4923ba260a55 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1392 microversion: 2.1 time: 0.244594 Oct 02 02:15:26.694213 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3499/7448] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:26 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:27.718502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:27.719174 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:27.722542 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:27.728094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:27.728604 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:27.729124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:27.729861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:27.730342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:27.730822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:27.879920 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:27.887646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49ab88ac-1bdf-4b40-b3eb-04d146d2c738 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1392 microversion: 2.1 time: 0.173634 Oct 02 02:15:27.888215 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3950/7449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:27 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:28.912476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:28.913126 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:28.919987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:28.920480 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:28.920923 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:28.921620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:28.922080 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:28.922513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:29.054104 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:29.061809 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91a4918d-9ed8-4172-b9f1-84d49920a0a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1392 microversion: 2.1 time: 0.154059 Oct 02 02:15:29.062386 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3500/7450] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:28 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:29.696871 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-42fd7ae3-2355-4f11-8e3e-ac39fc0befb0 req-fd558479-53d5-483b-b526-998bb9162542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b", "name": "network-vif-plugged", "status": "completed", "tag": "752e2807-dd66-4cc5-84fe-5c86f3abb681"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:29.711932 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-42fd7ae3-2355-4f11-8e3e-ac39fc0befb0 req-fd558479-53d5-483b-b526-998bb9162542 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:29.712481 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-42fd7ae3-2355-4f11-8e3e-ac39fc0befb0 req-fd558479-53d5-483b-b526-998bb9162542 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:29.712963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-42fd7ae3-2355-4f11-8e3e-ac39fc0befb0 req-fd558479-53d5-483b-b526-998bb9162542 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:29.726427 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-42fd7ae3-2355-4f11-8e3e-ac39fc0befb0 req-fd558479-53d5-483b-b526-998bb9162542 service nova] Creating event network-vif-plugged:752e2807-dd66-4cc5-84fe-5c86f3abb681 for instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b on n-h2-master-1 Oct 02 02:15:29.731572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-42fd7ae3-2355-4f11-8e3e-ac39fc0befb0 req-fd558479-53d5-483b-b526-998bb9162542 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038828 Oct 02 02:15:29.732295 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3951/7451] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:15:30.085318 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:30.085946 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:30.092783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:30.093272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:30.093716 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:30.094412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:30.094898 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:30.095829 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:30.228122 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:30.236544 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0ac62a6-91eb-4a77-b444-73c3a94163e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1392 microversion: 2.1 time: 0.154494 Oct 02 02:15:30.237167 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3501/7452] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:30 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:31.261192 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:31.261821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:31.268278 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:31.268769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:31.269221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:31.269918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:31.270386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:31.270852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:31.407800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:31.415806 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f27ff8da-6f5d-4e56-b389-04b060637d5f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1563 microversion: 2.1 time: 0.159854 Oct 02 02:15:31.416414 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3952/7453] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:31 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:31.518260 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:31.518848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:31.525702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:31.526199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:31.526675 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:31.527394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:31.527862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:31.528302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:31.606880 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:31.633426 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:31.662939 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:31.670742 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-807986c6-9a3a-4ce5-baa9-f9ff314dd131 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1563 microversion: 2.1 time: 0.156501 Oct 02 02:15:31.671327 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3502/7454] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:31 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:33.583470 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:15:33.584259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:33.586818 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-360e85a1-ee84-45e5-99af-777796571c0b req-dab4a25e-1a69-4e62-8032-2640b5d26e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b", "tag": "752e2807-dd66-4cc5-84fe-5c86f3abb681"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:33.588413 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:33.594009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:33.594522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:33.595005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:33.596348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:33.596819 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:33.597260 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:33.599992 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:33.602548 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-360e85a1-ee84-45e5-99af-777796571c0b req-dab4a25e-1a69-4e62-8032-2640b5d26e43 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:33.603711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-360e85a1-ee84-45e5-99af-777796571c0b req-dab4a25e-1a69-4e62-8032-2640b5d26e43 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:33.604391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-360e85a1-ee84-45e5-99af-777796571c0b req-dab4a25e-1a69-4e62-8032-2640b5d26e43 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:33.623132 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-360e85a1-ee84-45e5-99af-777796571c0b req-dab4a25e-1a69-4e62-8032-2640b5d26e43 service nova] Creating event network-changed:752e2807-dd66-4cc5-84fe-5c86f3abb681 for instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b on n-h2-master-1 Oct 02 02:15:33.629692 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-360e85a1-ee84-45e5-99af-777796571c0b req-dab4a25e-1a69-4e62-8032-2640b5d26e43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047282 Oct 02 02:15:33.631053 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3503/7455] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:15:33.822924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:15:33.832132 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-894dbc65-a956-447a-a459-f44e20a6b873 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1563 microversion: 2.1 time: 0.253461 Oct 02 02:15:33.847087 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3953/7456] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:15:33 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:15:55.091577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:15:55.093873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:15:55.097605 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=36 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:55.104250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:55.104744 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:55.105193 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:55.105894 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:15:55.106360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:15:55.106831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:15:55.174283 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4fa24c74-cc57-4cb3-9c27-2db6f9c9f7bc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b/action" status: 200 len: 24571 microversion: 2.1 time: 0.087101 Oct 02 02:15:55.175296 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3504/7457] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:15:55 2022] POST /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b/action => generated 24571 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:16:06.205034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:16:06.207258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:06.209541 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=7 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:06.210358 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=32 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:06.216774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:06.217275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:06.217727 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:06.218433 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:06.218931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:06.219456 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:06.294437 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c00cb8c-1202-4dc8-8a21-140f54bc81be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b/action" status: 202 len: 0 microversion: 2.1 time: 0.093692 Oct 02 02:16:06.295028 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3954/7458] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:16:06 2022] POST /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:16:06.304370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:06.305092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:06.308181 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:06.308851 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:06.315891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:06.316406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:06.316883 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:06.317602 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:06.318068 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:06.318773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:06.551285 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:06.559169 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4fb6a2d0-c231-47e0-bc1a-464e9378e5b4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1673 microversion: 2.1 time: 0.259143 Oct 02 02:16:06.559757 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3505/7459] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:06 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:07.585930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:07.586679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:07.592836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:07.593327 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:07.593775 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:07.594995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:07.595519 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:07.596009 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:07.728081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:07.736535 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e231ef3c-874c-49b2-8fa5-65fa06842968 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.155946 Oct 02 02:16:07.737113 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3955/7460] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:07 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:16:08.761393 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:08.762004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:08.768694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:08.769175 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:08.769614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:08.770305 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:08.770801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:08.771253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:08.905153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:08.912993 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8b9f57d6-c083-4867-a84b-718af5493f23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.155720 Oct 02 02:16:08.913564 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3506/7461] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:08 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:09.939362 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:09.939994 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:09.947113 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:09.947613 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:09.948070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:09.948777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:09.949252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:09.949696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:10.083667 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:10.091458 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9205034-7d87-4f67-8ebd-fa466fa3525e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.156086 Oct 02 02:16:10.092038 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3956/7462] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:09 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:11.116358 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:11.117056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:11.124294 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:11.124789 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:11.125227 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:11.126630 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:11.127149 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:11.127583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:11.263014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:11.271333 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0d638beb-12de-4d78-ab98-a3050252478c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.158994 Oct 02 02:16:11.271942 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3507/7463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:11 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:12.296329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:12.296879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:12.304449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:12.304944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:12.305390 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:12.306092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:12.306566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:12.307030 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:12.443752 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:12.451581 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ff5b1c2-68a1-4511-91bf-151f24d4281c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.159333 Oct 02 02:16:12.452149 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3957/7464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:12 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:13.476675 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:13.477333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:13.484197 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:13.484766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:13.485748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:13.486450 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:13.486951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:13.487386 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:13.627189 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:13.635063 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5ede9d70-c428-437c-8986-5e0b2820a091 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.162376 Oct 02 02:16:13.635671 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3508/7465] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:13 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:14.659330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:14.659929 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:14.667020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:14.667529 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:14.667991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:14.668707 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:14.669189 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:14.669636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:14.804853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:14.813433 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-14f5be97-3b0c-465e-8a8d-9b336588fbbf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.157428 Oct 02 02:16:14.814016 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3958/7466] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:14 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:15.837838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:15.838385 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:15.845236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:15.845725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:15.846169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:15.846974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:15.847477 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:15.847915 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:15.978881 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:15.986679 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5ac0560-75ee-4936-ac50-916f3a8e8fd7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.152983 Oct 02 02:16:15.987260 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3509/7467] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:15 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:17.011055 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:17.011687 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:17.018812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:17.019310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:17.019761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:17.020466 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:17.020936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:17.021376 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:17.156740 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:17.164493 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b438a866-d147-4ae9-bb3b-77b98cd5461f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.157449 Oct 02 02:16:17.165067 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3959/7468] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:17 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:18.189663 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:18.190305 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:18.197510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:18.197982 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:18.198422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:18.199153 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:18.199616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:18.200052 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:18.328214 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:18.336741 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f197f02c-558e-4cf7-9e0b-962964f9f989 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.151559 Oct 02 02:16:18.337325 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3510/7469] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:18 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:16:19.361967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:19.362587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:19.369603 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:19.370104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:19.370558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:19.371289 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:19.371763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:19.372207 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:19.504409 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:19.512347 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5e6f86a-49dd-4225-8e9e-d961d28067da tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.154977 Oct 02 02:16:19.512944 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3960/7470] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:19 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:20.536581 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:20.537211 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:20.543922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:20.544410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:20.544849 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:20.545547 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:20.546006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:20.546431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:20.683006 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:20.691628 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c34802e0-c970-41fd-ad52-80fa7e1cbae7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.159001 Oct 02 02:16:20.692238 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3511/7471] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:20 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:21.716411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:21.717037 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:21.724741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:21.725249 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:21.725703 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:21.726430 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:21.726937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:21.727386 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:21.857449 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:21.865877 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3efb9392-7259-415e-8c16-6f0f9a4e6a06 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.153489 Oct 02 02:16:21.866463 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3961/7472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:21 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:22.889349 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:22.889954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:22.896867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:22.897358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:22.897806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:22.898506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:22.898997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:22.899435 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:23.034280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:23.042095 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-28450e2a-9010-47fd-9d92-2c4c54cca74a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1678 microversion: 2.1 time: 0.156709 Oct 02 02:16:23.042702 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3512/7473] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:22 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:24.067767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:24.068649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:24.074906 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:24.075405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:24.075862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:24.076565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:24.077035 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:24.077480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:24.206061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:24.213713 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2b6c3047-3b0f-4ed6-9fbb-af22d6ecdb43 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1681 microversion: 2.1 time: 0.150186 Oct 02 02:16:24.214288 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3962/7474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:24 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:46.403742 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:16:46.406245 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:46.408938 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:46.410071 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=48 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:46.416035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:46.416523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:46.416986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:46.417686 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:46.418145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:46.418575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:46.490968 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7069c2a-024d-4d77-98d1-5503aa814b7c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b/action" status: 200 len: 68941 microversion: 2.1 time: 0.091089 Oct 02 02:16:46.491663 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3513/7475] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:16:46 2022] POST /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b/action => generated 68941 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:16:54.016925 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:54.017461 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:54.020436 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=18 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:54.021912 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:54.028443 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:54.028966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:54.029303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:54.030033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:54.030513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:54.031135 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:54.061088 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:16:54.078394 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0da3a940-3a83-4da4-b603-0af02ad73997 req-2437fc2b-a6fe-4e53-9978-b5de0565cd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b", "tag": "752e2807-dd66-4cc5-84fe-5c86f3abb681"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:16:54.091905 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0da3a940-3a83-4da4-b603-0af02ad73997 req-2437fc2b-a6fe-4e53-9978-b5de0565cd5e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:54.092396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0da3a940-3a83-4da4-b603-0af02ad73997 req-2437fc2b-a6fe-4e53-9978-b5de0565cd5e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:54.092840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0da3a940-3a83-4da4-b603-0af02ad73997 req-2437fc2b-a6fe-4e53-9978-b5de0565cd5e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:54.106735 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0da3a940-3a83-4da4-b603-0af02ad73997 req-2437fc2b-a6fe-4e53-9978-b5de0565cd5e service nova] Creating event network-changed:752e2807-dd66-4cc5-84fe-5c86f3abb681 for instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b on n-h2-master-1 Oct 02 02:16:54.112564 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0da3a940-3a83-4da4-b603-0af02ad73997 req-2437fc2b-a6fe-4e53-9978-b5de0565cd5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096637 Oct 02 02:16:54.114014 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3514/7476] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:16:54.143615 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a771c8a2-4188-406b-9b36-95e08df605e9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 204 len: 0 microversion: 2.1 time: 0.130348 Oct 02 02:16:54.144220 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3963/7477] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:16:54 2022] DELETE /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:16:54.156564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:54.158415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:54.166821 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:54.167764 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:54.168411 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:54.170206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:54.171353 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:54.171988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:54.366636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:54.374903 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2c701d95-d54d-46c0-8ff2-d38d7a50be54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1687 microversion: 2.1 time: 0.224444 Oct 02 02:16:54.375429 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3515/7478] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:54 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1687 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:55.400832 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:55.401427 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:55.409688 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:55.410281 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:55.410767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:55.411473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:55.411941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:55.412378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:55.625833 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:55.633627 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5eec595f-de17-4004-9dbe-d94cae85b375 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1687 microversion: 2.1 time: 0.237229 Oct 02 02:16:55.634200 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3964/7479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:55 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1687 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:56.316403 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-2dbbe5d3-f5f9-4157-89d9-5f4023dd93ff req-80d637c5-9c1f-4c91-bf25-1e5d4ca2b49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b", "name": "network-vif-deleted", "tag": "752e2807-dd66-4cc5-84fe-5c86f3abb681"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:16:56.326743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2dbbe5d3-f5f9-4157-89d9-5f4023dd93ff req-80d637c5-9c1f-4c91-bf25-1e5d4ca2b49c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:56.327222 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2dbbe5d3-f5f9-4157-89d9-5f4023dd93ff req-80d637c5-9c1f-4c91-bf25-1e5d4ca2b49c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:56.327654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-2dbbe5d3-f5f9-4157-89d9-5f4023dd93ff req-80d637c5-9c1f-4c91-bf25-1e5d4ca2b49c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:56.340009 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-2dbbe5d3-f5f9-4157-89d9-5f4023dd93ff req-80d637c5-9c1f-4c91-bf25-1e5d4ca2b49c service nova] Creating event network-vif-deleted:752e2807-dd66-4cc5-84fe-5c86f3abb681 for instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b on n-h2-master-1 Oct 02 02:16:56.345526 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-2dbbe5d3-f5f9-4157-89d9-5f4023dd93ff req-80d637c5-9c1f-4c91-bf25-1e5d4ca2b49c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086595 Oct 02 02:16:56.346484 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3516/7480] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:16:56.657560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:56.658193 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:56.665537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:56.666044 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:56.666498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:56.667242 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:56.667723 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:56.668163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:56.700817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:56.701313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:56.701761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:56.702217 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lazy-loading 'fault' on Instance uuid 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:16:56.745502 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:16:56.754538 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a15d5f7c-5fdc-41be-ac8d-edcf8f1c37dd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 200 len: 1357 microversion: 2.1 time: 0.100983 Oct 02 02:16:56.755157 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3965/7481] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:56 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:16:57.779796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:16:57.780536 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:16:57.786900 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:57.787395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:57.787840 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:57.788552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:16:57.789017 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:16:57.789455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:16:57.805098 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] HTTP exception thrown: Instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b could not be found. Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Request method failure captured: Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b HTTP/1.1 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPP2zTcvQHzOjJn5pf8cTPe4LaJi20bSbAigbb8-B_bE9sq3Q3LnmuTMJ5SlOczD4xHnassqviUnn86sYp2agw3mQDtBs1croMn27NDgi7bXbgCyhfgss0tTxbCPmYiSDQ9m_DupvN8TtHrc1FJDJAOGZIkaoYaQBKdLu_HZUs-mLc0 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bbed5972f66e4bbd8d012c06ef5f384d"}]}] Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5c1075fd1070483db992c1b46001a8e0 Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b could not be found. Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b'} Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b could not be found. Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b could not be found. Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:16:57.807169 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b could not be found. Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Returning 404 to user: Instance 34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-96984c61-3fca-441b-bf17-92a68eb1dce2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b" status: 404 len: 111 microversion: 2.1 time: 0.034168 Oct 02 02:16:57.811759 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3517/7482] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:16:57 2022] GET /compute/v2.1/servers/34ca90e5-21a4-40b3-a0c0-5bf7f1e1066b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:17:01.133238 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf60d57c-358e-4fc7-8b11-4fff68bce862 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '.version_select at 0x7fb880b0aee0>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:01.157567 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf60d57c-358e-4fc7-8b11-4fff68bce862 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1040590581" status: 202 len: 0 microversion: 2.1 time: 0.028026 Oct 02 02:17:01.158211 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3966/7483] 10.222.0.23 () {58 vars in 1284 bytes} [Sun Oct 2 02:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1040590581 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:17:01.189084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b73f0861-1300-4cab-ae26-0ce08e78bf91 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: .version_select at 0x7fb87be2be50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-53327498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRUJqN2AEWBM5c35OS+mfYXlh53uIp/B2KIXJ6tUeW2ktFiPbPhFD1EzdgU2+6oKnFalHh+0rr2v71ATO6Uv1rSgtS/4xwx0Ov/nNVZPVBWqNIefvHGrCVameBdL8xHiQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:01.207649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b73f0861-1300-4cab-ae26-0ce08e78bf91 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:17:01.213811 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-b73f0861-1300-4cab-ae26-0ce08e78bf91 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:17:01.237104 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b73f0861-1300-4cab-ae26-0ce08e78bf91 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051725 Oct 02 02:17:01.237830 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3518/7484] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:17:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:17:06.733246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1609641365", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "75717aa5-1297-4e64-9764-e92feb413816"}], "key_name": "tempest-TestNetworkAdvancedServerOps-53327498", "security_groups": [{"name": "tempest-secgroup-smoke-601738330"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:06.757313 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:06.862850 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] validate_networks() for [('75717aa5-1297-4e64-9764-e92feb413816', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:17:07.292798 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:17:07.293336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:17:07.293896 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:17:07.294391 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:17:07.294957 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:17:07.304020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:07.304618 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:07.305139 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:07.305986 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:07.306526 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:07.307065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:07.325838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:17:07.331668 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:17:07.344283 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:17:07.346714 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:17:07.392126 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [63d7ff48-bdc8-4d35-bd10-24583cd97a28] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:17:08.400526 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [63d7ff48-bdc8-4d35-bd10-24583cd97a28] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59926. Oct 02 02:17:08.404901 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49242f16-ab4b-4b66-9b50-8dc47ae0928e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.675557 Oct 02 02:17:08.412346 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3967/7485] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:17:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:17:08.416775 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:08.421638 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6294076d-e82c-45b1-8364-e8765e1f3ded tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:08.422980 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6294076d-e82c-45b1-8364-e8765e1f3ded tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:08.484185 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6294076d-e82c-45b1-8364-e8765e1f3ded tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:08.492341 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6294076d-e82c-45b1-8364-e8765e1f3ded tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1265 microversion: 2.1 time: 0.077968 Oct 02 02:17:08.492946 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3519/7486] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:08 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:09.516381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-59605494-7bc4-4543-b30e-1aca84bfc899 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:09.517039 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-59605494-7bc4-4543-b30e-1aca84bfc899 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:09.578447 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-59605494-7bc4-4543-b30e-1aca84bfc899 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:09.586330 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-59605494-7bc4-4543-b30e-1aca84bfc899 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1265 microversion: 2.1 time: 0.074597 Oct 02 02:17:09.586969 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3968/7487] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:09 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:10.611781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-81e8c47a-9978-4dc6-a395-d9a439189813 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:10.612547 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-81e8c47a-9978-4dc6-a395-d9a439189813 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:10.666492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-81e8c47a-9978-4dc6-a395-d9a439189813 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:10.674086 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-81e8c47a-9978-4dc6-a395-d9a439189813 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1265 microversion: 2.1 time: 0.066346 Oct 02 02:17:10.674771 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3520/7488] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:10 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:11.698990 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-60b42994-e878-4195-b8d2-e025c980fccb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:11.699621 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-60b42994-e878-4195-b8d2-e025c980fccb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:11.756537 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-60b42994-e878-4195-b8d2-e025c980fccb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:11.763911 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-60b42994-e878-4195-b8d2-e025c980fccb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1265 microversion: 2.1 time: 0.068845 Oct 02 02:17:11.764506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3969/7489] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:11 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:12.787901 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:12.788523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:12.795626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:12.796118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:12.796562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:12.797270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:12.797903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:12.799283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:12.873009 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:12.882585 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a3e83905-a961-4afe-97db-e987a539b46e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1323 microversion: 2.1 time: 0.098534 Oct 02 02:17:12.883193 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3521/7490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:12 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:13.907118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:13.907749 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:13.916380 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:13.916881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:13.917338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:13.918045 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:13.918522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:13.918989 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:13.990545 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fc3af2a5-23fc-4f10-88ab-7961f5be3831 req-d55480f1-5b96-4b00-afd9-ccf83ac9cd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:14.016912 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fc3af2a5-23fc-4f10-88ab-7961f5be3831 req-d55480f1-5b96-4b00-afd9-ccf83ac9cd3b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:14.017611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fc3af2a5-23fc-4f10-88ab-7961f5be3831 req-d55480f1-5b96-4b00-afd9-ccf83ac9cd3b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:14.018239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fc3af2a5-23fc-4f10-88ab-7961f5be3831 req-d55480f1-5b96-4b00-afd9-ccf83ac9cd3b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:14.044081 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fc3af2a5-23fc-4f10-88ab-7961f5be3831 req-d55480f1-5b96-4b00-afd9-ccf83ac9cd3b service nova] Creating event network-changed:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h2-master-1 Oct 02 02:17:14.051268 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fc3af2a5-23fc-4f10-88ab-7961f5be3831 req-d55480f1-5b96-4b00-afd9-ccf83ac9cd3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064728 Oct 02 02:17:14.051990 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3522/7491] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:17:14.073905 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:14.081752 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7ebc20ee-d2de-49aa-b268-5e3284f77b20 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.178546 Oct 02 02:17:14.082875 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3970/7492] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:13 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:15.107579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:15.108342 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:15.115086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:15.115619 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:15.116327 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:15.117150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:15.117614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:15.118050 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:15.259854 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:15.268362 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f29242dc-6c14-4f53-b3ba-d2c820d31ca3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.165951 Oct 02 02:17:15.268939 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3523/7493] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:15 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:16.292092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:16.292729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:16.299693 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:16.300203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:16.301210 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:16.301928 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:16.302409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:16.302897 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:16.437207 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:16.445177 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfc7e65f-8a78-44f2-a06f-230aff25e6cd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.157020 Oct 02 02:17:16.445752 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3971/7494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:16 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:17.468125 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:17.468753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:17.471564 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:17.478157 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:17.478677 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:17.479133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:17.479839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:17.480308 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:17.480746 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:17.617725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:17.625558 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-921b4f63-29f7-4c3c-ab29-787a2f6b5b0d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.161499 Oct 02 02:17:17.626152 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3524/7495] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:17 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:18.651529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:18.652172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:18.654896 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:18.661490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:18.662059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:18.662517 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:18.663264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:18.663731 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:18.664173 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:18.798375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:18.806371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4a004261-bc61-4ece-84de-99de6d508973 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.158890 Oct 02 02:17:18.806995 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3972/7496] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:18 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:19.829348 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:19.829957 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:19.837445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:19.837937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:19.838383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:19.839105 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:19.839601 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:19.840034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:19.975020 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:19.982833 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc4e2b79-e669-45a6-b3d5-f6c18e6d7889 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.157429 Oct 02 02:17:19.983409 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3525/7497] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:19 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:20.258165 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b4f8379a-4f90-4e44-9f63-0627ddd317b9 req-ba8e3ae6-6013-459a-84c2-284c4a1b7094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "name": "network-vif-plugged", "status": "completed", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:20.268152 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b4f8379a-4f90-4e44-9f63-0627ddd317b9 req-ba8e3ae6-6013-459a-84c2-284c4a1b7094 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:20.268642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b4f8379a-4f90-4e44-9f63-0627ddd317b9 req-ba8e3ae6-6013-459a-84c2-284c4a1b7094 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:20.269111 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b4f8379a-4f90-4e44-9f63-0627ddd317b9 req-ba8e3ae6-6013-459a-84c2-284c4a1b7094 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:20.280057 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b4f8379a-4f90-4e44-9f63-0627ddd317b9 req-ba8e3ae6-6013-459a-84c2-284c4a1b7094 service nova] Creating event network-vif-plugged:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h2-master-1 Oct 02 02:17:20.285202 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b4f8379a-4f90-4e44-9f63-0627ddd317b9 req-ba8e3ae6-6013-459a-84c2-284c4a1b7094 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090077 Oct 02 02:17:20.285760 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3973/7498] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:17:21.006379 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:21.007028 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:21.008885 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=8 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:21.015329 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:21.015819 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:21.016261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:21.016960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:21.017443 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:21.017893 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:21.150758 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:21.158479 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-da31749c-ef84-4bf5-abcf-9c735531a3cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1390 microversion: 2.1 time: 0.156404 Oct 02 02:17:21.159087 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3526/7499] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:21 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:22.179892 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:22.184160 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:22.184912 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:22.191997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:22.192569 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:22.193275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:22.197486 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:22.197971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:22.198424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:22.336594 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:22.344271 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d38b0f49-d3a7-47fc-bf06-4c603b183c30 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1560 microversion: 2.1 time: 0.166192 Oct 02 02:17:22.344840 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3974/7500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:22 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:22.367797 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:22.368420 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:22.375255 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:22.375750 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:22.376199 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:22.376903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:22.377364 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:22.377808 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:22.516649 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:22.525352 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2b23fbbb-e4f7-49bb-b41b-90f0d5617325 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1560 microversion: 2.1 time: 0.161574 Oct 02 02:17:22.525946 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3527/7501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:22 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:24.474631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:24.475632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:24.475817 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-98917e6f-7710-4455-a93e-6a8bdead1eba req-5c59f108-7184-4666-8e39-98cdf47ee0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:24.477683 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:24.485231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:24.485937 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:24.486453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:24.487208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:24.488482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:24.488991 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:24.490407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-98917e6f-7710-4455-a93e-6a8bdead1eba req-5c59f108-7184-4666-8e39-98cdf47ee0ea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:24.491328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-98917e6f-7710-4455-a93e-6a8bdead1eba req-5c59f108-7184-4666-8e39-98cdf47ee0ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:24.491990 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-98917e6f-7710-4455-a93e-6a8bdead1eba req-5c59f108-7184-4666-8e39-98cdf47ee0ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:24.504633 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-98917e6f-7710-4455-a93e-6a8bdead1eba req-5c59f108-7184-4666-8e39-98cdf47ee0ea service nova] Creating event network-changed:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h2-master-1 Oct 02 02:17:24.510082 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-98917e6f-7710-4455-a93e-6a8bdead1eba req-5c59f108-7184-4666-8e39-98cdf47ee0ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038477 Oct 02 02:17:24.511326 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3528/7502] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:17:24.651713 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:24.660303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b1ff8830-5554-4620-ac44-33dbc2878a54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1560 microversion: 2.1 time: 0.190520 Oct 02 02:17:24.661116 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3975/7503] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:24 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:45.905048 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=9 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:45.905715 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=40 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:45.910033 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:45.912448 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:45.919462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:45.919960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:45.920407 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:45.921116 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:45.921587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:45.922023 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:45.991111 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5360827a-14f2-41d1-b248-ce10ebcd8010 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action" status: 200 len: 24573 microversion: 2.1 time: 0.087879 Oct 02 02:17:45.991788 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3529/7504] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:17:45 2022] POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action => generated 24573 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:17:57.002437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:17:57.004917 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:57.007261 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:57.007915 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=34 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:57.013374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:57.013880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:57.014326 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:57.015052 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:57.015522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:57.015959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:57.059679 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:57.065699 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Old instance type m1.heat2, new instance type m1.heat {{(pid=122354) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 02 02:17:57.072641 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:17:57.073111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:17:57.073601 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:17:57.074022 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:17:57.074445 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:17:57.137464 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1369185-f04b-4171-8417-f7cea2a4c02d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action" status: 202 len: 0 microversion: 2.1 time: 0.138928 Oct 02 02:17:57.138143 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3976/7505] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:17:56 2022] POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:17:57.147899 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:57.148618 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:57.152713 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:57.153488 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:57.158573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:57.159160 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:57.159664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:57.161056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:57.161558 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:57.162031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:57.307204 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:57.315232 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-73fb1bfe-e539-4a52-a0d5-028a559937fe tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1688 microversion: 2.1 time: 0.172625 Oct 02 02:17:57.315821 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3530/7506] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:57 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:58.340399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:58.341611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:58.351143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:58.351760 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:58.352227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:58.352960 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:58.353442 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:58.354011 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:58.498272 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:58.507311 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4822b309-c7ae-4d4d-883c-b39f195c2c62 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1688 microversion: 2.1 time: 0.171800 Oct 02 02:17:58.508098 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3977/7507] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:58 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:17:59.535932 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:17:59.536553 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:17:59.547321 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:59.547814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:59.548260 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:59.548966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:17:59.549431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:17:59.549866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:17:59.679915 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:17:59.687758 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c168f6ac-b563-4284-a087-ebfc8005a264 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.155883 Oct 02 02:17:59.688350 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3531/7508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:17:59 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:00.712614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:00.713234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:00.720007 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:00.720493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:00.720938 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:00.721631 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:00.722098 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:00.722621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:00.863268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:00.871309 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-73171610-4e9e-4e03-a4d4-df7c880866c9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.162558 Oct 02 02:18:00.871895 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3978/7509] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:00 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:01.896608 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:01.897158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:01.905922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:01.906433 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:01.906918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:01.907618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:01.908087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:01.908520 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:02.040001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:02.047829 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ca6d7aa-72b1-4d41-800c-b26037e7317d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.155923 Oct 02 02:18:02.048398 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3532/7510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:01 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:03.072836 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:03.073462 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:03.080299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:03.080794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:03.081277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:03.081964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:03.082428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:03.082895 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:03.216785 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:03.225241 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5f4d73fe-720e-40d4-82f6-46c295b44344 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.156196 Oct 02 02:18:03.225746 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3979/7511] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:03 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:04.249629 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:04.250161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:04.257887 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:04.258629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:04.259158 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:04.259998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:04.260625 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:04.261070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:04.390678 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:04.398467 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2478b2f1-4b9d-4231-a2c8-e600a7915cea tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.152849 Oct 02 02:18:04.399076 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3533/7512] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:04 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:05.422183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:05.422840 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:05.430499 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:05.431033 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:05.431487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:05.432196 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:05.432667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:05.433108 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:05.566500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:05.574501 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4769c288-1616-4205-9a6f-992cead969bd tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.156255 Oct 02 02:18:05.575115 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3980/7513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:05 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:06.598883 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:06.599527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:06.606325 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:06.606797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:06.607237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:06.607928 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:06.608387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:06.608814 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:06.739072 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:06.746765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-df156fa7-c727-410d-8560-3458019ee549 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.152050 Oct 02 02:18:06.747334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3534/7514] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:06 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:07.769437 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:07.770068 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:07.777591 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:07.778092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:07.778543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:07.779273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:07.779741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:07.780181 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:07.917159 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:07.926371 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6612f17-587e-4687-b874-7c1636bea1b3 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.160888 Oct 02 02:18:07.927019 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3981/7515] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:07 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:08.951730 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:08.952354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:08.959568 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:08.960062 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:08.960505 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:08.961206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:08.962521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:08.962521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:09.101357 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:09.109129 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bc0302d8-3e6a-45ca-bc5a-84f4e3cfabc6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.161596 Oct 02 02:18:09.109709 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3535/7516] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:08 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:10.133092 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:10.133756 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:10.140678 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:10.141204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:10.141658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:10.142368 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:10.142865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:10.143310 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:10.275410 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:10.283161 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-55d40474-41a9-4daf-89b1-47215f14b355 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.153947 Oct 02 02:18:10.283678 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3982/7517] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:10 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:11.307830 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:11.308375 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:11.315940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:11.316669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:11.317128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:11.318104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:11.318573 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:11.319035 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:11.453916 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:11.462369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-8eb6a840-0e79-46a0-9243-c3363ff1ef4b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.158476 Oct 02 02:18:11.463211 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3536/7518] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:11 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:12.487102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:12.487879 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:12.494637 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:12.495138 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:12.495594 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:12.496308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:12.496782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:12.497228 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:12.631169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:12.638964 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8399f9e5-4b58-4811-90cd-39ad804e48d7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.155712 Oct 02 02:18:12.639524 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3983/7519] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:12 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:13.663731 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:13.664353 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:13.671210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:13.671695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:13.672136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:13.672827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:13.673283 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:13.673709 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:13.806056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:13.813737 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a60edb20-2a52-4d83-9f6b-d33d224e00a2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.154773 Oct 02 02:18:13.814307 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3537/7520] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:13 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:14.838111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:14.838808 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:14.845917 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:14.846415 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:14.846900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:14.847608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:14.848081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:14.848525 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:14.983067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:14.991397 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ecddeb92-cacf-45b8-86bf-555ce67bb24c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.157173 Oct 02 02:18:14.991970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3984/7521] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:14 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:16.017513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:16.018159 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:16.025304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:16.025787 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:16.026223 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:16.026951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:16.027409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:16.027837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:16.162766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:16.175500 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b2231558-0090-4903-a00a-148c512d6acf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1693 microversion: 2.1 time: 0.161868 Oct 02 02:18:16.176911 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3538/7522] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:16 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:16.813079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "name": "network-vif-unplugged", "status": "completed", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:18:16.824756 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:16.825243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:16.825818 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:16.840469 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] Creating event network-vif-unplugged:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h1-master-1 Oct 02 02:18:16.846110 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] Instance 83d2057f-9c93-4f86-b677-775283f82306 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122354) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:18:16.857098 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-9c2814eb-216e-4591-951b-91dfd6be3a97 req-56d9f356-ae94-4d3d-babd-c049c610710c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047841 Oct 02 02:18:16.857917 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3985/7523] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:18:17.201354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:17.202646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:17.209797 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:17.210291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:17.210770 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:17.211489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:17.211953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:17.212389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:17.478099 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:17.485999 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26266114-8d05-4c34-9eca-acd95dfef795 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1692 microversion: 2.1 time: 0.288538 Oct 02 02:18:17.486589 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3539/7524] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:17 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1692 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:18.512807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:18.513577 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:18.520199 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:18.521288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:18.521753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:18.522471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:18.522983 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:18.523453 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:18.655034 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:18.663336 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49a92c3f-277a-49e0-a929-0d808458e7c4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1690 microversion: 2.1 time: 0.156073 Oct 02 02:18:18.663910 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3986/7525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:18 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:18.897150 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:18:18.907218 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:18.907694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:18.908128 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:18.920120 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] Creating event network-changed:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h1-master-1 Oct 02 02:18:18.926123 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] Instance 83d2057f-9c93-4f86-b677-775283f82306 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122355) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 02 02:18:18.937376 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6aefd02e-5bd6-45e2-8222-c0510e9a9868 req-4fbd903b-191a-476d-8a59-ead5ec4ab69f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044022 Oct 02 02:18:18.938004 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3540/7526] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:18:19.687329 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:19.687969 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:19.695758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:19.696261 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:19.696712 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:19.697417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:19.697887 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:19.698329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:19.837556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:19.845381 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-868e1bae-5a00-41dd-9046-240d644fac41 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1690 microversion: 2.1 time: 0.162090 Oct 02 02:18:19.845958 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3987/7527] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:19 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:20.871611 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:20.872043 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:20.878836 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:20.879533 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:20.879721 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:20.880427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:20.880891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:20.881844 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.049688 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:21.058828 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-44af7570-ce1f-4cb5-88a9-11af94c1849b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1687 microversion: 2.1 time: 0.192844 Oct 02 02:18:21.059425 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3541/7528] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:20 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:21.082524 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:18:21.083130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:21.089936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:21.090437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:21.090918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.091628 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:21.092101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:21.092549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.153600 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f1044a89-ff11-4c21-b4d0-90de878233b2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action" status: 204 len: 0 microversion: 2.1 time: 0.075283 Oct 02 02:18:21.154263 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3988/7529] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:18:21 2022] POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:18:21.163395 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:21.164026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:21.170021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:21.170519 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:21.171005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.171713 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:21.172181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:21.172611 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.311689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:21.320351 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ffa886e-0212-4d7b-ad45-9139d62e6080 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1687 microversion: 2.1 time: 0.161723 Oct 02 02:18:21.320938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3542/7530] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:21 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:21.343874 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:21.344591 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:21.351566 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:21.352064 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:21.352513 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.353216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:21.353686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:21.354126 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:21.497556 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:21.506411 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-761ce7b6-2b90-4305-ab55-30dcda4c78ff tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1687 microversion: 2.1 time: 0.166975 Oct 02 02:18:21.507026 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3989/7531] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:21 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:22.531291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:18:22.532555 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:22.540984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:22.542740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:22.542740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:22.542740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:22.543285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:22.543722 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:22.710848 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:18:22.720145 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-65335a82-203f-480d-82f5-e51055dec4a9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1679 microversion: 2.1 time: 0.192821 Oct 02 02:18:22.721434 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3543/7532] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:18:22 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:18:24.605131 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8f474814-c840-4132-952e-80c5b1f7d799 req-9f24b1fc-d5b4-4523-8b62-b376efd7c853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "name": "network-vif-plugged", "status": "completed", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:18:24.618459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8f474814-c840-4132-952e-80c5b1f7d799 req-9f24b1fc-d5b4-4523-8b62-b376efd7c853 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:24.618997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8f474814-c840-4132-952e-80c5b1f7d799 req-9f24b1fc-d5b4-4523-8b62-b376efd7c853 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:24.619459 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8f474814-c840-4132-952e-80c5b1f7d799 req-9f24b1fc-d5b4-4523-8b62-b376efd7c853 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:24.632301 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8f474814-c840-4132-952e-80c5b1f7d799 req-9f24b1fc-d5b4-4523-8b62-b376efd7c853 service nova] Creating event network-vif-plugged:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h1-master-1 Oct 02 02:18:24.637619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8f474814-c840-4132-952e-80c5b1f7d799 req-9f24b1fc-d5b4-4523-8b62-b376efd7c853 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Oct 02 02:18:24.638230 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3990/7533] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:18:52.941588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:18:52.944322 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:18:52.946646 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=28 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:18:52.947310 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=82 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:18:52.953617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:52.954111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:52.954552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:52.955279 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:18:52.955741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:18:52.956171 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:18:53.021403 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c1d97ac5-e256-4567-bd81-c24638e2ec8f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action" status: 200 len: 24571 microversion: 2.1 time: 0.083659 Oct 02 02:18:53.022048 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3544/7534] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:18:52 2022] POST /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306/action => generated 24571 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:19:10.026060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:10.026857 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:10.028692 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-f91374ce-d3a3-4a12-82c2-3300a5ca3253 req-2f177b71-5780-4f63-88dd-42515c953f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:10.029329 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=34 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:10.030081 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:10.036915 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:19:10.036915 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 02 02:19:10.038185 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:10.038410 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:10.038799 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:10.038939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:10.040106 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:10.040301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:10.040893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:10.041409 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:10.047725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f91374ce-d3a3-4a12-82c2-3300a5ca3253 req-2f177b71-5780-4f63-88dd-42515c953f51 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:10.048284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f91374ce-d3a3-4a12-82c2-3300a5ca3253 req-2f177b71-5780-4f63-88dd-42515c953f51 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:10.048723 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-f91374ce-d3a3-4a12-82c2-3300a5ca3253 req-2f177b71-5780-4f63-88dd-42515c953f51 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:10.063132 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-f91374ce-d3a3-4a12-82c2-3300a5ca3253 req-2f177b71-5780-4f63-88dd-42515c953f51 service nova] Creating event network-changed:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h1-master-1 Oct 02 02:19:10.075958 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:19:10.076120 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-f91374ce-d3a3-4a12-82c2-3300a5ca3253 req-2f177b71-5780-4f63-88dd-42515c953f51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051280 Oct 02 02:19:10.076862 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3545/7535] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:19:10.157835 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-df53b145-c28f-4d15-b75b-fd470c62d552 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 204 len: 0 microversion: 2.1 time: 0.136054 Oct 02 02:19:10.158753 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3991/7536] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:19:10 2022] DELETE /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:19:10.169529 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:10.170244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:10.177376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:10.178013 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:10.178455 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:10.179184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:10.179643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:10.180070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:10.318736 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:10.326701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4765c3a-dcf9-4548-9330-2d724726fc54 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1685 microversion: 2.1 time: 0.161868 Oct 02 02:19:10.327306 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3546/7537] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:10 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:11.353318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:11.354151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:11.360990 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:11.361496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:11.361958 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:11.362685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:11.363608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:11.363745 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:11.516683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:11.526026 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17254e45-ef39-45d3-8059-69951f281c78 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1685 microversion: 2.1 time: 0.177041 Oct 02 02:19:11.526637 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3992/7538] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:11 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:12.551498 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:12.552161 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:12.559020 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:12.559509 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:12.559950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:12.560649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:12.561120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:12.561538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:12.649786 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:12.658369 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2535ab1b-7e71-419c-a0be-6866ae425e64 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 200 len: 1499 microversion: 2.1 time: 0.111440 Oct 02 02:19:12.659154 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3547/7539] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:12 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 1499 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:12.661172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-2d9bf2a7-424f-4d43-be05-a659c4b5ebec req-d8468368-07ef-40a3-a3d4-a8b5046e9a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d2057f-9c93-4f86-b677-775283f82306", "name": "network-vif-deleted", "tag": "11491cb3-7dbb-4f02-a290-4d331cba3e6a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:12.673303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d9bf2a7-424f-4d43-be05-a659c4b5ebec req-d8468368-07ef-40a3-a3d4-a8b5046e9a19 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:12.673829 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d9bf2a7-424f-4d43-be05-a659c4b5ebec req-d8468368-07ef-40a3-a3d4-a8b5046e9a19 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:12.674274 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-2d9bf2a7-424f-4d43-be05-a659c4b5ebec req-d8468368-07ef-40a3-a3d4-a8b5046e9a19 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:12.687548 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-2d9bf2a7-424f-4d43-be05-a659c4b5ebec req-d8468368-07ef-40a3-a3d4-a8b5046e9a19 service nova] Creating event network-vif-deleted:11491cb3-7dbb-4f02-a290-4d331cba3e6a for instance 83d2057f-9c93-4f86-b677-775283f82306 on n-h1-master-1 Oct 02 02:19:12.694847 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-2d9bf2a7-424f-4d43-be05-a659c4b5ebec req-d8468368-07ef-40a3-a3d4-a8b5046e9a19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037666 Oct 02 02:19:12.695460 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3993/7540] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:19:13.682552 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:13.683177 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 83d2057f-9c93-4f86-b677-775283f82306] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:13.690038 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:13.690528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:13.691641 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:13.692831 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:13.693296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:13.693734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:13.708083 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] HTTP exception thrown: Instance 83d2057f-9c93-4f86-b677-775283f82306 could not be found. Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Request method failure captured: Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 HTTP/1.1 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPP2zTcvQHzOjJn5pf8cTPe4LaJi20bSbAigbb8-B_bE9sq3Q3LnmuTMJ5SlOczD4xHnassqviUnn86sYp2agw3mQDtBs1croMn27NDgi7bXbgCyhfgss0tTxbCPmYiSDQ9m_DupvN8TtHrc1FJDJAOGZIkaoYaQBKdLu_HZUs-mLc0 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bbed5972f66e4bbd8d012c06ef5f384d"}]}] Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5c1075fd1070483db992c1b46001a8e0 Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: exception: Instance 83d2057f-9c93-4f86-b677-775283f82306 could not be found. Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': '83d2057f-9c93-4f86-b677-775283f82306'} Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d2057f-9c93-4f86-b677-775283f82306 could not be found. Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d2057f-9c93-4f86-b677-775283f82306 could not be found. Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:19:13.709751 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d2057f-9c93-4f86-b677-775283f82306 could not be found. Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Returning 404 to user: Instance 83d2057f-9c93-4f86-b677-775283f82306 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-00a5eb3c-b680-4e62-b9d5-9d8b274c4b3c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306" status: 404 len: 111 microversion: 2.1 time: 0.032692 Oct 02 02:19:13.714539 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3548/7541] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:13 2022] GET /compute/v2.1/servers/83d2057f-9c93-4f86-b677-775283f82306 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:19:16.794025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5d883d6-3f2b-4471-9141-af962cffa9fc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '.version_select at 0x7fb881bc4d30>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:16.815812 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5d883d6-3f2b-4471-9141-af962cffa9fc tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-53327498" status: 202 len: 0 microversion: 2.1 time: 0.025799 Oct 02 02:19:16.825865 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3994/7542] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 02:19:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-53327498 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:19:16.842323 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-716495bd-9609-43bf-a1f8-ff694665b23a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: .version_select at 0x7fb88166b4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1304703276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVEJ0qBB1w1i3/pu09AdOMEjaBXJSRQ2F747DmsVSdG0ig6r4KAXlphq2mO57Rtn0mfNT9nFd+o+U4DOptbQvWbdn/uqtoLv8e/GBpVjiyPwe+9++5mSTi0jHbQ0il2lw=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:16.860001 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-716495bd-9609-43bf-a1f8-ff694665b23a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:19:16.865948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-716495bd-9609-43bf-a1f8-ff694665b23a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:19:16.892535 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-716495bd-9609-43bf-a1f8-ff694665b23a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054062 Oct 02 02:19:16.893077 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3549/7543] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:19:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:19:22.533634 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1606832898", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "3e42c1ea-0b45-46e2-82a6-0bacfbf8be53"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1304703276", "security_groups": [{"name": "tempest-secgroup-smoke-1041369023"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:22.669000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] validate_networks() for [('3e42c1ea-0b45-46e2-82a6-0bacfbf8be53', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:19:22.680863 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:23.156471 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:19:23.156907 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:19:23.157401 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:19:23.157827 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:19:23.158249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:19:23.171375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:23.171874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:23.172624 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:23.173370 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:23.173835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:23.174468 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:23.202304 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:19:23.208375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:19:23.223926 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:19:23.226423 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:19:23.278425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-db22baa7-88e7-4bcf-b232-50901ae53ee9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750265 Oct 02 02:19:23.279134 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3995/7544] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:19:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:19:23.292400 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-943f52fd-4e2e-4741-a06b-ad0ea102d425 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:23.293022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-943f52fd-4e2e-4741-a06b-ad0ea102d425 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:23.366970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-943f52fd-4e2e-4741-a06b-ad0ea102d425 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:23.374252 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-943f52fd-4e2e-4741-a06b-ad0ea102d425 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1267 microversion: 2.1 time: 0.086967 Oct 02 02:19:23.375249 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3550/7545] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:23 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:24.409632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:24.411031 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:24.417568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:24.418361 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:24.419124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:24.419900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:24.420696 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:24.421324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:24.496249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:24.504860 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-420942b8-c98f-4b4a-9f11-30bd1f2ae9be tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1263 microversion: 2.1 time: 0.108734 Oct 02 02:19:24.505444 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3996/7546] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:24 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1263 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:25.530777 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:25.531391 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:25.533383 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:25.541570 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:25.542070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:25.542511 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:25.543515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:25.543983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:25.544415 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:25.611673 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:25.620206 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f38b3eae-823c-467b-a507-1007083bf28d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1325 microversion: 2.1 time: 0.094189 Oct 02 02:19:25.621232 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3551/7547] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:25 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1325 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:19:26.645771 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:26.646397 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:26.653503 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:26.654203 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:26.654847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:26.655515 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:26.656073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:26.656573 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:26.691268 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6c2487ac-de3a-4bac-a898-76cf65f0e80f req-0b6a450d-92a5-4c43-b28f-f2d0641012ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4de6f67-0cfa-4239-a3b1-2717284f22b0", "tag": "5ba551aa-8e10-47f9-9430-23da4ed8e6d1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:26.712702 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6c2487ac-de3a-4bac-a898-76cf65f0e80f req-0b6a450d-92a5-4c43-b28f-f2d0641012ea service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:26.713190 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6c2487ac-de3a-4bac-a898-76cf65f0e80f req-0b6a450d-92a5-4c43-b28f-f2d0641012ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:26.713752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6c2487ac-de3a-4bac-a898-76cf65f0e80f req-0b6a450d-92a5-4c43-b28f-f2d0641012ea service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:26.727338 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6c2487ac-de3a-4bac-a898-76cf65f0e80f req-0b6a450d-92a5-4c43-b28f-f2d0641012ea service nova] Creating event network-changed:5ba551aa-8e10-47f9-9430-23da4ed8e6d1 for instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 on n-h2-master-1 Oct 02 02:19:26.732500 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6c2487ac-de3a-4bac-a898-76cf65f0e80f req-0b6a450d-92a5-4c43-b28f-f2d0641012ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045910 Oct 02 02:19:26.733492 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3552/7548] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:19:26.811743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:26.820268 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-642cd52f-524d-446b-a8e0-c9518250e225 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.178719 Oct 02 02:19:26.820876 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3997/7549] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:26 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:27.844838 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:27.845554 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:27.853524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:27.854008 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:27.854453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:27.855185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:27.855649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:27.856087 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:27.998779 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:28.006562 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e1d3b2f5-d012-43c7-87d8-36267dcbc6b7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.166016 Oct 02 02:19:28.007185 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3553/7550] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:27 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:29.028974 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:29.029611 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:29.036439 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:29.036936 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:29.037387 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:29.038093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:29.038560 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:29.039023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:29.169947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:29.178417 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ffce335e-9c57-4950-97dd-d08be1585a38 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.153337 Oct 02 02:19:29.179020 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3998/7551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:29 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:30.202762 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:30.203362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:30.211902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:30.212452 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:30.212933 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:30.213882 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:30.214780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:30.215304 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:30.348636 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:30.356621 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f1a1588b-1024-4579-a4e9-2741d2b83429 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.157839 Oct 02 02:19:30.357195 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3554/7552] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:30 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:19:31.380293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:31.380945 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:31.389771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:31.390294 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:31.390900 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:31.391643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:31.392124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:31.392574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:31.535578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:31.543351 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-01ede6a7-e917-4cdc-a966-08f9ccf5939a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.167325 Oct 02 02:19:31.543931 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 3999/7553] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:31 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:32.566592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:32.567249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:32.574276 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:32.574805 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:32.575268 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:32.575946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:32.576402 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:32.576833 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:32.705585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:32.713347 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b40df466-f31c-49e7-b65a-b4f604b1cc69 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.150719 Oct 02 02:19:32.713922 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3555/7554] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:32 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:32.881902 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-7f3321dd-4411-4d0c-941a-25e9f9730e95 req-0967c36b-65cc-4334-bceb-fb75c026af08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4de6f67-0cfa-4239-a3b1-2717284f22b0", "name": "network-vif-plugged", "status": "completed", "tag": "5ba551aa-8e10-47f9-9430-23da4ed8e6d1"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:32.893785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7f3321dd-4411-4d0c-941a-25e9f9730e95 req-0967c36b-65cc-4334-bceb-fb75c026af08 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:32.894904 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7f3321dd-4411-4d0c-941a-25e9f9730e95 req-0967c36b-65cc-4334-bceb-fb75c026af08 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:32.895364 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-7f3321dd-4411-4d0c-941a-25e9f9730e95 req-0967c36b-65cc-4334-bceb-fb75c026af08 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:32.906592 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-7f3321dd-4411-4d0c-941a-25e9f9730e95 req-0967c36b-65cc-4334-bceb-fb75c026af08 service nova] Creating event network-vif-plugged:5ba551aa-8e10-47f9-9430-23da4ed8e6d1 for instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 on n-h2-master-1 Oct 02 02:19:32.912926 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-7f3321dd-4411-4d0c-941a-25e9f9730e95 req-0967c36b-65cc-4334-bceb-fb75c026af08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035367 Oct 02 02:19:32.913544 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4000/7555] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:19:33.738542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:33.739196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:33.741227 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:33.747535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:33.748029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:33.748474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:33.749206 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:33.749668 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:33.750103 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:33.884533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:33.892290 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-802cb33d-01c3-4daa-ab60-d3342d464c9a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1393 microversion: 2.1 time: 0.158762 Oct 02 02:19:33.892882 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3556/7556] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:33 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:34.912930 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:34.913735 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:34.919509 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:34.920259 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:34.927350 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:34.927851 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:34.928303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:34.929006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:34.929479 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:34.929920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:35.060689 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:35.069352 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b635f715-a0dc-49b5-8b7f-73912f48493b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1564 microversion: 2.1 time: 0.157452 Oct 02 02:19:35.069934 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4001/7557] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:34 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:35.092443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:35.093066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:35.099993 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:35.100479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:35.100922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:35.101624 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:35.102084 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:35.102515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:35.238527 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:35.246458 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-497e84df-90ec-4aab-b29a-cfd4d3aa4fdb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1564 microversion: 2.1 time: 0.158462 Oct 02 02:19:35.247078 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3557/7558] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:35 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:19:37.151702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:19:37.152358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:37.154559 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-634edd33-d9df-4466-a585-88d623fb13dd req-51cecc3a-23ba-400a-9a29-f39f9f60a6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4de6f67-0cfa-4239-a3b1-2717284f22b0", "tag": "5ba551aa-8e10-47f9-9430-23da4ed8e6d1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:37.159558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:37.160069 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:37.160522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:37.161258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:37.161753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:37.162377 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:37.167459 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-634edd33-d9df-4466-a585-88d623fb13dd req-51cecc3a-23ba-400a-9a29-f39f9f60a6f2 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:37.167941 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-634edd33-d9df-4466-a585-88d623fb13dd req-51cecc3a-23ba-400a-9a29-f39f9f60a6f2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:37.168553 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-634edd33-d9df-4466-a585-88d623fb13dd req-51cecc3a-23ba-400a-9a29-f39f9f60a6f2 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:37.180739 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-634edd33-d9df-4466-a585-88d623fb13dd req-51cecc3a-23ba-400a-9a29-f39f9f60a6f2 service nova] Creating event network-changed:5ba551aa-8e10-47f9-9430-23da4ed8e6d1 for instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 on n-h2-master-1 Oct 02 02:19:37.186181 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-634edd33-d9df-4466-a585-88d623fb13dd req-51cecc3a-23ba-400a-9a29-f39f9f60a6f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035896 Oct 02 02:19:37.186828 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3558/7559] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:19:37.303490 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:19:37.312108 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-24fdf860-1ab3-4a04-9c24-76e227549170 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1564 microversion: 2.1 time: 0.164451 Oct 02 02:19:37.312711 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4002/7560] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:19:37 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:19:58.550559 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:58.551477 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=40 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:58.556392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:19:58.558821 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:19:58.566395 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:58.567701 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:58.568152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:58.568872 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:19:58.569337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:19:58.569780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:19:58.639861 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ca2e7435-d0f0-42df-840a-8fe7d733f0c6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action" status: 200 len: 24567 microversion: 2.1 time: 0.091196 Oct 02 02:19:58.640773 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3559/7561] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:19:58 2022] POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action => generated 24567 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:20:09.684609 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a0d46ddd-ad78-4804-99a1-06ac948c73ac tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:20:09.686705 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:09.687385 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=40 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:09.693835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d46ddd-ad78-4804-99a1-06ac948c73ac tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:09.694333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d46ddd-ad78-4804-99a1-06ac948c73ac tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:09.694813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a0d46ddd-ad78-4804-99a1-06ac948c73ac tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:09.718845 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a0d46ddd-ad78-4804-99a1-06ac948c73ac tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Going to try to stop instance {{(pid=122354) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 02:20:09.760446 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a0d46ddd-ad78-4804-99a1-06ac948c73ac tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action" status: 202 len: 0 microversion: 2.1 time: 0.079537 Oct 02 02:20:09.761066 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4003/7562] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:20:09 2022] POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:20:09.770478 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:09.771389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:09.774071 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:09.774782 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:09.780165 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:09.780679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:09.781148 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:09.781834 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:09.782298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:09.782786 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:09.918867 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:09.927265 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cfbc1f16-82ec-4473-a687-fc0b24b2449f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.161624 Oct 02 02:20:09.927836 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3560/7563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:09 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:10.954007 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:10.954746 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:10.962833 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:10.963334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:10.963780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:10.964493 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:10.964962 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:10.965428 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:11.169060 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:11.177507 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3cec1d35-f6ba-4269-a99a-71f59b37b967 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.227793 Oct 02 02:20:11.178089 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4004/7564] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:10 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:12.201493 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:12.202111 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:12.209377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:12.209846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:12.210286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:12.211028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:12.211473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:12.211903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:12.341806 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:12.350228 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4825f2a-0960-436c-b889-0f542b49094c tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.152744 Oct 02 02:20:12.350825 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3561/7565] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:12 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:13.374654 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:13.375243 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:13.382127 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:13.382649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:13.383110 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:13.383820 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:13.384290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:13.384733 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:13.517873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:13.526397 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c6b70ab-1828-4799-bc6b-029c00f00fb6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.155806 Oct 02 02:20:13.527017 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4005/7566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:13 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:14.550540 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:14.552264 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:14.558901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:14.559385 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:14.559823 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:14.560513 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:14.560968 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:14.561394 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:14.695228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:14.702990 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fd07f313-d380-43bf-90a0-52a877f00a0b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.156343 Oct 02 02:20:14.703572 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3562/7567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:14 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:15.728314 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:15.728966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:15.735806 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:15.736301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:15.736750 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:15.737449 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:15.737946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:15.738431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:15.869004 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:15.876809 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f5b8c0b1-af2f-4dd9-95c8-731fe4fec053 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.152404 Oct 02 02:20:15.877382 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4006/7568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:15 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:16.901753 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:16.902330 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:16.909233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:16.909725 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:16.910172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:16.911504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:16.911971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:16.912408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:17.046982 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:17.055744 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-acc2ef4e-1945-4ce2-b4b2-5e81959bb144 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.158021 Oct 02 02:20:17.056332 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3563/7569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:16 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:18.082675 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:18.083542 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:18.090462 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:18.090996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:18.091448 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:18.092154 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:18.092634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:18.093077 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:18.223210 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:18.231996 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a337cf6-01ee-4463-ac0a-2f6400fff996 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.153174 Oct 02 02:20:18.232611 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4007/7570] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:18 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:19.257103 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:19.257640 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:19.264524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:19.265007 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:19.265445 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:19.266144 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:19.266628 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:19.267054 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:19.402892 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:19.410701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9243e358-69c3-4f5e-a7e2-47d7a2e814e2 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.158208 Oct 02 02:20:19.411281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3564/7571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:19 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:20.434998 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:20.435629 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:20.443551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:20.443890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:20.444341 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:20.445082 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:20.445554 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:20.445995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:20.578354 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:20.586881 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f3f973d-2578-4800-b13d-ab8ed77ca611 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.155830 Oct 02 02:20:20.587470 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4008/7572] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:20 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:21.610820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:21.611432 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:21.618739 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:21.619231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:21.619674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:21.620387 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:21.620852 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:21.621317 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:21.768444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:21.777553 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f6f73c76-634a-47c9-8839-ce7f30c060a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.170793 Oct 02 02:20:21.778156 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3565/7573] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:21 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:22.801529 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:22.802839 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:22.809769 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:22.810273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:22.810786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:22.811498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:22.811972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:22.812416 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:22.944003 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:22.951952 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dfd47ddf-3361-4062-b147-b3a47b9626b9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.154384 Oct 02 02:20:22.952529 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4009/7574] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:22 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:23.978722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:23.979365 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:23.986141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:23.986665 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:23.987111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:23.987806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:23.988266 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:23.988726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:24.119083 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:24.126935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-1aa4721d-f27c-4399-a6ac-4074fd454897 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1692 microversion: 2.1 time: 0.152225 Oct 02 02:20:24.127508 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3566/7575] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:23 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:25.151116 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:25.151758 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:25.158183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:25.158725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:25.159188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:25.159909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:25.160388 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:25.160837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:25.298622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:25.306985 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a6bf18f2-ac82-4e92-a4d7-70b0338b1940 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1669 microversion: 2.1 time: 0.159865 Oct 02 02:20:25.307569 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4010/7576] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:25 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:20:26.403641 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:20:26.406220 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:26.413458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:26.413953 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:26.414397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:26.415132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:26.415610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:26.416025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:26.616607 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e7e961e9-21b9-468f-a4c3-543523069c67 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action" status: 200 len: 38434 microversion: 2.1 time: 0.217593 Oct 02 02:20:26.617204 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3567/7577] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:20:26 2022] POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action => generated 38434 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:20:26.629250 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-641f05eb-8035-443a-8377-16c8562ab8e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:20:26.637258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-641f05eb-8035-443a-8377-16c8562ab8e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:26.637757 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-641f05eb-8035-443a-8377-16c8562ab8e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:26.638201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-641f05eb-8035-443a-8377-16c8562ab8e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:26.661311 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-641f05eb-8035-443a-8377-16c8562ab8e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Going to try to start instance {{(pid=122354) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 02:20:26.703643 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-641f05eb-8035-443a-8377-16c8562ab8e5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action" status: 202 len: 0 microversion: 2.1 time: 0.078168 Oct 02 02:20:26.704269 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4011/7578] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:20:26 2022] POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:20:26.713270 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:26.713996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:26.722876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:26.723639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:26.724183 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:26.724902 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:26.725389 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:26.725904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:26.864826 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:26.873024 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0ea08e58-2b6f-4fe0-af94-24fa831e814d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1678 microversion: 2.1 time: 0.163990 Oct 02 02:20:26.881276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3568/7579] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:26 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:27.899473 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:27.900185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:27.906325 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:27.906857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:27.907838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:27.908544 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:27.909020 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:27.909473 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:28.044966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:28.052737 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-067d6a69-f2f4-4817-8450-fea349b453a0 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1682 microversion: 2.1 time: 0.158985 Oct 02 02:20:28.053311 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4012/7580] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:27 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:20:52.245541 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:20:52.247706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:52.250442 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=18 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:52.251136 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=52 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:52.252043 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:20:52.252188 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action (ip 10.222.0.23) !!! Oct 02 02:20:52.260938 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:52.261427 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:52.261874 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:52.262581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:52.263143 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:52.263575 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:52.332484 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a3bd7ecc-7928-4497-a1ed-3f7ef74025b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action" status: 200 len: 62999 microversion: 2.1 time: 0.090827 Oct 02 02:20:52.333143 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3569/7581] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:20:52 2022] POST /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0/action => generated 62999 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:20:59.379986 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:59.380631 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:59.382854 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=20 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:59.383657 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:59.392039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-463d42d1-443e-42ab-963d-c4c3f83e46d7 req-05f377cc-28a4-4b56-a48b-c464be0e9d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4de6f67-0cfa-4239-a3b1-2717284f22b0", "tag": "5ba551aa-8e10-47f9-9430-23da4ed8e6d1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:20:59.404762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:59.405268 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:59.405724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:59.406455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:59.406956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:59.407396 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:59.416462 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-463d42d1-443e-42ab-963d-c4c3f83e46d7 req-05f377cc-28a4-4b56-a48b-c464be0e9d7e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:59.416950 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-463d42d1-443e-42ab-963d-c4c3f83e46d7 req-05f377cc-28a4-4b56-a48b-c464be0e9d7e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:59.417428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-463d42d1-443e-42ab-963d-c4c3f83e46d7 req-05f377cc-28a4-4b56-a48b-c464be0e9d7e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:59.430360 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-463d42d1-443e-42ab-963d-c4c3f83e46d7 req-05f377cc-28a4-4b56-a48b-c464be0e9d7e service nova] Creating event network-changed:5ba551aa-8e10-47f9-9430-23da4ed8e6d1 for instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 on n-h2-master-1 Oct 02 02:20:59.435786 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-463d42d1-443e-42ab-963d-c4c3f83e46d7 req-05f377cc-28a4-4b56-a48b-c464be0e9d7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047664 Oct 02 02:20:59.436403 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3570/7582] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:20:59.438256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:20:59.523507 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fdfbded2-df99-4e23-96ca-60946aa47bf7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 204 len: 0 microversion: 2.1 time: 0.147043 Oct 02 02:20:59.533810 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:20:59.534592 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:20:59.538167 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4013/7583] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:20:59 2022] DELETE /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:20:59.541424 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:59.541944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:59.542383 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:59.543118 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:20:59.543577 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:20:59.544005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:20:59.679859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:20:59.688021 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d12fc034-143e-4c9e-804a-9e82884ace6e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1688 microversion: 2.1 time: 0.158866 Oct 02 02:20:59.688827 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3571/7584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:20:59 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:00.713411 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:00.714135 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:00.721073 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:00.721574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:00.722027 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:00.722772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:00.723743 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:00.724182 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:00.858267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:00.866205 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e46df6f7-0c83-4051-b384-0b1c5f5672c7 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1688 microversion: 2.1 time: 0.157223 Oct 02 02:21:00.866815 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4014/7585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:00 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:01.677355 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ec3ddc28-587f-4d10-a466-ee66b5298dc7 req-f1d083ec-27c0-45e0-8700-7212c1cf0bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4de6f67-0cfa-4239-a3b1-2717284f22b0", "name": "network-vif-deleted", "tag": "5ba551aa-8e10-47f9-9430-23da4ed8e6d1"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:01.693311 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ec3ddc28-587f-4d10-a466-ee66b5298dc7 req-f1d083ec-27c0-45e0-8700-7212c1cf0bb3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:01.694196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ec3ddc28-587f-4d10-a466-ee66b5298dc7 req-f1d083ec-27c0-45e0-8700-7212c1cf0bb3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:01.694885 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ec3ddc28-587f-4d10-a466-ee66b5298dc7 req-f1d083ec-27c0-45e0-8700-7212c1cf0bb3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:01.706161 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ec3ddc28-587f-4d10-a466-ee66b5298dc7 req-f1d083ec-27c0-45e0-8700-7212c1cf0bb3 service nova] Creating event network-vif-deleted:5ba551aa-8e10-47f9-9430-23da4ed8e6d1 for instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 on n-h2-master-1 Oct 02 02:21:01.711656 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ec3ddc28-587f-4d10-a466-ee66b5298dc7 req-f1d083ec-27c0-45e0-8700-7212c1cf0bb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038521 Oct 02 02:21:01.712276 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3572/7586] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:21:01.889341 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:01.889975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:01.897660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:01.898165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:01.898649 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:01.899379 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:01.899852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:01.900298 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:01.931302 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:01.931801 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:01.932258 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:01.932717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lazy-loading 'fault' on Instance uuid c4de6f67-0cfa-4239-a3b1-2717284f22b0 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:21:01.978375 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:01.990115 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ffd5143-998a-4d52-9955-ad72537d7ea6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 200 len: 1357 microversion: 2.1 time: 0.103654 Oct 02 02:21:01.991540 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4015/7587] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:01 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:03.018152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:03.018886 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: c4de6f67-0cfa-4239-a3b1-2717284f22b0] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:03.032029 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:03.032535 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:03.032983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:03.033714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:03.034178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:03.034639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:03.049592 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] HTTP exception thrown: Instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 could not be found. Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Request method failure captured: Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 HTTP/1.1 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPP2zTcvQHzOjJn5pf8cTPe4LaJi20bSbAigbb8-B_bE9sq3Q3LnmuTMJ5SlOczD4xHnassqviUnn86sYp2agw3mQDtBs1croMn27NDgi7bXbgCyhfgss0tTxbCPmYiSDQ9m_DupvN8TtHrc1FJDJAOGZIkaoYaQBKdLu_HZUs-mLc0 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bbed5972f66e4bbd8d012c06ef5f384d"}]}] Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 5c1075fd1070483db992c1b46001a8e0 Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: exception: Instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 could not be found. Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'c4de6f67-0cfa-4239-a3b1-2717284f22b0'} Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 could not be found. Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 could not be found. Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:21:03.051341 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 could not be found. Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Returning 404 to user: Instance c4de6f67-0cfa-4239-a3b1-2717284f22b0 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d49bfbee-9707-4925-a33f-a37cd06db4db tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0" status: 404 len: 111 microversion: 2.1 time: 0.040681 Oct 02 02:21:03.057935 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3573/7588] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:03 2022] GET /compute/v2.1/servers/c4de6f67-0cfa-4239-a3b1-2717284f22b0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:21:06.342381 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa8c25b2-6ff0-4b91-bc9a-547ffcb1fd23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '.version_select at 0x7fb880ae1700>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:06.363065 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa8c25b2-6ff0-4b91-bc9a-547ffcb1fd23 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1304703276" status: 202 len: 0 microversion: 2.1 time: 0.024501 Oct 02 02:21:06.363821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4016/7589] 10.222.0.23 () {58 vars in 1284 bytes} [Sun Oct 2 02:21:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1304703276 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:21:06.403202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a255fa93-a78f-4dd7-83ea-e1827ac846a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: .version_select at 0x7fb880849a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1816039079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGCcYkqaaLxh+BtVamQAGmw7qZtbAqmeFAHHsnZcjPf7/e3RgbIJPjospQt7UQGtZuuMbCDspKPOGXW5+qq00i3dMK5vU+3HHwWqWH2YUrzmMfCLdp5iyvh4rL7DP+YCQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:06.424576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a255fa93-a78f-4dd7-83ea-e1827ac846a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:21:06.433066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-a255fa93-a78f-4dd7-83ea-e1827ac846a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:21:06.463936 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a255fa93-a78f-4dd7-83ea-e1827ac846a4 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066887 Oct 02 02:21:06.464897 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3574/7590] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:21:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:21:11.952326 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-539082107", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "networks": [{"uuid": "95c947a4-cb16-40a9-bb0b-7a9449ec4f56"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1816039079", "security_groups": [{"name": "tempest-secgroup-smoke-501647983"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:11.986380 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:12.101908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] validate_networks() for [('95c947a4-cb16-40a9-bb0b-7a9449ec4f56', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:21:12.540275 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:21:12.540717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:21:12.541202 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:21:12.541682 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:21:12.542099 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:21:12.551543 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:12.552171 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:12.553042 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:12.554176 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:12.554868 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:12.555318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:12.581251 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:21:12.587730 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Getting quotas for user 5c1075fd1070483db992c1b46001a8e0 and project bbed5972f66e4bbd8d012c06ef5f384d. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:21:12.606536 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:21:12.609127 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:21:12.663019 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8e8be99-0157-409e-ab16-6742a260519e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.715587 Oct 02 02:21:12.663784 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4017/7591] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:21:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 02:21:12.675249 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5d2079a-8e09-417a-a503-bfbbf1af9b88 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:12.677378 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5d2079a-8e09-417a-a503-bfbbf1af9b88 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:12.754472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5d2079a-8e09-417a-a503-bfbbf1af9b88 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:12.762442 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5d2079a-8e09-417a-a503-bfbbf1af9b88 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1266 microversion: 2.1 time: 0.090816 Oct 02 02:21:12.780459 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3575/7592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:12 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:13.790979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:13.792350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:13.799446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:13.800178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:13.800800 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:13.801740 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:13.802980 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:13.803687 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:13.897172 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:13.905239 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-601dd402-39f9-4538-aca9-3dd145062b5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1336 microversion: 2.1 time: 0.120178 Oct 02 02:21:13.905821 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4018/7593] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:13 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:14.930486 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:14.931152 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:14.933498 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=16 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:14.940586 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:14.941098 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:14.941545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:14.942801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:14.943517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:14.943965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:15.164336 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:15.173951 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5e64d97-f219-4940-b4b8-e7118c3e92f9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.248354 Oct 02 02:21:15.174555 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3576/7594] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:14 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:15.471781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-cdd090eb-f03a-45f5-bf89-1531e66a5736 req-f4db959a-6828-4235-8eca-44c650a6f7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fc8291-342b-4f2f-9943-f8776258f174", "tag": "17458ce6-ed0d-46bb-8a00-327fc48e9d3a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:15.483718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cdd090eb-f03a-45f5-bf89-1531e66a5736 req-f4db959a-6828-4235-8eca-44c650a6f7e3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:15.484222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cdd090eb-f03a-45f5-bf89-1531e66a5736 req-f4db959a-6828-4235-8eca-44c650a6f7e3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:15.484680 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-cdd090eb-f03a-45f5-bf89-1531e66a5736 req-f4db959a-6828-4235-8eca-44c650a6f7e3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:15.496345 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-cdd090eb-f03a-45f5-bf89-1531e66a5736 req-f4db959a-6828-4235-8eca-44c650a6f7e3 service nova] Creating event network-changed:17458ce6-ed0d-46bb-8a00-327fc48e9d3a for instance 71fc8291-342b-4f2f-9943-f8776258f174 on n-h2-master-1 Oct 02 02:21:15.501554 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-cdd090eb-f03a-45f5-bf89-1531e66a5736 req-f4db959a-6828-4235-8eca-44c650a6f7e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033730 Oct 02 02:21:15.502196 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4019/7595] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:21:16.200442 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:16.200950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:16.208458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:16.209303 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:16.209749 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:16.210474 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:16.210961 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:16.211391 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:16.350816 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:16.358668 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b68d768b-ddc2-4f07-b61e-06fdb6debd5d tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.164305 Oct 02 02:21:16.359334 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3577/7596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:16 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:17.384102 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:17.384820 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:17.391107 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:17.391606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:17.392184 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:17.392889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:17.393357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:17.393798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:17.610274 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:17.618734 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-277a01d3-818a-4e05-8a7d-7db6fd252fcb tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.240030 Oct 02 02:21:17.619322 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4020/7597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:17 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:18.643367 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:18.643978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:18.654537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:18.655073 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:18.655496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:18.656209 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:18.656694 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:18.657576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:18.792480 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:18.800242 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d53ba58e-d486-4377-a028-4860e7458039 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.160815 Oct 02 02:21:18.800819 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3578/7598] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:18 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:19.825393 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:19.826683 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:19.833992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:19.834508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:19.834993 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:19.835754 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:19.836234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:19.836684 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:19.976346 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:19.984936 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49ddc1fd-f837-444c-adb7-a39bf52c4399 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.163460 Oct 02 02:21:19.985660 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4021/7599] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:19 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:21.010517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:21.011182 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:21.018031 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:21.018525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:21.019006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:21.019711 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:21.020741 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:21.021184 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:21.150563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:21.158359 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-daa2d080-e240-4ded-97de-160e70df3c5b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.151797 Oct 02 02:21:21.158969 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3579/7600] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:21 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:21.487781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-82692683-ad10-4ea5-9260-4101aea21840 req-241054a6-f348-4fd3-95a8-53ac3b5753ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fc8291-342b-4f2f-9943-f8776258f174", "name": "network-vif-plugged", "status": "completed", "tag": "17458ce6-ed0d-46bb-8a00-327fc48e9d3a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:21.500596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-82692683-ad10-4ea5-9260-4101aea21840 req-241054a6-f348-4fd3-95a8-53ac3b5753ad service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:21.501337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-82692683-ad10-4ea5-9260-4101aea21840 req-241054a6-f348-4fd3-95a8-53ac3b5753ad service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:21.501798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-82692683-ad10-4ea5-9260-4101aea21840 req-241054a6-f348-4fd3-95a8-53ac3b5753ad service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:21.516228 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-82692683-ad10-4ea5-9260-4101aea21840 req-241054a6-f348-4fd3-95a8-53ac3b5753ad service nova] Creating event network-vif-plugged:17458ce6-ed0d-46bb-8a00-327fc48e9d3a for instance 71fc8291-342b-4f2f-9943-f8776258f174 on n-h2-master-1 Oct 02 02:21:21.522786 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-82692683-ad10-4ea5-9260-4101aea21840 req-241054a6-f348-4fd3-95a8-53ac3b5753ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039364 Oct 02 02:21:21.523421 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4022/7601] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:21:22.181766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:22.182415 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:22.189404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:22.189888 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:22.190324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:22.191053 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:22.191508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:22.192816 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:22.334032 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:22.341746 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ef6d6824-87b7-40f4-b7a3-08a31bdbd5b6 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1391 microversion: 2.1 time: 0.163887 Oct 02 02:21:22.342339 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3580/7602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:22 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:21:23.363623 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:23.364358 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:23.368622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:23.369339 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:23.376587 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:23.377086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:23.377535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:23.378243 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:23.378741 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:23.379186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:23.512382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:23.521141 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-19cad850-ff88-493d-8ece-9355c47d732f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1563 microversion: 2.1 time: 0.159295 Oct 02 02:21:23.521919 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4023/7603] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:23 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:23.544283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:23.544902 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:23.547028 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=6 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:23.548558 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:23.555070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:23.555804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:23.556562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:23.557444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:23.558076 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:23.558729 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:23.698263 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:23.706312 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-87f6a16a-476c-4c29-87fc-ee2d2a372e0e tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1563 microversion: 2.1 time: 0.165900 Oct 02 02:21:23.706924 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3581/7604] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:23 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:25.299366 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:25.300118 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:25.300805 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-effbebb8-9e01-444b-b0de-ba28ad14a8c8 req-6fbc0332-eea7-4096-b857-c2aec55cdba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fc8291-342b-4f2f-9943-f8776258f174", "tag": "17458ce6-ed0d-46bb-8a00-327fc48e9d3a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:25.308062 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:25.308890 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:25.309431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:25.310231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:25.310999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:25.311518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:25.311860 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-effbebb8-9e01-444b-b0de-ba28ad14a8c8 req-6fbc0332-eea7-4096-b857-c2aec55cdba3 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:25.312559 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-effbebb8-9e01-444b-b0de-ba28ad14a8c8 req-6fbc0332-eea7-4096-b857-c2aec55cdba3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:25.312999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-effbebb8-9e01-444b-b0de-ba28ad14a8c8 req-6fbc0332-eea7-4096-b857-c2aec55cdba3 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:25.325770 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-effbebb8-9e01-444b-b0de-ba28ad14a8c8 req-6fbc0332-eea7-4096-b857-c2aec55cdba3 service nova] Creating event network-changed:17458ce6-ed0d-46bb-8a00-327fc48e9d3a for instance 71fc8291-342b-4f2f-9943-f8776258f174 on n-h2-master-1 Oct 02 02:21:25.331357 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-effbebb8-9e01-444b-b0de-ba28ad14a8c8 req-6fbc0332-eea7-4096-b857-c2aec55cdba3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Oct 02 02:21:25.332532 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3582/7605] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:21:25.528910 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:25.538379 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-caa35a1d-785b-4eb6-82c6-58209b66a71f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1563 microversion: 2.1 time: 0.243422 Oct 02 02:21:25.550623 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4024/7606] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:25 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:46.788186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:46.790525 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:46.793509 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:46.794150 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=38 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:46.801078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:46.801566 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:46.802027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:46.802757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:46.803217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:46.803645 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:46.870230 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ae9f8080-d223-4f0f-82e5-fc766fccac3a tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action" status: 200 len: 24572 microversion: 2.1 time: 0.087129 Oct 02 02:21:46.870938 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3583/7607] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:21:46 2022] POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action => generated 24572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:21:57.804261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:21:57.804941 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:57.806871 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:57.807550 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=36 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:57.814227 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:57.814771 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:57.815230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:57.817101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:57.817841 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:57.818293 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:57.843061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lazy-loading 'flavor' on Instance uuid 71fc8291-342b-4f2f-9943-f8776258f174 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:21:57.910623 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e838055b-70b9-4d3d-ad74-18fc5ec7784f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action" status: 202 len: 0 microversion: 2.1 time: 0.111630 Oct 02 02:21:57.911602 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4025/7608] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:21:57 2022] POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:21:57.920377 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:57.921082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:57.925585 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:57.926582 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:57.931397 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:57.931889 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:57.932336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:57.933089 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:57.933590 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:57.934145 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:58.124180 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:58.132240 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-69cf6ff1-137a-47a8-83a8-67862bfd69c5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1690 microversion: 2.1 time: 0.216172 Oct 02 02:21:58.132815 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3584/7609] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:57 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:21:59.158350 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:21:59.159137 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:21:59.167643 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:59.168148 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:59.168608 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:59.169324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:21:59.169803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:21:59.170252 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:21:59.302134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:21:59.309906 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-25500cb1-0fec-48c0-8143-bbd0a48feb15 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1673 microversion: 2.1 time: 0.156247 Oct 02 02:21:59.310484 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4026/7610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:21:59 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:22:00.406538 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:00.408694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:00.416999 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:00.417489 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:00.417932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:00.418664 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:00.419130 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:00.419564 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:00.479610 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-005889d8-c084-467e-8fb5-249f5e100ea9 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action" status: 200 len: 38383 microversion: 2.1 time: 0.076940 Oct 02 02:22:00.480268 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3585/7611] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:22:00 2022] POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action => generated 38383 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:22:00.493105 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:00.493666 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:00.500704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:00.501206 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:00.501663 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:00.502374 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:00.502930 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:00.503378 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:00.569723 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9799046d-8f25-477a-b404-de95906e2a95 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action" status: 202 len: 0 microversion: 2.1 time: 0.080318 Oct 02 02:22:00.570415 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4027/7612] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:22:00 2022] POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:22:00.579747 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:00.580460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:00.590120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:00.590866 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:00.591314 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:00.592200 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:00.592690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:00.593125 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:00.816477 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:00.824686 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61fd04ba-4420-4820-8c66-2a3ea58659cf tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1679 microversion: 2.1 time: 0.249370 Oct 02 02:22:00.825392 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3586/7613] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:00 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:01.851399 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:01.852111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:01.858318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:01.858849 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:01.859304 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:01.860008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:01.860478 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:01.860918 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:01.996336 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:02.005178 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e946392f-8715-4a7a-94fd-baa38b32f0b5 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1679 microversion: 2.1 time: 0.159468 Oct 02 02:22:02.005770 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4028/7614] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:01 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:03.039244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:03.039874 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:03.047679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:03.048170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:03.048620 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:03.049324 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:03.050060 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:03.050708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:03.184749 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:03.194271 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-24051724-cbb8-49b0-94ce-a47d82d901ab tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1682 microversion: 2.1 time: 0.160167 Oct 02 02:22:03.194892 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3587/7615] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:03 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:03.289038 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:03.291319 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:03.298201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:03.298739 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:03.299195 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:03.299964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:03.300381 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:03.300821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:03.365863 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a63df8dd-2a6b-4237-a655-3c10b8e24517 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action" status: 200 len: 38383 microversion: 2.1 time: 0.081190 Oct 02 02:22:03.366661 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4029/7616] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:22:03 2022] POST /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174/action => generated 38383 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 02:22:04.327588 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:04.328314 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:04.335562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:04.336291 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:04.336966 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:04.337679 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:04.338378 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:04.339027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:04.367809 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:22:04.384948 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-bcadcf3d-769e-4d97-91ac-0350e436fb5d req-31d54a52-ba73-4d2e-a28a-655fd57b5baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fc8291-342b-4f2f-9943-f8776258f174", "tag": "17458ce6-ed0d-46bb-8a00-327fc48e9d3a"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:04.397332 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bcadcf3d-769e-4d97-91ac-0350e436fb5d req-31d54a52-ba73-4d2e-a28a-655fd57b5baa service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:04.397825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bcadcf3d-769e-4d97-91ac-0350e436fb5d req-31d54a52-ba73-4d2e-a28a-655fd57b5baa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:04.398323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-bcadcf3d-769e-4d97-91ac-0350e436fb5d req-31d54a52-ba73-4d2e-a28a-655fd57b5baa service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:04.410128 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-bcadcf3d-769e-4d97-91ac-0350e436fb5d req-31d54a52-ba73-4d2e-a28a-655fd57b5baa service nova] Creating event network-changed:17458ce6-ed0d-46bb-8a00-327fc48e9d3a for instance 71fc8291-342b-4f2f-9943-f8776258f174 on n-h2-master-1 Oct 02 02:22:04.415450 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-bcadcf3d-769e-4d97-91ac-0350e436fb5d req-31d54a52-ba73-4d2e-a28a-655fd57b5baa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089179 Oct 02 02:22:04.419007 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4030/7617] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:22:04.450648 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-61334474-4563-4938-a395-40ce5bd3ca68 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 204 len: 0 microversion: 2.1 time: 0.127373 Oct 02 02:22:04.451257 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3588/7618] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:22:04 2022] DELETE /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:22:04.470738 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:04.472248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:04.480947 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:04.482040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:04.482495 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:04.483251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:04.483721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:04.484161 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:04.622787 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:04.630924 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-474d27a1-81ef-4965-9226-128f9c2f13ba tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1688 microversion: 2.1 time: 0.164798 Oct 02 02:22:04.631503 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4031/7619] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:04 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:05.657456 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:05.658112 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:05.665745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:05.666239 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:05.666708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:05.667412 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:05.667876 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:05.668310 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:05.868571 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:05.878142 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2d5292a6-f93e-4ee8-b7c6-d49b9fd6ef90 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1688 microversion: 2.1 time: 0.224987 Oct 02 02:22:05.878893 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3589/7620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:05 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:06.903430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:06.904062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:06.912363 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:06.913017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:06.913786 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:06.914521 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:06.915006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:06.915454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:07.011309 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1075fd1070483db992c1b46001a8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed5972f66e4bbd8d012c06ef5f384d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:07.024563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-25710047-bfad-41e2-bf61-0d0ef0f04774 req-b7b4b5bf-d4c9-421d-b4f7-80a2ab974af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fc8291-342b-4f2f-9943-f8776258f174", "name": "network-vif-deleted", "tag": "17458ce6-ed0d-46bb-8a00-327fc48e9d3a"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:07.031880 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4691521-3ec6-4a82-b757-b9f740793757 tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 200 len: 1502 microversion: 2.1 time: 0.132488 Oct 02 02:22:07.032738 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4032/7621] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:06 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 1502 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:07.037534 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-25710047-bfad-41e2-bf61-0d0ef0f04774 req-b7b4b5bf-d4c9-421d-b4f7-80a2ab974af4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:07.038034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-25710047-bfad-41e2-bf61-0d0ef0f04774 req-b7b4b5bf-d4c9-421d-b4f7-80a2ab974af4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:07.038475 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-25710047-bfad-41e2-bf61-0d0ef0f04774 req-b7b4b5bf-d4c9-421d-b4f7-80a2ab974af4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:07.051441 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-25710047-bfad-41e2-bf61-0d0ef0f04774 req-b7b4b5bf-d4c9-421d-b4f7-80a2ab974af4 service nova] Creating event network-vif-deleted:17458ce6-ed0d-46bb-8a00-327fc48e9d3a for instance 71fc8291-342b-4f2f-9943-f8776258f174 on n-h2-master-1 Oct 02 02:22:07.056841 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-25710047-bfad-41e2-bf61-0d0ef0f04774 req-b7b4b5bf-d4c9-421d-b4f7-80a2ab974af4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102146 Oct 02 02:22:07.057547 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3590/7622] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:22:08.056703 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:08.057242 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] [instance: 71fc8291-342b-4f2f-9943-f8776258f174] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:08.064312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:08.064813 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:08.065862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:08.066767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:08.067246 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:08.067944 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:08.082081 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] HTTP exception thrown: Instance 71fc8291-342b-4f2f-9943-f8776258f174 could not be found. Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Request method failure captured: Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 HTTP/1.1 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPP2zTcvQHzOjJn5pf8cTPe4LaJi20bSbAigbb8-B_bE9sq3Q3LnmuTMJ5SlOczD4xHnassqviUnn86sYp2agw3mQDtBs1croMn27NDgi7bXbgCyhfgss0tTxbCPmYiSDQ9m_DupvN8TtHrc1FJDJAOGZIkaoYaQBKdLu_HZUs-mLc0 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bbed5972f66e4bbd8d012c06ef5f384d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bbed5972f66e4bbd8d012c06ef5f384d"}]}] Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: bbed5972f66e4bbd8d012c06ef5f384d Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-569554176 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 5c1075fd1070483db992c1b46001a8e0 Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestNetworkAdvancedServerOps-569554176-project Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 71fc8291-342b-4f2f-9943-f8776258f174 could not be found. Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '71fc8291-342b-4f2f-9943-f8776258f174'} Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71fc8291-342b-4f2f-9943-f8776258f174 could not be found. Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71fc8291-342b-4f2f-9943-f8776258f174 could not be found. Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:22:08.083765 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71fc8291-342b-4f2f-9943-f8776258f174 could not be found. Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Returning 404 to user: Instance 71fc8291-342b-4f2f-9943-f8776258f174 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-fceb5817-d700-42a4-8a28-601b762c2e7f tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174" status: 404 len: 111 microversion: 2.1 time: 0.032547 Oct 02 02:22:08.089788 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4033/7623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:08 2022] GET /compute/v2.1/servers/71fc8291-342b-4f2f-9943-f8776258f174 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:22:11.074996 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a817197b-ee0f-43f7-a969-e9454e85b92b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] Calling method '.version_select at 0x7fb8802b0040>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:11.099935 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a817197b-ee0f-43f7-a969-e9454e85b92b tempest-TestNetworkAdvancedServerOps-569554176 tempest-TestNetworkAdvancedServerOps-569554176-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1816039079" status: 202 len: 0 microversion: 2.1 time: 0.030751 Oct 02 02:22:11.100563 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3591/7624] 10.222.0.23 () {58 vars in 1284 bytes} [Sun Oct 2 02:22:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1816039079 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:22:22.712833 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=18 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:22.713685 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:22.945712 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6fc9cfe3-e040-416b-af74-3f13938ebab7 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'create', calling method: .version_select at 0x7fb87875bf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-205782045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtmz2jLjXfGE/vLBYsjqlm8F+ZM0OmUZe8kW+H2JDoO4clkfz7+2pI35dN2cfW/uKjWUeO/IFzHlFYwqbS1sRI+brK8pkeGJJboykc9bV2/Q3ySPYsrpSlGZn1VrNNWuQ=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:22.962268 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6fc9cfe3-e040-416b-af74-3f13938ebab7 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:22:22.968834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6fc9cfe3-e040-416b-af74-3f13938ebab7 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for user efefb16531ff4d68a6e3c97f845e9e12 and project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:22:22.997687 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6fc9cfe3-e040-416b-af74-3f13938ebab7 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.290867 Oct 02 02:22:22.998419 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4034/7625] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:22:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:22:24.073370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-651753161", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-205782045", "security_groups": [{"name": "tempest-secgroup-smoke-649465037"}], "networks": [{"uuid": "629e210c-3140-400c-a4c4-59f62876fe6a"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:24.083956 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:24.085140 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:24.200485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] validate_networks() for [('629e210c-3140-400c-a4c4-59f62876fe6a', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:22:24.741436 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:22:24.741895 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:22:24.742501 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:22:24.743022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:22:24.743443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:22:24.753004 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:24.753576 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:24.754018 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:24.754780 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:24.755240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:24.755670 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:24.772679 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:22:24.777978 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for user efefb16531ff4d68a6e3c97f845e9e12 and project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:22:24.790462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:22:24.792956 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:22:24.848794 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-45a74147-efe2-42b4-a02d-03f7c2b294a2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.779467 Oct 02 02:22:24.855658 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3592/7626] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:22:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:22:24.862552 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6b84a6c8-b46f-4a27-ab01-a13f1388fe65 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:24.863853 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6b84a6c8-b46f-4a27-ab01-a13f1388fe65 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:24.917508 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6b84a6c8-b46f-4a27-ab01-a13f1388fe65 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:24.925409 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6b84a6c8-b46f-4a27-ab01-a13f1388fe65 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1245 microversion: 2.1 time: 0.068269 Oct 02 02:22:24.925976 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4035/7627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:24 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:25.950662 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4d14ddd-e936-4384-886a-b28e1dc8f25b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:25.951388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4d14ddd-e936-4384-886a-b28e1dc8f25b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:26.013074 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4d14ddd-e936-4384-886a-b28e1dc8f25b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:26.020531 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4d14ddd-e936-4384-886a-b28e1dc8f25b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1245 microversion: 2.1 time: 0.074751 Oct 02 02:22:26.021366 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3593/7628] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:25 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:27.046206 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-510f6101-95b1-4616-9daf-e59dd3cfa158 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:27.046984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-510f6101-95b1-4616-9daf-e59dd3cfa158 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:27.108146 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-510f6101-95b1-4616-9daf-e59dd3cfa158 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:27.115777 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-510f6101-95b1-4616-9daf-e59dd3cfa158 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1245 microversion: 2.1 time: 0.074053 Oct 02 02:22:27.116452 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4036/7629] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:27 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:28.139790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-09f18ca3-d06e-4728-bada-b571241e4f8d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:28.140476 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-09f18ca3-d06e-4728-bada-b571241e4f8d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:28.198409 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-09f18ca3-d06e-4728-bada-b571241e4f8d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:28.206889 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-09f18ca3-d06e-4728-bada-b571241e4f8d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1245 microversion: 2.1 time: 0.070863 Oct 02 02:22:28.223227 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3594/7630] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:28 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:29.232267 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:29.232960 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:29.241617 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:29.242130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:29.242588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:29.243340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:29.243815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:29.244272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:29.306130 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:29.313861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2e7d7ca1-c67d-4fc9-ad98-6aeff8b65710 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1249 microversion: 2.1 time: 0.085803 Oct 02 02:22:29.314472 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4037/7631] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:29 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:30.338252 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:30.339025 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:30.346086 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:30.347170 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:30.347674 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:30.348453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:30.348977 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:30.349409 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:30.425492 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:30.433447 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7ae512c5-6c85-4933-82ad-d888ee1ec985 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1303 microversion: 2.1 time: 0.099042 Oct 02 02:22:30.434065 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3595/7632] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:30 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:22:31.397791 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-e0537acb-d3d9-44f4-8d2c-2d5fd9b4c8e5 req-88cecac7-9430-454d-8e8f-8bb2f528933e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:31.410512 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e0537acb-d3d9-44f4-8d2c-2d5fd9b4c8e5 req-88cecac7-9430-454d-8e8f-8bb2f528933e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:31.411204 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e0537acb-d3d9-44f4-8d2c-2d5fd9b4c8e5 req-88cecac7-9430-454d-8e8f-8bb2f528933e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:31.411667 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-e0537acb-d3d9-44f4-8d2c-2d5fd9b4c8e5 req-88cecac7-9430-454d-8e8f-8bb2f528933e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:31.425932 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-e0537acb-d3d9-44f4-8d2c-2d5fd9b4c8e5 req-88cecac7-9430-454d-8e8f-8bb2f528933e service nova] Creating event network-changed:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h1-master-1 Oct 02 02:22:31.432619 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-e0537acb-d3d9-44f4-8d2c-2d5fd9b4c8e5 req-88cecac7-9430-454d-8e8f-8bb2f528933e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039165 Oct 02 02:22:31.433804 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4038/7633] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:22:31.458066 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:31.458708 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:31.468875 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:31.469359 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:31.469817 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:31.470650 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:31.471172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:31.471609 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:31.704386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:31.712787 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-fc3b91ac-1603-4d0e-8879-dc69ddc009fd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.259215 Oct 02 02:22:31.713375 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3596/7634] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:31 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:32.736477 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:32.737846 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:32.744940 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:32.745432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:32.746144 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:32.746862 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:32.747334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:32.747768 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:32.890748 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:32.900742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5049eb32-318a-47e1-8580-bbe4b0cf6408 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.168608 Oct 02 02:22:32.901335 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4039/7635] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:32 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:33.924890 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:33.925513 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:33.933122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:33.933689 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:33.934138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:33.934873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:33.935335 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:33.935766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:34.146839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:34.154884 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-15b4f3e2-419a-402b-a836-9314f5a21b0b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.233927 Oct 02 02:22:34.155685 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3597/7636] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:33 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:35.177656 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:35.178286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:35.185358 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:35.185858 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:35.186313 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:35.187046 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:35.187523 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:35.187966 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:35.323454 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:35.331794 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-408856c1-a1fd-4017-9f60-97da5a749fc1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.158113 Oct 02 02:22:35.332389 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4040/7637] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:35 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:36.354725 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:36.355351 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:36.357183 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:36.363626 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:36.364109 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:36.364544 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:36.365248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:36.365703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:36.366133 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:36.508948 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:36.516700 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3d5b4afd-aac0-4e58-9c1b-c6d76506d3f6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.166020 Oct 02 02:22:36.517281 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3598/7638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:36 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:37.541279 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:37.541908 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:37.544720 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:37.551124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:37.551629 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:37.552087 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:37.552798 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:37.553272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:37.553721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:37.686043 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:37.694571 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aa83cfb2-744e-4baf-a19c-5ce061fd2b51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.157246 Oct 02 02:22:37.695205 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4041/7639] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:37 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:38.025216 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c1d011a5-f374-4320-a006-6f9b33e099b7 req-30443243-a0a3-4109-9a32-93b3d5150616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "name": "network-vif-plugged", "status": "completed", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:38.037846 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c1d011a5-f374-4320-a006-6f9b33e099b7 req-30443243-a0a3-4109-9a32-93b3d5150616 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:38.038320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c1d011a5-f374-4320-a006-6f9b33e099b7 req-30443243-a0a3-4109-9a32-93b3d5150616 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:38.038842 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c1d011a5-f374-4320-a006-6f9b33e099b7 req-30443243-a0a3-4109-9a32-93b3d5150616 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:38.050287 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c1d011a5-f374-4320-a006-6f9b33e099b7 req-30443243-a0a3-4109-9a32-93b3d5150616 service nova] Creating event network-vif-plugged:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h1-master-1 Oct 02 02:22:38.055492 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c1d011a5-f374-4320-a006-6f9b33e099b7 req-30443243-a0a3-4109-9a32-93b3d5150616 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096767 Oct 02 02:22:38.056156 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3599/7640] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:22:38.719285 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:38.719946 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:38.726973 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:38.727470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:38.727919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:38.728645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:38.729116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:38.729559 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:38.857156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:38.865111 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9cb147d1-b50a-4e84-9f7f-d468722a893c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1370 microversion: 2.1 time: 0.149733 Oct 02 02:22:38.865682 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4042/7641] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:38 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:39.886337 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=10 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:39.891550 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:39.892271 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:39.899437 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:39.899922 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:39.900370 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:39.901069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:39.901530 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:39.901965 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:40.035706 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:40.043858 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ab40152-456c-49a0-aa5d-c615f10cd46d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1553 microversion: 2.1 time: 0.158460 Oct 02 02:22:40.044477 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3600/7642] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:39 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:40.066651 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:22:40.067288 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:22:40.074999 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:40.075498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:40.075950 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:40.076657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:40.077132 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:40.077576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:40.208636 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:22:40.216392 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-20caaacc-ec91-47c1-b3f3-b975143e8ce3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1553 microversion: 2.1 time: 0.153675 Oct 02 02:22:40.216971 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4043/7643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:22:40 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:22:42.157107 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e5a7f822-4385-430f-b755-6faa2c1db1c8 req-787a28b1-fd27-463c-9221-6c2288496079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:22:42.167323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e5a7f822-4385-430f-b755-6faa2c1db1c8 req-787a28b1-fd27-463c-9221-6c2288496079 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:22:42.167801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e5a7f822-4385-430f-b755-6faa2c1db1c8 req-787a28b1-fd27-463c-9221-6c2288496079 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:22:42.168233 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e5a7f822-4385-430f-b755-6faa2c1db1c8 req-787a28b1-fd27-463c-9221-6c2288496079 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:22:42.180040 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e5a7f822-4385-430f-b755-6faa2c1db1c8 req-787a28b1-fd27-463c-9221-6c2288496079 service nova] Creating event network-changed:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h1-master-1 Oct 02 02:22:42.185009 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e5a7f822-4385-430f-b755-6faa2c1db1c8 req-787a28b1-fd27-463c-9221-6c2288496079 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 Oct 02 02:22:42.185626 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3601/7644] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:25:08.878444 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:25:08.879453 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:25:08.880032 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:08.880796 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=38 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:08.881689 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:25:08.881871 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action (ip 10.222.0.23) !!! Oct 02 02:25:08.884727 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:25:08.884861 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action (ip 10.222.0.23) !!! Oct 02 02:25:08.886400 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:25:08.886523 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action (ip 10.222.0.23) !!! Oct 02 02:25:08.891422 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:25:08.891972 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:08.912657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:08.913160 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:08.913615 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:08.914333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:08.914857 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:08.915338 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:08.941883 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lazy-loading 'flavor' on Instance uuid f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:25:09.148843 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0a3bff3b-d991-4b4e-b78d-8178a174f925 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action" status: 202 len: 0 microversion: 2.1 time: 0.272398 Oct 02 02:25:09.149662 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4044/7645] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:25:08 2022] POST /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:25:09.156337 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:25:09.157164 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8287f448-c3f1-49b5-a79e-0c54076f44eb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:25:09.157783 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:09.158532 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=36 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:09.159709 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 02 02:25:09.160520 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:25:09.160663 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:25:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c (ip 10.222.0.23) !!! Oct 02 02:25:09.167406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:09.168140 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:09.178377 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:09.178891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:09.179333 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:09.180037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:09.180496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:09.181525 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:09.323055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:09.332274 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-988dab2e-e0e4-4e72-bc4e-f72fc5604748 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.177886 Oct 02 02:25:09.332885 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3602/7646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:09 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:10.361388 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:10.362111 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:10.370941 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:10.371502 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:10.371977 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:10.372694 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:10.373163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:10.373602 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:10.380751 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60770. Oct 02 02:25:10.382528 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60772. Oct 02 02:25:10.510566 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:10.518301 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-eb01b833-4d58-43d5-941b-e2cba55809cb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.163419 Oct 02 02:25:10.518908 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4045/7647] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:10 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:11.543563 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:11.544195 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:11.553358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:11.553854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:11.554296 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:11.555028 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:11.555493 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:11.555998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:11.562071 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [8287f448-c3f1-49b5-a79e-0c54076f44eb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60778. Oct 02 02:25:11.572942 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60776. Oct 02 02:25:11.709964 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:11.718542 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3ddf3f40-2c42-4b39-bb9f-2112b30a939e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.179769 Oct 02 02:25:11.719167 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3603/7648] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:11 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:12.742523 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:12.744062 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:12.751532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:12.752028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:12.752475 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:12.753178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:12.753645 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:12.754083 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:12.956389 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:12.965041 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-45d97ca7-3c05-457a-bdf6-c81bd17a865f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.226368 Oct 02 02:25:12.965640 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4046/7649] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:12 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:13.989341 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:13.989969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:13.997751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:13.998242 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:13.998718 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:13.999515 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:13.999978 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:14.000413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:14.129208 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:14.137613 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-7a71527a-4196-4101-b114-9fa422946ae0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.152202 Oct 02 02:25:14.138197 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3604/7650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:13 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:15.161231 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:15.161838 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:15.168773 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:15.169264 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:15.169713 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:15.170446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:15.170948 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:15.171391 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:15.306967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:15.314899 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-087cd78f-c912-4537-92f7-253a1a7bf28d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.157641 Oct 02 02:25:15.315477 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4047/7651] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:15 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:16.340068 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:16.340694 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:16.347504 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:16.347992 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:16.348438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:16.349136 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:16.349599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:16.350034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:16.483820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:16.491708 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d0d98506-718a-4bde-833d-02988fcb2af8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.156249 Oct 02 02:25:16.492284 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3605/7652] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:16 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:17.515541 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:17.516156 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:17.523051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:17.523549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:17.524002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:17.525271 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:17.525744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:17.526188 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:17.659170 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:17.667470 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f144512e-1cc6-4d91-a99e-0aab50ee2b0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.155894 Oct 02 02:25:17.668055 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4048/7653] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:17 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:18.690511 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:18.691190 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:18.698471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:18.698986 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:18.699429 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:18.700131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:18.700592 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:18.701021 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:18.835975 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:18.843967 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2bf83471-6213-4402-98ff-4276992d255e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.157388 Oct 02 02:25:18.844552 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3606/7654] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:18 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:19.867680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:19.868773 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:19.875822 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:19.876318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:19.876767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:19.877480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:19.877945 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:19.878385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:20.022543 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:20.031127 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0d73603b-933b-464c-8922-7c8e5e2d2e49 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.167403 Oct 02 02:25:20.031698 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4049/7655] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:19 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:21.055168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:21.056000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:21.063173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:21.063705 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:21.064152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:21.064867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:21.065331 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:21.065766 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:21.198523 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:21.206307 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-10623baf-14fe-45a1-a32d-222149f46172 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1699 microversion: 2.1 time: 0.155130 Oct 02 02:25:21.206913 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3607/7656] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:21 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:22.232169 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:22.232728 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:22.239606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:22.240101 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:22.240553 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:22.241257 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:22.241729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:22.242166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:22.375107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:22.382908 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b2b9d8ac-6403-451a-8c56-a3aee41b8796 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1699 microversion: 2.1 time: 0.154657 Oct 02 02:25:22.384022 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4050/7657] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:22 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:23.407576 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:23.408196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:23.416033 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:23.416521 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:23.416960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:23.417653 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:23.418111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:23.418538 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:23.558362 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:23.566148 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-074394d7-cbac-4213-be9c-f44ee7deb24b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1699 microversion: 2.1 time: 0.162508 Oct 02 02:25:23.566758 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3608/7658] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:23 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:24.591318 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:24.592113 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:24.599509 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:24.600008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:24.602695 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:24.603535 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:24.604357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:24.604658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:24.743457 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-4019ebbf-d26f-4404-a7b2-47e90ea47699 req-86fc95b8-1f9f-415d-8552-91ccdebe39fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "name": "network-vif-plugged", "status": "completed", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:25:24.764442 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4019ebbf-d26f-4404-a7b2-47e90ea47699 req-86fc95b8-1f9f-415d-8552-91ccdebe39fe service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:24.765708 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4019ebbf-d26f-4404-a7b2-47e90ea47699 req-86fc95b8-1f9f-415d-8552-91ccdebe39fe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:24.768615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-4019ebbf-d26f-4404-a7b2-47e90ea47699 req-86fc95b8-1f9f-415d-8552-91ccdebe39fe service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:24.794828 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-4019ebbf-d26f-4404-a7b2-47e90ea47699 req-86fc95b8-1f9f-415d-8552-91ccdebe39fe service nova] Creating event network-vif-plugged:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h1-master-1 Oct 02 02:25:24.809395 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:24.813802 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-4019ebbf-d26f-4404-a7b2-47e90ea47699 req-86fc95b8-1f9f-415d-8552-91ccdebe39fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073766 Oct 02 02:25:24.816881 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3609/7659] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:25:24.818369 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4420303f-bf0b-458b-97f9-19a19a23cb85 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1699 microversion: 2.1 time: 0.231134 Oct 02 02:25:24.827369 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4051/7660] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:24 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1699 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:25.845352 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:25.846057 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:25.852845 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:25.853328 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:25.854034 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:25.854892 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:25.855565 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:25.856152 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:26.022280 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:26.033421 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f04a79bb-4048-4c1e-bc06-069e44757a2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.193333 Oct 02 02:25:26.034023 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3610/7661] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:25 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:25:27.060096 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:27.061457 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:27.069648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:27.070356 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:27.070881 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:27.072251 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:27.072729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:27.073178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:27.243737 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:27.252278 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cf6de6ab-80fb-4a9c-8634-2bdac48a2cca tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.198538 Oct 02 02:25:27.253283 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4052/7662] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:27 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:28.278010 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:28.278664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:28.287734 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:28.288500 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:28.289107 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:28.290069 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:28.290524 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:28.291198 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:28.435100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:28.443181 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-80be3949-c9a3-402c-9b7d-57b341608ead tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.169543 Oct 02 02:25:28.444604 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3611/7663] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:28 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:29.468114 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:29.469560 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:29.478104 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:29.478632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:29.479091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:29.479821 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:29.480285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:29.480781 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:29.628959 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:29.637236 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-22d1a3bb-dafa-4443-849b-bbf17fecf698 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.173068 Oct 02 02:25:29.638645 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4053/7664] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:29 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:30.663462 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:30.664119 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:30.671241 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:30.671726 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:30.672164 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:30.672865 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:30.673341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:30.673742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:30.828209 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:30.838977 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0aa4fad2-2930-4088-96b7-27029b9f6f97 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.180582 Oct 02 02:25:30.839723 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3612/7665] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:30 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:31.863616 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:31.864286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:31.872290 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:31.872971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:31.873385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:31.874163 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:31.874732 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:31.875240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:32.022729 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:32.032082 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1817573a-224c-4a7b-946a-9ef20099acff tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.172353 Oct 02 02:25:32.046622 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4054/7666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:31 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:33.059138 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:33.059824 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:33.067410 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:33.067908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:33.068348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:33.069338 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:33.069801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:33.070231 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:33.249438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:33.257611 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0dfa25bd-9f4e-4739-917d-fbf7b649de51 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.203693 Oct 02 02:25:33.259450 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3613/7667] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:33 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:34.282622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:34.283253 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:34.290140 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:34.290657 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:34.291116 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:34.291817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:34.292285 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:34.292721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:34.429685 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:34.437572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b76b79eb-b81a-434c-9e86-f1499320d93f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1694 microversion: 2.1 time: 0.158830 Oct 02 02:25:34.438146 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4055/7668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:34 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:35.462472 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:35.463129 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:35.470441 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:35.470957 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:35.471396 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:35.472096 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:35.472552 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:35.473005 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:35.605056 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:35.612948 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-e4df950b-8832-43fb-ae1c-3680052f9721 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1676 microversion: 2.1 time: 0.155071 Oct 02 02:25:35.613528 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3614/7669] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:35 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:36.636011 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:36.636589 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:36.643546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:36.644055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:36.644508 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:36.645218 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:36.645702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:36.646149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:36.785134 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:36.796143 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d0a67fc2-3b65-46c3-97c1-f8286a22e589 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1676 microversion: 2.1 time: 0.163613 Oct 02 02:25:36.810844 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4056/7670] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:36 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:37.822450 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:37.823109 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:37.830479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:37.831024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:37.831470 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:37.832176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:37.832643 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:37.833079 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:37.970709 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:37.979211 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bfdf00b9-d00a-463c-b690-88334c840652 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1619 microversion: 2.1 time: 0.161706 Oct 02 02:25:37.979807 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3615/7671] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:37 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1619 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:38.002753 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:25:38.003364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:38.010079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:38.010956 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:38.011419 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:38.012120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:38.012592 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:38.013028 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:38.106126 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122354) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 02:25:38.151749 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:38.178150 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-ee980830-ee8c-4a68-ab46-4c1157a8f747 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action" status: 202 len: 0 microversion: 2.1 time: 0.179277 Oct 02 02:25:38.178805 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4057/7672] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:25:37 2022] POST /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:25:38.187877 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:38.188599 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:38.195159 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:38.195496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:38.196047 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:38.196837 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:38.197300 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:38.197806 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:38.332613 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:38.340538 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6ef0246e-123a-408a-af9a-c873267b9ad0 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1627 microversion: 2.1 time: 0.156703 Oct 02 02:25:38.341128 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3616/7673] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:38 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1627 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:38.722097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b1d768e6-1e33-4e21-80da-d4c63b80a560 req-68d787c5-14f6-49e4-af1f-12456ebf6572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "name": "network-vif-unplugged", "status": "completed", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:25:38.732852 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b1d768e6-1e33-4e21-80da-d4c63b80a560 req-68d787c5-14f6-49e4-af1f-12456ebf6572 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:38.733418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b1d768e6-1e33-4e21-80da-d4c63b80a560 req-68d787c5-14f6-49e4-af1f-12456ebf6572 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:38.733951 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b1d768e6-1e33-4e21-80da-d4c63b80a560 req-68d787c5-14f6-49e4-af1f-12456ebf6572 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:38.746387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.compute.server_external_events [req-b1d768e6-1e33-4e21-80da-d4c63b80a560 req-68d787c5-14f6-49e4-af1f-12456ebf6572 service nova] Unable to find a host for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c. Dropping event network-vif-unplugged {{(pid=122354) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 02:25:38.747388 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b1d768e6-1e33-4e21-80da-d4c63b80a560 req-68d787c5-14f6-49e4-af1f-12456ebf6572 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029305 Oct 02 02:25:38.748863 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4058/7674] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 02 02:25:39.364954 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:39.365519 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:39.368872 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=31 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:39.374111 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:39.374617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:39.375058 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:39.375751 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:39.376213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:39.376642 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:39.379386 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=87 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:39.512911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:39.520727 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-6a8598c4-72ef-4823-9c26-c332013dc228 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.159717 Oct 02 02:25:39.521307 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3617/7675] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:39 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:40.473151 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-b96fe1dc-04f1-4ce1-aaa6-1eb0d882aed1 req-53d38c2b-b66c-483e-8482-cd5881f42c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:25:40.479442 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:40.484724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b96fe1dc-04f1-4ce1-aaa6-1eb0d882aed1 req-53d38c2b-b66c-483e-8482-cd5881f42c62 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:40.485231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b96fe1dc-04f1-4ce1-aaa6-1eb0d882aed1 req-53d38c2b-b66c-483e-8482-cd5881f42c62 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:40.485674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-b96fe1dc-04f1-4ce1-aaa6-1eb0d882aed1 req-53d38c2b-b66c-483e-8482-cd5881f42c62 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:40.499092 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-b96fe1dc-04f1-4ce1-aaa6-1eb0d882aed1 req-53d38c2b-b66c-483e-8482-cd5881f42c62 service nova] Creating event network-changed:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h2-master-1 Oct 02 02:25:40.504536 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-b96fe1dc-04f1-4ce1-aaa6-1eb0d882aed1 req-53d38c2b-b66c-483e-8482-cd5881f42c62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035036 Oct 02 02:25:40.505506 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4059/7676] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:25:40.546703 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:40.547329 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:40.555246 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:40.555827 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:40.556272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:40.556979 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:40.557438 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:40.557869 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:40.692606 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:40.702523 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3f97da88-2644-4a84-996c-13000e02639d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.159743 Oct 02 02:25:40.703657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3618/7677] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:40 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:41.729967 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:41.730966 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:41.738292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:41.738975 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:41.739532 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:41.740359 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:41.740965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:41.741505 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:41.901331 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:41.910098 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5b5196ad-2435-4aa4-886d-911823721e3e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.185441 Oct 02 02:25:41.910713 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4060/7678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:41 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:42.935387 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:42.936118 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:42.942919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:42.943422 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:42.944119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:42.944963 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:42.945464 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:42.945899 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:43.097444 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:43.106578 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3aa71316-47f7-4250-9a94-65e2aef516b6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.174943 Oct 02 02:25:43.107645 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3619/7679] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:42 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:44.131759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:44.132394 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:44.140279 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:44.140785 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:44.141234 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:44.141954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:44.142426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:44.142892 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:44.290441 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:44.298769 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-edfb1387-63ca-4fa0-b9e4-6bd6e8d6abb5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.170823 Oct 02 02:25:44.299596 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4061/7680] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:44 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:25:45.326977 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:45.328389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:45.336623 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:45.337114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:45.337540 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:45.338506 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:45.339229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:45.339660 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:45.494333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:45.502743 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0aae12a3-04c8-433a-ac1b-e7878e6c8b60 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.180516 Oct 02 02:25:45.503542 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3620/7681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:45 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:46.532129 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:46.533554 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:46.542219 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:46.542762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:46.543221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:46.544237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:46.544765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:46.545157 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:46.701782 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:46.711265 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-237ee658-5df3-42f7-bb66-8861c36f0ced tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.182803 Oct 02 02:25:46.712072 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4062/7682] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:46 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:25:47.735839 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:47.736533 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:47.743610 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:47.744102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:47.744545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:47.745264 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:47.745891 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:47.746361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:47.906577 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:47.932520 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-77ced5b6-5211-4078-a752-9ee7724c435c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.200552 Oct 02 02:25:47.933161 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3621/7683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:47 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:48.956414 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:48.957046 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:48.964671 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:48.965215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:48.965677 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:48.966398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:48.966972 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:48.967425 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:49.103627 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:49.111364 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-036ba13f-6b0f-4883-b95c-a88c9dd2801a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.158857 Oct 02 02:25:49.111946 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4063/7684] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:48 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:25:50.136240 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:50.136919 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:50.143853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:50.144341 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:50.144783 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:50.145479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:50.145939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:50.146376 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:50.277040 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:50.284816 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-70fd7117-67fa-4bc3-af18-43198d1ce703 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.153159 Oct 02 02:25:50.285397 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3622/7685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:50 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:51.310330 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:51.311018 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:51.317920 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:51.318417 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:51.319175 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:51.320660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:51.320660 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:51.320996 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:51.457670 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:51.465651 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d5f8beaf-1559-432a-9867-89ec127be563 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.160945 Oct 02 02:25:51.466231 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4064/7686] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:51 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:52.490354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:52.491000 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:52.498528 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:52.499056 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:52.499503 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:52.500204 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:52.500669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:52.501102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:52.630911 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:52.639285 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-492f149a-fd6f-4827-82de-e6d275d6d071 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.152884 Oct 02 02:25:52.639860 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3623/7687] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:52 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:53.663646 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:53.664244 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:53.671864 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:53.672357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:53.672835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:53.673536 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:53.674002 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:53.674437 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:53.807813 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:53.815682 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c8d1f30d-1058-4fc6-a15f-65c69b740001 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.155953 Oct 02 02:25:53.816266 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4065/7688] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:53 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:54.841745 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:54.842383 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:54.849344 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:54.849839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:54.850298 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:54.851037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:54.851508 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:54.851946 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:54.874975 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-937d8d64-5467-48ab-9f13-785f30b79030 req-aaab03f4-6883-4509-9d0f-6c1806278713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "name": "network-vif-plugged", "status": "completed", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:25:54.886283 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-937d8d64-5467-48ab-9f13-785f30b79030 req-aaab03f4-6883-4509-9d0f-6c1806278713 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:54.886997 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-937d8d64-5467-48ab-9f13-785f30b79030 req-aaab03f4-6883-4509-9d0f-6c1806278713 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:54.887504 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-937d8d64-5467-48ab-9f13-785f30b79030 req-aaab03f4-6883-4509-9d0f-6c1806278713 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:54.899039 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-937d8d64-5467-48ab-9f13-785f30b79030 req-aaab03f4-6883-4509-9d0f-6c1806278713 service nova] Creating event network-vif-plugged:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h2-master-1 Oct 02 02:25:54.904989 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-937d8d64-5467-48ab-9f13-785f30b79030 req-aaab03f4-6883-4509-9d0f-6c1806278713 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Oct 02 02:25:54.905909 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4066/7689] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:25:54.994388 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:55.002475 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b06b04e9-ccc9-4b05-b8b1-ac57d321c7db tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.165804 Oct 02 02:25:55.003098 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3624/7690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:54 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:56.028922 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:56.029639 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:56.035814 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:56.036308 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:56.036759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:56.037455 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:56.037921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:56.038354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:56.201992 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:56.210494 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1f7418a4-b29e-4484-a6a1-761080f4ba36 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1685 microversion: 2.1 time: 0.187301 Oct 02 02:25:56.211152 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4067/7691] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:56 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:25:57.235836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:25:57.236389 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:25:57.243316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:57.243828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:57.244919 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:57.245629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:25:57.246094 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:25:57.246527 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:25:57.377069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:25:57.386218 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4be9ebb1-dd9c-4afe-b40c-05a0f5faed11 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1672 microversion: 2.1 time: 0.153214 Oct 02 02:25:57.386854 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3625/7692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:25:57 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:07.608790 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=17 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:07.610364 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:07.615578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:07.615926 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=17 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:07.616846 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=53 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:07.616999 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:07.628263 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:07.628777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:07.629230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:07.630588 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:07.631121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:07.631565 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:07.659079 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:27:07.678850 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-815ae429-ac54-4f0d-8e2d-a7765f97c996 req-d4fa7cea-de2d-4f49-8a31-d1624cd81804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:07.689862 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-815ae429-ac54-4f0d-8e2d-a7765f97c996 req-d4fa7cea-de2d-4f49-8a31-d1624cd81804 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:07.690360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-815ae429-ac54-4f0d-8e2d-a7765f97c996 req-d4fa7cea-de2d-4f49-8a31-d1624cd81804 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:07.691137 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-815ae429-ac54-4f0d-8e2d-a7765f97c996 req-d4fa7cea-de2d-4f49-8a31-d1624cd81804 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:07.703864 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-815ae429-ac54-4f0d-8e2d-a7765f97c996 req-d4fa7cea-de2d-4f49-8a31-d1624cd81804 service nova] Creating event network-changed:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h2-master-1 Oct 02 02:27:07.709007 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-815ae429-ac54-4f0d-8e2d-a7765f97c996 req-d4fa7cea-de2d-4f49-8a31-d1624cd81804 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100065 Oct 02 02:27:07.713837 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3626/7693] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:27:07.740649 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c0378c31-1d87-4a3e-be88-0b39517a4d77 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 204 len: 0 microversion: 2.1 time: 0.133615 Oct 02 02:27:07.744617 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4068/7694] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:27:07 2022] DELETE /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:27:07.752754 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:07.753665 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:07.763217 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:07.763879 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:07.765221 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:07.766025 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:07.766492 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:07.766987 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:07.964004 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:07.972867 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-5fc86fcf-2a82-4394-b588-3998c3e96dad tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.226725 Oct 02 02:27:07.973790 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3627/7695] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:07 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:08.997468 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:08.998185 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:09.005162 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:09.005656 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:09.006112 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:09.006837 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:09.007303 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:09.007737 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:09.144485 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:09.152861 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d7d43b91-4772-4b96-b642-afb827729913 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1678 microversion: 2.1 time: 0.160379 Oct 02 02:27:09.153452 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4069/7696] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:08 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:09.736899 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-aef7ba55-d051-41e0-ae99-f0d5a9ae7d3f req-06876cf6-52f5-4d79-a7db-ac48452666ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c", "name": "network-vif-deleted", "tag": "9c34819f-7700-4e2f-855a-bd708ae50b16"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:09.750667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-aef7ba55-d051-41e0-ae99-f0d5a9ae7d3f req-06876cf6-52f5-4d79-a7db-ac48452666ef service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:09.751773 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-aef7ba55-d051-41e0-ae99-f0d5a9ae7d3f req-06876cf6-52f5-4d79-a7db-ac48452666ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:09.752212 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-aef7ba55-d051-41e0-ae99-f0d5a9ae7d3f req-06876cf6-52f5-4d79-a7db-ac48452666ef service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:09.765798 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-aef7ba55-d051-41e0-ae99-f0d5a9ae7d3f req-06876cf6-52f5-4d79-a7db-ac48452666ef service nova] Creating event network-vif-deleted:9c34819f-7700-4e2f-855a-bd708ae50b16 for instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c on n-h2-master-1 Oct 02 02:27:09.772016 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-aef7ba55-d051-41e0-ae99-f0d5a9ae7d3f req-06876cf6-52f5-4d79-a7db-ac48452666ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039359 Oct 02 02:27:09.772680 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3628/7697] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:27:10.177430 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:10.178040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:10.186221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:10.186765 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:10.187222 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:10.187939 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:10.188422 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:10.188865 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:10.222549 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:10.223086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:10.223538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:10.224000 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lazy-loading 'fault' on Instance uuid f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:27:10.269518 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:10.277524 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3a0939f0-71d8-49ca-bb29-9eb24d02b02d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 200 len: 1335 microversion: 2.1 time: 0.104100 Oct 02 02:27:10.278137 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4070/7698] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:10 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:11.302689 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:11.303340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:11.310545 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:11.311104 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:11.311599 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:11.312336 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:11.312798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:11.313229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:11.327704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] HTTP exception thrown: Instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c could not be found. Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Request method failure captured: Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c HTTP/1.1 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPXZBP0eMObgzeIAS3orKcnGzySlQGGpfvd9OxIs92xzmRRmlOAPOm4DguOxJ15rvWpDoj15vxkMWDfKZJhvhKNFRdfTEJZksx5SZAqWCIbiF20UtU0dIlduMe9HB24vijz--nHNcyjIPJ7nRikXtjUnHUQ8wWDXQExRq8f28LgdLWU Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 1f05359cdbb64ee8a632f63c04d6792f Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestShelveInstance-1531837743 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f05359cdbb64ee8a632f63c04d6792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f05359cdbb64ee8a632f63c04d6792f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f05359cdbb64ee8a632f63c04d6792f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f05359cdbb64ee8a632f63c04d6792f"}]}] Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestShelveInstance-1531837743 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 1f05359cdbb64ee8a632f63c04d6792f Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestShelveInstance-1531837743 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestShelveInstance-1531837743-project Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: efefb16531ff4d68a6e3c97f845e9e12 Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestShelveInstance-1531837743-project Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: exception: Instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c could not be found. Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c'} Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c could not be found. Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c could not be found. Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:27:11.329371 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c could not be found. Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Returning 404 to user: Instance f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4edef8ac-aec7-478f-b9ce-14ae6da97cb9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c" status: 404 len: 111 microversion: 2.1 time: 0.032553 Oct 02 02:27:11.335077 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3629/7699] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:11 2022] GET /compute/v2.1/servers/f9c89c95-5ffc-4b6e-8171-45ff8a7fc38c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:27:11.500428 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a3d437ee-30d2-4f0d-b0f2-a661594b3f2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '.version_select at 0x7fb87bffd940>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:11.539710 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a3d437ee-30d2-4f0d-b0f2-a661594b3f2c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-205782045" status: 202 len: 0 microversion: 2.1 time: 0.043554 Oct 02 02:27:11.540487 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4071/7700] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 02:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-205782045 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:27:11.562792 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-449c989b-52af-493f-a425-1a3e5fd5620d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'create', calling method: .version_select at 0x7fb880841ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1039656855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3fWhHhqHWvS/DreL7yCaYBrdmGaSq1/RYIIA0dxJUkL/s10WfvKbUo9/drVzeetjjs3oiw5bentJd8WgPqmW1S8hePQxHaLtw4doxCpqy6e4e11+vYQVm9HRxY1jlUDQ=="}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:11.579961 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-449c989b-52af-493f-a425-1a3e5fd5620d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:27:11.585143 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-449c989b-52af-493f-a425-1a3e5fd5620d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for user efefb16531ff4d68a6e3c97f845e9e12 and project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'key_pairs'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:27:11.598788 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [None req-449c989b-52af-493f-a425-1a3e5fd5620d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [1ca9303e-bd9b-44eb-af41-44da04a3265d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:27:12.606412 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [None req-449c989b-52af-493f-a425-1a3e5fd5620d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [1ca9303e-bd9b-44eb-af41-44da04a3265d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 32816. Oct 02 02:27:12.622795 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-449c989b-52af-493f-a425-1a3e5fd5620d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.064318 Oct 02 02:27:12.623400 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3630/7701] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:27:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:27:28.957460 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:28.958224 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:28.962694 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-600541536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1039656855", "security_groups": [{"name": "tempest-secgroup-smoke-1629253118"}], "networks": [{"uuid": "629e210c-3140-400c-a4c4-59f62876fe6a"}], "block_device_mapping_v2": [{"uuid": "64f0d624-925e-4f40-94a4-57f4c7f54818", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:29.105622 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] validate_networks() for [('629e210c-3140-400c-a4c4-59f62876fe6a', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:27:29.483016 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:27:29.483487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:27:29.483979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:27:29.484431 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:27:29.484861 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:27:29.493832 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:29.494347 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:29.494836 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:29.495581 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:29.496054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:29.496496 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:29.513522 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:27:29.518765 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Getting quotas for user efefb16531ff4d68a6e3c97f845e9e12 and project 1f05359cdbb64ee8a632f63c04d6792f. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:27:29.577308 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:27:29.579500 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64f0d624-925e-4f40-94a4-57f4c7f54818',volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:27:29.722548 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6c42341a-b239-4de8-9826-ce25027c4465 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766798 Oct 02 02:27:29.723236 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4072/7702] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:27:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:27:29.735073 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b4ee51ec-fdfc-4a82-95f9-49d714a47e6b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:29.735702 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b4ee51ec-fdfc-4a82-95f9-49d714a47e6b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:29.738758 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=12 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:29.739434 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:29.740063 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:29.796413 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b4ee51ec-fdfc-4a82-95f9-49d714a47e6b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:29.803463 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b4ee51ec-fdfc-4a82-95f9-49d714a47e6b tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1088 microversion: 2.1 time: 0.072754 Oct 02 02:27:29.804031 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3631/7703] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:29 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:30.827707 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3097e9d8-b72a-4900-9983-8ea3a5ee6f9c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:30.828368 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3097e9d8-b72a-4900-9983-8ea3a5ee6f9c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:30.883067 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3097e9d8-b72a-4900-9983-8ea3a5ee6f9c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:30.890129 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3097e9d8-b72a-4900-9983-8ea3a5ee6f9c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1088 microversion: 2.1 time: 0.066268 Oct 02 02:27:30.890726 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4073/7704] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:30 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:31.913196 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-68eb588b-8b52-47a9-a73c-0a9eb18ee0c5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:31.913819 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-68eb588b-8b52-47a9-a73c-0a9eb18ee0c5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:31.973100 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-68eb588b-8b52-47a9-a73c-0a9eb18ee0c5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:31.980390 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-68eb588b-8b52-47a9-a73c-0a9eb18ee0c5 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1088 microversion: 2.1 time: 0.071403 Oct 02 02:27:31.980964 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3632/7705] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:31 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:33.004382 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26568ca8-0acb-4f75-811b-8ec7a0f8c2ce tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:33.005249 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26568ca8-0acb-4f75-811b-8ec7a0f8c2ce tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:33.067807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26568ca8-0acb-4f75-811b-8ec7a0f8c2ce tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:33.075341 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26568ca8-0acb-4f75-811b-8ec7a0f8c2ce tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1088 microversion: 2.1 time: 0.074919 Oct 02 02:27:33.075929 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4074/7706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:32 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:34.098917 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:34.099539 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:34.107138 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:34.107629 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:34.108075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:34.108778 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:34.109240 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:34.109671 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:34.170167 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:34.177890 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c9ef29d2-c9d5-4c27-bb84-91e57abf213c tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1138 microversion: 2.1 time: 0.082996 Oct 02 02:27:34.178468 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3633/7707] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:34 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:35.201559 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:35.202943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:35.210216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:35.210848 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:35.211299 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:35.212006 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:35.213323 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:35.214017 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:35.299811 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:35.307898 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b8c328c4-6675-4fbf-a34e-139cc47306c4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1204 microversion: 2.1 time: 0.110289 Oct 02 02:27:35.308480 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4075/7708] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:35 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:36.333231 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fa1b5f70-2104-4535-888a-e9e2af77da5c req-35c74591-9ab1-472f-a206-ce8b65fe7c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:36.334984 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:36.336337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:36.345142 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:36.346197 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:36.346994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:36.348232 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:36.349047 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:36.349764 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:36.355161 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fa1b5f70-2104-4535-888a-e9e2af77da5c req-35c74591-9ab1-472f-a206-ce8b65fe7c28 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:36.355663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fa1b5f70-2104-4535-888a-e9e2af77da5c req-35c74591-9ab1-472f-a206-ce8b65fe7c28 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:36.358203 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fa1b5f70-2104-4535-888a-e9e2af77da5c req-35c74591-9ab1-472f-a206-ce8b65fe7c28 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:36.378722 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fa1b5f70-2104-4535-888a-e9e2af77da5c req-35c74591-9ab1-472f-a206-ce8b65fe7c28 service nova] Creating event network-changed:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h2-master-1 Oct 02 02:27:36.388408 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fa1b5f70-2104-4535-888a-e9e2af77da5c req-35c74591-9ab1-472f-a206-ce8b65fe7c28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058749 Oct 02 02:27:36.389093 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3634/7709] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:27:36.597361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:36.607566 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-501dadca-a696-459a-9db7-dc61e517db55 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1272 microversion: 2.1 time: 0.276590 Oct 02 02:27:36.608713 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4076/7710] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:36 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:37.633651 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:37.634392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:37.640732 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:37.641236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:37.641663 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:37.642361 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:37.642854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:37.643285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:37.779455 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:37.787406 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f21a12d5-20e9-496b-9d91-80b963c6d2b8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1272 microversion: 2.1 time: 0.159008 Oct 02 02:27:37.787993 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3635/7711] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:37 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:38.811400 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:38.812021 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:38.819231 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:38.820003 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:38.820452 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:38.821179 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:38.821654 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:38.822287 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:38.955191 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:38.964153 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0ab88d44-012b-48c9-89b1-ed7e21433f54 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1272 microversion: 2.1 time: 0.156547 Oct 02 02:27:38.964745 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4077/7712] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:38 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:39.987041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:39.987664 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:39.994682 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:39.995173 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:39.995615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:39.996307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:39.996763 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:39.997187 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:40.136517 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:40.144378 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-72128d4e-573e-43d1-bbb0-11c5b482d034 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.161287 Oct 02 02:27:40.144959 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3636/7713] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:39 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:41.168596 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:41.169224 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:41.171250 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:41.176863 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:41.177354 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:41.177802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:41.178498 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:41.179015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:41.179451 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:41.311045 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:41.318971 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c9320eff-f07c-45c1-91a5-bb21c227d311 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.154676 Oct 02 02:27:41.319478 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4078/7714] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:41 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:42.342468 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:42.344406 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:42.346628 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=4 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:42.351756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:42.352250 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:42.352693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:42.353925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:42.354393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:42.354856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:42.491039 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:42.498803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-110d31a8-0cbd-4150-aa89-d6348ea7c71d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.160350 Oct 02 02:27:42.499397 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3637/7715] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:42 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:43.521796 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:43.522453 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:43.525482 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=10 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:43.531070 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:43.531576 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:43.532032 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:43.532772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:43.533275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:43.533724 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:43.675247 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:43.683688 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2ee60eff-2d1c-467f-a4f8-332a74a5bdbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.165827 Oct 02 02:27:43.684265 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4079/7716] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:43 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:44.707637 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:44.708255 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:44.716627 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:44.717115 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:44.717591 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:44.718289 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:44.718782 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:44.719210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:44.856732 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:44.864482 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ce183436-9c9d-4fbf-a772-1d4008fcb5e8 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.160770 Oct 02 02:27:44.865063 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3638/7717] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:44 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:45.888081 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:45.888638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:45.895682 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:45.896253 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:45.896612 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:45.897318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:45.897783 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:45.898223 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:46.034890 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:46.043511 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c5faf3d4-0546-4bf7-9e2b-f159a4460f04 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.159502 Oct 02 02:27:46.044081 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4080/7718] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:45 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:47.067392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:47.068055 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:47.075285 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:47.075781 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:47.076229 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:47.076936 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:47.077404 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:47.077847 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:47.208011 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:47.216414 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-49587a03-441c-4673-b533-c6be6cbf2e93 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.152999 Oct 02 02:27:47.217006 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3639/7719] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:47 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:48.240332 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:48.240970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:48.249059 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:48.249558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:48.250013 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:48.250762 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:48.251240 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:48.251686 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:48.382528 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:48.390755 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-797d7fcd-ccd3-438f-97a6-cb97ed1498f3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.154237 Oct 02 02:27:48.391326 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4081/7720] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:48 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:49.414153 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:49.414834 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:49.422379 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:49.422925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:49.423365 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:49.424248 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:49.424714 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:49.425141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:49.513726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-f7c52d5d-c629-4804-a1d4-fdd296b56863 req-8e5f6aa2-2b99-4d4d-9159-5a23383d2739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "name": "network-vif-plugged", "status": "completed", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:49.526963 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7c52d5d-c629-4804-a1d4-fdd296b56863 req-8e5f6aa2-2b99-4d4d-9159-5a23383d2739 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:49.527792 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7c52d5d-c629-4804-a1d4-fdd296b56863 req-8e5f6aa2-2b99-4d4d-9159-5a23383d2739 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:49.528237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-f7c52d5d-c629-4804-a1d4-fdd296b56863 req-8e5f6aa2-2b99-4d4d-9159-5a23383d2739 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:49.541088 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-f7c52d5d-c629-4804-a1d4-fdd296b56863 req-8e5f6aa2-2b99-4d4d-9159-5a23383d2739 service nova] Creating event network-vif-plugged:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h2-master-1 Oct 02 02:27:49.546749 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-f7c52d5d-c629-4804-a1d4-fdd296b56863 req-8e5f6aa2-2b99-4d4d-9159-5a23383d2739 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095130 Oct 02 02:27:49.547365 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4082/7721] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:27:49.585721 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:49.594343 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f83c90eb-31d1-4086-a061-83524754d89d tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.184381 Oct 02 02:27:49.594966 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3640/7722] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:49 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:50.617968 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:50.619234 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:50.626149 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:50.626669 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:50.627120 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:50.627815 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:50.628282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:50.628718 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:50.764360 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:50.772073 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c3c26648-6cb1-442b-b7b2-e41c66729494 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1260 microversion: 2.1 time: 0.158434 Oct 02 02:27:50.772648 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4083/7723] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:50 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:51.795844 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:51.796399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:51.803416 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:51.803903 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:51.804345 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:51.805040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:51.805507 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:51.805937 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:51.937623 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:51.945726 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-403279a8-957f-42ee-891a-c9f93f335888 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1444 microversion: 2.1 time: 0.153975 Oct 02 02:27:51.946313 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3641/7724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:51 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:51.970396 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:27:51.971063 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:27:51.978010 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:51.980272 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:51.980752 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:51.981482 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:51.981964 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:51.982411 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:52.118614 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:27:52.127234 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5434096e-5557-4646-a4da-ec01e0e3b044 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1444 microversion: 2.1 time: 0.160668 Oct 02 02:27:52.127815 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4084/7725] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:27:51 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:27:54.065283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-60382158-d9a9-459f-99f2-ae201c9a191a req-b408a333-efbc-452e-83e6-714dc29c3318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:27:54.076458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-60382158-d9a9-459f-99f2-ae201c9a191a req-b408a333-efbc-452e-83e6-714dc29c3318 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:27:54.076951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-60382158-d9a9-459f-99f2-ae201c9a191a req-b408a333-efbc-452e-83e6-714dc29c3318 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:27:54.077393 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-60382158-d9a9-459f-99f2-ae201c9a191a req-b408a333-efbc-452e-83e6-714dc29c3318 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:27:54.089449 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-60382158-d9a9-459f-99f2-ae201c9a191a req-b408a333-efbc-452e-83e6-714dc29c3318 service nova] Creating event network-changed:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h2-master-1 Oct 02 02:27:54.094500 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-60382158-d9a9-459f-99f2-ae201c9a191a req-b408a333-efbc-452e-83e6-714dc29c3318 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032916 Oct 02 02:27:54.095379 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3642/7726] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:29:49.564893 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:29:49.566037 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:29:49.566631 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:29:49.567395 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=58 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:29:49.573270 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:29:49.573816 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:49.581055 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:49.581552 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:49.582005 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:49.582744 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:49.583221 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:49.583665 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:49.611222 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.objects.instance [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lazy-loading 'flavor' on Instance uuid 4d4dad61-4b3c-4d42-934b-aba381fdec57 {{(pid=122354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:29:49.680892 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7f141208-2013-47a0-b36c-12ca22c14404 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57/action" status: 202 len: 0 microversion: 2.1 time: 0.117759 Oct 02 02:29:49.681564 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4085/7727] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:29:49 2022] POST /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 02:29:49.688177 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8287f448-c3f1-49b5-a79e-0c54076f44eb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:29:49.688989 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 02:29:49.689609 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=28 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:29:49.690445 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=52 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:29:49.692415 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:29:49.692563 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 (ip 10.222.0.23) !!! Oct 02 02:29:49.699291 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:49.700082 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:49.709360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:49.709851 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:49.710293 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:49.711027 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:49.711491 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:49.711931 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:49.847165 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:49.855400 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a241cd99-300e-4811-86b8-d8b25989a750 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.169167 Oct 02 02:29:49.855987 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3643/7728] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:49 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:50.882183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:50.882930 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:50.890992 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:50.891492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:50.891942 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:50.892648 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:50.893124 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:50.893558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:50.897864 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33096. Oct 02 02:29:50.898697 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33094. Oct 02 02:29:51.034144 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:51.042026 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-49bcf2e1-23de-42f4-b5d1-162667faf2fb tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.166009 Oct 02 02:29:51.042623 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4086/7729] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:50 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:52.066228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:52.066876 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:52.076757 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:52.077253 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:52.077695 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:52.078406 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:52.078886 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:52.079320 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:52.089358 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33102. Oct 02 02:29:52.090185 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [8287f448-c3f1-49b5-a79e-0c54076f44eb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33100. Oct 02 02:29:52.215820 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:52.223851 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-89e968f5-297b-472d-b529-b8c9f713e39a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.162378 Oct 02 02:29:52.224379 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3644/7730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:52 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:53.248219 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:53.248777 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:53.255690 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:53.256186 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:53.256635 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:53.257334 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:53.257802 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:53.258238 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:53.389854 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:53.398212 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-44128c2b-13fe-4380-9c40-d3eb60c2bbbe tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.154045 Oct 02 02:29:53.398808 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4087/7731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:53 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:54.421300 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:54.421923 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:54.429428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:54.429911 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:54.430349 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:54.431078 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:54.431542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:54.432185 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:54.563828 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:54.572344 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-720f57db-4c29-442a-b37c-02963189170e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.154962 Oct 02 02:29:54.572922 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3645/7732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:54 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:55.596726 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:55.597383 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:55.604208 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:55.604699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:55.605145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:55.605847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:55.606314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:55.606778 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:55.736872 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:55.744715 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b6b57e3f-9577-43c0-b742-7357d64c2134 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.152440 Oct 02 02:29:55.745306 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4088/7733] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:55 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:56.769156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:56.769781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:56.776745 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:56.777237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:56.777683 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:56.778413 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:56.778901 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:56.779334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:56.913302 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:56.921260 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-3dffb16f-2af2-48ee-beca-754d780e8e2f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.156061 Oct 02 02:29:56.921847 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3646/7734] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:56 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:57.946956 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:57.948246 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:57.955329 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:57.955830 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:57.956277 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:57.956981 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:57.957446 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:57.957884 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:58.093138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:58.101499 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f12f25b5-4774-4729-acf1-c07fdd88c3a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.158988 Oct 02 02:29:58.102118 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4089/7735] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:57 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:29:59.126506 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:29:59.127765 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:29:59.134666 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:59.135150 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:59.135587 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:59.136284 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:29:59.136742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:29:59.137169 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:29:59.271595 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:29:59.279393 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-06cd9796-55e0-4fc4-bf5c-467829f3cd22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.156798 Oct 02 02:29:59.279976 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3647/7736] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:29:59 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:00.305655 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:00.306286 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:00.315522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:00.316038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:00.316490 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:00.318929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:00.319424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:00.320909 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:00.544680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:00.553093 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-d6984a84-dc04-4e75-b8b4-7dadae7562e6 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.252960 Oct 02 02:30:00.553769 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4090/7737] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:00 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:01.577156 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:01.577807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:01.585998 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:01.586488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:01.586960 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:01.587657 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:01.588119 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:01.588550 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:01.727069 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:01.734949 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cc30d08d-e08d-4ee5-820c-3ab52b9c83ba tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.161675 Oct 02 02:30:01.735488 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3648/7738] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:01 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:02.759821 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:02.760456 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:02.767636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:02.768169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:02.768627 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:02.769447 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:02.770121 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:02.771598 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:02.915767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:02.924497 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a7450050-ec9e-4c65-baeb-5bbf30cd4c35 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.167942 Oct 02 02:30:02.925264 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4091/7739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:02 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:03.951168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:03.951800 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:03.963867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:03.963867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:03.963867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:03.963867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:03.963867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:03.963867 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:04.106935 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:04.115846 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-27454469-0f66-4aea-b6d7-37b4091957e1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.169623 Oct 02 02:30:04.116428 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3649/7740] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:03 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:05.140014 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:05.140649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:05.148636 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:05.149143 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:05.149600 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:05.150314 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:05.150823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:05.151273 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:05.281880 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:05.289882 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3f69bf1e-599e-4edb-9f31-4a9ee49c53e2 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1510 microversion: 2.1 time: 0.153811 Oct 02 02:30:05.290457 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4092/7741] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:05 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:05.314621 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:30:05.315504 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:05.322618 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:05.323122 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:05.323567 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:05.324271 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:05.324754 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:05.325176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:05.408564 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122355) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 02:30:05.477764 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-26e4770f-5700-42d1-91e0-5fba5e360890 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "POST /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57/action" status: 202 len: 0 microversion: 2.1 time: 0.167621 Oct 02 02:30:05.478765 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3650/7742] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:30:05 2022] POST /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:30:05.488050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:05.489090 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:05.494861 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:05.495373 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:05.495838 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:05.496621 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:05.497133 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:05.497596 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:05.635040 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:05.644309 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a4456041-be04-44c3-883d-d66528c81b1e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1518 microversion: 2.1 time: 0.161310 Oct 02 02:30:05.645131 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4093/7743] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:05 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:30:06.040549 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-5506bb70-65f4-4bf8-8954-399b88e419d7 req-f1e8659b-b08d-4167-81e7-c9a48174324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "name": "network-vif-unplugged", "status": "completed", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:30:06.054962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5506bb70-65f4-4bf8-8954-399b88e419d7 req-f1e8659b-b08d-4167-81e7-c9a48174324b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:06.055526 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5506bb70-65f4-4bf8-8954-399b88e419d7 req-f1e8659b-b08d-4167-81e7-c9a48174324b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:06.055976 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-5506bb70-65f4-4bf8-8954-399b88e419d7 req-f1e8659b-b08d-4167-81e7-c9a48174324b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:06.068267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.compute.server_external_events [req-5506bb70-65f4-4bf8-8954-399b88e419d7 req-f1e8659b-b08d-4167-81e7-c9a48174324b service nova] Unable to find a host for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57. Dropping event network-vif-unplugged {{(pid=122355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 02:30:06.069171 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-5506bb70-65f4-4bf8-8954-399b88e419d7 req-f1e8659b-b08d-4167-81e7-c9a48174324b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032959 Oct 02 02:30:06.069959 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3651/7744] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 02 02:30:06.668489 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:06.669138 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:06.677255 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:06.677758 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:06.678213 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:06.678968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:06.679441 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:06.679894 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:06.823342 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:06.831529 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4429c81c-f440-41e9-917d-9f8cf4e3817f tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1520 microversion: 2.1 time: 0.166934 Oct 02 02:30:06.832112 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4094/7745] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:06 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:07.856560 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:07.857213 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:07.864761 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:07.865306 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:07.865755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:07.866473 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:07.866971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:07.867400 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:08.007197 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:08.015186 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c376a66a-d9a5-4ad3-a4d7-0e6a0172e5bd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1520 microversion: 2.1 time: 0.162726 Oct 02 02:30:08.015769 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3652/7746] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:07 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:09.040036 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:09.040684 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:09.047921 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:09.048431 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:09.048889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:09.049616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:09.050165 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:09.050632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:09.193328 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:09.201767 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-6a4ecfcd-4141-46af-9541-d35a80e587a1 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1520 microversion: 2.1 time: 0.165669 Oct 02 02:30:09.202361 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4095/7747] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:09 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:10.226041 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:10.226787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:10.233654 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:10.234141 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:10.234585 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:10.235313 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:10.235804 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:10.236237 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:10.371396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:10.379586 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0bd092e1-2c2c-46ab-9fb5-659e40ff694a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1520 microversion: 2.1 time: 0.157965 Oct 02 02:30:10.380180 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3653/7748] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:10 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:11.402947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:11.403578 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:11.410965 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:11.411467 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:11.411919 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:11.412634 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:11.413137 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:11.413793 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:11.642970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:11.651600 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-732ba236-aa4a-420e-bdb2-fa90dc48a6cd tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.252652 Oct 02 02:30:11.652183 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4096/7749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:11 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:12.537639 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-812ee038-82b0-487a-8cd1-c11f91faef35 req-7cf58a5b-7141-4fff-ab54-80cddff09c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:30:12.548102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-812ee038-82b0-487a-8cd1-c11f91faef35 req-7cf58a5b-7141-4fff-ab54-80cddff09c82 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:12.548595 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-812ee038-82b0-487a-8cd1-c11f91faef35 req-7cf58a5b-7141-4fff-ab54-80cddff09c82 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:12.549037 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-812ee038-82b0-487a-8cd1-c11f91faef35 req-7cf58a5b-7141-4fff-ab54-80cddff09c82 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:12.563013 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-812ee038-82b0-487a-8cd1-c11f91faef35 req-7cf58a5b-7141-4fff-ab54-80cddff09c82 service nova] Creating event network-changed:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h1-master-1 Oct 02 02:30:12.569463 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-812ee038-82b0-487a-8cd1-c11f91faef35 req-7cf58a5b-7141-4fff-ab54-80cddff09c82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036131 Oct 02 02:30:12.570270 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3654/7750] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:30:12.675539 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:12.676163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:12.682931 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:12.683432 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:12.683876 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:12.684606 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:12.685056 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:12.685699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:12.905512 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:12.914425 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c752d2a0-ef74-491d-8efc-e98d742ed033 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.242676 Oct 02 02:30:12.915145 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4097/7751] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:12 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:13.940274 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:13.941542 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:13.948176 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:13.948693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:13.949142 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:13.949839 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:13.950302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:13.950762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:14.086193 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:14.094080 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a4a8bd22-5751-46de-8928-24a029f35808 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.158953 Oct 02 02:30:14.094680 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3655/7752] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:13 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:15.117894 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:15.118548 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:15.125413 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:15.125901 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:15.126348 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:15.127081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:15.127548 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:15.128593 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:15.324652 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:15.332481 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b3e603ac-ddc9-46fa-a8ab-41978ad38ad9 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.218546 Oct 02 02:30:15.333056 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4098/7753] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:15 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:30:16.355970 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:16.356625 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:16.363820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:16.364307 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:16.364748 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:16.365444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:16.365904 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:16.366334 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:16.501239 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:16.509603 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-2ba43c34-4d1c-4117-9250-358084d7552a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.157607 Oct 02 02:30:16.510189 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3656/7754] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:16 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:17.533418 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:17.534078 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:17.541817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:17.542319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:17.542803 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:17.543518 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:17.543995 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:17.544440 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:17.563218 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:30:17.677878 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:17.685680 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-17acd42c-74b8-4a9e-a84a-bb9e5026af82 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.156230 Oct 02 02:30:17.686264 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4099/7755] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:17 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:18.709386 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:18.709999 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:18.716843 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:18.717323 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:18.717762 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:18.718453 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:18.718940 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:18.719362 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:18.866086 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:18.873953 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-35594930-3b79-43c7-8e3b-ca8174fdcd1a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.168499 Oct 02 02:30:18.874539 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3657/7756] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:18 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:19.897630 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:19.898248 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:19.900959 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=31 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:30:19.906193 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:19.906720 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:19.907172 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:19.907871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:19.908339 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:19.908774 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:20.038369 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:20.046378 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-2d985654-f90e-4a7f-9f1f-95ba3579ad28 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.152813 Oct 02 02:30:20.046984 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4100/7757] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:19 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:21.070520 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:21.071171 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:21.074195 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:30:21.080192 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:21.080678 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:21.081788 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:21.082316 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:21.082850 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:21.083286 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:21.086402 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:30:21.216283 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:21.224476 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f482355c-c505-40d9-a062-9b564f854316 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.157797 Oct 02 02:30:21.224995 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3658/7758] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:21 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:22.248555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:22.249123 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:22.256333 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:22.256835 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:22.257288 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:22.257994 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:22.258465 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:22.258943 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:22.397245 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:22.405099 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7003bf3f-3ce1-4a20-ba28-59f3118cbc16 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.160491 Oct 02 02:30:22.405673 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4101/7759] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:22 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:23.428778 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:23.429399 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:23.435703 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:23.436196 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:23.436639 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:23.437337 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:23.437798 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:23.438228 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:23.573556 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:23.581875 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-91693a74-fa13-48a5-a28c-b270bb6e3a0a tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.156713 Oct 02 02:30:23.582467 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3659/7760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:23 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:24.606873 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:24.607507 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:24.615270 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:24.615770 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:24.616215 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:24.616927 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:24.617399 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:24.617839 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:24.754337 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:24.762426 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a1d6373c-8391-401d-b485-3462626fab22 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.159737 Oct 02 02:30:24.763051 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4102/7761] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:24 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:25.785893 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:25.786491 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:25.793420 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:25.793908 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:25.794348 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:25.795070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:25.795562 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:25.795996 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:25.930186 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:25.939549 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-58ec3b3e-feaf-4e11-ab96-9f63cdaa5d72 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.157535 Oct 02 02:30:25.940559 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3660/7762] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:25 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:26.017237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-50992779-7fca-47c9-b038-58cdcdbe250c req-28ffcb7c-897b-4be4-a9e3-98d9a0bb1c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "name": "network-vif-plugged", "status": "completed", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:30:26.028685 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-50992779-7fca-47c9-b038-58cdcdbe250c req-28ffcb7c-897b-4be4-a9e3-98d9a0bb1c01 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:26.029178 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-50992779-7fca-47c9-b038-58cdcdbe250c req-28ffcb7c-897b-4be4-a9e3-98d9a0bb1c01 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:26.029626 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-50992779-7fca-47c9-b038-58cdcdbe250c req-28ffcb7c-897b-4be4-a9e3-98d9a0bb1c01 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:26.043079 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-50992779-7fca-47c9-b038-58cdcdbe250c req-28ffcb7c-897b-4be4-a9e3-98d9a0bb1c01 service nova] Creating event network-vif-plugged:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h1-master-1 Oct 02 02:30:26.048303 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-50992779-7fca-47c9-b038-58cdcdbe250c req-28ffcb7c-897b-4be4-a9e3-98d9a0bb1c01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035599 Oct 02 02:30:26.049372 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4103/7763] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:30:26.964584 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:26.965205 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:26.972985 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:26.973667 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:26.974114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:26.974853 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:26.975322 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:26.975756 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:27.109671 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:27.117724 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-49f929c7-79e4-43a0-aad3-d9b8cb2ce742 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1576 microversion: 2.1 time: 0.157056 Oct 02 02:30:27.118312 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3661/7764] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:26 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:30:28.143094 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:30:28.143961 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:30:28.150081 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:28.150577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:28.151054 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:28.151759 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:30:28.152230 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:30:28.152674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:30:28.286632 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:30:28.294945 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9c6cbcf7-dc9f-42bc-aa7b-90cb49b8738e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1563 microversion: 2.1 time: 0.157003 Oct 02 02:30:28.295536 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4104/7765] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:30:28 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:41.477203 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=7 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:41.478685 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=23 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:41.480358 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:31:41.480723 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 (ip 10.222.0.23) !!! Oct 02 02:31:41.484671 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=9 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:41.485440 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=28 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:41.486689 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:31:41.487071 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 02 02:31:41.488298 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:31:41.488582 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 02 02:31:41.491906 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:41.492885 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:41.512581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:41.513369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:41.514040 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:41.515006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:41.515769 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:41.516421 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:41.548050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:31:41.591487 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-92cc922c-fd5b-4a45-842b-51266d38cd56 req-82347634-7972-4d78-904a-0f98c760c999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:31:41.601245 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92cc922c-fd5b-4a45-842b-51266d38cd56 req-82347634-7972-4d78-904a-0f98c760c999 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:41.602023 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92cc922c-fd5b-4a45-842b-51266d38cd56 req-82347634-7972-4d78-904a-0f98c760c999 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:41.602485 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-92cc922c-fd5b-4a45-842b-51266d38cd56 req-82347634-7972-4d78-904a-0f98c760c999 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:41.614616 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-92cc922c-fd5b-4a45-842b-51266d38cd56 req-82347634-7972-4d78-904a-0f98c760c999 service nova] Creating event network-changed:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h1-master-1 Oct 02 02:31:41.621130 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-92cc922c-fd5b-4a45-842b-51266d38cd56 req-82347634-7972-4d78-904a-0f98c760c999 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144614 Oct 02 02:31:41.621803 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4105/7766] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:31:41.643825 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9a98225d-110d-41e3-86dc-a20c79fe927e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 204 len: 0 microversion: 2.1 time: 0.168592 Oct 02 02:31:41.645077 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3662/7767] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:31:41 2022] DELETE /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:31:41.657455 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:41.658258 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:41.665955 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:41.667265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:41.667725 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:41.668674 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:41.669145 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:41.669782 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:41.831112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:41.839677 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a01a61d0-80ae-4e4c-aae0-7b7768bdc133 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.188913 Oct 02 02:31:41.840371 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4106/7768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:41 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:42.864370 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:42.865092 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:42.872110 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:42.872604 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:42.873049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:42.873755 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:42.874213 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:42.874669 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:43.037722 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:43.046152 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c20deb2a-4a65-4fb7-b767-517345fb8b47 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1569 microversion: 2.1 time: 0.186047 Oct 02 02:31:43.046767 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3663/7769] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:42 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:44.070807 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:44.071444 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:44.079355 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:44.079854 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:44.080301 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:44.081008 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:44.081480 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:44.081922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:44.297763 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:44.306228 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-aadb5da0-bfa7-4790-8ad4-01c4fa18c6c3 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1450 microversion: 2.1 time: 0.239610 Oct 02 02:31:44.307429 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4107/7770] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:44 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1450 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:44.454579 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-6b60afb1-5a5e-4eca-92ba-e1fa76be6311 req-20baf64a-9156-4de5-b3d7-6437c00e971f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4dad61-4b3c-4d42-934b-aba381fdec57", "name": "network-vif-deleted", "tag": "b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:31:44.467496 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6b60afb1-5a5e-4eca-92ba-e1fa76be6311 req-20baf64a-9156-4de5-b3d7-6437c00e971f service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:44.467988 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6b60afb1-5a5e-4eca-92ba-e1fa76be6311 req-20baf64a-9156-4de5-b3d7-6437c00e971f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:44.468428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-6b60afb1-5a5e-4eca-92ba-e1fa76be6311 req-20baf64a-9156-4de5-b3d7-6437c00e971f service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:44.481165 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-6b60afb1-5a5e-4eca-92ba-e1fa76be6311 req-20baf64a-9156-4de5-b3d7-6437c00e971f service nova] Creating event network-vif-deleted:b3dc0b61-fd99-4d13-bb65-b29dd32cbbb4 for instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 on n-h1-master-1 Oct 02 02:31:44.487023 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-6b60afb1-5a5e-4eca-92ba-e1fa76be6311 req-20baf64a-9156-4de5-b3d7-6437c00e971f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037318 Oct 02 02:31:44.487644 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3664/7771] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 02:31:45.330717 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:45.331387 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:45.338807 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:45.339321 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:45.339777 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:45.340514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:45.340970 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:45.341418 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:45.409800 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:45.417879 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-a5254d11-224d-49c4-8dc7-7ef152b2f145 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1219 microversion: 2.1 time: 0.091074 Oct 02 02:31:45.418465 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4108/7772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:45 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:46.443276 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:46.445026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:46.453301 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:46.453801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:46.454258 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:46.455006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:46.455479 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:46.455924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:46.524168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:46.532822 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-04705606-3438-4c2b-b7aa-1d8a727ad785 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1219 microversion: 2.1 time: 0.094876 Oct 02 02:31:46.533401 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3665/7773] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:46 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:47.556434 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:47.557576 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:47.564546 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:47.565040 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:47.565487 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:47.566216 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:47.566716 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:47.567155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:47.629659 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:47.638828 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-82bec1fb-290f-451f-b41c-28008b39b825 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1219 microversion: 2.1 time: 0.086205 Oct 02 02:31:47.639426 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4109/7774] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:47 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:48.661596 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:48.662228 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:48.670075 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:48.670932 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:48.671049 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:48.671810 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:48.672358 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:48.672801 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:48.706830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:48.706830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:48.707261 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:48.707710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.objects.instance [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lazy-loading 'fault' on Instance uuid 4d4dad61-4b3c-4d42-934b-aba381fdec57 {{(pid=122355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 02:31:48.755464 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efefb16531ff4d68a6e3c97f845e9e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f05359cdbb64ee8a632f63c04d6792f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:31:48.764286 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-cb71e78c-674e-411b-8754-dec0cc07985e tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 200 len: 1224 microversion: 2.1 time: 0.106709 Oct 02 02:31:48.764865 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3666/7775] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:48 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:31:49.788033 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:49.788593 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] [instance: 4d4dad61-4b3c-4d42-934b-aba381fdec57] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:31:49.795922 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:49.796426 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:49.796874 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:49.797585 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:31:49.798094 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:31:49.798540 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:31:49.812655 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] HTTP exception thrown: Instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 could not be found. Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Request method failure captured: Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 HTTP/1.1 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPXZBP0eMObgzeIAS3orKcnGzySlQGGpfvd9OxIs92xzmRRmlOAPOm4DguOxJ15rvWpDoj15vxkMWDfKZJhvhKNFRdfTEJZksx5SZAqWCIbiF20UtU0dIlduMe9HB24vijz--nHNcyjIPJ7nRikXtjUnHUQ8wWDXQExRq8f28LgdLWU Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 1f05359cdbb64ee8a632f63c04d6792f Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestShelveInstance-1531837743 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f05359cdbb64ee8a632f63c04d6792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f05359cdbb64ee8a632f63c04d6792f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f05359cdbb64ee8a632f63c04d6792f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f05359cdbb64ee8a632f63c04d6792f"}]}] Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestShelveInstance-1531837743 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 1f05359cdbb64ee8a632f63c04d6792f Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestShelveInstance-1531837743 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestShelveInstance-1531837743-project Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: efefb16531ff4d68a6e3c97f845e9e12 Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestShelveInstance-1531837743-project Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 could not be found. Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '4d4dad61-4b3c-4d42-934b-aba381fdec57'} Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 could not be found. Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 could not be found. Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:31:49.814356 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 could not be found. Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Returning 404 to user: Instance 4d4dad61-4b3c-4d42-934b-aba381fdec57 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-9f534a67-a74f-45fc-ad99-b189c774e6f4 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57" status: 404 len: 111 microversion: 2.1 time: 0.031823 Oct 02 02:31:49.819386 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4110/7776] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:31:49 2022] GET /compute/v2.1/servers/4d4dad61-4b3c-4d42-934b-aba381fdec57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:31:49.988680 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-ee93fc01-b64a-4f8e-a908-f97a15864c81 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] Calling method '.version_select at 0x7fb88102e550>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:31:50.019803 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-ee93fc01-b64a-4f8e-a908-f97a15864c81 tempest-TestShelveInstance-1531837743 tempest-TestShelveInstance-1531837743-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1039656855" status: 202 len: 0 microversion: 2.1 time: 0.035387 Oct 02 02:31:50.021072 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3667/7777] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 02:31:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1039656855 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 02:32:07.235635 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=12 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:07.236384 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=28 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:07.459256 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1459b2a4-3733-45c7-9e6f-505adae96995 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Action: 'create', calling method: .version_select at 0x7fb87875b3a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-963836728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYja0RLOkByQP9FpE6HmQN85d9FFZIZj9zGTvJojpEg/jBhTeQeWGgnuiAzf5o0HwDMciSBHUS+BEpWQG1Mb8n7ZeDNt/GFL8ef5XVQqzoLUzs+iiOQ9e9avbsZ214S7A=="}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:32:07.495050 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1459b2a4-3733-45c7-9e6f-505adae96995 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Getting quotas for project 4c8d09faa16d4f00b10c9a302fe110df. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:32:07.505743 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-1459b2a4-3733-45c7-9e6f-505adae96995 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Getting quotas for user 0e0b1745c8814aa49198d4170bc2de7b and project 4c8d09faa16d4f00b10c9a302fe110df. Resources: {'key_pairs'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:32:07.539139 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1459b2a4-3733-45c7-9e6f-505adae96995 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308508 Oct 02 02:32:07.552423 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4111/7778] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 2 02:32:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:32:08.549047 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:08.550223 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:08.554460 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1405212503", "imageRef": "d452563b-d97f-4ef2-b927-770421bd0406", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-963836728", "security_groups": [{"name": "tempest-secgroup-smoke-1262064042"}], "networks": [{"uuid": "baa9ede0-67e6-40a6-8e54-5f4526f59e5a"}]}} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:32:08.764401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.network.neutron [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] validate_networks() for [('baa9ede0-67e6-40a6-8e54-5f4526f59e5a', None, None, None, None, None)] {{(pid=122355) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:32:09.504700 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Flavor limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:32:09.505137 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Image limits 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:32:09.505646 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Flavor pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:32:09.506084 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Image pref 0:0:0 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:32:09.506500 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.virt.hardware [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:32:09.516346 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:09.516841 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:09.517290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:09.518706 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:09.519181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:09.519617 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:09.539354 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Getting quotas for project 4c8d09faa16d4f00b10c9a302fe110df. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:32:09.544873 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.quota [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Getting quotas for user 0e0b1745c8814aa49198d4170bc2de7b and project 4c8d09faa16d4f00b10c9a302fe110df. Resources: {'ram', 'instances', 'cores'} {{(pid=122355) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:32:09.559801 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Going to run 1 instances... {{(pid=122355) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:32:09.563254 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d452563b-d97f-4ef2-b927-770421bd0406',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:32:09.609639 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-eeabecd1-f310-4ae7-9594-ba4c89e5ec51 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062778 Oct 02 02:32:09.610310 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3668/7779] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:32:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:32:09.622095 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-e1da004f-6d57-4a7f-a3aa-70b7246812c3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:09.622834 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-e1da004f-6d57-4a7f-a3aa-70b7246812c3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:09.677702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-e1da004f-6d57-4a7f-a3aa-70b7246812c3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:09.685545 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-e1da004f-6d57-4a7f-a3aa-70b7246812c3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1248 microversion: 2.1 time: 0.068000 Oct 02 02:32:09.686116 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4112/7780] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:09 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:10.708710 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-33c89b5b-df70-428c-b4e1-ce8d46adfa0f tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:10.709485 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-33c89b5b-df70-428c-b4e1-ce8d46adfa0f tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:10.789278 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-33c89b5b-df70-428c-b4e1-ce8d46adfa0f tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:10.796366 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-33c89b5b-df70-428c-b4e1-ce8d46adfa0f tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1248 microversion: 2.1 time: 0.091496 Oct 02 02:32:10.796954 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3669/7781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:10 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:11.819664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-bfae11b6-341c-473f-88f9-bf30457de856 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:11.820316 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-bfae11b6-341c-473f-88f9-bf30457de856 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:11.881358 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-bfae11b6-341c-473f-88f9-bf30457de856 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:11.889988 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-bfae11b6-341c-473f-88f9-bf30457de856 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1248 microversion: 2.1 time: 0.074193 Oct 02 02:32:11.890936 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4113/7782] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:11 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:12.913438 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d1af99ad-019c-48ab-9c91-f793b756d06a tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:12.914158 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d1af99ad-019c-48ab-9c91-f793b756d06a tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:12.973136 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d1af99ad-019c-48ab-9c91-f793b756d06a tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:12.982839 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d1af99ad-019c-48ab-9c91-f793b756d06a tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1248 microversion: 2.1 time: 0.073202 Oct 02 02:32:12.983414 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3670/7783] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:12 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:14.006988 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:14.007615 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:14.017871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:14.018375 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:14.018871 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:14.019586 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:14.020065 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:14.020514 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:14.084097 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:14.092721 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-53862db5-ce09-42aa-b466-d6dcf743164c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1252 microversion: 2.1 time: 0.089712 Oct 02 02:32:14.093316 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4114/7784] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:14 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1252 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:15.117168 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:15.117788 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:15.124758 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:15.125247 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:15.125690 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:15.126408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:15.126873 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:15.127302 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:15.212090 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:15.219924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-9dd72b75-5d1b-456d-8b94-ffe0018f5859 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1306 microversion: 2.1 time: 0.107145 Oct 02 02:32:15.220535 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3671/7785] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:15 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:16.243215 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:16.244581 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:16.251568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:16.252079 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:16.252537 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:16.253259 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:16.253736 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:16.254183 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:16.498333 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-c145a017-36b1-47a1-8592-3186a20363b8 req-67ce916f-7b0c-4b21-b1f5-e6c5d8353dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:32:16.500702 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:16.508918 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c145a017-36b1-47a1-8592-3186a20363b8 req-67ce916f-7b0c-4b21-b1f5-e6c5d8353dc4 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:16.509270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c145a017-36b1-47a1-8592-3186a20363b8 req-67ce916f-7b0c-4b21-b1f5-e6c5d8353dc4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:16.509917 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-c145a017-36b1-47a1-8592-3186a20363b8 req-67ce916f-7b0c-4b21-b1f5-e6c5d8353dc4 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:16.510450 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-4f8fd5a3-10a7-45f0-9449-4075b849cad0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1374 microversion: 2.1 time: 0.270730 Oct 02 02:32:16.511168 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4115/7786] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:16 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:16.522792 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-c145a017-36b1-47a1-8592-3186a20363b8 req-67ce916f-7b0c-4b21-b1f5-e6c5d8353dc4 service nova] Creating event network-changed:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:32:16.530347 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-c145a017-36b1-47a1-8592-3186a20363b8 req-67ce916f-7b0c-4b21-b1f5-e6c5d8353dc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100999 Oct 02 02:32:16.531621 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3672/7787] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:32:17.534979 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:17.535671 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:17.542698 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:17.543201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:17.543683 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:17.544398 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:17.544870 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:17.545312 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:17.679937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:17.688524 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-958b75e9-9852-4b41-9496-65709b2655ec tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1374 microversion: 2.1 time: 0.157611 Oct 02 02:32:17.689150 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4116/7788] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:17 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:18.715244 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:18.716022 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:18.722752 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:18.723210 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:18.723655 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:18.724369 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:18.724830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:18.725295 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:18.862859 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:18.870957 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a7ba691a-126a-4369-8a1d-d42644326d67 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1374 microversion: 2.1 time: 0.161717 Oct 02 02:32:18.871707 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3673/7789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:18 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:19.895084 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:19.895710 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:19.903385 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:19.903880 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:19.904328 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:19.905025 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:19.905492 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:19.905929 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:20.036446 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:20.045542 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-f8bb6536-8405-460e-8305-28fe4858def4 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1374 microversion: 2.1 time: 0.154259 Oct 02 02:32:20.046135 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4117/7790] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:19 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:20.789097 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-fbb154ad-2a82-4326-89de-5f08fedab62c req-94a43dbd-be63-4a41-9ce7-d5f99e39865e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "name": "network-vif-plugged", "status": "completed", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:32:20.794097 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:20.803523 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fbb154ad-2a82-4326-89de-5f08fedab62c req-94a43dbd-be63-4a41-9ce7-d5f99e39865e service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:20.804014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fbb154ad-2a82-4326-89de-5f08fedab62c req-94a43dbd-be63-4a41-9ce7-d5f99e39865e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:20.804458 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-fbb154ad-2a82-4326-89de-5f08fedab62c req-94a43dbd-be63-4a41-9ce7-d5f99e39865e service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:20.816974 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-fbb154ad-2a82-4326-89de-5f08fedab62c req-94a43dbd-be63-4a41-9ce7-d5f99e39865e service nova] Creating event network-vif-plugged:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:32:20.823170 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-fbb154ad-2a82-4326-89de-5f08fedab62c req-94a43dbd-be63-4a41-9ce7-d5f99e39865e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037526 Oct 02 02:32:20.824090 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3674/7791] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:32:21.071344 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:21.072167 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:21.078568 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:21.079091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:21.079538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:21.080236 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:21.080702 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:21.081159 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:21.210781 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:21.218488 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-584d8a1b-e024-4655-b56a-a74961931fbf tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1374 microversion: 2.1 time: 0.151153 Oct 02 02:32:21.219099 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4118/7792] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:21 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:22.242243 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:22.243019 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:22.249907 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:22.250390 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:22.250856 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:22.251557 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:22.252014 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:22.252444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:22.405984 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:22.413924 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-bcac08ff-af80-448f-8798-e9ffb376f1a2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1559 microversion: 2.1 time: 0.176303 Oct 02 02:32:22.414514 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3675/7793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:22 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:22.437293 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:32:22.437924 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:32:22.439818 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=8 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:22.445787 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:22.446282 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:22.447429 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:22.448337 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:22.448805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:22.449244 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:22.583023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:32:22.591443 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-26aad925-ce3e-44cb-93b6-5de7913ee2d5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1559 microversion: 2.1 time: 0.157957 Oct 02 02:32:22.592011 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4119/7794] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:32:22 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:32:24.214434 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-0ee1f3f6-77e7-4c4b-acd3-87c96fc192c3 req-fa76528f-df73-454d-827d-fb9783cf52f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:32:24.219373 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=10 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:24.225997 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0ee1f3f6-77e7-4c4b-acd3-87c96fc192c3 req-fa76528f-df73-454d-827d-fb9783cf52f0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:32:24.226478 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0ee1f3f6-77e7-4c4b-acd3-87c96fc192c3 req-fa76528f-df73-454d-827d-fb9783cf52f0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:32:24.226951 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-0ee1f3f6-77e7-4c4b-acd3-87c96fc192c3 req-fa76528f-df73-454d-827d-fb9783cf52f0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:32:24.238585 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-0ee1f3f6-77e7-4c4b-acd3-87c96fc192c3 req-fa76528f-df73-454d-827d-fb9783cf52f0 service nova] Creating event network-changed:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:32:24.243771 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-0ee1f3f6-77e7-4c4b-acd3-87c96fc192c3 req-fa76528f-df73-454d-827d-fb9783cf52f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033641 Oct 02 02:32:24.244903 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3676/7795] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:34:21.732357 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:34:21.733268 n-d-master-1 devstack@n-api.service[122354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:34:21.733808 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:21.734767 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=36 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:21.735622 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 02:34:21.735933 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8/action (ip 10.222.0.23) !!! Oct 02 02:34:21.740762 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-73922939"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:34:21.743175 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:21.752319 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:21.752961 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:21.753470 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:21.754217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:21.754794 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:21.755241 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:21.971785 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7e6d4609-0100-4c15-9a5b-5dd06e111187 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "POST /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8/action" status: 202 len: 0 microversion: 2.1 time: 0.241154 Oct 02 02:34:21.972635 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4120/7796] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:34:21 2022] POST /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 02:34:27.320170 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8287f448-c3f1-49b5-a79e-0c54076f44eb] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:34:27.321190 n-d-master-1 devstack@n-api.service[122355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 02:34:27.321813 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:27.322654 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=26 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:27.419087 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-ac3d1690-929a-4171-a6b0-18a05758503b req-bc86e132-51d3-4083-8228-bfd1e4379f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "name": "network-vif-plugged", "status": "completed", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:34:27.437172 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ac3d1690-929a-4171-a6b0-18a05758503b req-bc86e132-51d3-4083-8228-bfd1e4379f67 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:27.437800 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ac3d1690-929a-4171-a6b0-18a05758503b req-bc86e132-51d3-4083-8228-bfd1e4379f67 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:27.438743 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-ac3d1690-929a-4171-a6b0-18a05758503b req-bc86e132-51d3-4083-8228-bfd1e4379f67 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:27.453071 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-ac3d1690-929a-4171-a6b0-18a05758503b req-bc86e132-51d3-4083-8228-bfd1e4379f67 service nova] Creating event network-vif-plugged:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:34:27.459682 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-ac3d1690-929a-4171-a6b0-18a05758503b req-bc86e132-51d3-4083-8228-bfd1e4379f67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142169 Oct 02 02:34:27.463246 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3677/7797] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:34:35.560621 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:35.561468 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:35.566107 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-285924931", "imageRef": "01f0d3e7-2984-478a-9420-ef2d4cdd01c9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-963836728", "security_groups": [{"name": "tempest-secgroup-smoke-1262064042"}], "networks": [{"uuid": "baa9ede0-67e6-40a6-8e54-5f4526f59e5a"}]}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:34:35.593394 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [32673cf3-e467-404c-9851-f6a2e279c30e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33616. Oct 02 02:34:35.595526 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b2910a3-7db3-429a-a1ca-21fb3b3f4f81] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33618. Oct 02 02:34:35.679579 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.network.neutron [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] validate_networks() for [('baa9ede0-67e6-40a6-8e54-5f4526f59e5a', None, None, None, None, None)] {{(pid=122354) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 02:34:36.124772 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Flavor limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 02:34:36.125209 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Image limits 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 02:34:36.125692 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Flavor pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 02:34:36.126112 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Image pref 0:0:0 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 02:34:36.126538 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.virt.hardware [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 02:34:36.135471 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:36.136050 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:36.136497 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:36.137237 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:36.137729 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:36.138166 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:36.155089 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Getting quotas for project 4c8d09faa16d4f00b10c9a302fe110df. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 02:34:36.160361 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.quota [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Getting quotas for user 0e0b1745c8814aa49198d4170bc2de7b and project 4c8d09faa16d4f00b10c9a302fe110df. Resources: {'ram', 'instances', 'cores'} {{(pid=122354) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 02:34:36.172884 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Going to run 1 instances... {{(pid=122354) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 02:34:36.175413 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='01f0d3e7-2984-478a-9420-ef2d4cdd01c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 02:34:36.224532 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-c14f5015-dae0-4794-91c1-3ef1aad20866 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.665978 Oct 02 02:34:36.225382 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4121/7798] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 02:34:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 02:34:36.240063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-4534a423-fe8e-46c5-9eb8-ce20cb06fa56 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:36.240775 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-4534a423-fe8e-46c5-9eb8-ce20cb06fa56 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:36.254471 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce12f57d-f915-41a5-a843-42eda3d36f7a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33634. Oct 02 02:34:36.261917 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] [8287f448-c3f1-49b5-a79e-0c54076f44eb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33632. Oct 02 02:34:36.311401 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-4534a423-fe8e-46c5-9eb8-ce20cb06fa56 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:36.319088 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-4534a423-fe8e-46c5-9eb8-ce20cb06fa56 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1247 microversion: 2.1 time: 0.085584 Oct 02 02:34:36.319658 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3678/7799] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:36 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1247 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:37.344701 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:37.345981 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:37.354424 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:37.355233 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:37.355899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:37.356630 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:37.357318 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:37.357971 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:37.443404 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:37.452418 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-7fd8ffd9-0ef9-421f-bbe4-26fa837a08de tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1307 microversion: 2.1 time: 0.112992 Oct 02 02:34:37.453008 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4122/7800] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:37 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:38.476567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:38.478443 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:38.486718 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:38.489471 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:38.490024 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:38.490854 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:38.493114 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:38.494083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:38.494799 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:38.659392 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:38.667860 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-78ca4853-c315-407d-841d-ba47b7b78b66 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.195166 Oct 02 02:34:38.668463 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3679/7801] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:38 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:39.309970 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-982840d5-d480-4f91-b9fa-8ef52bfe7dcc req-5443edd7-8a39-4661-860e-f40d858d6609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "name": "network-vif-unplugged", "status": "completed", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:34:39.333130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-982840d5-d480-4f91-b9fa-8ef52bfe7dcc req-5443edd7-8a39-4661-860e-f40d858d6609 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:39.333772 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-982840d5-d480-4f91-b9fa-8ef52bfe7dcc req-5443edd7-8a39-4661-860e-f40d858d6609 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:39.334214 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-982840d5-d480-4f91-b9fa-8ef52bfe7dcc req-5443edd7-8a39-4661-860e-f40d858d6609 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:39.349059 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-982840d5-d480-4f91-b9fa-8ef52bfe7dcc req-5443edd7-8a39-4661-860e-f40d858d6609 service nova] Creating event network-vif-unplugged:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:34:39.355498 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-982840d5-d480-4f91-b9fa-8ef52bfe7dcc req-5443edd7-8a39-4661-860e-f40d858d6609 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051087 Oct 02 02:34:39.356970 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4123/7802] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:34:39.692481 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:39.693225 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:39.701350 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:39.701924 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:39.702431 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:39.703249 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:39.703775 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:39.704272 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:39.861202 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:39.872493 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-88e12cd1-046b-4503-aa5e-6dd77d98766b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.184088 Oct 02 02:34:39.873554 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3680/7803] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:39 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:40.900183 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:40.900937 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:40.907389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:40.907893 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:40.908340 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:40.909053 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:40.909522 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:40.909959 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:41.060664 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:41.068742 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-07cd191c-7f46-4769-8403-050636e81529 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.174446 Oct 02 02:34:41.069338 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4124/7804] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:40 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:42.096014 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:42.097567 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:42.105983 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:42.106614 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:42.107151 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:42.107939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:42.108649 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:42.109178 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:42.255950 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:42.266525 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-0068347b-6969-47f3-8512-c98c08c42f59 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.176548 Oct 02 02:34:42.267263 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3681/7805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:42 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:43.291947 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:43.293261 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:43.300262 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:43.300767 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:43.301229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:43.302589 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:43.303300 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:43.303946 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:43.449312 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:43.458150 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-315252d3-2fbb-43e5-b195-71c3cc236c7b tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.170843 Oct 02 02:34:43.474636 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4125/7806] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:43 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:44.483815 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:44.485142 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:44.492974 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:44.493583 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:44.494179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:44.494925 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:44.495488 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:44.496179 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:44.643141 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:44.651912 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a2f9f505-7f93-493a-9a9d-1ae711d58b1d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.171986 Oct 02 02:34:44.652505 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3682/7807] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:44 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:45.675587 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:45.676237 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:45.683704 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:45.684201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:45.684650 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:45.685357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:45.685825 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:45.686265 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:45.822061 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:45.830143 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-5ff038ef-fbac-4b2b-884e-bb44438505ac tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.158444 Oct 02 02:34:45.830767 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4126/7808] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:45 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:46.855154 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:46.855781 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:46.858482 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell0:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:46.864043 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:46.864536 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:46.864984 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:46.865698 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:46.866188 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:46.866622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:46.997794 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:47.005565 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-a3fb1685-f337-42ca-a1e8-07e907acbaf5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.154946 Oct 02 02:34:47.006147 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3683/7809] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:46 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:48.029015 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:48.029638 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:48.031654 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:48.032331 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell0:SELECT=6 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:48.040201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:48.040721 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:48.041169 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:48.041877 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:48.042342 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:48.042809 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:48.184266 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:48.192085 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-8a458549-fe70-44b5-ac46-257d4521abfe tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.167043 Oct 02 02:34:48.192660 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4127/7810] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:48 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:49.219063 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:49.219782 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:49.227579 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:49.228120 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:49.228616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:49.229351 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:49.229828 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:49.230270 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:49.435655 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:49.444291 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c8f638b6-319e-421c-9378-0d0be87608ea tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.231667 Oct 02 02:34:49.446248 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3684/7811] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:49 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:49.740163 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-8c860758-c9dc-46a1-8650-ea75ecb2ffc2 req-ee2f48c3-85d0-4b36-9934-04967eb29fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89aeb84f-4b45-4f43-9918-7a65d49b8358", "tag": "ca20a8fc-7f25-47d7-97d3-0856dcdf2be7"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:34:49.750699 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8c860758-c9dc-46a1-8650-ea75ecb2ffc2 req-ee2f48c3-85d0-4b36-9934-04967eb29fd5 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:49.751292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8c860758-c9dc-46a1-8650-ea75ecb2ffc2 req-ee2f48c3-85d0-4b36-9934-04967eb29fd5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:49.751804 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-8c860758-c9dc-46a1-8650-ea75ecb2ffc2 req-ee2f48c3-85d0-4b36-9934-04967eb29fd5 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:49.762646 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-8c860758-c9dc-46a1-8650-ea75ecb2ffc2 req-ee2f48c3-85d0-4b36-9934-04967eb29fd5 service nova] Creating event network-changed:ca20a8fc-7f25-47d7-97d3-0856dcdf2be7 for instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 on n-h1-master-1 Oct 02 02:34:49.767837 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-8c860758-c9dc-46a1-8650-ea75ecb2ffc2 req-ee2f48c3-85d0-4b36-9934-04967eb29fd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031408 Oct 02 02:34:49.768442 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4128/7812] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:34:50.469397 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:50.470050 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:50.478278 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:50.478855 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:50.480181 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:50.481132 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:50.481608 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:50.482042 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:50.620277 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:50.629027 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-11bebf78-a51e-41de-9dc8-c53ff3cf9a76 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.163309 Oct 02 02:34:50.630071 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3685/7813] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:50 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:51.655723 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:51.656464 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:51.663641 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:51.664780 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:51.665530 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:51.666405 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:51.666899 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:51.667336 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:51.808333 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:51.816137 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-dca7c845-4cd8-4657-af54-1d30eabd4cd3 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.164914 Oct 02 02:34:51.816708 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4129/7814] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:51 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:52.840094 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:52.840633 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:52.847616 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:52.848102 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:52.848542 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:52.849236 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:52.849693 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:52.850121 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:52.982766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:52.990415 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b24e1e3b-004e-41a1-858d-cd374f911515 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.154717 Oct 02 02:34:52.991023 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3686/7815] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:52 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:54.014023 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:54.014688 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:54.021632 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:54.022130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:54.022579 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:54.023324 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:54.023799 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:54.024438 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:54.156494 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:54.164859 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-42b917e0-5be9-4edd-83fa-0f4f7dba8226 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.154121 Oct 02 02:34:54.165644 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4130/7816] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:54 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:55.188340 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:55.188969 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:55.196251 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:55.196742 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:55.197182 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:55.197896 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:55.198360 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:55.198820 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:55.344522 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:55.352322 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-df144b64-2d8f-4bb5-9c7e-d6df7a1ec7a0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.167969 Oct 02 02:34:55.352908 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3687/7817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:55 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:56.375759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:56.376767 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:56.384577 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:56.385091 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:56.385558 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:56.386276 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:56.386805 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:56.387913 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:56.521719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:56.529848 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-0de4bf92-6008-4573-8a19-b2e31735762c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.158092 Oct 02 02:34:56.530425 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4131/7818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:56 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:57.158787 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-9602ab43-8ed5-4c59-8ef4-a63795340a9b req-d7a2d78a-cfa4-4e40-af75-ff09e8ad7b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89aeb84f-4b45-4f43-9918-7a65d49b8358", "name": "network-vif-plugged", "status": "completed", "tag": "ca20a8fc-7f25-47d7-97d3-0856dcdf2be7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:34:57.170466 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9602ab43-8ed5-4c59-8ef4-a63795340a9b req-d7a2d78a-cfa4-4e40-af75-ff09e8ad7b8b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:57.170991 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9602ab43-8ed5-4c59-8ef4-a63795340a9b req-d7a2d78a-cfa4-4e40-af75-ff09e8ad7b8b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:57.171428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-9602ab43-8ed5-4c59-8ef4-a63795340a9b req-d7a2d78a-cfa4-4e40-af75-ff09e8ad7b8b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:57.183765 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-9602ab43-8ed5-4c59-8ef4-a63795340a9b req-d7a2d78a-cfa4-4e40-af75-ff09e8ad7b8b service nova] Creating event network-vif-plugged:ca20a8fc-7f25-47d7-97d3-0856dcdf2be7 for instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 on n-h1-master-1 Oct 02 02:34:57.188976 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-9602ab43-8ed5-4c59-8ef4-a63795340a9b req-d7a2d78a-cfa4-4e40-af75-ff09e8ad7b8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033914 Oct 02 02:34:57.189657 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3688/7819] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:34:57.553364 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:57.553903 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:57.562093 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:57.562616 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:57.563092 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:57.563812 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:57.564317 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:57.564763 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:57.703555 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:57.711592 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-833ee222-6f5d-4baf-9079-8746a2ed4659 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1373 microversion: 2.1 time: 0.162114 Oct 02 02:34:57.712172 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4132/7820] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:57 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:58.738967 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:58.739807 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:58.741754 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=27 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:58.748490 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:58.748981 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:58.749419 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:58.750124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:58.750581 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:58.751041 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:58.881396 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:58.889308 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-f3b50537-e54e-4663-b2b6-ed95294043d0 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1558 microversion: 2.1 time: 0.155626 Oct 02 02:34:58.889880 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3689/7821] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:58 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:34:58.912122 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:34:58.912759 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:34:58.920454 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:58.920954 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:58.921407 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:58.922115 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:34:58.922614 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:34:58.923051 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:34:59.064392 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:34:59.072770 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1ae3998f-31f3-4b98-99d4-6dbac4609be7 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1558 microversion: 2.1 time: 0.164419 Oct 02 02:34:59.073358 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4133/7822] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:34:58 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:35:00.976026 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-90440225-a260-48bc-b1c6-c3fad1979626 req-28d5bac3-935d-4aeb-b541-9b0246969fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89aeb84f-4b45-4f43-9918-7a65d49b8358", "tag": "ca20a8fc-7f25-47d7-97d3-0856dcdf2be7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:35:00.986939 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-90440225-a260-48bc-b1c6-c3fad1979626 req-28d5bac3-935d-4aeb-b541-9b0246969fa0 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:35:00.987428 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-90440225-a260-48bc-b1c6-c3fad1979626 req-28d5bac3-935d-4aeb-b541-9b0246969fa0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:35:00.987962 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-90440225-a260-48bc-b1c6-c3fad1979626 req-28d5bac3-935d-4aeb-b541-9b0246969fa0 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:35:00.999704 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-90440225-a260-48bc-b1c6-c3fad1979626 req-28d5bac3-935d-4aeb-b541-9b0246969fa0 service nova] Creating event network-changed:ca20a8fc-7f25-47d7-97d3-0856dcdf2be7 for instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 on n-h1-master-1 Oct 02 02:35:01.004701 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-90440225-a260-48bc-b1c6-c3fad1979626 req-28d5bac3-935d-4aeb-b541-9b0246969fa0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032359 Oct 02 02:35:01.005299 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3690/7823] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:37:06.857252 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:06.858017 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=66 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:06.859119 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 02:37:06.859357 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358/action (ip 10.222.0.23) !!! Oct 02 02:37:06.861675 n-d-master-1 devstack@n-api.service[122354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:37:06.861826 n-d-master-1 devstack@n-api.service[122354]: Sun Oct 2 02:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358/action (ip 10.222.0.23) !!! Oct 02 02:37:06.869370 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2124003433"}} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:37:06.871727 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:06.882292 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:06.883450 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:06.883914 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:06.884633 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:06.885155 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:06.885551 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:07.243246 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-cc15546f-4724-4890-99a6-ffcdcebe66f2 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "POST /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358/action" status: 202 len: 0 microversion: 2.1 time: 0.387906 Oct 02 02:37:07.243901 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4134/7824] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 2 02:37:06 2022] POST /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 02 02:37:13.811746 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=3 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:13.812600 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=64 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:13.814004 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:37:13.814138 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 02 02:37:13.815482 n-d-master-1 devstack@n-api.service[122355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 02:37:13.815613 n-d-master-1 devstack@n-api.service[122355]: Sun Oct 2 02:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 02 02:37:13.821585 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-56d6a68c-75cf-49c8-8e00-58076df6cf1a req-b9516518-6772-412e-9c7f-653680e0cc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89aeb84f-4b45-4f43-9918-7a65d49b8358", "name": "network-vif-plugged", "status": "completed", "tag": "ca20a8fc-7f25-47d7-97d3-0856dcdf2be7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:37:13.837510 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-56d6a68c-75cf-49c8-8e00-58076df6cf1a req-b9516518-6772-412e-9c7f-653680e0cc7b service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:13.838006 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-56d6a68c-75cf-49c8-8e00-58076df6cf1a req-b9516518-6772-412e-9c7f-653680e0cc7b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:13.838449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-56d6a68c-75cf-49c8-8e00-58076df6cf1a req-b9516518-6772-412e-9c7f-653680e0cc7b service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:13.851133 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-56d6a68c-75cf-49c8-8e00-58076df6cf1a req-b9516518-6772-412e-9c7f-653680e0cc7b service nova] Creating event network-vif-plugged:ca20a8fc-7f25-47d7-97d3-0856dcdf2be7 for instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 on n-h1-master-1 Oct 02 02:37:13.857674 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-56d6a68c-75cf-49c8-8e00-58076df6cf1a req-b9516518-6772-412e-9c7f-653680e0cc7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048240 Oct 02 02:37:13.858476 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3691/7825] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:37:26.051336 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_api:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:26.052025 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:26.052443 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:26.053574 n-d-master-1 devstack@n-api.service[122355]: DEBUG dbcounter [-] [122355] Writing DB stats nova_cell1:SELECT=2 {{(pid=122355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:26.057711 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_api:SELECT=2 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:26.058408 n-d-master-1 devstack@n-api.service[122354]: DEBUG dbcounter [-] [122354] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:26.065647 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:26.066389 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:26.066968 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:26.067789 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:26.068353 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:26.068889 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:26.101911 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Going to try to terminate instance {{(pid=122354) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:37:26.113580 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-e98b5353-10f0-4b23-a971-3dbd8f798452 req-6f329057-4e07-4e52-a498-28e1d02e3a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89aeb84f-4b45-4f43-9918-7a65d49b8358", "tag": "ca20a8fc-7f25-47d7-97d3-0856dcdf2be7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:37:26.124740 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e98b5353-10f0-4b23-a971-3dbd8f798452 req-6f329057-4e07-4e52-a498-28e1d02e3a97 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:26.125812 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e98b5353-10f0-4b23-a971-3dbd8f798452 req-6f329057-4e07-4e52-a498-28e1d02e3a97 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:26.126482 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-e98b5353-10f0-4b23-a971-3dbd8f798452 req-6f329057-4e07-4e52-a498-28e1d02e3a97 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:26.139411 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-e98b5353-10f0-4b23-a971-3dbd8f798452 req-6f329057-4e07-4e52-a498-28e1d02e3a97 service nova] Creating event network-changed:ca20a8fc-7f25-47d7-97d3-0856dcdf2be7 for instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 on n-h1-master-1 Oct 02 02:37:26.145559 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-e98b5353-10f0-4b23-a971-3dbd8f798452 req-6f329057-4e07-4e52-a498-28e1d02e3a97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096258 Oct 02 02:37:26.146499 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3692/7826] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:37:26.199530 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-1c35f408-b184-4b2f-a68c-a3e0a198fe27 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 204 len: 0 microversion: 2.1 time: 0.151842 Oct 02 02:37:26.204019 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4135/7827] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:37:26 2022] DELETE /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:37:26.209796 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:26.211586 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:26.218290 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:26.219571 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:26.220124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:26.220944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:26.221532 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:26.222066 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:26.406267 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:37:26.414303 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d5a444f1-f74c-488f-a626-cd3d815a8989 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1681 microversion: 2.1 time: 0.208779 Oct 02 02:37:26.415101 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3693/7828] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:37:26 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:37:27.438950 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:27.439680 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:27.447847 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:27.448357 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:27.448817 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:27.449538 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:27.450015 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:27.450464 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:28.008320 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:37:28.018572 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-b628c07c-d91e-4b8a-bda2-d603583926a1 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 200 len: 1681 microversion: 2.1 time: 0.582651 Oct 02 02:37:28.021276 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4136/7829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:37:27 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 1681 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:37:28.544945 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [req-eff63dbd-98fc-4862-a5c6-33ede5886800 req-dcef58c7-2caf-4969-8a9f-e87608455976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89aeb84f-4b45-4f43-9918-7a65d49b8358", "name": "network-vif-deleted", "tag": "ca20a8fc-7f25-47d7-97d3-0856dcdf2be7"}]} {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:37:28.555449 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-eff63dbd-98fc-4862-a5c6-33ede5886800 req-dcef58c7-2caf-4969-8a9f-e87608455976 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:28.555964 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-eff63dbd-98fc-4862-a5c6-33ede5886800 req-dcef58c7-2caf-4969-8a9f-e87608455976 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:28.556408 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [req-eff63dbd-98fc-4862-a5c6-33ede5886800 req-dcef58c7-2caf-4969-8a9f-e87608455976 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:28.571093 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.compute.server_external_events [req-eff63dbd-98fc-4862-a5c6-33ede5886800 req-dcef58c7-2caf-4969-8a9f-e87608455976 service nova] Creating event network-vif-deleted:ca20a8fc-7f25-47d7-97d3-0856dcdf2be7 for instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 on n-h1-master-1 Oct 02 02:37:28.575899 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [req-eff63dbd-98fc-4862-a5c6-33ede5886800 req-dcef58c7-2caf-4969-8a9f-e87608455976 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092772 Oct 02 02:37:28.576527 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3694/7830] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:37:29.043943 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:29.044545 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: 89aeb84f-4b45-4f43-9918-7a65d49b8358] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:29.050528 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:29.051068 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:29.051556 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:29.052275 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:29.052753 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:29.053201 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:29.067988 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.wsgi [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] HTTP exception thrown: Instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 could not be found. Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Request method failure captured: Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: request: GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 HTTP/1.1 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Accept: application/json Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Accept-Encoding: identity Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Connection: close Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Content-Length: 0 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Content-Type: application/json Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Host: 10.222.0.23 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: Openstack-System-Scope: None Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: User-Agent: python-urllib3/1.26.12 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Auth-Token: gAAAAABjOPgixKA7pYNJLxfBmibHDfgriCGH55v3qwjsFdoWq_KdfciHtgVoNImPtvEncyfVVC4mITUaLQbtrM1TKbpiYihTBTol-gWwgNN5fUI9-lL9WJVjWKI_D0LfZdKZFhyCDBtqQVnAG87R0owg7BEA6ee8T_8UY64sgiMYcrZj_JI42no Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Id: None Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Domain-Name: None Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Identity-Status: Confirmed Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Is-Admin-Project: True Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Id: default Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Project-Domain-Name: Default Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Project-Id: 4c8d09faa16d4f00b10c9a302fe110df Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Project-Name: tempest-TestSnapshotPattern-1198644781 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Role: member,reader Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Roles: member,reader Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c8d09faa16d4f00b10c9a302fe110df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8d09faa16d4f00b10c9a302fe110df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8d09faa16d4f00b10c9a302fe110df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c8d09faa16d4f00b10c9a302fe110df"}]}] Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Tenant: tempest-TestSnapshotPattern-1198644781 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Id: 4c8d09faa16d4f00b10c9a302fe110df Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-Tenant-Name: tempest-TestSnapshotPattern-1198644781 Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-User: tempest-TestSnapshotPattern-1198644781-project Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Id: default Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-User-Domain-Name: Default Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-User-Id: 0e0b1745c8814aa49198d4170bc2de7b Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: X-User-Name: tempest-TestSnapshotPattern-1198644781-project Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: method: > Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: exception: Instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 could not be found. Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: action_args: {'id': '89aeb84f-4b45-4f43-9918-7a65d49b8358'} Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 could not be found. Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 could not be found. Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:37:29.069719 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 could not be found. Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: ERROR nova.api.openstack.wsgi Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Returning 404 to user: Instance 89aeb84f-4b45-4f43-9918-7a65d49b8358 could not be found. {{(pid=122354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-3c58a84f-5dc2-40be-99a4-f78a7e0939e5 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358" status: 404 len: 111 microversion: 2.1 time: 0.032795 Oct 02 02:37:29.077488 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4137/7831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:37:29 2022] GET /compute/v2.1/servers/89aeb84f-4b45-4f43-9918-7a65d49b8358 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:37:30.767790 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:30.768381 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:30.768735 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-c342fbe7-97c2-464a-b07a-cba4bab81398 req-149273b1-b2aa-4406-beb6-2c8692127f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:37:30.774943 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:30.775681 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:30.776124 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:30.776830 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:30.777537 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:30.777971 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:30.779823 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c342fbe7-97c2-464a-b07a-cba4bab81398 req-149273b1-b2aa-4406-beb6-2c8692127f7a service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:30.780316 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c342fbe7-97c2-464a-b07a-cba4bab81398 req-149273b1-b2aa-4406-beb6-2c8692127f7a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:30.780761 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-c342fbe7-97c2-464a-b07a-cba4bab81398 req-149273b1-b2aa-4406-beb6-2c8692127f7a service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:30.792037 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-c342fbe7-97c2-464a-b07a-cba4bab81398 req-149273b1-b2aa-4406-beb6-2c8692127f7a service nova] Creating event network-changed:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:37:30.797110 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-c342fbe7-97c2-464a-b07a-cba4bab81398 req-149273b1-b2aa-4406-beb6-2c8692127f7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032032 Oct 02 02:37:30.797715 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4138/7832] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:37:30.806229 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Going to try to terminate instance {{(pid=122355) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 02:37:30.901091 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-d215138e-7016-4b38-b970-7a3ad8b96217 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 204 len: 0 microversion: 2.1 time: 0.137954 Oct 02 02:37:30.905869 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3695/7833] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 02:37:30 2022] DELETE /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 02:37:30.911706 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:30.912649 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.compute.api [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122354) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:30.921038 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:30.921658 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:30.922217 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:30.923086 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:30.923691 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:30.924229 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:31.068260 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.policy [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122354) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:37:31.076341 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-31a818cf-9dd2-4a68-ade1-f0dd382b0c0c tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1684 microversion: 2.1 time: 0.169070 Oct 02 02:37:31.076908 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4139/7834] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:37:30 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 02:37:32.103013 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:32.103766 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:32.110944 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:32.111444 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:32.111895 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:32.112615 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:32.113083 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:32.113517 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:32.183743 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.policy [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b1745c8814aa49198d4170bc2de7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d09faa16d4f00b10c9a302fe110df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122355) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 02:37:32.192243 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-b3ed13d8-3206-425c-b257-8b079aa87e5d tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 200 len: 1497 microversion: 2.1 time: 0.094878 Oct 02 02:37:32.193307 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3696/7835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:37:32 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 1497 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 02:37:32.812483 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [req-54b51d54-447e-4a4c-bcf8-38ab863f25c5 req-db8c3e21-17d2-4132-af83-4469b4cd87b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4194aef-5ea8-4c8b-b622-909a1b4519c8", "name": "network-vif-deleted", "tag": "e04f6eb3-8e98-42d2-8656-4d1fc02f11b6"}]} {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 02:37:32.822642 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-54b51d54-447e-4a4c-bcf8-38ab863f25c5 req-db8c3e21-17d2-4132-af83-4469b4cd87b7 service nova] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:32.823130 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-54b51d54-447e-4a4c-bcf8-38ab863f25c5 req-db8c3e21-17d2-4132-af83-4469b4cd87b7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:32.823574 n-d-master-1 devstack@n-api.service[122354]: DEBUG oslo_concurrency.lockutils [req-54b51d54-447e-4a4c-bcf8-38ab863f25c5 req-db8c3e21-17d2-4132-af83-4469b4cd87b7 service nova] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:32.834902 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.compute.server_external_events [req-54b51d54-447e-4a4c-bcf8-38ab863f25c5 req-db8c3e21-17d2-4132-af83-4469b4cd87b7 service nova] Creating event network-vif-deleted:e04f6eb3-8e98-42d2-8656-4d1fc02f11b6 for instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 on n-h2-master-1 Oct 02 02:37:32.840298 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [req-54b51d54-447e-4a4c-bcf8-38ab863f25c5 req-db8c3e21-17d2-4132-af83-4469b4cd87b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031569 Oct 02 02:37:32.840882 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4140/7836] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 2 02:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 02:37:33.217514 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '>' {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:33.218127 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.compute.api [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] [instance: b4194aef-5ea8-4c8b-b622-909a1b4519c8] Fetching instance by UUID {{(pid=122355) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 02:37:33.225131 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:33.225622 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:33.226070 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:33.226835 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Acquiring lock "f9af6514-793d-4739-b224-af2946cacb7b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 02:37:33.227299 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 02:37:33.227737 n-d-master-1 devstack@n-api.service[122355]: DEBUG oslo_concurrency.lockutils [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Lock "f9af6514-793d-4739-b224-af2946cacb7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 02:37:33.241054 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.wsgi [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] HTTP exception thrown: Instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 could not be found. Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Request method failure captured: Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: request: GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 HTTP/1.1 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Accept: application/json Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Accept-Encoding: identity Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Connection: close Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Content-Length: 0 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Content-Type: application/json Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Host: 10.222.0.23 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: Openstack-System-Scope: None Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: User-Agent: python-urllib3/1.26.12 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Auth-Token: gAAAAABjOPgixKA7pYNJLxfBmibHDfgriCGH55v3qwjsFdoWq_KdfciHtgVoNImPtvEncyfVVC4mITUaLQbtrM1TKbpiYihTBTol-gWwgNN5fUI9-lL9WJVjWKI_D0LfZdKZFhyCDBtqQVnAG87R0owg7BEA6ee8T_8UY64sgiMYcrZj_JI42no Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Id: None Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Domain-Name: None Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Identity-Status: Confirmed Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Is-Admin-Project: True Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Id: default Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Project-Domain-Name: Default Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Project-Id: 4c8d09faa16d4f00b10c9a302fe110df Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Project-Name: tempest-TestSnapshotPattern-1198644781 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Role: member,reader Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Roles: member,reader Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c8d09faa16d4f00b10c9a302fe110df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8d09faa16d4f00b10c9a302fe110df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c8d09faa16d4f00b10c9a302fe110df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c8d09faa16d4f00b10c9a302fe110df"}]}] Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Tenant: tempest-TestSnapshotPattern-1198644781 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Id: 4c8d09faa16d4f00b10c9a302fe110df Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-Tenant-Name: tempest-TestSnapshotPattern-1198644781 Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-User: tempest-TestSnapshotPattern-1198644781-project Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Id: default Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-User-Domain-Name: Default Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-User-Id: 0e0b1745c8814aa49198d4170bc2de7b Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: X-User-Name: tempest-TestSnapshotPattern-1198644781-project Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: method: > Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: exception: Instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 could not be found. Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: action_args: {'id': 'b4194aef-5ea8-4c8b-b622-909a1b4519c8'} Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: {{(pid=122355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 could not be found. Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 could not be found. Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 02:37:33.242836 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 could not be found. Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: ERROR nova.api.openstack.wsgi Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: DEBUG nova.api.openstack.wsgi [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Returning 404 to user: Instance b4194aef-5ea8-4c8b-b622-909a1b4519c8 could not be found. {{(pid=122355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: INFO nova.api.openstack.requestlog [None req-c0cad849-2421-4596-a591-12f6795a6695 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8" status: 404 len: 111 microversion: 2.1 time: 0.030722 Oct 02 02:37:33.248404 n-d-master-1 devstack@n-api.service[122355]: [pid: 122355|app: 0|req: 3697/7837] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 02:37:33 2022] GET /compute/v2.1/servers/b4194aef-5ea8-4c8b-b622-909a1b4519c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 02:37:33.405901 n-d-master-1 devstack@n-api.service[122354]: DEBUG nova.api.openstack.wsgi [None req-afa2ab2f-1aea-43f2-807c-937a7e91f149 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] Calling method '.version_select at 0x7fb87863ba60>' {{(pid=122354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 02:37:33.431350 n-d-master-1 devstack@n-api.service[122354]: INFO nova.api.openstack.requestlog [None req-afa2ab2f-1aea-43f2-807c-937a7e91f149 tempest-TestSnapshotPattern-1198644781 tempest-TestSnapshotPattern-1198644781-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-963836728" status: 202 len: 0 microversion: 2.1 time: 0.029710 Oct 02 02:37:33.431959 n-d-master-1 devstack@n-api.service[122354]: [pid: 122354|app: 0|req: 4141/7838] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 02:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-963836728 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)